All Projects → alkihis → twitter-archive-reader

alkihis / twitter-archive-reader

Licence: CC-BY-SA-4.0 license
Full featured TypeScript Twitter archive reader and browser

Programming Languages

typescript
32286 projects

Projects that are alternatives of or similar to twitter-archive-reader

Hadoop For Geoevent
ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.
Stars: ✭ 5 (-88.37%)
Mutual labels:  big-data, bigdata
Spark Py Notebooks
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
Stars: ✭ 1,338 (+3011.63%)
Mutual labels:  big-data, bigdata
Countly Sdk Cordova
Countly Product Analytics SDK for Cordova, Icenium and Phonegap
Stars: ✭ 69 (+60.47%)
Mutual labels:  big-data, bigdata
Cortx
CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.
Stars: ✭ 426 (+890.7%)
Mutual labels:  big-data, bigdata
Genie
Distributed Big Data Orchestration Service
Stars: ✭ 1,544 (+3490.7%)
Mutual labels:  big-data, bigdata
Circosjs
d3 library to build circular graphs
Stars: ✭ 436 (+913.95%)
Mutual labels:  big-data, bigdata
Uproot4
ROOT I/O in pure Python and NumPy.
Stars: ✭ 80 (+86.05%)
Mutual labels:  big-data, bigdata
big data
A collection of tutorials on Hadoop, MapReduce, Spark, Docker
Stars: ✭ 34 (-20.93%)
Mutual labels:  big-data, bigdata
Spark R Notebooks
R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks
Stars: ✭ 109 (+153.49%)
Mutual labels:  big-data, bigdata
Tennis Crystal Ball
Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction
Stars: ✭ 107 (+148.84%)
Mutual labels:  big-data, bigdata
Uproot3
ROOT I/O in pure Python and NumPy.
Stars: ✭ 312 (+625.58%)
Mutual labels:  big-data, bigdata
Sparkrdma
RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+400%)
Mutual labels:  big-data, bigdata
NiFi-Rule-engine-processor
Drools processor for Apache NiFi
Stars: ✭ 34 (-20.93%)
Mutual labels:  big-data, bigdata
Spark Movie Lens
An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset
Stars: ✭ 745 (+1632.56%)
Mutual labels:  big-data, bigdata
leaflet heatmap
简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-69.77%)
Mutual labels:  big-data, bigdata
Big Data Engineering Coursera Yandex
Big Data for Data Engineers Coursera Specialization from Yandex
Stars: ✭ 71 (+65.12%)
Mutual labels:  big-data, bigdata
SparkProgrammingInScala
Apache Spark Course Material
Stars: ✭ 57 (+32.56%)
Mutual labels:  big-data, bigdata
v6.dooring.public
可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.
Stars: ✭ 323 (+651.16%)
Mutual labels:  big-data, bigdata
Bigdata Notes
大数据入门指南 ⭐
Stars: ✭ 10,991 (+25460.47%)
Mutual labels:  big-data, bigdata
Big Data Study
🐳 big data study
Stars: ✭ 141 (+227.91%)
Mutual labels:  big-data, bigdata

twitter-archive-reader

Read data from classic Twitter archive and GDPR archive

Explore easily tweets, direct messages, medias and more from Twitter archives.

This is a JavaScript/TypeScript package available on npm that provides useful data structures concieved to manipulate Twitter archives. If you're looking for a graphical tool to explore archives without programming, take a look to Archive Explorer.

Features

For all types of archives

  • Access tweets using date selectors (by month, interval)
  • Search in tweets with custom filters
  • Get a single tweet by ID
  • Access user data stored in archive, like screen name, name or profile picture

For GDPR archives

  • Access direct messages with query selectors (conversation, date, content, context around one message)
  • Access images and videos stored in archive
  • List of favorites, blocks, mutes, followers and followings
  • Screen name history
  • Lots of user-related data like interests, age information and email addresses
  • Data from views and interactions with ads on Twitter website/mobile app
  • Twitter moments
  • Subscribed and created lists

What's a GDPR archive ?

Usage

This package can be used inside a browser or in Node.js.

Getting ready

Full documentation (version 6.x.x) is available on GitHub Wiki. Take a look !

Examples

You can find a bunch of usage examples in this file.

Linking archive files to twitter-archive-reader objects and properties

You can find a link between files and directories inside raw Twitter archives to this package data structures here. This can help you if you've found a intersting property in some file and you want to explore it with twitter-archive-reader !

Detailled type documentation

If you want to find a type definition quickly, or get a detailled view of a data structure, a automatically-generated documentation is available here.

About archive support

  • Classic archives are supported in every version of this module
    • Since 1.0.0:
      • Tweet read
      • Basic user info read
  • GDPR archives basic support since 1.0.0:
    • Since 1.0.0:
      • Tweet read
      • DM read
      • File size must be < 2 GB
    • Since 1.2.0:
      • Favorites
      • Mutes
      • Blocks
    • Since 1.3.0:
      • DM images
    • Since 1.4.1:
      • Support DM images nested in ZIP files (GDPR archives 1.1)
    • Since 2.0.0:
      • GDPR archives are streamed: file size is no longer a limit.
      • Screen name history
    • Since 4.0.0:
      • Extended favorites
      • Personalization data
      • Email addresses
      • Connected application
      • Many other user data
      • Ad data
    • Since 4.0.7:
      • Support GDPR 1.2 archives (created since January 2020)
    • Since 5.0.0:
      • Events in direct messages
      • Read every type of media available in GDPR archives

Old documentation

Wiki for 2.x.x is available here.

Wiki for 3.x.x is available here.

Wiki for 4.x.x is available here.

Documentation for 5.x.x is nearly the same as 6.0.0. Use current documentation for those versions.

Migrate from 2.x.x to 3.0.0

Migration guide is available here.

Migrate from 3.x.x to 4.0.0

Migration guide is available here.

Migrate from 4.0.x to 5.0.0

Migration guide is available here.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].