GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → HitomaruKonpaku → twspace-crawler

HitomaruKonpaku / twspace-crawler

Licence: other
Script to monitor & download Twitter Spaces 24/7

Programming Languages

typescript
32286 projects
javascript
184084 projects - #8 most used programming language

Labels

nodejstwitterffmpegtwitter-apidiscordtwitter-api-v2twitter-spaces

Projects that are alternatives of or similar to twspace-crawler

search-tweets-ruby
Ruby client for the Twitter search endpoints (v2/Labs/premium/enterprise). Now supports Twitter API v2 /recent and /all search endpoints.
Stars: ✭ 45 (-42.31%)
Mutual labels:  twitter-api, twitter-api-v2
twittered
Twitter API client for Java developers
Stars: ✭ 170 (+117.95%)
Mutual labels:  twitter-api, twitter-api-v2
bird-elephant
PHP client library for Twitter API v2 endpoints.
Stars: ✭ 28 (-64.1%)
Mutual labels:  twitter-api, twitter-api-v2
Trendr App
Twitter Trends history explorer app. Trending topics can be explored by date and location. Backend served with Lambda Function (NodeJS) from AWS. Frontend made with VueJS. Twitter API queried with a Python script from Google Colab. MongoDB database.
Stars: ✭ 17 (-78.21%)
Mutual labels:  twitter-api
twitter-like-bot
This app allows you to automate Twitter liking for specific keywords, hashtags, or even full sentences. The bot uses streaming API which means that everything happens in real time.
Stars: ✭ 30 (-61.54%)
Mutual labels:  twitter-api
trumptweets
Download data on all of Donald Trump's (@RealDonaldTrump) tweets
Stars: ✭ 39 (-50%)
Mutual labels:  twitter-api
github-readme-twitter
Add Twitter to your github readme
Stars: ✭ 73 (-6.41%)
Mutual labels:  twitter-api
viewtweets
🙈🐵 View tweets (timelines, favorites, searches) in Rstudio 🐵🙈
Stars: ✭ 21 (-73.08%)
Mutual labels:  twitter-api
trending-twitter
Simple dashboard for getting currently trending hashtags and topics on Twitter
Stars: ✭ 23 (-70.51%)
Mutual labels:  twitter-api
Broadcast
🗣 A write-only Twitter client
Stars: ✭ 36 (-53.85%)
Mutual labels:  twitter-api
TinyFlowerBeds
Educational bot that posts a tiny flower bed on Twitter every few hours. Check it out if you're new to Python and open source!
Stars: ✭ 12 (-84.62%)
Mutual labels:  twitter-api
StockerBot
Twitter Bot to follow financial trends in publicly traded companies
Stars: ✭ 77 (-1.28%)
Mutual labels:  twitter-api
Stranger Things Wall
A wall of addressable LEDs inspired by the Netflix series Stranger Things that displays messages from Twitter.
Stars: ✭ 22 (-71.79%)
Mutual labels:  twitter-api
node-social-feed-api
Aggregates social media feeds and outputs them to use in an API
Stars: ✭ 20 (-74.36%)
Mutual labels:  twitter-api
twitter-d
TypeScript types for Twitter API objects
Stars: ✭ 54 (-30.77%)
Mutual labels:  twitter-api
tt-history
A project that keeps history of trending topics on Twitter.
Stars: ✭ 33 (-57.69%)
Mutual labels:  twitter-api
Penicillin
Modern powerful Twitter API wrapper for Kotlin Multiplatform. #PureKotlin
Stars: ✭ 91 (+16.67%)
Mutual labels:  twitter-api
SMMT
Social Media Mining Toolkit (SMMT) main repository
Stars: ✭ 116 (+48.72%)
Mutual labels:  twitter-api
tweet-to-markdown
A command line tool to convert Tweets to Markdown.
Stars: ✭ 111 (+42.31%)
Mutual labels:  twitter-api-v2
twitter-stream
A Go wrapper for Twitter's V2 Filtered Stream API
Stars: ✭ 26 (-66.67%)
Mutual labels:  twitter-api
View All Similar Projects ➔

twspace-crawler

npm npm

Node.js script & command-line app to automatically monitor & download Twitter Spaces.

Contents

  1. Requirements
  2. Installation
  3. Usage
  4. Options
  5. Commands
  6. Webhooks
  7. Changelog

Requirements

Installation

FULL INSTALLATION

Command-line installation

npm install --global twspace-crawler

Module installation

npm install twspace-crawler

Usage

Monitor user(s) indefinitely, wait for live Space and download when Space ended

twspace-crawler --user nakiriayame

twspace-crawler --user nakiriayame,sakamatachloe

twspace-crawler --env ./.env --config ./config.json

Monitor & download Space by id

twspace-crawler --id 1yoJMWvbybNKQ

Download Space by playlist url

twspace-crawler --url https://prod-fastly-ap-northeast-1.video.pscp.tv/Transcoding/v1/hls/1Nq1QFkYTQ4v1X4BTV_aJ_pFeQhYyuYXY7ykz5xB7v5NvGwFMJMKwnRBmxyi9twF4BZ90ZKks5wdGKqESVsjLw...

Download Space by playlist url with additional metadata (if Space url still available)

twspace-crawler --id 1yoJMWvbybNKQ --url https://prod-fastly-ap-northeast-1.video.pscp.tv/Transcoding/v1/hls/1Nq1QFkYTQ4v1X4BTV_aJ_pFeQhYyuYXY7ykz5xB7v5NvGwFMJMKwnRBmxyi9twF4BZ90ZKks5wdGKqESVsjLw...

Options

General options

  -h, --help                        Display help
  -d, --debug                       Show debug logs

One-time download options

  --id <SPACE_ID>                   Monitor & download live Space with its id
  -surl, --space-url <SPACE_URL>    Monitor & download live Space with its URL
  --force                           Force download Space when using with --id
  --url <PLAYLIST_URL>              Download Space using playlist url

User monitoring options

  --env <ENV_PATH>                  Path to .env file, default to current working
                                    folder (See .env.example)
  --config <CONFIG_PATH>            Path to config file (See config.example.json)
  --user <USER>                     Monitor & download live Spaces from users
                                    indefinitely, separate by comma (,)

Additional options

  --notification                    Show notification about new live Space
  --force-open                      Force open Space in browser

Commands

Use to manually process audio/captions

List

  • cc
  download|d <SPACE_ID> <ENDPOINT> <TOKEN>  Download Space captions, with
                                            - ENDPOINT: Chat endpoint
                                            - TOKEN: Chat access token

  extract|e <FILE> [STARTED_AT]             Extract Space captions

Example

twspace-crawler cc d 1yoJMWneoZwKQ https://prod-chatman-ancillary-ap-northeast-1.pscp.tv 2Ozpcu2xxqb5wxMdkyodUCygOrbYMLv8rq...

twspace-crawler cc e /download/sample_cc.jsonl

twspace-crawler cc e /download/sample_cc.jsonl 1633612289669

Webhooks

Currently support Discord Webooks

Check config.example.yaml or config.example.json for more detail

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].