All Projects → tracking-exposed → yttrex

tracking-exposed / yttrex

Licence: AGPL-3.0 license
youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

Programming Languages

HTML
75241 projects
javascript
184084 projects - #8 most used programming language
typescript
32286 projects

Projects that are alternatives of or similar to yttrex

diffbot-php-client
[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Stars: ✭ 53 (+70.97%)
Mutual labels:  scraping
oversmash
Overwatch API library for player details and career stats
Stars: ✭ 42 (+35.48%)
Mutual labels:  scraping
PrawWallpaperDownloader
Download images from reddit
Stars: ✭ 18 (-41.94%)
Mutual labels:  scraping
sinimr
Chilean Municipalities Information System (SINIM) Wrapper 📈🏛🇨🇱
Stars: ✭ 19 (-38.71%)
Mutual labels:  accountability
video-to-markdown
How to embed a video in markdown? Here the answer. Add videos to your markdown files easier.
Stars: ✭ 159 (+412.9%)
Mutual labels:  tiktok
node-red-contrib-nbrowser
Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.
Stars: ✭ 31 (+0%)
Mutual labels:  scraping
4cat
The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.
Stars: ✭ 144 (+364.52%)
Mutual labels:  scraping
selectorlib
A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
Stars: ✭ 53 (+70.97%)
Mutual labels:  scraping
TikTokDownloader PyWebIO
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+2864.52%)
Mutual labels:  tiktok
docker-selenium-lambda
The simplest demo of chrome automation by python and selenium in AWS Lambda
Stars: ✭ 172 (+454.84%)
Mutual labels:  scraping
shorter.recipes
A website dedicated to making recipes from any website easy to read.
Stars: ✭ 27 (-12.9%)
Mutual labels:  scraping
asyncio-hn
Python (asyncio) wrapper for hackernews api
Stars: ✭ 27 (-12.9%)
Mutual labels:  scraping
interpretable-ml
Techniques & resources for training interpretable ML models, explaining ML models, and debugging ML models.
Stars: ✭ 17 (-45.16%)
Mutual labels:  accountability
scrapy-fieldstats
A Scrapy extension to log items coverage when the spider shuts down
Stars: ✭ 17 (-45.16%)
Mutual labels:  scraping
reason-rust-scraper
🦀 Scraping & crawling websites using Rust, and ReasonML
Stars: ✭ 21 (-32.26%)
Mutual labels:  scraping
RARBG-scraper
With Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (+22.58%)
Mutual labels:  scraping
videoedit
模仿抖音分屏效果 同时支持滤镜和旋转
Stars: ✭ 23 (-25.81%)
Mutual labels:  tiktok
LInkedIn-Reverese-Lookup
🔎Search LinkedIn profile by email address📧
Stars: ✭ 20 (-35.48%)
Mutual labels:  scraping
crawling-framework
Easily crawl news portals or blog sites using Storm Crawler.
Stars: ✭ 22 (-29.03%)
Mutual labels:  scraping
covid19br-pub
Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.
Stars: ✭ 12 (-61.29%)
Mutual labels:  scraping

Tracking Exposed toolkit

This monorepo will eventually include all packages needed and platforms supported by Tracking Exposed:

Commands

unit test execution:

yarn
yarn test spec --coverage
  1. It executes all the test files you can find with find platforms/ -name '*.spec.ts
  2. Check the output in coverage/lcov-report/index.html

To run end to end test:

yarn pm2 start platforms/ecosystem.config.js --env test
yarn test e2e
yarn pm2 stop all

To start the services in production:

yarn pm2 start platforms/ecosystem.config.js
yarn pm2 status

(also for extension reviewer) how to build the extensions:

  • tiktok: yarn; yarn tk:ext dist; ls platforms/tktrex/extension/dist/*.zip
  • youtube: yarn; yarn yt:ext dist; ls platforms/yttrex/extension/dist/*.zip
  • youchoose: yarn; yarn ycai dist; ls platforms/ycai/studio/build/extension/*.zip

To assist debug

you might run yarn tsc-diagnostics and check out the content of diagnostics/ directory.

Supported Platforms

tktrex

The browser extension of tiktok.tracking.exposed the tiktok algorithm analysis toolkit for researcher, power user, and algorithm analysts.

yttrex

The browser extension of youtube.tracking.exposed the youtube algorithm analysis toolkit for researcher, power user, and algorithm analysts.

Initially sponsored by ALEX from University of Amsterdam DATACTIVE reseaerch group. Maintained by the Technical team of Tracking Exposed, more details on youtube.tracking.exposed.

Guardoni

A complete Pupetteer wrapper to orchestrate reproducible data collection with YTTrEx extension, documented with the name of Guardoni

Maintained by the Technical and Research team of Tracking Exposed, more details on youtube.tracking.exposed.

YCAI

The browser extension for YouChoose.AI and studio dashboard studio.youchoose.ai

Sponsored by the European Commission Ledger project in 2021, Develope by the technical team of YouChoose AI a project by Tracking Exposed. It is listed separately as we consider YouChoose should develop its own governance, reach out to us if you want to know more.

Note on supported platforms

As you can see in Tracking Exposed website a few other platforms are supported, work in progress, or discontinued. For example: Pornhub, Facebook, Amazon. They are not imported in this repository, but making this repository a shared resource and a monorepo is part of the refactor begun in 2021.

Packages

Taboule

A portable data table written in React to display TRex data by pre-configured API.

License

Affero-GPL 3, as file attached in this repository display.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].