657 Open source projects that are alternatives of or similar to PTTmineR

Indonesia Index News Crawler, including 10 online media

🎬 An attempt at the most complete IMDb API

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

Instagram comment scraper using python and selenium. Save the comments into excel.

Intuitive timetable builder for the Australian National University.

API for fetching data from news websites.

simple multi-level scraper json input/output for Cheerio

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

An Instagram Scrapper

A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.

Parallel NDJSON Reader for Python

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Webscraper

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

YouTube video downloader in javascript.

Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news

Creating Scrapy scrapers via the Django admin interface

Get Aliexpress product details in JSON

Generalised and highly customisable, hybrid-parallelism, database based, deep learning framework.

Command line program to download documents from web portals.

Shopify Scraper (not monitor)

A web scraper starter project

💀 The Pirate Bay node.js client

Download Impartus lectures, convert to mkv for offline viewing.

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

Using Arrows to model parallel processes/computations.

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

Code relating to scraping public police data.

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Search and download mangas from the command line

Search for and retrieve US Patent and Trademark Office Patent Data

A monadic web scraping library

WAND-PIC

A free TVTime API based on scraping TVTime website. No API key required

A Node.js wrapper for scraping allrecipes.com

Scrapers for many e-SAJ systems

DocSearch - Scraper

Page metadata as a service

Download website to local directory (including all css, images, js, etc.)

京东App自动登录，在线商品自动下单

Finds cat images/videos/gifs on reddit, sends them to my mom via applescript

No description or website provided.

There was no free Dictionary API on the web when I wanted one for my friend, so I created one.

Crawl instagram photos, posts and videos for download.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。

ProxyCrawl Python library for scraping and crawling

Python爬虫，京东自动登录，在线抢购商品

A data scraper for retrieving old tweets in Twitter using Python3.

Yet Another Concurrency Library

Simple, easy-to-use scraper to scrape data from WordPress JSON API

A 'supervised' parser for Google Scholar

Un bot de Twitter que comparte cada hora un TFM hasta que Cristina Cifuentes enseñe el suyo.

Functional library for Javascript

Be nice on the web

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.