2022 Open source projects that are alternatives of or similar to Tianyancha

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

No description or website provided.

Instagram comment scraper using python and selenium. Save the comments into excel.

中国大陆大学列表爬虫

📊 Financial markets data library implemented in go.

Google, Naver multiprocess image web crawler (Selenium)

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

A web crawler (for bug hunting) that gathers more than you can imagine.

Elegant Scraper and Crawler Framework for Golang

Scraping scripts for various websites.

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Headless Chrome For Java （Java 爬虫）

Social media research and promotion, semi-autonomous CLI bot

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

An Instagram Scrapper

News, full-text, and article metadata extraction in Python 3. Advanced docs:

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Google play scraper for Python inspired by <facundoolano/google-play-scraper>

An Instagram bot developed using the Selenium Framework

This repository contains all the code I use in my YouTube tutorials.

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

Scrapping tool for GISAID data regarding SARS-CoV-2

Automated Script to scrape flight prices from any website into a csv format

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.

Precompiled packages for AWS Lambda

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。

[Unmaintained] A simple and clean video/music/image downloader 👾

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Golang pkg to quickly return a preview of a webpage (title/description/images)

Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

Python爬虫，京东自动登录，在线抢购商品

Amazon商品引流的 python 爬虫

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

A high performance web crawler in Elixir.

Learn Python for the next 30 (or so) Days.

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

This repository is no longer maintained.

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

Zillow Scraper for Python using Selenium

Pandas and Spark DataFrame comparison for humans

scrapy专利爬虫（停止维护）

Alternative for VK Audio API

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Extract data from a wide range of Internet sources into a pandas DataFrame.

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

📅🇨🇳 中国法定节假日数据 自动每日抓取国务院公告

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Crawl instagram photos, posts and videos for download.

基于 Selenium 的知乎关键词爬虫

Clean APIs for data cleaning. Python implementation of R package Janitor

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.