1215 Open source projects that are alternatives of or similar to TikTokDownloader_PyWebIO

How to use and test fastAPI with an aiohttp client

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

图片爬取下载工具，极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。

Crawly, a high-level web crawling & scraping framework for Elixir.

A Facebook crawler

Download public videos on TikTok using Python with Selenium

An open source webapp for scraping: towards a public service for webscraping

A web crawler for Go

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Bulk Downloader for Reddit

PHP Scraper - an highly opinionated web-interface for PHP

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Python API to extract data from rateyourmusic.com.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

By serving course 📚 data that is more "edible" 🍰 for developers, we hope CourseCake offers a smooth approach to build useful tools for students.

High performance crawler for Nodejs

📝 Random quotes generator package. Available on npm and PyPi

OSINT Swiss Army Knife

A web spider for shodan.io without using the Developer API.

Creating Scrapy scrapers via the Django admin interface

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Zillow Scraper for Python using Selenium

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Cache with async power

Crawling and scraping the Web for fun and profit

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

Web Scraping Framework

robots.txt file parsing and checking for R

owllook-小说搜索引擎

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Get Aliexpress product details in JSON

Web crawling framework based on asyncio.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

🚆This web scraper builds a dataset for São Paulo subway operation status

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

快速、简洁且强大的PHP爬虫框架

A collection of awesome web crawler,spider in different languages

Async Python 3.6+ web scraping micro-framework based on asyncio

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Scraping scripts for various websites.

Python Package for scraping NHL Play-by-Play and Shift data

A python web scraper for public email lists.

A web crawler (for bug hunting) that gathers more than you can imagine.

A Devtools driver for web automation and scraping

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

A high performance web crawler in Elixir.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

FastAPI application without global variables(almost) =)

Elegant Scraper and Crawler Framework for Golang

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Powerful web scraping framework for Crystal

Bytedance(TikTok, Toutiao)third party open platform backend SDK, provides easy-to-use authorization, template management, code package management and other APIs.字节跳动(抖音, 头条)第三方开放平台小程序sdk, 提供了简单易用的授权,模版管理,代码包管理等api.

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

🌎 🏨 Scrape Booking.com 🏨 🌎

Grabs all of the audio files from all of the Blinkist books