398 Open source projects that are alternatives of or similar to Videoserver

基于搜狗微信搜索的微信公众号爬虫接口

GOPA, a spider written in Go.（NOTE: this project moved to https://github.com/infinitbyte/gopa ）

A Facebook crawler

To crawl all csgo skins from website.

The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.

Amazon商品引流的 python 爬虫

Doujinshi downloader 绅士漫画下载

带你了解一下Golang的市场行情

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

A collection of awesome web crawler,spider in different languages

An Instagram bot developed using the Selenium Framework

Declarative web scraping

Secret and/ credential patterns used for gf.

Crawler for Nintendo Switch eShop

Bitextor generates translation memories from multilingual websites.

Python的基础练习代码与各种爬虫代码

利用文本挖掘技术进行新闻热点关注问题分析

Crawly, a high-level web crawling & scraping framework for Elixir.

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Social media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类

爬虫代理IP池服务，可供其他爬虫程序通过restapi获取

本项目不再维护，详情可加群了解 https://t.me/onecomicbook

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

What do people have in their dotfiles?

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Core part of NewPipe

一个获取知乎用户主页信息的多线程Python爬虫程序。

👩 美女写真套图爬虫（一）

Scrapy-based Crawlers for news of Taiwan

各种App、小程序、网站的请求签名或加密算法。 现已有：自如、小红书、蛋壳公寓、luckin coffee(瑞幸咖啡)、bangkokair(曼谷航空)

Polite, slim and concurrent web crawler.

🎵 将可下载的网易云音乐的缓存文件转换为 MP3 文件

Verify that a request is from Google crawlers using Google's DNS verification steps

A search engine that doesn't track you.

Python3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation

小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对

Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

A non API python program to crawl public photos, posts or followers

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

Crawler (Bot) searching for credential leaks on different paste sites.

a puppeteer walker 🕷 🕸

Download videos from pornhub.

News, full-text, and article metadata extraction in Python 3. Advanced docs:

今日头条机器人，支持用户登陆、关注、取消关注、获取关注粉丝、发文、发悟空问答、点赞、评论、采集各种类型新闻讯息等，使用今日头条网页版API实现

Python: An all-in-one Web Crawler, Web Parser and Web Scrapping library!

知乎模拟登录，支持提取验证码和保存 Cookies

JS逆向研究

🌭💦 91porn爬虫在线API接口（永久有效） 及 在线web预览

Some classic web crawler projects.一些经典的爬虫

The DomCrawler component eases DOM navigation for HTML and XML documents.

MM131网站图片爬取 🚨

Golang pkg to quickly return a preview of a webpage (title/description/images)

golang light-weight image crawler

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Github 仓库及用户分析爬虫

A simple distributed crawler for zhihu && data analysis

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

A simple but powerful web crawler library for .NET

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis