1134 Open source projects that are alternatives of or similar to Gain

Node.js scraper to get data from Google Play

Simple retry client for aiohttp.

A collection of awesome web scaper, crawler.

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

Scrapy, a fast high-level web crawling & scraping framework for Python.

File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

Node.js seed downloader (Node.js 种子神器)

🕷招聘网站爬虫合集，不定期更新分支

Web Crawler written in C#

news-please - an integrated web crawler and information extractor for news that just works.

A Python framework to write Kubernetes operators in just few lines of code.

Discover hidden deepweb pages

A Python concurrency scheduling library, compatible with asyncio and trio.

抖音爬虫. 通过手机代理爬取用户的作品和用户的喜欢

Crawler for leboncoin.fr

🐍🌚🤖 GitHub bot that formats code with `black`

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

🔍 简单的搜索引擎, django 框架

Cross-platform persistent and distributed web crawler 🔗

爬取百度贴吧、TapTap、appstore、微博官方博主上的游戏评论(基于redis_scrapy)，过滤器采用了bloomfilter。

dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Find web directories without bruteforce

Code examples from my toptal engineering blog article

Easy configurable workers based on asyncio

🏡 Open source home automation that puts local control and privacy first.

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

DownZemAll! is a download manager for Windows, MacOS and Linux

📖《Python Parallel Programming Cookbook》中文版

A scalable web crawler framework for Java.

Create WebKit/Safari .webarchive files on any platform

日常小脚本，懒人欢乐多。

头条号爬虫案例

aiohttp中文文档😉 Gitbook在线阅读

一些爬虫的代码

Google, Naver multiprocess image web crawler (Selenium)

asyncio historical repository

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

Python web app to index telegram channel and serve its files for download.

netease-music-spider is a sipder that you can find beautiful girlfriend or handsome boyfriend.

一个完整的nodeJs 串行爬虫 抓取3万多个页面。

爬虫, http代理, 模拟登陆!

A userbot for Telegram account made using Pyrogram Library and Python

A configurable web spider with a easy-to-use web console

Versatile async-friendly library to retry failed operations with configurable backoff strategies

😴 Turbulette - A batteries-included framework to build high performance, fully async GraphQL APIs

A dynamic FastAPI router that automatically creates CRUD routes for your models

Высокопроизводительный API wrapper для Питона для быстрого массового обмена данными с Битрикс24 через REST API

FastAPI framework, high performance, easy to learn, fast to code, ready for production

JSpider会每周更新至少一个网站的JS解密方式，欢迎 Star，交流微信：13298307816

Asynchronous web toolkit for python - alpha

Crawler used to crawl papers

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

Scrapy as a Web Crawler for Azure Search Samples

安安 - 育儿医疗问答机器人

简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。

all kinds of scrapy demo

The Resources for "Natural Language to Logical Form" ; "自然语言转逻辑形式"研究资料收集。

A Python based web application scanner to gather OSINT and fuzz for OWASP vulnerabilities on a target website.

Tor website crawler (specific for Alphabay at the time)