1299 Open source projects that are alternatives of or similar to Ruiji.net

🏃 Some of the python tutorial - 《Python学习笔记》

This is a list of repositories and libraries that allow for scripted downloading of online content.

Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file

Python Package for scraping NHL Play-by-Play and Shift data

A cross-platform plotting library for .NET

利用文本挖掘技术进行新闻热点关注问题分析

Automatically constructing corpus for automatic speech recognition from YouTube videos

爬虫代理IP池服务，可供其他爬虫程序通过restapi获取

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

简单易用的Python爬虫框架，QQ交流群：597510560

Creates an XML-Sitemap by crawling a given site.

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

Python Library to download images and metadata from popular search engines.

借助Python抓取微博数据，并对抓取的数据进行情绪分析

Support Swedish BankID (svenskt BankID) authentication in .NET.

Scrape any online Mediawiki motorised wiki (like Wikipedia) to your local filesystem

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

API that uncovers the technologies used on websites and generates thumbnail from screenshot of website

FFMediaToolkit is a cross-platform video decoder/encoder library for .NET that uses FFmpeg native libraries. It supports video frames extraction, reading stream metadata and creating videos from bitmaps in any format supported by FFmpeg.

A python module to scrape arxiv.org for specific date range and categories

An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, ZOJ, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

ng-alain 与 .net core 搭配

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

An Open Source Search Engine

A curated list of awesome puppeteer resources.

kikoeru 后端，不再维护，请到https://github.com/umonaca/kikoeru-express 获取更新

Expansible Unit Conversion Library for .Net Core and .Net Framework

Library for scraping free proxies lists

Headless Chrome as a Service

POOPAK - TOR Hidden Service Crawler

京东自动登录，在线商品自动下单

It covers the blockade principle of most anti-climbing strategies and corresponding solutions.👽👽👽👽（涵盖了大部分的反爬策略的封锁原理以及对应的解决方案。）

Typed .NET clients for stripe.com REST APIs

capture pictures from website like sina, lofter, huaban and so on

대량의 뉴스 데이터를 수집하기 위해 만들어진 뉴스 크롤러입니다.

Puppeteer Firebase Functions demo

Python爬虫代理IP池(proxy pool)

Some classic web crawler projects.一些经典的爬虫

A scraper for https://bandcamp.com

COVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉

Download YouTube comments from numerous videos, playlists, and channels for archiving, general search, and showing activity.

（已跑路）百度贴吧吧务管理工具，自动扫描帖子并处理违规帖

GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)

An unofficial .Net wrapper for the Discord API (http://discordapp.com)

A php crawler that finds emails on the internets

Web crawling framework based on asyncio.

Download images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

python crawler spider

Cross platform code coverage tool for .NET Core

Type safe go bindings to interact with chrome remote interface.

Scrapy Training companion code

可视化爬虫自动采集平台

Web crawler.

基于python语言开发的千万级别搜索引擎

获取免费socks/https/http代理的网站集合

DocSearch - Scraper

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture