1299 Open source projects that are alternatives of or similar to Ruiji.net

data resource untuk NLP bahasa indonesia

A simple distributed crawler for zhihu && data analysis

Dynamic meta tags in your AngularJS single page application

Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.

A survey of Apple developer documentation.

Use Tor for your C# HTTP clients. Tor + Privoxy = ❤️

📢 Ptt 文章通知機器人！Notify Ptt Article in Realtime

🔥 Shadowsocks 账号爬虫

2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

🥄 A package for building specific Proxy Pool for different Sites.

scrapy框架爬取51job(scrapy.Spider)，智联招聘(扒接口)，拉勾网(CrawlSpider)

dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites

네이버 뉴스 수집을 위한 도구

A collection of awesome web scaper, crawler.

A Tumblr Backup Application

简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。

An open source implementation of Sid Meier's Civilization.

Enjoy driving on a Javascriptive (originally Pythonic) way to Japanese AV!

simple multi-level scraper json input/output for Cheerio

ScraperWiki Python library for scraping and saving data

A Light-ORM for accesing WMI

由Python编写的全异步实现的动漫之家(dmzj)漫画批量下载器（爬虫）

Sample Application DDD, Reactive Microservices, CQRS Event Sourcing Powered by DERMAYON LIBRARY

Everybody can be scrapy guru

Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file

A cross-platform plotting library for .NET

中国大陆大学列表爬虫

Creates an XML-Sitemap by crawling a given site.

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

Crawler for LinkedIn full profiles 2019

Docker-powered html convert to pdf(html2pdf), html to image(html2image like jpeg,png),which using chrome(golang) kernel, add watermarks to pdf, convert pdf to images etc.

Determine if a page may be crawled from robots.txt, robots meta tags and robot headers

借助Python抓取微博数据，并对抓取的数据进行情绪分析

Zillow Scraper for Python using Selenium

Support Swedish BankID (svenskt BankID) authentication in .NET.

一个跨平台的图形验证码生成工具包/.net core

To crawl all csgo skins from website.

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

An Instagram bot developed using the Selenium Framework

An Open Source Search Engine

YouTube video downloader in javascript.

基于 Laravel 5.2 的小说网站

A Pure C# Class to Store Files in Zip

Expansible Unit Conversion Library for .Net Core and .Net Framework

Headless Chrome as a Service

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

京东自动登录，在线商品自动下单

Typed .NET clients for stripe.com REST APIs

🕷️ A node crawler for github trending.

pigat ( Passive Intelligence Gathering Aggregation Tool ) 被动信息收集聚合工具

대량의 뉴스 데이터를 수집하기 위해 만들어진 뉴스 크롤러입니다.

Python爬虫代理IP池(proxy pool)

A to Z Sky Operating System / Microservice Chassis Framework

A scraper for https://bandcamp.com

🖥 Chrome automation made simple. Runs locally or headless on AWS Lambda.