565 Open source projects that are alternatives of or similar to 163Music

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

With Selenium headless browsing and CAPTCHA solving

正方教务管理系统学生版的自动登录、选课、信息获取

A web crawler for Go

Inventus is a spider designed to find subdomains of a specific domain by crawling it and any subdomains it discovers.

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

scrapy mysql pipeline

Scrapy downloader middleware that stores response HTMLs to disk.

The source code for animecenter

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

带图形界面的哔哩哔哩漫画下载工具

蜘蛛纸牌 for mac

该项目是一个使用celery作为主体框架的爬虫应用，能够灵活的添加爬虫任务，并且同时运行多站点的爬虫工作，所有组件都能够原生支持规模并发和分布式，加上celery原生的分布式调用，实现大规模并发。

动漫之家漫画站电脑版原图爬虫

Classificador de poemas do Fernando Pessoa de acordo com os seus heterônimos

Your web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data

🍨 一个简洁到极致的单曲播放器

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

Common interface for data container classes

妹子图

妹子图全站采集10G套图资源

Scrapy project boilerplate done right

ICP备案查询，可查询企业或域名的ICP备案信息，自动完成滑动验证，保存结果到Excel表格，适用于2022年新版的工信部备案管理系统网站，告别频繁拖动验证，以及某站*工具要开通VIP才可查看备案信息的坑

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

A spider on Dcard. Strong and speedy.

爬取拉勾、BOSS直聘、智联招聘、51job、赶集招聘、58招聘等职位信息

Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).

⭐ 图虫网爬虫

爬虫学习仓库，适合零基础的人学习，对新手比较友好

PTT 表特版爬蟲圖片下載器

🕷️ A simple crawler (spider) writen in php just for fun, with zero dependencies

gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。

UFC bout winner prediction using neural nets.

文章采集工具 Article collection tool

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

新浪爬虫，基于Python+Selenium。模拟登陆后保存cookie，实现登录状态的保存。可以通过输入关键词来爬取到关键词相关的热门微博。

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

No description or website provided.

My code for scraping financial data in Vietnam

基于Electron爬虫程序

利用墨墨背单词的分享功能拿每日20个的单词上限奖励（多线程

Araignée LeBonCoin avec Scrapy et ElasticSearch

Crawling the data from lazada, websosanh, compare.vn, cdiscount and cungmua with flexible configs

robots.txt file parsing and checking for R

客户端爬虫安卓端demo

This taobao spider has been archived

python爬虫项目集合

some small project and some articles

使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架

Grapy, a fast high-level web crawling framework for Python 3.3 or later base on asyncio.

😚 Q & A website based on Spring Boot.

A web spider framework

A Web Crawler that scrapes using YAML and python code.

研究学习各种拦截：反爬虫、拦截ad、防广告注入、斗黄牛等

爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本

A spiders' program for weixin which made by Express & cheerio

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer