513 Open source projects that are alternatives of or similar to learning_spider

A web search engine built with Python which uses TF-IDF and PageRank to sort search results.

Want to build your own twitter bot 🐣 check out the documentation.

妹子图全站采集10G套图资源

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Code repository for the "Arduino for beginners" YouTube videos

163music spider by scrapy.

CDI Guide And Tutorials - Many examples of how to use CDI and CDI 2.0 like Qualifiers, Interceptors, Decorators, Lazy Initialization an much more!

自动答题程序🎉

🧊 一个可爱且任性的 B 站视频下载器（bilili V2）

golang spider Crawler 爬虫 电影

100 days of Go learning

动漫之家漫画站电脑版原图爬虫

🌟 powered by python3( simple learning of spider) 百度文库；网易云歌曲； 豆瓣电影； GitHub； 京东； QQ空间； 天气； vip解析助手； TED文本内容； wifi破解脚本； 必应图片设置为桌面等爬取

一个php爬虫

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

Learning data structures, algorithms, machine learning and various computer science constructs by programming practice from resources around the web.

A sample project exploring MVVM pattern with SwiftUI/Combine, using Unsplash API (via Picsum.photos API)

Get movie info from douban(豆瓣) and display in your terminal

徒手实现定时爬取知乎，从中发掘有价值的信息，并可视化爬取的数据作网页展示。

A web spider framework

一些脚本和工具

Simple for use node html crawler (spider) of site web pages

正方教务管理系统学生版的自动登录、选课、信息获取

新浪爬虫，基于Python+Selenium。模拟登陆后保存cookie，实现登录状态的保存。可以通过输入关键词来爬取到关键词相关的热门微博。

My sandbox repository to learn go

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

🎊 Design and implement of lightweight crawler framework.

Spider项目将会不断更新本人学习使用过的爬虫方法！！！

千万级图片爬虫、视频爬虫 [开源版本] Image Spider

An ongoing open-source e-commerce shop using React, Express, Firebase, and MongoDB. Designed for pandemic-relief and social good. New contributors are always, always, welcomed, regardless of where you are 🔥. Feel free to reach out at [email protected]~

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

A bunch of small Unity projects where I explore and learn Unity's new ECS and Job System.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

😚 Q & A website based on Spring Boot.

ICP备案查询，可查询企业或域名的ICP备案信息，自动完成滑动验证，保存结果到Excel表格，适用于2022年新版的工信部备案管理系统网站，告别频繁拖动验证，以及某站*工具要开通VIP才可查看备案信息的坑

中国明星数据爬取。你甚至可以拿到互联网上所有的人之间的关系，接下来你可以自己发挥！基于这些数据，你可以完成更多有趣的事情。比如说社交网络分析，关系网络可视化，算法研究，和其他有意思的事情。Chinese star data crawling. You can even get all the people on the internet! Based on these data, you can do more interesting things. For example, social network analysis, relational network visualization, algorithm research, and other interesting things.

robots.txt file parsing and checking for R

Android debts management app

研究学习各种拦截：反爬虫、拦截ad、防广告注入、斗黄牛等

A web spider for shodan.io without using the Developer API.

This repo contains all the things which I practice while learning the Full-stack web development

A program that generates a folder structure with challenges and projects for mastering a programming language.

so that stuff read/seen don't get muddled up with time

🕰 A customizable analog clock built using React

多线程爬取互联网行业常用招聘网站

银行、支行名称。中国各地区各银行支行名称数据爬虫，数据来源微信商户平台，已经整理可直接导入的sql文件

We constantly learn new things. This is a repo to share my learnings everyday.

Get Aliexpress product details in JSON

利昂图书馆预约系统自动预约&签到程序。支持包括中国人民大学、北京师范大学、济南大学、哈尔滨工业大学等在内的38所高校的图书馆系统

Learn HTML with an interactive and auto-graded tutorial with dozens of exercises.

带图形界面的哔哩哔哩漫画下载工具

This is a repository built by the community for the community.

The Virtual Lab for Physics

爬取QQ用户信息（qq号、昵称、生日、地址等基本信息）并做简要analysis。

项目已经过时！无法应用在改版后的网站上。

An open source webapp for scraping: towards a public service for webscraping

免费 IP 代理池。Scrapy 爬虫框架插件

Rover is a command-line tool for learning programming interactively.