1943 Open source projects that are alternatives of or similar to Price Monitor

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

B站用户爬虫 好耶~是爬虫

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

新浪微博相册大图多线程爬虫。

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

一个获取知乎用户主页信息的多线程Python爬虫程序。

Python Lambda Chrome Automation (naming pending)

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.

基于 Selenium 的知乎关键词爬虫

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Simple but useful Python web scraping tutorial code.

Android应用市场网络爬虫

Amazon商品引流的 python 爬虫

本仓库收集整理爬虫相关资源，开发语言以Java为主

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

Integration layer between Requests and Selenium for automation of web actions.

AutoLink是一个开源Web IDE自动化测试集成解决方案

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

An image scraper that scraps images from unsplash.com

An Instagram bot developed using the Selenium Framework

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

A Python module to use the Tesla Motors Owner API

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

No description or website provided.

一个灵活、友好的爬虫框架

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

Google, Naver multiprocess image web crawler (Selenium)

📷 web scrapping in python: multiple libraries -requests, beautifulsoup, mechanize, selenium

🐤️ Lost Ark wait notifier

selenium异步爬取网页图片

APIs for loginning some websites by using requests.

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

A non API python program to crawl public photos, posts or followers

🎓 中国大学MOOC、学堂在线、网易云课堂、好大学在线、爱课程 MOOC 课程下载。

Script using requests module to register accounts to Slam Jam Socialism raffles.

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

🐳 A most popular sql audit platform for mysql

Get a grip on your finances.

A search application to explore, discover and share online files

Fess is very powerful and easily deployable Enterprise Search Server.

🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

Synopse mORMot ORM/SOA/MVC framework

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

NideShop 开源微信小程序商城服务端 API（Node.js + ThinkJS）

Asynchronous interface for peewee ORM powered by asyncio

基于搜狗微信搜索的微信公众号爬虫接口

Distributed crawler powered by Headless Chrome

A wiki focusing on aggregating and documenting various SQL injection methods

Database for search

🍇更完善的Spring+SpringMVC+Mybatis+easyUI后台管理系统(RESTful API+redis)

python爬虫

程序员进阶书籍（视频），持续更新（Programmer Books）

Constantly updated lists of world countries and their associated alpha-2, alpha-3 and numeric country codes as defined by the ISO 3166 standard, available in CSV, JSON , PHP and SQL formats, in multiple languages and with national flags included

我是追梦赤子心，公众号「深圳湾码农」的作者，某上市集团公司高级前端开发，深耕前端领域多年，每天攻破一道题，带你从0到1系统构建web全栈完整的知识体系！

Scrapy middleware to handle javascript pages using selenium

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

A collection of Ruby libraries for working with SQL on top of ActiveRecord's connection

Carina automation framework: Web, Mobile, API, DB