613 Open source projects that are alternatives of or similar to XMQ-BackUp

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Python入门网络爬虫之精华版

Build and deploy a machine learning app from scratch 🚀

Code for the second edition Web Scraping with Python book by Packt Publications

🚀电商网站爬虫合集，淘宝京东亚马逊等

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

Scrapy middleware to handle javascript pages using selenium

With Selenium headless browsing and CAPTCHA solving

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Python Program To Schedule Your Instagram Posts

V2EX爬虫

Robust Functional Tests leveraging WebDriver with flavour of neat AJAX-ready API

scrapy 常用爬网必备工具包

📷 web scrapping in python: multiple libraries -requests, beautifulsoup, mechanize, selenium

Realtime Browser Element Verification Tool [Stable]

E2E Tests with WebdriverIO and Cucumber

a document with regard to selenium

WEB UI自动化测试框架，selenium结合python，测试人员不需要会代码，只需要写配置即可实现，并且方便懂代码的测试人员扩展

(Bypass reCAPTCHAs) A Selenium Python bot to automatically and bulky upload and list your NFTs on OpenSea (all metadata integrated - Ethereum and Polygon supported); reCAPTCHA solver & bypasser included.

Compiled binaries of Gecko Driver for ARMv6 architecture (cross-compiled)

No description or website provided.

boilerplate for nightwatch.js with selenium

Library packs for google cloud functions

UI自动化测试框架，支持APP、Web、HTML5三端， 基于SpringBoot框架， 采用Page Object设计模式，基于 TestNG 测试框架构建测试用例，支持消息通知、失败截屏、HTTP 报告、并发执行等特性

Python script to control whatsapp web using terminal

解放双手，u校园的题再也不用写啦(暂停维护

Extensions for Selenium WebDriver including jQuery/Sizzle selector support.

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Script using requests module to register accounts to Slam Jam Socialism raffles.

A Scrapy demo : Download all images from a site

收集各种免费的 Python 爬虫项目

极验滑动验证码研究报告

python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答

content discovery... IN 3D

Personal Data Engineering Projects

Python script which sends a custom morning message to your significant other every morning at a given time range on Facebook Messenger, WhatsApp, Telegram or SMS, for lazy people

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

Headless chrome running on tencent serverless cloud function.

秀人网爬虫 55156爬虫

Scraping Ebay's products using Scrapy Web Crawling Framework

💉🤖 Bot for the German "ImpfterminService - 116117"

Crawler with Python 3.

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

A tutorial-based introduction to web scraping with Python.

Carina demo project.

Introduction to Robot Framework - TriTAUG Presentation

Bangumi小工具

An image scraper that scraps images from unsplash.com

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

🛠️一些小工具脚本

A django admin site for scrapy

问卷星

一个基于Scrapy的数据采集爬虫代码库

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

An open source webapp for scraping: towards a public service for webscraping

Use Scrapy crawl foreign exchange rate from BOC (Bank of China)