613 Open source projects that are alternatives of or similar to E Commerce Crawlers

Build and deploy a machine learning app from scratch 🚀

Code for the second edition Web Scraping with Python book by Packt Publications

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)

Python入门网络爬虫之精华版

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Scrapy middleware to handle javascript pages using selenium

With Selenium headless browsing and CAPTCHA solving

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

爬虫学习仓库，适合零基础的人学习，对新手比较友好

小密圈备份，圈子/话题/图片/文件。

This is public repository for Selenium Learners at TestLeaf

A set of spiders and scrapers to extract location information from places that post their location on the internet.

Sahagin generates highly readable Selenium/Appium test report from your test code.

Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.

🎊 Design and implement of lightweight crawler framework.

a document with regard to selenium

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

A course downloader/scrapper for https://www.pluralsight.com

Tor Browser automation with Selenium.

python-Reptile

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

A non API python program to crawl public photos, posts or followers

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

A lightweight load balancer used to create big Selenium clusters

Installs and configures selenium standalone, hub, or node server

Python script to get WhatsApp iformation frrom WhatsApp Web

An R client for Selenium Remote WebDriver

Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go

Uno Crawler por https://douban.com

Automated WhatsApp replies using selenium module in Python

A curated list of awesome packages, articles, and other cool resources from the Scrapy community.

东南大学抢课助手。适配2021版选课系统。脚本仅用于捡漏，虽然理论上也可以抢课，但至少，我自己是不敢尝试的😋。本脚本仅供 SEU er 学习交流使用，出啥问题的话俺一概不负责任

Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.

This project aims to provide a generic implementation for HTML test reports.

Android in docker solution with noVNC supported and video recording

PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)

An OSINT tool that allows you to draw out relationships between people on LinkedIn via endorsements/skills.

JUnit tests with Selenium WebDriver and WebDriverManager

🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。

Django boilerplate with GraphQL, serving a Webpack compiled React Relay Modern frontend.

郑州轻工业大学疫情打卡

🐠 Babel plugin to strip `data-test-id` HTML attributes

Generate Free Edu Mail(s) within minutes

Selenium/appium-based Page Objects test library

网络爬虫模拟登陆bilibili 滑动验证码的破解 弹幕发送 2018-10-9

a simple & tiny scrapy clustering solution, considered a drop-in replacement for scrapyd

Python Automation using selenium & Scheduling of messages and media

No description or website provided.

今日头条科技新闻接口爬虫

swiss army knife for hackers

Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file

Html Elements is a Java framework providing easy-to-use way of interaction with web-page elements in web-page tests.

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

A set of Atata components for Kendo UI

百度贴吧爬虫(基于scrapy和mysql)

API for scrapping common meme sites