348 Open source projects that are alternatives of or similar to scraping-ebay

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

A framework for creating semi-automatic web content extractors

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Faster requests on Python 3

Scrape, standardize and share public meetings from local government websites

Random User-Agent middleware based on fake-useragent

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Scrapy Training companion code

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

A middleware of cookies persistence for Scrapy

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

Docker microservice & Crawler by scrapy

一些简单有趣的Python小Demo

Scrapy项目（mysql+mongodb豆瓣top250电影）

No description or website provided.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

Bangumi小工具

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

爬取拉勾、BOSS直聘、智联招聘、51job、赶集招聘、58招聘等职位信息

🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library

Compensation analysis on the posts scraped from leetcode.com/discuss/compensation. At present, the reports have been generated only for Indian cities.

web scraping tool for grailed.com

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码

Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices

163music spider by scrapy.

Searching torrents on popular trackers - CLI, readline, GUI, web client. Tutorial and binaries (issue tracker on https://gitlab.com/vindarel/cl-torrents/)

WhatsApps related deaths News Articles along with other articles across India during that period

Python API to extract data from rateyourmusic.com.

(DISCONTINUED) Save WhatsApp Web Sessions as files and open them everywhere!

Python分布式爬虫打造搜索引擎

Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter

基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star

𝐫⟋ Get Reddit data

The source code for animecenter

UFC bout winner prediction using neural nets.

show full stack technology applications : Scrapy + webservice[restful] + websocket + VueJS + MongoDB

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

Simple scripts that I'm using to automate the boring things.

A Dragnet that also extract author, headline, date, keywords from context

The API for Furaffinity you wish existed

covers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈

Scrapy project boilerplate done right

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

日常爬虫

An open source webapp for scraping: towards a public service for webscraping

免费 IP 代理池。Scrapy 爬虫框架插件

A Web Crawler that scrapes using YAML and python code.

🕸→ℹ️ Reap Information from Websites

bing、google、baidu搜索引擎爬虫。python3.6 and scrapy

AI based web-wrapper for web-content-extraction

Web Scraping Framework