348 Open source projects that are alternatives of or similar to scraping-ebay

🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library

You can use this act to monitor any page's content and get a notification when content changes.

Compensation analysis on the posts scraped from leetcode.com/discuss/compensation. At present, the reports have been generated only for Indian cities.

scrapy mysql pipeline

web scraping tool for grailed.com

Classificador de poemas do Fernando Pessoa de acordo com os seus heterônimos

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码

Simplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices

Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).

163music spider by scrapy.

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

Searching torrents on popular trackers - CLI, readline, GUI, web client. Tutorial and binaries (issue tracker on https://gitlab.com/vindarel/cl-torrents/)

My code for scraping financial data in Vietnam

WhatsApps related deaths News Articles along with other articles across India during that period

Crawling the data from lazada, websosanh, compare.vn, cdiscount and cungmua with flexible configs

Python API to extract data from rateyourmusic.com.

Use Puppeteer to download pens from Codepen.io as single html pages

(DISCONTINUED) Save WhatsApp Web Sessions as files and open them everywhere!

Web scraping Page Objects core library

Python分布式爬虫打造搜索引擎

Iota is a web scraper which can find all of the images and links/suburls on a webpage

Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter

Dynamic configurable crawl (动态可配置化爬虫)

基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star

Crawling and scraping the Web for fun and profit

𝐫⟋ Get Reddit data

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

python+scrapy+splash 爬取拉勾全站职位信息

UFC bout winner prediction using neural nets.

Building a Concurrent Web Scraper with Python and Selenium

The source code for animecenter

Scraping the real estate agencies for up-to-date house listings as soon as they arrive!

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

A web application that generates timetables for university students at the University of Toronto

Simple scripts that I'm using to automate the boring things.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

covers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈

Scrapy project boilerplate done right

Web Scraping Framework

Web scrapping and related analytics using Python tools

Selenium-python but lighter: Helium is the best Python library for web automation.

日常爬虫

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

An open source webapp for scraping: towards a public service for webscraping

Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)

bing、google、baidu搜索引擎爬虫。python3.6 and scrapy

Web Scraping Framework

AI based web-wrapper for web-content-extraction

Bulk Downloader for Reddit

This repository provides everything you need to get started with Python for (social science) research.

This repository contains very useful restful API's and functionalities in node-js containing many important tutorial code for mastering node-js, all tutorials have been published on medium.com, tutorials link is given below

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

A Scrapy extension to log items coverage when the spider shuts down

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

虎扑步行街爬虫