1074 Open source projects that are alternatives of or similar to OLX_Scraper

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Faster requests on Python 3

A framework for creating semi-automatic web content extractors

PHP Scraper - an highly opinionated web-interface for PHP

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

A collection of awesome web scaper, crawler.

A collection of awesome web crawler,spider in different languages

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

🚆This web scraper builds a dataset for São Paulo subway operation status

A list of scrapers from around the web.

Declarative web scraping

Interactive CLI Web Crawler

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

A monadic web scraping library

A python web scraper for public email lists.

Creating Scrapy scrapers via the Django admin interface

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

A Devtools driver for web automation and scraping

Indonesia Index News Crawler, including 10 online media

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

A simple browser/client-side web scraper.

Implementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021

Crawling and scraping the Web for fun and profit

A tutorial-based introduction to web scraping with Python.

🎬 An attempt at the most complete IMDb API

NodeJS package that fetches a given URL's title, description, images, links etc.

A console application that can scrape the Azur Lane wiki and export the data to Json files

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

The Zipru scraper developed in the Advanced Web Scraping Tutorial.

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

HTTP API for Scrapy spiders

A scrapy spider that scraps times and prices from Voyages Sncf. It uses scrapyrt to provide an API interface.

A Facebook crawler

Python Package for scraping NHL Play-by-Play and Shift data

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

An open source webapp for scraping: towards a public service for webscraping

🌎 🏨 Scrape Booking.com 🏨 🌎

crawler framework, distributed crawler extractor

**[ARCHIVED]** website changes tracker 🔍

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

A web crawler for Go

Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Compares price of the product entered by the user from e-commerce sites Amazon and Flipkart 💰 📊

Araignée LeBonCoin avec Scrapy et ElasticSearch

Explore a website recursively and download all the wanted documents (PDF, ODT…)

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

Web Scraping Framework

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

Bulk Downloader for Reddit

Python API to extract data from rateyourmusic.com.

At present contains scraped data from around 1500 problems present on the site. More to follow....

Command line program to download documents from web portals.

Zillow Scraper for Python using Selenium