819 Open source projects that are alternatives of or similar to Scrapers

Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

PHP Scraper - an highly opinionated web-interface for PHP

A collection of awesome web crawler,spider in different languages

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

A simple browser/client-side web scraper.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

A console application that can scrape the Azur Lane wiki and export the data to Json files

Cryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.

🐚 Use your terminal shell to do awesome things.

🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot

A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS.

The best (weekly) newsletters

A curated list of awesome deep vision web demo

Curated list of Prolog packages and resources

A curated list of cryptography resources and links.

Library of generic and type safe containers in pure C language (C99 or C11) for a wide collection of container (comparable to the C++ STL).

Redisson - Redis Java client with features of In-Memory Data Grid. Over 50 Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Publish / Subscribe, Bloom filter, Spring Cache, Tomcat, Scheduler, JCache API, Hibernate, MyBatis, RPC, local cache ...

Awesome Observable related stuff - An Observable is a collection that arrives over time.

Awesome crypto trading bots

快速、简洁且强大的PHP爬虫框架

😎 Curated list of awesome things regarding WebAssembly WASI ecosystem.

Awesome UWP libs

🕶️ List of communities powered by Slack.

B+ Tree - List - File Structures 2 - Memory Mapped File Structures for Go

📝 Frontend Tech List for Developers 💡

tracking medical datasets, with a focus on medical imaging

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

✅ List of Automated Testing (TDD/BDD/ATDD/SBE) Tools and Frameworks for .NET

A curated list of awesome lorem ipsum generators.

Documenting the explosion of packages in the standard ecosystem!

Promise packages, patterns, chat, and tutorials

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

A curated list of awesome CMake resources, scripts, modules and examples.

🎨 A curated contents of amazing CSS :)

BxJS Weekly news podcast links collection

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

A curated list of awesome Yii Framework extensions, tutorials and other nice things

Sci-Fi worth consuming

Awesome AVA resources

NBA Stats API via Basketball Reference

Resources for learning about Text Mining and Natural Language Processing

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

Lists of resources useful for my PhD in computer vision

An R web crawler and scraper

😎 A curated list of packages and resources regarding Steam development

An elegant selection list or dropdown menu for iOS with single or multiple selections.

List of "only yours" cloud services for everyday needs 🏴

💯 The most essential list of resources for Front-End beginners (🇺🇸 🇬🇧 🇨🇦 & 🇫🇷)

A collection of resources covering Nginx, Nginx + Lua, OpenResty and Tengine

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

A curated list of articles complaining that go (golang) isn't good enough

📖 A collection of pure POSIX sh alternatives to external processes.

Curated list of awesome Esoteric languages and resources

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

A library which configures a divider for a RecyclerView.