1173 Open source projects that are alternatives of or similar to Faster Than Requests

Scrape, standardize and share public meetings from local government websites

A framework for creating semi-automatic web content extractors

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Go cascadia package command line CSS selector

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

Random User-Agent middleware based on fake-useragent

PHP Scraper - an highly opinionated web-interface for PHP

MetaData html scraper and parser for Node.js (supports Promises and callback style)

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

A Router WiFi key recovery/cracking tool with a twist.

Fetch user's data across social media

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Hargo is a Go library and command line utility that parses HAR files, can convert to curl format, and serve as a load test driver.

A collection of awesome web scaper, crawler.

PHP Library for detecting CMS

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

Scrapy Training companion code

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Scraping Ebay's products using Scrapy Web Crawling Framework

Scape top GitHub repositories and users based on keywords

Public web scraping scripts for the University of Toronto.

Powerful web scraping framework for Crystal

Подсистема 1С для работы с HTTP

This is a high performance , very useful multi-curl tool written in php. 一个超级好用的并发CURL工具！！！(httpful，restful, concurrency)

NBA Stats API via Basketball Reference

Redis-based components for Scrapy.

💰 curl cryptocurrencies exchange rates

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

A PHP API client class to interact with Ubiquiti's UniFi Controller API

Zero-allocation hashing for Java

A fast PostgreSQL Database Client Library for Python/asyncio.

curl statistics made simple

GoFrame is a modular, powerful, high-performance and enterprise-class application development framework of Golang.

The next generation relational database.

CLI tool to crawl a website and check HTTP status codes

Nextjs server to query websites with GraphQL

Request HTTP(s) URLs in a complex world

The Apache Kafka C/C++ library

a high performance, general purpose data compressor written in rust

Fast and exact implementation of the C++ from_chars functions for float and double types: 4x faster than strtod

The high-performance distributed SQL database for global, internet-scale apps.

A high performance, distributed RPC framework.（分布式服务框架XXL-RPC）

the champagne of beta embedded databases

binary serialization format

基于搜狗微信搜索的微信公众号爬虫接口

A collection of awesome web crawler,spider in different languages

A swift network profiler built on top of URLSession.

python爬虫

High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.

A JavaScript library for generating random user agents with data that's updated daily.

A multi-thread crawler framework with many builtin image crawlers provided.

The terminal-first http client