391 Open source projects that are alternatives of or similar to Find Cheapest Flights

The Zipru scraper developed in the Advanced Web Scraping Tutorial.

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Google does not provide Google Dictionary API so I created one.

A library that scrapes Linkedin for user data

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

Fast, flexible, and lean implementation of core jQuery designed specifically for the server.

A list of scrapers from around the web.

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Cryptocurrency historical price data library in Python. Data from https://coinmarketcap.com.

A collection of awesome web crawler,spider in different languages

Crawly, a high-level web crawling & scraping framework for Elixir.

Scrape a Facebook profile and turn it into a JSON file

📷 Instagram private API in Java

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

A Telegram Mass Surveillance Bot in Python

🔮 A Node.js scraper for humans.

Scrapes an instagram user's photos and videos

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

An unofficial DuckDuckGo search API.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

operative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.

🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot

Get Instagram posts/profile/hashtag data without using Instagram API

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Crawler for Nintendo Switch eShop

Crawl BookCorpus

A Simple Proxy Scraper

✂️ High performance, multi-threaded image scraper

A social networking service scraper in Python

A high performance web crawler in Elixir.

OSINT Swiss Army Knife

Distributed crawler powered by Headless Chrome

📊 Financial markets data library implemented in go.

Fetch new releases from http://www.juno.co.uk/.

Information Gathering Instagram.

A Facebook crawler

A tiny Node.js microservice to scrape open graph data with joy.

Scrape all the media from an OnlyFans account - Updated regularly

A Python Tool For google Hacking

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

快速、简洁且强大的PHP爬虫框架

Automated Script to scrape flight prices from any website into a csv format

JavGo是一个集合影片管理，影片刮削，视频处理，资源搜索等综合一体的全功能影音软件，支持爬取javbus，jav321，javdb，javlibrary进行刮削，支持db，bus的磁力搜索，支持获取library的影片评论。

Scrapes Reddit to download media of your choice.

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

Declarative DOM extraction expression evaluator. 👨‍⚕️

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

Unofficial API for finviz.com

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

IMDbPY is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies

An R web crawler and scraper

Declarative web scraping

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

HTTP API for Scrapy spiders

Extract structured data from web sites. Web sites scraping.

A news scraper for nodejs that help to scrap news from Indonesian news portal.

📈 Create GIFs from user's GitHub activity graph

[Unmaintained] A simple and clean video/music/image downloader 👾

A Scala library for scraping content from HTML pages

LinkedIn Scraper (currently working 2020)