654 Open source projects that are alternatives of or similar to diffbot-php-client

.NET agile and extensible web searching API

Extract all CSS from a webpage, packaged as a Now V2 Lambda

🌐 Web scraping made easy with the visual 🗺 mind map editor to JSON

Instagram Photo Downloader

📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Get all videos from a youtube channel, get all videos from a playlist, get all videos that match a search

Multithreaded Web spider crawler written in Rust.

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

An api to check social media username availability on a variety of services

Essential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.

Scraping the Un–scrapable™

PhantomJS/Node.js web scraper for AWS Lambda

Scoopi Web Scraper is a heavy duty tool to extract data from HTML pages.

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.

Python script to download messages from a Facebook page to a CSV file

Google Maps reviews scraping

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

Interactive CLI Web Crawler

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

项目已经移动至：https://github.com/BaiduSpider/BaiduSpider ！！ 一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)

Declarative DOM extraction expression evaluator. 👨‍⚕️

http interceptor to hoomanize cloudflare requests

Crawler dos dados metereológicos de estações convencionais do INMET (BDMEP)

Tweets when words are published for the first time in the NYT

DocSearch - Scraper

Get Instagram posts/profile/hashtag data without using Instagram API

Read an Amazon wishlist programmatically with Python

Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

client for https://ammobin.ca

A console application that can scrape the Azur Lane wiki and export the data to Json files

kikoeru 后端，不再维护，请到https://github.com/umonaca/kikoeru-express 获取更新

AngularJS SPA interface for awesome lists. Awesome lists parsed using python.

Araignée LeBonCoin avec Scrapy et ElasticSearch

🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.

Whisper of the arxiv: read comments in tex of papers

Implementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021

Python3 API wrapper and web scraper for https://coinmarketcap.com

A magic html parser

A Scala library for scraping content from HTML pages

Proof of concept for a security issue (in my opinion) that I found in accounts.google.com

Tool to scrape linkedin

Crawl instagram photos, posts and videos for download.

📷 Instagram private API in Java

Python爬虫，京东自动登录，在线抢购商品

百度贴吧分布式爬虫，用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析

🏠 a.k.a 591 rent scraper（591 租屋網爬蟲）

Web scraper that can create an offline readable version of a website

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

Scrapers for vk, facebook, instagram and more

Fast, flexible, and lean implementation of core jQuery designed specifically for the server.

Generate JSON representations of HTML tables

Scrapes an instagram user's photos and videos

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

Google does not provide Google Dictionary API so I created one.

基于 Laravel 5.2 的小说网站