245 Open source projects that are alternatives of or similar to shorter.recipes

Use SQL on various data sources

Lightweight package to query popular search engines and scrape for result titles, links and descriptions

Serverless selenium which dynamically execute any given code.

This class can retrieve search results from Google.

Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.

Pillaging the seven seas for torrents, pieces of eight and other bounty.

Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

📊 Python tool to scrape real-time information about ETFs from the web and mixing them together by proportionally distributing their assets allocation

Transistor, a Python web scraping framework for intelligent use cases.

Machine learning for beginner(Data Science enthusiast)

Generate a network graph of connections from your WhatsApp groups data

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

Tutorial for web scraping / crawling with Node.js.

High-Performance configuration patterns and recipes.

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

📄 Python tool to turn Notion.so pages into lightweight, customizable static websites

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

reborn of https://bitbucket.org/rflechner/scrapysharp

A Selenium-driven tool for automated website interaction and scraping.

Elegant Scraper and Crawler Framework for Golang

Simple app for scraping author profiles and tutorials from Scotch.io - https://scotch.io.

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

simple multi-level scraper json input/output for Cheerio

👨🏻‍🍳 Biggest list of the Best Recipes - React App and Api Rest

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Udacity Android Developer Nanodegree project baking app

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.

🤖 A Versatile Telegram Bot

List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

Distributed crawling framework for documents and structured data.

Tool to scrape linkedin

Jsoup Annotations POJO

scrapers for building your own image databases

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

A CLI for Mozilla Readability. Get clean, uncluttered, ready-to-read HTML from any webpage!

Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Universal scrapping tool, which allows you to extract data using multiple environments

⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!

Getting started with Puppeteer and Chrome Headless for Web Scraping

Instagram Photo Downloader

A browser testing and web crawling library for PHP and Symfony

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

The REST API for Jikan

Generate JSON representations of HTML tables

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

Pahe.ph [Pahe.in] Movies Website Scraper

An API to scrape American court websites for metadata.

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

.NET agile and extensible web searching API

A Scrapy extension to log items coverage when the spider shuts down

With Selenium headless browsing and CAPTCHA solving

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

**[ARCHIVED]** website changes tracker 🔍

Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.