Top 17 scrapper open source projects

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

Evaluate JavaScript on a URL through headless Chrome browser.

Powerful dork searcher and vulnerability scanner for windows platform

telegram.dog/usetgxbot

Text Generation using Markov Chains fed by 4chan APIs

Transform online stores into APIs !

xvideos API library

📆 Sigarra Tools | An extension that makes the information system of the University of Porto slightly better.

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

gosquito ("go" + "mosquito") is a pluggable tool for data gathering, data processing and data transmitting to various destinations.

API for SIGA from Centro Paula Souza made for students to create things based in their profile data

Block crawlers and high traffic users on your site by IP using Redis

Simple metadata scrapper for node.js

Let's pick up your favorite waifu just from the API

💫 Spider is a PHP library with easily module integration for crawling website that allows you to scrape informations.

Advanced python library to scrap Twitter (tweets, users) from unofficial API

"I Make dropshiper's job easier" ~ Python Shopee Inventory Bot