557 Open source projects that are alternatives of or similar to Webinspector

Automatically opens external links in a new browser for Jekyll Pages, Posts and Docs.

💀 The Pirate Bay node.js client

scraper for Rensselaer Polytechnic Institute (RPI)'s Covid Dashboard

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Scraper for downloading the entire ebooks repository of project Gutenberg

DocSearch - Scraper

Covenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

Crawl instagram photos, posts and videos for download.

Node.js based scraper using headless chrome

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

Convert a markdown document or text into a terminal friendly output.

🐦 Access Twitter data without an API key. [DEPRECATED]

Using this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.

Alternative for VK Audio API

🕸 List of mini projects that involve web scraping 🕸

COVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉

A gem that allows you to get detailed statistics of a git repository.

Demeter is a tool for scraping the calibre web ui

simple framework for containing spreadsheet like data

A survey of Apple developer documentation.

Unity Odin editor helper which permits to set a "SOVariant" attribute to a ScriptableObject and override, or not, certain fields (similar to prefab variants but for scriptable objects).

ScraperWiki Python library for scraping and saving data

PHP Metacritic API - Mirrored by my GitLab

This repository contains all the code I use in my YouTube tutorials.

Tools for downloading agendas, minutes and other documents produced by local government

Zillow Scraper for Python using Selenium

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

A scraper for https://bandcamp.com

Extract rich metadata from URLs

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

CircleCI REST API Ruby Gem

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

Inspector client

Scrape any online Mediawiki motorised wiki (like Wikipedia) to your local filesystem

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

Download YouTube comments from numerous videos, playlists, and channels for archiving, general search, and showing activity.

robots.txt file parsing and checking for R

comic updater, mangafied

A Python package for acquiring both historical and current data of cryptocurrencies

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

Scrape all the media from an OnlyFans account - Updated regularly

Scrape job websites into a single spreadsheet with no duplicates.

Scrape a Facebook profile and turn it into a JSON file

A web crawler (for bug hunting) that gathers more than you can imagine.

Injectable developer tools for ProseMirror rich-text editors implemented in Svelte and TypeScript.

A Devtools driver for web automation and scraping

Docker Compose specific tasks for Capistrano

The most integrated web scraper package for Laravel.

All Turkish Banks and Their Branches

This is a list of repositories and libraries that allow for scripted downloading of online content.

Scraps for publicly accessible MongoDB instances and dumps user passwords

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

A simple mixin to make Ruby classes configurable

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

Simple Weibo Scraper

Some useful scripts simplifying bureaucracy

An api to check social media username availability on a variety of services

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

基于React开发的新一代web调试工具，支持React组件调试，类似于Chrome Devtools。A Lightweight, Easy To Extend Web Debugging Tool Build With React