251 Open source projects that are alternatives of or similar to Shadow Useragent

No description or website provided.

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.

Contains all the public APIs listed in Phantombuster's API store. Pull requests welcome!

Laravel package to collect your bank statements history. Currently support for parsing statements history from BCA, Mandiri, BNI, and MUAMALAT e-banking websites.

Tracking PG&E outages

A blazingly fast and memory efficient (thread-safe) Java client on top of the BrowsCap CSV source files.

Example end to end data engineering project.

✂️ High performance, multi-threaded image scraper

HTTP User Agent parser for the Go programming language.

ASP.NET View State Decoder

Scrapy, a fast high-level web crawling & scraping framework for Python.

Torrengo is a CLI (command line) program written in Go which concurrently searches torrents from various sources.

🔥🐻 The Speakeasy Scripting Engine Which Combines Speed, Safety, and Simplicity

artoo.js - the client-side scraping companion.

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

Search for and retrieve US Patent and Trademark Office Patent Data

📖 This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.

Useragent analysis tool.浏览器分析判断工具 - 用户代理、操作系统信息

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

Free Web Scraping Tool with Java

Distributed crawler, database and web frontend for public directories indexing

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

Distributed crawler powered by Headless Chrome

a browser detector

PHP Library for detecting CMS

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Nim library for querying HTML using CSS-selectors (like JavaScripts document.querySelector)

Detect mobile device and its type.

Detect device, and render view according to detected device type.

A scalable web crawler framework for Java.

OCaml functional web scraping library

Get info from any web service or page

Code for the collection and analysis of the MTNT dataset

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

Creating Scrapy scrapers via the Django admin interface

scan for webcams on the internet

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with genetic algorithm. Capstone Project for Machine Learning Engineer Nanodegree by Udacity.

HTML scraping for Objective-C.

Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).

[Unmaintained] A simple and clean video/music/image downloader 👾

htmlSQL is a experimental PHP library which allows you to access HTML values by an SQL like syntax.

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Python framework to scrape Pastebin pastes and analyze them

Simple but useful Python web scraping tutorial code.

🕷 Google client for SERPS

Tabula is a tool for liberating data tables trapped inside PDF files

legacy backend for Open States

A PHP Class to detect a user's Browser. This encapsulation provides a breakdown of the browser and the version of the browser using the browser's user-agent string. This is not a guaranteed solution but provides an overall accurate way to detect what browser a user is using.

A curated list of awesome puppeteer resources.

🥫 The simple, fast, and modern web scraping library

Data extraction of Google's COVID-19 Mobility Reports

PHP Scraper - an highly opinionated web-interface for PHP

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Simple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube