1244 Open source projects that are alternatives of or similar to Awesome Java Crawler

简悦( SimpRead ) · 轻阅版

Official Algolia Plugin for Netlify. Index your website to Algolia when deploying your project to Netlify with the Algolia Crawler

Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites

A browser extension (Chrome, Firefox) that toggles concealment of sensitive information found in the Azure Portal web page such as Subscription Id's

Promise wrapper for the Chrome extension API so that it can be used with async/await rather than callbacks

A small cross-browser emoji cheatsheet extension 👍

A Swift Web Crawler 🕷

采集免费、优质的机场订阅连接；科学上网，从娃娃抓起！/SSR/V2RAY/TROJAN/SPIDER

💯 Teach puppeteer new tricks through plugins.

A REST client for almost any web service (Firefox and Chrome Extension)

收集那些优秀的软件（Windows & Mac & Android & Chrome Plugins）

Selenium WebDriver client for Rust, for automated testing of websites

Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok

An open source tab manager for Chrome

🌐 Run headless Chrome/Chromium on AWS Lambda

🎨 An extension that can run Prettier in the browser

Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.

Automated Chrome tracing for benchmarking.

Elegant Scraper and Crawler Framework for Golang

Browser extension for inspection Preact applications

An image crawler written in Python.

模拟登陆基本采用的是直接登录或者使用selenium+webdriver的方式，有的网站直接登录难度很大，比如qq空间，bilibili等如果采用selenium就相对轻松一些。

It is a Chrome extension for printing JSON and JSONP.

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

Simple abstraction to use Chrome as a Headless Browser with Node JS

JUnit 5 extension for Selenium WebDriver

Simple news aggregator displaying top stories in real time

👾 Fast and simple video download library and CLI tool written in Go

Search wiki of the repository on Github

A Laravel wrapper for CrawlerDetect - the web crawler detection library

recheck for web apps – change comparison tool with local Golden Masters, Git-like ignore syntax and "Unbreakable Selenium" tests.

PHP libraries that makes Selenium WebDriver + PHPUnit functional testing easy and robust

A collection of tools for forensic analysis

🐝 Web vertical crawler framework for fun

Chrome extension that allows you to manage your Github stars with tags, and to create a bookmark folder with all your stars organized by the tags you created

Python bindings for the Chromium Embedded Framework (CEF)

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

A browser extension to mock AJAX requests at the browser level

Creates an XML-Sitemap by crawling a given site.

A browser testing and web crawling library for PHP and Symfony

A simple distributed crawler for zhihu && data analysis

A web extension for firefox and chrome to insert login credentials from gopass

JavaScript + BeautifulSoup = JSSoup

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。 [AD]中文知识图谱门户

The Selenium for Chatbots - Bots Testing Bots

Chrome & Firefox Browser extension to aid gRPC-Web development

Robot Framework in Docker Alpine

Awesome Chrome Extensions

Vim bindings for Google Chrome.

A Python framework that inspires developers to become better test automation engineers. 🧠💡

🎯 Autonomously buy Nvidia Founders Edition GPUs as soon as they become available.

☁️ Sync your bookmarks privately across browsers

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

Powerfull download accelerator and video downloader

Crawl instagram photos, posts and videos for download.

네이버 뉴스 수집을 위한 도구

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

使用jsoup爬取樱花动漫部分内容编写的第三方Android客户端。

Debug your JavaScript code running in Google Chrome from VS Code.