500 Open source projects that are alternatives of or similar to WeReadScan

Turn large Web sites into tables and charts using simple SQLs.

🎯Python 3 网络爬虫实战、数据分析合集 | 当当 | 网易云音乐 | unsplash | 必胜客 | 猫眼 |

A simple distributed crawler for zhihu && data analysis

A HTML Report of test executions via TestNG (No code changes required, Export results)

简单易用的Python爬虫框架，QQ交流群：597510560

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

A web crawler for Go

Norconex HTTP Collector is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.

php selenium 数据采集

Displays all the 2019 CVPR Accepted Papers in a way that they are easy to parse.

（已不適用新版臺鐵訂票系統，且不再更新）台灣鐵路訂票應用程式（臺鐵 / 台鐵 / 訂單程票 / 訂來回票），基於 Selenium + PyQt4。

Rust Web Crawler saving pages on Redis

Asynchronous node.js wrapper for the Poppler PDF rendering library

Repository containing sample code used in a Frontend Testing workshop

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

PowerShell Web Automation module, made to make automating websites easier

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

基于WebDriver的WebUI自动化测试框架

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

Using Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.

Web Crawler

Scraping Visually Similar Images from Pinterest

Parser and database to index the terpene profile of different strains of Cannabis from online databases

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

A scalable, mature and versatile web crawler based on Apache Storm

A comprehensive list of selenium commands in Java

A collection of awesome web crawler,spider in different languages

This project shows how to drive your selenium tests with Jest.

Dynamic test framework for web and mobile applications

This is a project of build knowledge graph course. The project leverages historical stock price, and integrates social media listening from customers to predict market Trend On Dow Jones Industrial Average (DJIA).

Carina automation framework: Web, Mobile, API, DB etc testing...

Opensource Korean chatbot framework

With Selenium headless browsing and CAPTCHA solving

Apache Nutch is an extensible and scalable web crawler

Sample project which utilises frameworkium-core, a framework for writing maintainable Selenium and REST API tests and facilitates reporting and integration to JIRA.

A set of reusable Java components that implement functionality common to any web crawler

Helpful Selenium functions to make web-scraping easier and faster

A collection of awesome web scaper, crawler.

Automation for Kivy Application

A simple tool for fetching usable proxies from several websites.

Automation Testing | Web | Java | OOPS | Selenium WebDriver | TestNG | Maven | ExtentReport | Allure Reports | Java mail API | Design Patterns (Page Object Model, Singleton) | Jenkins | Data-Driven Testing using JSON file

A Python module to use the Tesla Motors Owner API

A simple but powerful web crawler library for .NET

An complete example of a pipeline focusing on API and UI (mobile and web) tests.

开源矢量地理数据获取与预处理工具(POI/AOI/行政区/路网/土地利用)

This Python script is used to scrape all the video links from a youtube channel.

Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.

Selenium-based bot that autobids and autobuys players on FIFA 23 Ultimate Team's transfer market

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

web scraping in parallel with Selenium Grid and Docker

快速登录大连理工大学统一身份认证系统（SSO）的Python模块，可轻松实现成绩提醒、抢课、玉兰卡信息、个人信息查询等功能。

Code to download web-images

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

All studies about python

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

Explore a website recursively and download all the wanted documents (PDF, ODT…)

Extension for SeleniumLibrary that provides manual and automatic waiting for asyncronous events like fetch, xhr, etc.

an example selenium test project

🙋 A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.

An attempt to improve user privacy by intelligent data obfuscation.