MarionetteSelenium alternative for Crystal. Browser manipulation without the Java overhead.
Stars: ✭ 119 (-35.68%)
Lxspider爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》
Stars: ✭ 60 (-67.57%)
Httpcode.core简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫,api请求等等。
Stars: ✭ 146 (-21.08%)
TibEasy e2e browser testing in Node
Stars: ✭ 64 (-65.41%)
BeanbunBeanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman。
Stars: ✭ 1,096 (+492.43%)
MoonAn efficient Selenium protocol implementation running everything in Kubernetes or Openshift
Stars: ✭ 116 (-37.3%)
Sentinel CrawlerXenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-36.22%)
Car PricesGolang爬虫 爬取汽车之家 二手车产品库
Stars: ✭ 57 (-69.19%)
BaiducrawlerSample of using proxies to crawl baidu search results.
Stars: ✭ 116 (-37.3%)
Wdio Video ReporterReporter for WebdriverIO v6 that makes videos of failed tests and has optional allure integration
Stars: ✭ 53 (-71.35%)
Csharp.webdriverBrowser test automation using Selenium WebDriver in C#
Stars: ✭ 115 (-37.84%)
Images Web CrawlerThis package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..
Stars: ✭ 51 (-72.43%)
Python web framework这是一个关于python的WebUI自动化测试的项目,之前用的是unittest测试框架,现在改成pytest测试框架,Python+PageObject+Pytest
Stars: ✭ 49 (-73.51%)
Memex ExplorerViewers for statistics and dashboarding of Domain Search Engine data
Stars: ✭ 115 (-37.84%)
Gwen WebA web automation engine for Gwen.
Stars: ✭ 47 (-74.59%)
Spoon🥄 A package for building specific Proxy Pool for different Sites.
Stars: ✭ 173 (-6.49%)
Social ScraperTổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt
Stars: ✭ 47 (-74.59%)
Query Selector Shadow DomquerySelector that can pierce Shadow DOM roots without knowing the path through nested shadow roots. Useful for automated testing of Web Components. Production use is not advised, this is for test environments/tools such as Web Driver, Playwright, Puppeteer
Stars: ✭ 115 (-37.84%)
WhalesongWhalesong is an asyncio python library to manage WebApps remotely. Currently WhatsappWeb is implemented
Stars: ✭ 46 (-75.14%)
Python crawlerIt's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.
Stars: ✭ 45 (-75.68%)
Jianso movie🎬 电影资源爬虫,电影图片抓取脚本,Flask|Nginx|wsgi
Stars: ✭ 114 (-38.38%)
Weibo Crawler新浪微博爬虫,用python爬取新浪微博数据,并下载微博图片和微博视频
Stars: ✭ 1,019 (+450.81%)
GocrawlPolite, slim and concurrent web crawler.
Stars: ✭ 1,962 (+960.54%)
AvbookAV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+4296.22%)
Vulnxvulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}
Stars: ✭ 1,009 (+445.41%)
WebiumWebium is a Page Object pattern implementation library for Python (http://martinfowler.com/bliki/PageObject.html). It allows you to extend WebElement class to your custom controls like Link, Button and group them as pages.
Stars: ✭ 144 (-22.16%)
Lizard💐 Full Amazon Automatic Download
Stars: ✭ 41 (-77.84%)
Lcrawl一只优雅的正方教务系统爬虫。
Stars: ✭ 112 (-39.46%)
Hacking ScriptsHacking Scripts contains amazing and awesome scripts written in Python, JavaScript, Java, Nodejs, and more. The main aim of the repository will be to provide utility scripts that might make everyday life easy.
Stars: ✭ 41 (-77.84%)
GraphqueryGraphQuery is a query language and execution engine tied to any backend service.
Stars: ✭ 112 (-39.46%)
Cbt Tunnel NodejsNode.js module for Local Connections to crossbrowsertesting.com
Stars: ✭ 39 (-78.92%)
Zhihuapi PyUnofficial API for zhihu.
Stars: ✭ 39 (-78.92%)
PixivcrawleriiiA python3 crawler for crawling Pixiv ranking top and any illustrator all artworks
Stars: ✭ 38 (-79.46%)
WebtauWebtau (short for web test automation) is a testing API, command line tool and a framework to write unit, integration and end-to-end tests. Test across REST-API, Graph QL, Browser, Database, CLI and Business Logic with consistent set of matchers and concepts. REPL mode speeds-up tests development. Rich reporting cuts down investigation time.
Stars: ✭ 156 (-15.68%)
Schannel Qt5A GUI client of schannel powered by therecipe/qt and golang
Stars: ✭ 36 (-80.54%)
GargantuaThe fast website crawler
Stars: ✭ 35 (-81.08%)
Robots TxtDetermine if a page may be crawled from robots.txt, robots meta tags and robot headers
Stars: ✭ 142 (-23.24%)
Tumblr CrawlerEasily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片,视频
Stars: ✭ 1,118 (+504.32%)
BitextorBitextor generates translation memories from multilingual websites.
Stars: ✭ 168 (-9.19%)
Th Music Video GeneratorTouhou Project random music video generator/player, crawling image and video from websites to generate MV.
Stars: ✭ 146 (-21.08%)
Docs《数据采集从入门到放弃》源码。内容简介:爬虫介绍、就业情况、爬虫工程师面试题 ;HTTP协议介绍; Requests使用 ;解析器Xpath介绍; MongoDB与MySQL; 多线程爬虫; Scrapy介绍 ;Scrapy-redis介绍; 使用docker部署; 使用nomad管理docker集群; 使用EFK查询docker日志
Stars: ✭ 118 (-36.22%)
Hproxyhproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)
Stars: ✭ 62 (-66.49%)
Moodle Downloader 2A Moodle downloader that downloads course content fast from Moodle (eg. lecture pdfs)
Stars: ✭ 118 (-36.22%)
PyleniumioBring the best of Selenium and Cypress into a single Python package
Stars: ✭ 61 (-67.03%)