Spoon🥄 A package for building specific Proxy Pool for different Sites.
Stars: ✭ 173 (-6.49%)
GocrawlPolite, slim and concurrent web crawler.
Stars: ✭ 1,962 (+960.54%)
WebiumWebium is a Page Object pattern implementation library for Python (http://martinfowler.com/bliki/PageObject.html). It allows you to extend WebElement class to your custom controls like Link, Button and group them as pages.
Stars: ✭ 144 (-22.16%)
WebtauWebtau (short for web test automation) is a testing API, command line tool and a framework to write unit, integration and end-to-end tests. Test across REST-API, Graph QL, Browser, Database, CLI and Business Logic with consistent set of matchers and concepts. REPL mode speeds-up tests development. Rich reporting cuts down investigation time.
Stars: ✭ 156 (-15.68%)
Robots TxtDetermine if a page may be crawled from robots.txt, robots meta tags and robot headers
Stars: ✭ 142 (-23.24%)
OddishTo crawl all csgo skins from website.
Stars: ✭ 139 (-24.86%)
JlitespiderA lite distributed Java spider framework :-)
Stars: ✭ 151 (-18.38%)
SearchAn Open Source Search Engine
Stars: ✭ 139 (-24.86%)
Go SeleniumSelenium web driver library written in Go
Stars: ✭ 157 (-15.14%)
Automationtest自动化测试,支持接口自动化、WEB UI自动化、APP UI自动化、性能测试
Stars: ✭ 171 (-7.57%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (-25.95%)
AbotCross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Stars: ✭ 1,961 (+960%)
4chan DownloaderPython3 script to continuously download all images/webms of multiple 4chan thread simultaneously - without installation
Stars: ✭ 136 (-26.49%)
Instagram CrawlerCrawl instagram photos, posts and videos for download.
Stars: ✭ 178 (-3.78%)
Goclone Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
Stars: ✭ 134 (-27.57%)
Qxf2 Page Object ModelWrite Selenium and Appium tests in Python using the Page Object pattern. This Pythonic GUI and API test automation framework will help you get started with QA automation quickly. It comes with many useful integrations like - email, BrowserStack, Slack, TestRail, etc. This repository is developed and maintained by Qxf2 Services (https://qxf2.com).
Stars: ✭ 155 (-16.22%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+6140.54%)
Proxy poolPython爬虫代理IP池(proxy pool)
Stars: ✭ 13,964 (+7448.11%)
UniumAutomation for Unity games
Stars: ✭ 132 (-28.65%)
CrawlerAn easy to use, powerful crawler implemented in PHP. Can execute Javascript.
Stars: ✭ 2,055 (+1010.81%)
Web Bee🐝 Web vertical crawler framework for fun
Stars: ✭ 184 (-0.54%)
DiggerDigger is a powerful and flexible web crawler implemented by pure golang
Stars: ✭ 130 (-29.73%)
QtwebdriverWebDriver implementation for Qt
Stars: ✭ 152 (-17.84%)
Zhiliao知乎去广告Xposed模块
Stars: ✭ 157 (-15.14%)
ScreenshotsSimple Website Screenshots as a Service (Django, Selenium, Docker, Docker-compose)
Stars: ✭ 126 (-31.89%)
NgmetaDynamic meta tags in your AngularJS single page application
Stars: ✭ 152 (-17.84%)
Selenium IdeOpen Source record and playback test automation for the web.
Stars: ✭ 1,815 (+881.08%)
SquidwarcSquidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
Stars: ✭ 125 (-32.43%)
QafQuality Automation Framework for web, mobileweb, mobile native and rest web-service using Selenium, webdrier, TestNG and Java Jersey
Stars: ✭ 150 (-18.92%)
RequestiumIntegration layer between Requests and Selenium for automation of web actions.
Stars: ✭ 1,618 (+774.59%)
GainWeb crawling framework based on asyncio.
Stars: ✭ 2,002 (+982.16%)
Ptt Alertor📢 Ptt 文章通知機器人!Notify Ptt Article in Realtime
Stars: ✭ 150 (-18.92%)
Black WidowGUI based offensive penetration testing tool (Open Source)
Stars: ✭ 124 (-32.97%)
Crawlab LiteLite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (-34.05%)
Dxy Covid 19 Crawler2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API
Stars: ✭ 1,865 (+908.11%)
Botium CoreThe Selenium for Chatbots - Bots Testing Bots
Stars: ✭ 181 (-2.16%)
Fun crawlerCrawl some picture for fun
Stars: ✭ 169 (-8.65%)
AyespyA performant visual regression testing tool
Stars: ✭ 150 (-18.92%)
Qqmusicspider基于Scrapy的QQ音乐爬虫(QQ Music Spider),爬取歌曲信息、歌词、精彩评论等,并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料
Stars: ✭ 120 (-35.14%)
Pspider简单易用的Python爬虫框架,QQ交流群:597510560
Stars: ✭ 1,611 (+770.81%)
Vantpy基于Selenium+unittest的WebUI自动化测试框架,使用POM(页面对象模型)设计模式,适合几乎所有web项目,可集成Jenkins部署自动化测试
Stars: ✭ 149 (-19.46%)
Pddspider拼多多爬虫,爬取所有商品、评论等信息
Stars: ✭ 121 (-34.59%)
Horn3tPowerful Visual Subdomain Enumeration at the Click of a Mouse
Stars: ✭ 120 (-35.14%)
CocrawlerCoCrawler is a versatile web crawler built using modern tools and concurrency.
Stars: ✭ 148 (-20%)