Zhihu Crawlerzhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (+381.08%)
InstagramcrawlerA non API python program to crawl public photos, posts or followers
Stars: ✭ 349 (+88.65%)
AutocrawlerGoogle, Naver multiprocess image web crawler (Selenium)
Stars: ✭ 957 (+417.3%)
NetdiscoveryNetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
Stars: ✭ 573 (+209.73%)
Price Monitor京东商品价格监控:监控用户设定商品价格,降价邮件/微信提醒。技术:Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取
Stars: ✭ 634 (+242.7%)
Zhihu Login知乎模拟登录,支持提取验证码和保存 Cookies
Stars: ✭ 340 (+83.78%)
Instagram Profilecrawl💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!
Stars: ✭ 110 (-40.54%)
bots-zooNo description or website provided.
Stars: ✭ 59 (-68.11%)
DecryptloginAPIs for loginning some websites by using requests.
Stars: ✭ 1,861 (+905.95%)
Tianyanchapip安装的天眼查爬虫API,指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.
Stars: ✭ 206 (+11.35%)
PychromelessPython Lambda Chrome Automation (naming pending)
Stars: ✭ 219 (+18.38%)
zhihu-crawler徒手实现定时爬取知乎,从中发掘有价值的信息,并可视化爬取的数据作网页展示。
Stars: ✭ 56 (-69.73%)
Instagram Profilecrawl📝 quickly crawl the information (e.g. followers, tags etc...) of an instagram profile.
Stars: ✭ 816 (+341.08%)
Python3 SpiderPython爬虫实战 - 模拟登陆各大网站 包含但不限于:滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝,如果喜欢请start ❤️
Stars: ✭ 2,129 (+1050.81%)
Examples Of Web Crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (+5696.76%)
Instagram BotAn Instagram bot developed using the Selenium Framework
Stars: ✭ 138 (-25.41%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (-7.57%)
Datmusic ApiAlternative for VK Audio API
Stars: ✭ 160 (-13.51%)
CreeveyCross-browser screenshot testing tool for Storybook with fancy UI Runner.
Stars: ✭ 155 (-16.22%)
Spoon🥄 A package for building specific Proxy Pool for different Sites.
Stars: ✭ 173 (-6.49%)
GocrawlPolite, slim and concurrent web crawler.
Stars: ✭ 1,962 (+960.54%)
WebtauWebtau (short for web test automation) is a testing API, command line tool and a framework to write unit, integration and end-to-end tests. Test across REST-API, Graph QL, Browser, Database, CLI and Business Logic with consistent set of matchers and concepts. REPL mode speeds-up tests development. Rich reporting cuts down investigation time.
Stars: ✭ 156 (-15.68%)
NosmokeA cross platform UI crawler which scans view trees then generate and execute UI test cases.
Stars: ✭ 178 (-3.78%)
Yispider一款分布式爬虫平台,帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则(模版),可使用模版快速定义爬虫,也可当作框架手动开发爬虫。(兴趣使然的项目,用的不爽了就更新)
Stars: ✭ 158 (-14.59%)
Go SeleniumSelenium web driver library written in Go
Stars: ✭ 157 (-15.14%)
Automationtest自动化测试,支持接口自动化、WEB UI自动化、APP UI自动化、性能测试
Stars: ✭ 171 (-7.57%)
DownzemallDownZemAll! is a download manager for Windows, MacOS and Linux
Stars: ✭ 157 (-15.14%)
AbotCross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Stars: ✭ 1,961 (+960%)
Instagram CrawlerCrawl instagram photos, posts and videos for download.
Stars: ✭ 178 (-3.78%)
Instapy📷 Instagram Bot - Tool for automated Instagram interactions
Stars: ✭ 12,473 (+6642.16%)
Instagram Scraperscrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+1094.05%)
Qxf2 Page Object ModelWrite Selenium and Appium tests in Python using the Page Object pattern. This Pythonic GUI and API test automation framework will help you get started with QA automation quickly. It comes with many useful integrations like - email, BrowserStack, Slack, TestRail, etc. This repository is developed and maintained by Qxf2 Services (https://qxf2.com).
Stars: ✭ 155 (-16.22%)
Proxy poolPython爬虫代理IP池(proxy pool)
Stars: ✭ 13,964 (+7448.11%)
SelenoidSelenium Hub successor running browsers within containers. Scalable, immutable, self hosted Selenium-Grid on any platform with single binary.
Stars: ✭ 2,065 (+1016.22%)
CrawlerAn easy to use, powerful crawler implemented in PHP. Can execute Javascript.
Stars: ✭ 2,055 (+1010.81%)
Web Bee🐝 Web vertical crawler framework for fun
Stars: ✭ 184 (-0.54%)
Crawler illegal cases in chinaCollection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律,避免触碰数据合规红线。 [AD]中文知识图谱门户
Stars: ✭ 2,448 (+1223.24%)
N2h4네이버 뉴스 수집을 위한 도구
Stars: ✭ 177 (-4.32%)
Windows ImagesStep by step instructions for building Docker images with Windows
Stars: ✭ 170 (-8.11%)
Zhiliao知乎去广告Xposed模块
Stars: ✭ 157 (-15.14%)
QtwebdriverWebDriver implementation for Qt
Stars: ✭ 152 (-17.84%)
NgmetaDynamic meta tags in your AngularJS single page application
Stars: ✭ 152 (-17.84%)
JlitespiderA lite distributed Java spider framework :-)
Stars: ✭ 151 (-18.38%)
QafQuality Automation Framework for web, mobileweb, mobile native and rest web-service using Selenium, webdrier, TestNG and Java Jersey
Stars: ✭ 150 (-18.92%)