All Projects → zdg39 → Z-Spider

zdg39 / Z-Spider

Licence: MIT license
一些爬虫开发的技巧和案例

Programming Languages

java
68154 projects - #9 most used programming language
python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Z-Spider

Hive
lots of spider (很多爬虫)
Stars: ✭ 110 (+233.33%)
Mutual labels:  spider, selenium-webdriver
Scrapy-Spiders
一个基于Scrapy的数据采集爬虫代码库
Stars: ✭ 34 (+3.03%)
Mutual labels:  spider, appium
Scrapingoutsourcing
ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个
Stars: ✭ 164 (+396.97%)
Mutual labels:  spider, appium
Weixin Spider
微信公众号爬虫,公众号历史文章,文章评论,文章阅读及在看数据,可视化web页面,可部署于Windows服务器。基于Python3之flask/mysql/redis/mitmproxy/pywin32等实现,高效微信爬虫,微信公众号爬虫,历史文章,文章评论,数据更新。
Stars: ✭ 287 (+769.7%)
Mutual labels:  spider, mitmproxy
OneFramework
Automation for iOS, Android, & Web Apps with one codebase. Like it, Star it & spread the word !!!
Stars: ✭ 46 (+39.39%)
Mutual labels:  selenium-webdriver, appium
Spider Flow
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Stars: ✭ 365 (+1006.06%)
Mutual labels:  spider, xpath
QVisual
Tinkoff tool to control quality by visual testing
Stars: ✭ 47 (+42.42%)
Mutual labels:  selenium-webdriver, opencv-java
Selenium Jupiter
JUnit 5 extension for Selenium WebDriver
Stars: ✭ 185 (+460.61%)
Mutual labels:  selenium-webdriver, appium
TikTokBot
Bot save videos from instagram and then post them to Tik-Tok
Stars: ✭ 21 (-36.36%)
Mutual labels:  captcha, captcha-solver
AppiumGrid
A framework for running appium tests in parallel across devices and also on desktop browser... U like it STAR it !!
Stars: ✭ 17 (-48.48%)
Mutual labels:  selenium-webdriver, appium
web-data-extractor
Extracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON.
Stars: ✭ 52 (+57.58%)
Mutual labels:  spider, xpath
OpenYspider
千万级图片爬虫、视频爬虫 [开源版本] Image Spider
Stars: ✭ 122 (+269.7%)
Mutual labels:  spider, selenium-webdriver
Buster
Captcha solver extension for humans
Stars: ✭ 4,244 (+12760.61%)
Mutual labels:  captcha, captcha-solver
Python Spider
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
Stars: ✭ 615 (+1763.64%)
Mutual labels:  spider, xpath
Appcrawler
基于appium的app自动遍历工具
Stars: ✭ 925 (+2703.03%)
Mutual labels:  xpath, appium
ulozto-captcha-breaker
Deep learning model using Tensorflow that breaks ulozto captcha codes.
Stars: ✭ 65 (+96.97%)
Mutual labels:  captcha, captcha-solver
Java.appium
Mobile test automation using Appium in Java
Stars: ✭ 59 (+78.79%)
Mutual labels:  selenium-webdriver, appium
Frameworkium Core
Framework for writing maintainable Selenium and REST API tests in Java.
Stars: ✭ 107 (+224.24%)
Mutual labels:  selenium-webdriver, appium
SHAFT ENGINE
SHAFT is an MIT licensed test automation engine. Powered by best-in-class frameworks like Selenium WebDriver, Appium & RestAssured it provides a wizard-like syntax to increase productivity, and built-in wrappers to eliminate boilerplate code and to ensure your tests are extra stable and your results are extra reliable.
Stars: ✭ 170 (+415.15%)
Mutual labels:  selenium-webdriver, appium
python-appium-framework
Complete Python Appium framework in 360 degree
Stars: ✭ 43 (+30.3%)
Mutual labels:  selenium-webdriver, appium

Welcome to Z-Spider 👋

Documentation License: MIT

Z-Spider:一些爬虫开发的技巧和案例

🏠 Homepage

目录


正文

🛠️ 抓包工具

Fiddler

Charles

mitmproxy

Proxyman

Wireshark


👻 正则

基础知识

元字符和简写字符集


🛸 xpath

基础知识


🕸️ jsoup

基础知识


🌀 滑块验证码

拼图类滑块验证码

拖动类滑块验证码


♠️ 图形验证码

数字英文类图形验证码


📯 反编译

jadx-gui


🕴️ 中间人

littleproxy

mitmproxy

servlet反向代理


🏴 xposed

xposed插件

xposed脱壳

hook

virtualXposed


🧹 selenium

headlessChrome


🗺️ appium

appium环境搭建


Author

👤zdg <[email protected]>

🤝 Contributing

Contributions, issues and feature requests are welcome!
Feel free to check issues page.

Show your support

Give a ⭐️ if this project helped you!

📝 License

Copyright © 2019 zdg.
This project is MIT licensed.


This README was generated with ❤️ by readme-md-generator

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].