799 Open source projects that are alternatives of or similar to Spider

No description or website provided.

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。

AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)

This is a web crawler for pubg.op.gg, written by Ruichong Liu. 绝地求生游戏数据抓取

微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理

🎯Python 3 网络爬虫实战、数据分析合集 | 当当 | 网易云音乐 | unsplash | 必胜客 | 猫眼 |

拼多多爬虫，爬取所有商品、评论等信息

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

千万级图片爬虫、视频爬虫 [开源版本] Image Spider

徒手实现定时爬取知乎，从中发掘有价值的信息，并可视化爬取的数据作网页展示。

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

一些脚本和工具

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Automate Web WhatsApp with selenium in python.

Simon is a Python library that helps made easy the browser automation for WhatsApp Web service

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

A script to download images from images.google.com

Automate the process of sending referral request and cold mailing on LinkedIn

利昂图书馆预约系统自动预约&签到程序。支持包括中国人民大学、北京师范大学、济南大学、哈尔滨工业大学等在内的38所高校的图书馆系统

Converts English statements to automation.

Complete Python Appium framework in 360 degree

带图形界面的哔哩哔哩漫画下载工具

一个php爬虫

QQ 空间爬虫，基于 selenium 模拟登录空间，破解滑动验证码，拿到 cookies，然后使用 requests 抓取好友留言板的所有留言与回复，并生成词图。只抓了留言，本来还想抓说说，不过因为我已经好多年不玩 QQ 空间，感觉它对我已经没什么意义了，遂作罢。

Python module to get easy machine access to dnevnik.mos.ru

travian kingdoms automation (www.kingdoms.com)

多线程爬取互联网行业常用招聘网站

🎪 End-to-end testing made simple (using Jest and Puppeteer)

A Selenium TDD framework that incorporates key features of Selenium and TestNG which can be used to create web-based automation scripts.

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

🕵️ Lightweight utility to intercept WebDriver and WebElement method calls.

Automatische Impfterminbuchung für www.impfterminservice.de

Web.whatsapp.com bot made with selenium

Python Program To Send Instagram Story Views

Download public videos on TikTok using Python with Selenium

📷 Instagram Bot - Tool for automated Instagram interactions

Experiences in extracting data from Facebook with these 3 methods: Facebook Graph API, Automation tools, DevTools Console

正方教务管理系统学生版的自动登录、选课、信息获取

robots.txt file parsing and checking for R

动漫之家漫画站电脑版原图爬虫

🕊TwitPy - Follow/Unfollow Automation

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

Keep track of jobs you've applied to, automate resume & cover letter creation; generate PDFs from .odt templates on the fly while scraping the job post and tracking employer status.

The simplest demo of chrome automation by python and selenium in AWS Lambda

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

This is the sample repository that we use in the Complete Selenium WebDriver with Java Bootcamp

A test harness that allows Selenium tests to be run using JUnit and test fixtures to be created and injected by a WebDriver-aware Guice

Browser automation for Chameleon.

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

A simple automation script that logs into your kra account and files your taxes with one command

🍃 Everything You Need to Know About Testing Spring Boot Applications

Automated Tinder bot and scraper using selenium in python.

This is an auto-clicker bot used to trade players and items on FIFA Ultimate Team's Web App.

ICP备案查询，可查询企业或域名的ICP备案信息，自动完成滑动验证，保存结果到Excel表格，适用于2022年新版的工信部备案管理系统网站，告别频繁拖动验证，以及某站*工具要开通VIP才可查看备案信息的坑

It is almost spring, so time for a pre spring cleaning. This time: taking care of your Facebook. This script can safe you a lot of time if you would try to do that by hand.

Image comparison for Robot Framework

扫描“微信读书”已购图书并下载本地PDF的爬虫

研究学习各种拦截：反爬虫、拦截ad、防广告注入、斗黄牛等