799 Open source projects that are alternatives of or similar to Spider

多线程爬取互联网行业常用招聘网站

Using Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.

🎪 End-to-end testing made simple (using Jest and Puppeteer)

web scraping in parallel with Selenium Grid and Docker

A Selenium TDD framework that incorporates key features of Selenium and TestNG which can be used to create web-based automation scripts.

日常爬虫

计算机基础知识，数据结构，设计模式，Tomcat中间件的实现

Carina automation framework: Web, Mobile, API, DB etc testing...

🕵️ Lightweight utility to intercept WebDriver and WebElement method calls.

PowerShell Web Automation module, made to make automating websites easier

Automatische Impfterminbuchung für www.impfterminservice.de

Generate an object for testing if a request is sent, request is Mikeal's request.

Web.whatsapp.com bot made with selenium

Automation for Kivy Application

Grabs all of the audio files from all of the Blinkist books

Python Program To Send Instagram Story Views

php selenium 数据采集

Download public videos on TikTok using Python with Selenium

A standalone package to scrape financial data from listed Vietnamese companies via Vietstock

📷 Instagram Bot - Tool for automated Instagram interactions

This Python script is used to scrape all the video links from a youtube channel.

Experiences in extracting data from Facebook with these 3 methods: Facebook Graph API, Automation tools, DevTools Console

All studies about python

正方教务管理系统学生版的自动登录、选课、信息获取

Dynamic test framework for web and mobile applications

robots.txt file parsing and checking for R

With Selenium headless browsing and CAPTCHA solving

动漫之家漫画站电脑版原图爬虫

Helpful Selenium functions to make web-scraping easier and faster

🕊TwitPy - Follow/Unfollow Automation

Automation Testing | Web | Java | OOPS | Selenium WebDriver | TestNG | Maven | ExtentReport | Allure Reports | Java mail API | Design Patterns (Page Object Model, Singleton) | Jenkins | Data-Driven Testing using JSON file

百度贴吧生日爬虫，可抓取贴吧内吧友生日，并且在对应日期自动发送祝福

An complete example of a pipeline focusing on API and UI (mobile and web) tests.

Keep track of jobs you've applied to, automate resume & cover letter creation; generate PDFs from .odt templates on the fly while scraping the job post and tracking employer status.

Selenium-based bot that autobids and autobuys players on FIFA 23 Ultimate Team's transfer market

A bash script to spider a site, follow links, and fetch urls (with built-in filtering) into a generated text file.

Code to download web-images

This is the sample repository that we use in the Complete Selenium WebDriver with Java Bootcamp

该项目是一个使用celery作为主体框架的爬虫应用，能够灵活的添加爬虫任务，并且同时运行多站点的爬虫工作，所有组件都能够原生支持规模并发和分布式，加上celery原生的分布式调用，实现大规模并发。

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data

A simple automation script that logs into your kra account and files your taxes with one command

Bot for scheduling and entering google meet sessions automatically

Automated Tinder bot and scraper using selenium in python.

妹子图

This is an auto-clicker bot used to trade players and items on FIFA Ultimate Team's Web App.

Simply scrape / download all the media from an fansly account

扫描“微信读书”已购图书并下载本地PDF的爬虫

A library use jQuery like API for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.

scrapers for building your own image databases

研究学习各种拦截：反爬虫、拦截ad、防广告注入、斗黄牛等

PTT 表特版爬蟲圖片下載器

⭐ 图虫网爬虫

🕷️ A simple crawler (spider) writen in php just for fun, with zero dependencies

No description or website provided.

Advanced python library to scrap Twitter (tweets, users) from unofficial API

爬虫学习仓库，适合零基础的人学习，对新手比较友好

gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。

利用墨墨背单词的分享功能拿每日20个的单词上限奖励（多线程

文章采集工具 Article collection tool