1285 Open source projects that are alternatives of or similar to Seleniumcrawler

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Creating Scrapy scrapers via the Django admin interface

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

With Selenium headless browsing and CAPTCHA solving

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Build and deploy a machine learning app from scratch 🚀

A browser testing and web crawling library for PHP and Symfony

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

A tutorial-based introduction to web scraping with Python.

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

No description or website provided.

An installer and wrapper for Chromedriver.

The Zipru scraper developed in the Advanced Web Scraping Tutorial.

A complete test automation tool

A framework for creating semi-automatic web content extractors

Crawly, a high-level web crawling & scraping framework for Elixir.

Declarative web scraping

Code for the second edition Web Scraping with Python book by Packt Publications

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

✂️ High performance, multi-threaded image scraper

[Unmaintained] A simple and clean video/music/image downloader 👾

This bot will post a predefined comment as fast as possible to a new post on the target profile. I used this to successfully win tickets for a big music festival.

Scrapy middleware to handle javascript pages using selenium

A python web scraper for public email lists.

A scrapy spider that scraps times and prices from Voyages Sncf. It uses scrapyrt to provide an API interface.

Browser test automation using Selenium WebDriver in C#

🚀电商网站爬虫合集，淘宝京东亚马逊等

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

A maven template for Selenium that will let you check out and go.

PHP client for Selenium/WebDriver protocol. Previously facebook/php-webdriver

Extract structured data from web sites. Web sites scraping.

A Facebook crawler

C#/.NET test automation framework for web

Python入门网络爬虫之精华版

Simple but useful Python web scraping tutorial code.

HTTP API for Scrapy spiders

Distributed crawler powered by Headless Chrome

Scrapping tool for GISAID data regarding SARS-CoV-2

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Send messages to any person in any time how much you want.

A Python Tool For google Hacking

Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku

Java EE 7 Petclinic

Search for and retrieve US Patent and Trademark Office Patent Data

An Instagram Scrapper

lots of spider (很多爬虫）

Mobile test automation using Appium in Java

Indonesia Index News Crawler, including 10 online media

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Mozilla's Gecko Marionette client in golang

Reporter for WebdriverIO v6 that makes videos of failed tests and has optional allure integration

Bring the best of Selenium and Cypress into a single Python package

AlipaySpider on Scrapy(use chrome driver); 支付宝爬虫(基于Scrapy)

A native Selenium WebDriver binding for ColdFusion

Social media research and promotion, semi-autonomous CLI bot

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

ASP.NET View State Decoder