1673 Open source projects that are alternatives of or similar to kick-off-web-scraping-python-selenium-beautifulsoup

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Scrape job websites into a single spreadsheet with no duplicates.

（已不適用新版臺鐵訂票系統，且不再更新）台灣鐵路訂票應用程式（臺鐵 / 台鐵 / 訂單程票 / 訂來回票），基於 Selenium + PyQt4。

This repository provides usage examples for the Python module Newspaper3k.

Learn Python for the next 30 (or so) Days.

Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file

Wikipedia API wrapper for references

🤖 A Versatile Telegram Bot

Scraping Visually Similar Images from Pinterest

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Implementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021

pip安装的天眼查爬虫API，指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.

Bot for scheduling and entering google meet sessions automatically

A comprehensive list of selenium commands in Java

**[ARCHIVED]** website changes tracker 🔍

web scraping in parallel with Selenium Grid and Docker

Repository containing sample code used in a Frontend Testing workshop

Sample project which utilises frameworkium-core, a framework for writing maintainable Selenium and REST API tests and facilitates reporting and integration to JIRA.

Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access

Download public videos on TikTok using Python with Selenium

At present contains scraped data from around 1500 problems present on the site. More to follow....

🎬 An attempt at the most complete IMDb API

Extensions for Selenium WebDriver including jQuery/Sizzle selector support.

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

A slim PHP wrapper around ffmpeg to record screen,best for recording your acceptance test using selenium, easy to use and clean OOP interface

Selenium automation test framework

Zillow Scraper for Python using Selenium

PhantomJS/Node.js web scraper for AWS Lambda

Universal scrapping tool, which allows you to extract data using multiple environments

Python Web Crawler with Selenium and PhantomJS

An Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.

Instagram comment scraper using python and selenium. Save the comments into excel.

🌎 🏨 Scrape Booking.com 🏨 🌎

Script using requests module to register accounts to Slam Jam Socialism raffles.

A Spider About Wechat Articles 、Official Accounts

API for fetching data from news websites.

An attempt to improve user privacy by intelligent data obfuscation.

Automated Tinder bot and scraper using selenium in python.

Social media research and promotion, semi-autonomous CLI bot

Keep track of jobs you've applied to, automate resume & cover letter creation; generate PDFs from .odt templates on the fly while scraping the job post and tracking employer status.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🕵️ Lightweight utility to intercept WebDriver and WebElement method calls.

千万级图片爬虫、视频爬虫 [开源版本] Image Spider

E2E Tests with WebdriverIO and Cucumber

Install Selenium-compatible Chrome/Firefox/Opera/PhantomJS/Edge webdrivers automatically.

ProxyCrawl Python library for scraping and crawling

Elements model for Selenium.WebDriver

Automate the process of sending referral request and cold mailing on LinkedIn

Instagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

An Instagram Scrapper

🎶 Unofficial python API for pitchfork.com reviews.

Complete Python Appium framework in 360 degree

No description or website provided.

Command line program to download documents from web portals.