fBrowserHelpful Selenium functions to make web-scraping easier and faster
Stars: ✭ 16 (+14.29%)
chesfCHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Stars: ✭ 18 (+28.57%)
tithiwaAutomate Web WhatsApp with selenium in python.
Stars: ✭ 17 (+21.43%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (+735.71%)
PantherA browser testing and web crawling library for PHP and Symfony
Stars: ✭ 2,480 (+17614.29%)
iowebWeb Scraping Framework
Stars: ✭ 31 (+121.43%)
browser-automation-apiBrowser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (+71.43%)
Undetected ChromedriverCustom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (+2507.14%)
Gazpacho🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+3650%)
RARBG-scraperWith Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (+171.43%)
non-api-fb-scraperScrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Stars: ✭ 40 (+185.71%)
HuginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Stars: ✭ 33,694 (+240571.43%)
SocialreaperSocial media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 338 (+2314.29%)
Instagram-Scraper-2021Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (+307.14%)
docker-selenium-lambdaThe simplest demo of chrome automation by python and selenium in AWS Lambda
Stars: ✭ 172 (+1128.57%)
bots-zooNo description or website provided.
Stars: ✭ 59 (+321.43%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+29021.43%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+614.29%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (+164.29%)
ReaperSocial media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 240 (+1614.29%)
google-meet-botBot for scheduling and entering google meet sessions automatically
Stars: ✭ 33 (+135.71%)
Sneakers ProjectUsing Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.
Stars: ✭ 32 (+128.57%)
ARGUSARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
Stars: ✭ 68 (+385.71%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (+50%)
Instagram-Giveaways-WinnerInstagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!
Stars: ✭ 95 (+578.57%)
Spam Bot 3000Social media research and promotion, semi-autonomous CLI bot
Stars: ✭ 79 (+464.29%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (+700%)
InstaBotSimple and friendly Bot for Instagram, using Selenium and Scrapy with Python.
Stars: ✭ 32 (+128.57%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (+878.57%)
chirpsTwitter bot powering @arichduvet
Stars: ✭ 35 (+150%)
Selenium Python HeliumSelenium-python but lighter: Helium is the best Python library for web automation.
Stars: ✭ 2,732 (+19414.29%)
SeleniumbaseA Python framework that inspires developers to become better test automation engineers. 🧠💡
Stars: ✭ 2,520 (+17900%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+1607.14%)
image-crawlerAn image scraper that scraps images from unsplash.com
Stars: ✭ 12 (-14.29%)
impf-botpyImpf Bot.py 🐍⚡ – Automatisierung für den Corona ImpfterminService Bot
Stars: ✭ 254 (+1714.29%)
choco-seleniumInstalls and configures selenium standalone, hub, or node server
Stars: ✭ 16 (+14.29%)
avatars-io👤 Wanna get a social media avatar? Avatars-io makes it easy for you. Just give a username then get an avatar!
Stars: ✭ 13 (-7.14%)
instagram explorer📷 An app to scrap instagram posts and analyze data.
Stars: ✭ 17 (+21.43%)
Automated-WhatsappAutomated WhatsApp replies using selenium module in Python
Stars: ✭ 23 (+64.29%)
rjangoDjango boilerplate with GraphQL, serving a Webpack compiled React Relay Modern frontend.
Stars: ✭ 73 (+421.43%)
twitter-analytics-wrapperA simple Python wrapper to download tweets data from the Twitter Analytics platform. Particularly interesting for the impressions metrics that are unavailable on current Twitter API. Also works for the videos data.
Stars: ✭ 44 (+214.29%)
doucheblockAutomatically block anyone with specific keywords in their Twitter bio.
Stars: ✭ 20 (+42.86%)
SocMapSocial Mapping Framework for Twitter
Stars: ✭ 16 (+14.29%)
TwEaterA Python Bot for Scraping Conversations from Twitter
Stars: ✭ 16 (+14.29%)
passport-examplesA variety of examples using PassportJS with ExpressJS and ReactJS applications
Stars: ✭ 44 (+214.29%)