All Projects → umihico → docker-selenium-lambda

umihico / docker-selenium-lambda

Licence: MIT license
The simplest demo of chrome automation by python and selenium in AWS Lambda

Programming Languages

Dockerfile
14818 projects
python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to docker-selenium-lambda

Panther
A browser testing and web crawling library for PHP and Symfony
Stars: ✭ 2,480 (+1341.86%)
Mutual labels:  scraping, selenium, chromedriver
Lambdium
headless chrome + selenium webdriver in AWS Lambda using the serverless application model
Stars: ✭ 246 (+43.02%)
Mutual labels:  lambda, selenium, chromium
Undetected Chromedriver
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (+112.21%)
Mutual labels:  scraping, selenium, chromedriver
Seleniumcrawler
An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (-31.98%)
Mutual labels:  scraping, selenium
Post Tuto Deployment
Build and deploy a machine learning app from scratch 🚀
Stars: ✭ 368 (+113.95%)
Mutual labels:  scraping, selenium
Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Stars: ✭ 5,129 (+2881.98%)
Mutual labels:  scraping, chromium
chesf
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Stars: ✭ 18 (-89.53%)
Mutual labels:  scraping, selenium
Secret Agent
The web browser that's built for scraping.
Stars: ✭ 151 (-12.21%)
Mutual labels:  scraping, chromium
Udemycoursegrabber
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (-20.35%)
Mutual labels:  scraping, selenium
chameleon-crawler
Browser automation for Chameleon.
Stars: ✭ 17 (-90.12%)
Mutual labels:  selenium, chromedriver
Serverless Chrome
🌐 Run headless Chrome/Chromium on AWS Lambda
Stars: ✭ 2,625 (+1426.16%)
Mutual labels:  lambda, chromium
docker-node-ci
The Docker image based on the official "node" image optimized for a CI environment
Stars: ✭ 18 (-89.53%)
Mutual labels:  chromium, chromedriver
Edu Mail Generator
Generate Free Edu Mail(s) within minutes
Stars: ✭ 301 (+75%)
Mutual labels:  scraping, selenium
schedule-tweet
Schedules tweets using TweetDeck
Stars: ✭ 14 (-91.86%)
Mutual labels:  scraping, selenium
bots-zoo
No description or website provided.
Stars: ✭ 59 (-65.7%)
Mutual labels:  scraping, selenium
Fifa21-Autobidder
Selenium-based bot that autobids and autobuys players on FIFA 23 Ultimate Team's transfer market
Stars: ✭ 106 (-38.37%)
Mutual labels:  selenium, chromedriver
InstaBot
Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.
Stars: ✭ 32 (-81.4%)
Mutual labels:  scraping, selenium
rubium
Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby
Stars: ✭ 65 (-62.21%)
Mutual labels:  scraping, chromium
Scrape Linkedin Selenium
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+38.95%)
Mutual labels:  scraping, selenium
jest-selenium
This project shows how to drive your selenium tests with Jest.
Stars: ✭ 22 (-87.21%)
Mutual labels:  selenium, chromedriver

docker-selenium-lambda

This is minimum demo of headless chrome and selenium on container image on AWS Lambda

This image goes with these versions. These are automatically updated and tested everyday. CircleCI

  • Python 3.9.14
  • chromium 107.0.5304.0
  • chromedriver 107.0.5304.62
  • selenium 4.5.0

Running the demo

$ npm install -g serverless # skip this line if you have already installed Serverless Framework
$ export AWS_REGION=ap-northeast-1 # You can specify region or skip this line. us-east-1 will be used by default.
$ sls create --template-url "https://github.com/umihico/docker-selenium-lambda/tree/main" --path docker-selenium-lambda && cd $_
$ sls deploy
$ sls invoke --function demo # Yay! You will get texts of example.com

Public image is available

If you want your image simplier and updated automatically, rewrite the Dockerfile with the following commands:

FROM umihico/aws-lambda-selenium-python:latest

COPY main.py ./
CMD [ "main.handler" ]

Available tags are listed here

Side Project

If you don't want to create functions each time for each purpose, Please check out pythonista-chromeless

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].