crawlkitA crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.
Stars: ✭ 23 (-75.27%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+126.88%)
web-crawlerPython Web Crawler with Selenium and PhantomJS
Stars: ✭ 19 (-79.57%)
Lambda PacksPrecompiled packages for AWS Lambda
Stars: ✭ 997 (+972.04%)
Proxy ScraperLibrary for scraping free proxies lists
Stars: ✭ 78 (-16.13%)
Dynamodb Stream ElasticsearchMissing blueprint for AWS Lambda. Reads stream from AWS DynamoDB and writes it to ElasticSearch.
Stars: ✭ 83 (-10.75%)
Echo360Commandline tool for automated downloads of echo360 videos hosted by university
Stars: ✭ 81 (-12.9%)
Aws Sam Golang ExampleAn example API and Worker written in Golang using the Amazon Serverless Application Model (AWS SAM)
Stars: ✭ 73 (-21.51%)
Kikoeru Expresskikoeru 后端,不再维护,请到https://github.com/umonaca/kikoeru-express 获取更新
Stars: ✭ 79 (-15.05%)
Brain Power Amazon FidgetologyServerless web app for streaming browser webcam feed to Amazon Kinesis Video Streams and Rekognition Video. See our post on the AWS Machine Learning Blog: https://aws.amazon.com/blogs/machine-learning/building-automatic-analysis-of-body-language-to-gauge-attention-and-engagement-using-amazon-kinesis-video-streams-and-amazon-ai-services
Stars: ✭ 84 (-9.68%)
ClojiderAWS Lambda powered, distributed load testing tool for Clojure
Stars: ✭ 76 (-18.28%)
Aws Serverless Airline BookingAirline Booking is a sample web application that provides Flight Search, Flight Payment, Flight Booking and Loyalty points including end-to-end testing, GraphQL and CI/CD. This web application was the theme of Build on Serverless Season 2 on AWS Twitch running from April 24th until end of August in 2019.
Stars: ✭ 1,290 (+1287.1%)
Aws MaintenanceCollection of scripts and Lambda functions used for maintaining AWS resources
Stars: ✭ 75 (-19.35%)
TorchlambdaLightweight tool to deploy PyTorch models to AWS Lambda
Stars: ✭ 83 (-10.75%)
Hoomanhttp interceptor to hoomanize cloudflare requests
Stars: ✭ 82 (-11.83%)
Jd AutobuyPython爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,174 (+1162.37%)
TspiderYet Another Web Spider
Stars: ✭ 70 (-24.73%)
MuFramework to Run General-Purpose Parallel Computations on AWS Lambda
Stars: ✭ 85 (-8.6%)
Email ExtractorThe main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Stars: ✭ 81 (-12.9%)
Image LambdaAn AWS Lambda function that AWS S3 can invoke to create thumbnails or reduce file size for png and jpg images.
Stars: ✭ 78 (-16.13%)
Lambda Refarch WebappThe Web Application reference architecture is a general-purpose, event-driven, web application back-end that uses AWS Lambda, Amazon API Gateway for its business logic. It also uses Amazon DynamoDB as its database and Amazon Cognito for user management. All static content is hosted using AWS Amplify Console.
Stars: ✭ 1,208 (+1198.92%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+1239.78%)
Instascrape🚀 A fast and lightweight utility and Python library for downloading posts, stories, and highlights from Instagram.
Stars: ✭ 76 (-18.28%)
DiscfgA distributed, serverless, configuration tool using AWS services
Stars: ✭ 75 (-19.35%)
Python Lambda A toolkit for developing and deploying serverless Python code in AWS Lambda.
Stars: ✭ 1,247 (+1240.86%)
PittapiAn API to easily get data from the University of Pittsburgh
Stars: ✭ 74 (-20.43%)
PymarketcapPython3 API wrapper and web scraper for https://coinmarketcap.com
Stars: ✭ 73 (-21.51%)
Splashr💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R
Stars: ✭ 93 (+0%)
GoscraperGolang pkg to quickly return a preview of a webpage (title/description/images)
Stars: ✭ 72 (-22.58%)
Extra Php ExtensionsExtra PHP extensions usable in AWS Lambda with the Bref PHP runtimes.
Stars: ✭ 79 (-15.05%)
Image searchPython Library to download images and metadata from popular search engines.
Stars: ✭ 86 (-7.53%)
SkraperKotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, IFunny, VK, Pikabu)
Stars: ✭ 72 (-22.58%)
Gastly👻 Create screenshots or previews of web pages
Stars: ✭ 89 (-4.3%)
GoscrapeWeb scraper that can create an offline readable version of a website
Stars: ✭ 69 (-25.81%)
Pgdump Aws LambdaLambda function for executing pg_dump and streaming the output to s3.
Stars: ✭ 80 (-13.98%)
Faasshsimple go SSH server with reverse tunneling designed for running in cloud functions like AWS lambda
Stars: ✭ 69 (-25.81%)
Api StoreContains all the public APIs listed in Phantombuster's API store. Pull requests welcome!
Stars: ✭ 69 (-25.81%)
WombatLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Stars: ✭ 1,220 (+1211.83%)
Pitchfork🎶 Unofficial python API for pitchfork.com reviews.
Stars: ✭ 67 (-27.96%)
Aws Lambda UnzipFunction for AWS Lambda to extract zip files uploaded to S3
Stars: ✭ 79 (-15.05%)