All Projects → kimcoder → serverless-instagram-crawler

kimcoder / serverless-instagram-crawler

Licence: MIT License
serverless, instagram hashtag crawler with lambda, dynamoDB

Programming Languages

typescript
32286 projects
javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to serverless-instagram-crawler

Instagram Bot
An Instagram bot developed using the Selenium Framework
Stars: ✭ 138 (+318.18%)
Mutual labels:  instagram, crawling
craft-instagram-feed
Craft CMS plugin to receive Instragram feed data as variable in templates
Stars: ✭ 25 (-24.24%)
Mutual labels:  instagram
dmi-instascraper
A GUI for Instaloader to scrape users and hashtags with on Instagram
Stars: ✭ 21 (-36.36%)
Mutual labels:  instagram
hexo-instagram-wall
Displays up to 18 most recent images from your Instagram account
Stars: ✭ 12 (-63.64%)
Mutual labels:  instagram
PyGram
An Instagram-like photo editor in Python
Stars: ✭ 15 (-54.55%)
Mutual labels:  instagram
UPES-SPE-Fest
An Instagram like Social Networking Android App for UPES SPE Fest using Firebase as backend.
Stars: ✭ 39 (+18.18%)
Mutual labels:  instagram
instabot
Instagram bot to increase the account number of followers using CasperJS.
Stars: ✭ 55 (+66.67%)
Mutual labels:  instagram
talospider
talospider - A simple,lightweight scraping micro-framework
Stars: ✭ 57 (+72.73%)
Mutual labels:  crawling
sharestapp
Sharestapp lets you to directly share an image/videos/reels post from Instagram to other apps and also allows to save.
Stars: ✭ 13 (-60.61%)
Mutual labels:  instagram
image-editor-effects
💎 A WebGL example of image adjustment / effects shaders found in Photoshop, other image editors and game engines.
Stars: ✭ 68 (+106.06%)
Mutual labels:  instagram
django-instagram
Instagram application for Django.
Stars: ✭ 73 (+121.21%)
Mutual labels:  instagram
instagram-api-clone
Instagram RESTful API clone made with Django REST framework
Stars: ✭ 56 (+69.7%)
Mutual labels:  instagram
InstagramSaver
Application for saving photos/videos from Instagram
Stars: ✭ 31 (-6.06%)
Mutual labels:  instagram
php-instagram-private-api-with-checkpoint-feature
This is a liam cottle instagram private library with checkpoint issue solved. Checkpoint required error solved and can be found at examples folder.
Stars: ✭ 12 (-63.64%)
Mutual labels:  instagram
InstantInsta
Android Application To Download and Manage Instagram Images And Videos
Stars: ✭ 47 (+42.42%)
Mutual labels:  instagram
insta-dl
📷 Download Instagram images from a public user.
Stars: ✭ 88 (+166.67%)
Mutual labels:  instagram
Flutter-Photoarc-app
(Full-stack) Fully functional social media app (Instagram clone) written in flutter and dart with backend node.js and Postgres SQL.
Stars: ✭ 38 (+15.15%)
Mutual labels:  instagram
kirby3-instagram
Kirby 3 Plugin to call Instagram (or any other) API Endpoints
Stars: ✭ 20 (-39.39%)
Mutual labels:  instagram
Endless
🛣 A lightweight endless pageControl based on CAShapeLayers and UICollectionView
Stars: ✭ 19 (-42.42%)
Mutual labels:  instagram
igcreator
Instagram mass account creator with proxies 🔃 and cookies 🍪 support
Stars: ✭ 35 (+6.06%)
Mutual labels:  instagram

serverless-instagram-crawler

this is instagram hashtag crawler with serverless framework.

Config

you have to config like this. ( before deploy )

yarn run config

config
If you do config, will save a file .config.json

Serverless

Get environment variables from .config.json file

provider:
    environment:
        HASH_TAG: ${file(./.config.json):hashTag}
        COUNT: ${file(./.config.json):count}
        DYNAMODB_TABLE: ${file(./.config.json):dynamoDB}

also, lambda function has set schedule & timeout like this

it means that function will run every midnight (12:00)

functions:
    crawling:
        ..
        ..
        timeout: 180
        events:
          - schedule: cron(0 12 * * ? *)

scripts

yarn run config
yarn run test 
sls deploy

directory structure

.
├── dist/              # compiled source dir ( .js )
├── src/               # source dir ( .ts )
└── test/              # test source ( .js )
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].