shaikhsajid1111 / Social Media Profile Scrapers
Licence: apache-2.0
Fetch user's data across social media
Stars: ✭ 60
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Social Media Profile Scrapers
OLX Scraper
📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-75%)
Mutual labels: web-scraper, web-scraping
Basketball reference web scraper
NBA Stats API via Basketball Reference
Stars: ✭ 279 (+365%)
Mutual labels: web-scraping, web-scraper
Instagram-Giveaways-Winner
Instagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!
Stars: ✭ 95 (+58.33%)
Mutual labels: web-scraper, instagram-scraper
Scrapy Craigslist
Web Scraping Craigslist's Engineering Jobs in NY with Scrapy
Stars: ✭ 54 (-10%)
Mutual labels: web-scraping, web-scraper
Linkedin-Client
Web scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (-30%)
Mutual labels: web-scraper, web-scraping
Php Curl Class
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Stars: ✭ 2,903 (+4738.33%)
Mutual labels: web-scraping, web-scraper
Html Metadata
MetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (+115%)
Mutual labels: web-scraping, web-scraper
Faster Than Requests
Faster requests on Python 3
Stars: ✭ 639 (+965%)
Mutual labels: web-scraping, web-scraper
Scrapple
A framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+673.33%)
Mutual labels: web-scraping, web-scraper
Scrape Linkedin Selenium
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+298.33%)
Mutual labels: web-scraping, web-scraper
Socialmanagertools Igbot
🤖 📷 Instagram Bot made with love and nodejs
Stars: ✭ 699 (+1065%)
Mutual labels: social-media, instagram-scraper
Web Scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (+155%)
Mutual labels: web-scraping, web-scraper
Phpscraper
PHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+146.67%)
Mutual labels: web-scraping, web-scraper
top-github-scraper
Scape top GitHub repositories and users based on keywords
Stars: ✭ 40 (-33.33%)
Mutual labels: web-scraper, web-scraping
Daftlistings
A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (+43.33%)
Mutual labels: web-scraping, web-scraper
Socialreaper
Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 338 (+463.33%)
Mutual labels: pinterest, social-media
Spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+993.33%)
Mutual labels: web-scraping, web-scraper
Social Media Profile Crawlers
These are the collections of scripts that scrape's social media profiles
Available Social Media
- tiktok
- Medium
- Quora
- Github
Installation
- Install dependencies mentioned inside requirement.txt by opening terminal in project's directory and enter command
pip install -r requirement.txt
Usage
- Open terminal in project's directory and enter command
examplepython SCRIPT_NAME USERNAME --browser BROWSER_NAME
ifpython twitter.py barackObama --browser firefox
--browser
argument is not passed, chrome is used by default. currently only firefox and chrome is supported- for more help enter command
examplepython SCRIPT_NAME -h
python instagram.py -h
Tech
Screenshot
LICENSE
Apache License 2.0
If You have suggestions for more social media. Let me know 😉
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].