LinkedIn-ScraperA LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!
Stars: ✭ 62 (+47.62%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+469.05%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-64.29%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+1461.9%)
LinkedIn networkingPython code to automatically expend your LinkedIn network based on your interest. ONLY FOR EDUCATIONAL PURPOSES. PLEASE DO NOT MISUSE IT.
Stars: ✭ 27 (-35.71%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+252.38%)
Project TauroA Router WiFi key recovery/cracking tool with a twist.
Stars: ✭ 52 (+23.81%)
Detect CmsPHP Library for detecting CMS
Stars: ✭ 78 (+85.71%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (+207.14%)
AzurLaneWikiScrapersA console application that can scrape the Azur Lane wiki and export the data to Json files
Stars: ✭ 12 (-71.43%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-42.86%)
SocialInfo4Jfetch data from Facebook, Instagram and LinkedIn
Stars: ✭ 44 (+4.76%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+9607.14%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+1004.76%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (+61.9%)
Scrapy CraigslistWeb Scraping Craigslist's Engineering Jobs in NY with Scrapy
Stars: ✭ 54 (+28.57%)
LinkedInNETSparkle.LinkedInNET will help you query the LinkedIn API with C# :)
Stars: ✭ 31 (-26.19%)
LinkedIn-DownloaderLinkedIn DL is a small GUI program codded with Python and based on my previous Lynda Download script
Stars: ✭ 85 (+102.38%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-64.29%)
Web ScrapingDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (+264.29%)
Operative Frameworkoperative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
Stars: ✭ 511 (+1116.67%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (+121.43%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (+138.1%)
ZillowZillow Scraper for Python using Selenium
Stars: ✭ 141 (+235.71%)
RodA Devtools driver for web automation and scraping
Stars: ✭ 1,392 (+3214.29%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+307.14%)
rymscraperPython API to extract data from rateyourmusic.com.
Stars: ✭ 63 (+50%)
Php Curl ClassPHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Stars: ✭ 2,903 (+6811.9%)
top-github-scraperScape top GitHub repositories and users based on keywords
Stars: ✭ 40 (-4.76%)
CascadiaGo cascadia package command line CSS selector
Stars: ✭ 67 (+59.52%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (+104.76%)
github-readme-linkedin📋 A serverless application to get dynamically generated images from your LinkedIn profile on your GitHub READMEs
Stars: ✭ 52 (+23.81%)
linkyYet Another LInkedIn Scraper...
Stars: ✭ 44 (+4.76%)
linkedinscraperLinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (-47.62%)
LinkedinLinkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Stars: ✭ 309 (+635.71%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+33.33%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+11311.9%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-52.38%)
TikTokDownloader PyWebIO🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+2088.1%)
ScrapedinLinkedIn Scraper (currently working 2020)
Stars: ✭ 453 (+978.57%)
social-post-apiSocial Media API: Automate Posting and Analytics to Social Networks like Instagram, TikTok, Twitter, Facebook, LinkedIn, Reddit, YouTube, and Telegram
Stars: ✭ 38 (-9.52%)
React-Linkedin-LoginA React demo app for Linkedin API: LinkedIn OAuth, LinkedIn REST API
Stars: ✭ 70 (+66.67%)
GetsyA simple browser/client-side web scraper.
Stars: ✭ 238 (+466.67%)
Linkedin scraperA library that scrapes Linkedin for user data
Stars: ✭ 413 (+883.33%)
LinkedIn Scraper🙋 A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.
Stars: ✭ 25 (-40.48%)
ScrapersA list of scrapers from around the web.
Stars: ✭ 366 (+771.43%)
linkedin connectConfigurable and easy to use LinkedIn tool to automate connections with personalized messages.
Stars: ✭ 58 (+38.1%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+209.52%)
linkedinBotAutomate the process of sending referral request and cold mailing on LinkedIn
Stars: ✭ 25 (-40.48%)
unfurlExtract rich metadata from URLs
Stars: ✭ 41 (-2.38%)
linkedin-employee-scraperExtract all employees from LinkedIn. Especially useful for companies with thousands of employees.
Stars: ✭ 16 (-61.9%)
selectorlibA library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
Stars: ✭ 53 (+26.19%)
grailerweb scraping tool for grailed.com
Stars: ✭ 30 (-28.57%)