ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+66.31%)
Project TauroA Router WiFi key recovery/cracking tool with a twist.
Stars: ✭ 52 (-81.36%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-94.62%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (-53.76%)
Scrapy CraigslistWeb Scraping Craigslist's Engineering Jobs in NY with Scrapy
Stars: ✭ 54 (-80.65%)
Detect CmsPHP Library for detecting CMS
Stars: ✭ 78 (-72.04%)
Linkedin-ClientWeb scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (-84.95%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (-14.34%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (-75.63%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+135.13%)
top-github-scraperScape top GitHub repositories and users based on keywords
Stars: ✭ 40 (-85.66%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (-46.95%)
CascadiaGo cascadia package command line CSS selector
Stars: ✭ 67 (-75.99%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (-69.18%)
Web ScrapingDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (-45.16%)
Php Curl ClassPHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Stars: ✭ 2,903 (+940.5%)
get-sauceA command line program to download hentai videos and images from multiple websites
Stars: ✭ 40 (-85.66%)
linkextractorA Docker tutorial using a link extraction application example
Stars: ✭ 41 (-85.3%)
Instagram-Giveaways-WinnerInstagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!
Stars: ✭ 95 (-65.95%)
uoft-scrapersPublic web scraping scripts for the University of Toronto.
Stars: ✭ 48 (-82.8%)
VideoRecognition-realtime-autotrainer-alertsState of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.
Stars: ✭ 36 (-87.1%)
Node-js-functionalitiesThis repository contains very useful restful API's and functionalities in node-js containing many important tutorial code for mastering node-js, all tutorials have been published on medium.com, tutorials link is given below
Stars: ✭ 69 (-75.27%)
scraping-ebayScraping Ebay's products using Scrapy Web Crawling Framework
Stars: ✭ 79 (-71.68%)
raspagem-de-dados-fatec📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí
Stars: ✭ 22 (-92.11%)
IMDB-ScraperScrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.
Stars: ✭ 37 (-86.74%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-91.4%)
halfstaff🇺🇸 Is the US flag at half-staff?
Stars: ✭ 22 (-92.11%)
WaWebSessionHandler(DISCONTINUED) Save WhatsApp Web Sessions as files and open them everywhere!
Stars: ✭ 27 (-90.32%)
automation-scriptsSimple scripts that I'm using to automate the boring things.
Stars: ✭ 14 (-94.98%)
scrapeDepth controllable Web scraper and Sitemap Generator in Go
Stars: ✭ 19 (-93.19%)
leetcode-compensationCompensation analysis on the posts scraped from leetcode.com/discuss/compensation. At present, the reports have been generated only for Indian cities.
Stars: ✭ 83 (-70.25%)
mysportsfeeds-nodeNodeJS wrapper for the MySportsFeeds Sports Data API
Stars: ✭ 62 (-77.78%)
rreddit𝐫⟋ Get Reddit data
Stars: ✭ 49 (-82.44%)
codechef-rank-comparatorWeb application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).
Stars: ✭ 23 (-91.76%)
browser-poolA Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (-74.55%)
NBA-analyticsShort, offhand analyses of the NBA
Stars: ✭ 37 (-86.74%)
Apify JsApify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+1030.47%)
comic-scraper[Python] Scraps comics and manga from various websites and creates cbz files from them
Stars: ✭ 16 (-94.27%)
investigation-amazon-brandsMaterials to reproduce our findings in our stories, "Amazon Puts Its Own 'Brands' First Above Better-Rated Products" and "When Amazon Takes the Buy Box, it Doesn’t Give it up"
Stars: ✭ 56 (-79.93%)
extractnetA Dragnet that also extract author, headline, date, keywords from context
Stars: ✭ 52 (-81.36%)
iwwAI based web-wrapper for web-content-extraction
Stars: ✭ 61 (-78.14%)
GSoC-Data-AnalyserSimple search for organisations participating/participated in the GSoC
Stars: ✭ 29 (-89.61%)
nba-smart-contractsSmart contracts and transactions for Topshot, the official NBA digital collectibles game on the Flow Blockchain
Stars: ✭ 316 (+13.26%)
MediumScraperScraping articles of medium and providing audio versions 📑 to 🔊 using django
Stars: ✭ 12 (-95.7%)
actor-scraperHouse of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
Stars: ✭ 83 (-70.25%)
nba-analysisUsing machine learning libraries to analyze NBA data
Stars: ✭ 14 (-94.98%)
htmlunit🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library
Stars: ✭ 39 (-86.02%)
restaurant-finder-featureReviewsBuild a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).
Stars: ✭ 21 (-92.47%)
grailerweb scraping tool for grailed.com
Stars: ✭ 30 (-89.25%)
Data-Wrangling-with-PythonSimplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices
Stars: ✭ 90 (-67.74%)