ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+494.87%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+206.41%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+89.74%)
top-github-scraperScape top GitHub repositories and users based on keywords
Stars: ✭ 40 (-48.72%)
iowebWeb Scraping Framework
Stars: ✭ 31 (-60.26%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (+84.62%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (+65.38%)
HumanoidNode.js package to bypass CloudFlare's anti-bot JavaScript challenges
Stars: ✭ 88 (+12.82%)
Gopa[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Stars: ✭ 277 (+255.13%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (+10.26%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (-12.82%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-80.77%)
CascadiaGo cascadia package command line CSS selector
Stars: ✭ 67 (-14.1%)
Apify JsApify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+3943.59%)
browser-poolA Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (-8.97%)
Linkedin-ClientWeb scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (-46.15%)
Php Curl ClassPHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Stars: ✭ 2,903 (+3621.79%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+5126.92%)
PythonScrapyBasicSetupBasic setup with random user agents and IP addresses for Python Scrapy Framework.
Stars: ✭ 57 (-26.92%)
trafilaturaPython & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
Stars: ✭ 711 (+811.54%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-80.77%)
selectorlibA library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
Stars: ✭ 53 (-32.05%)
Scrapy CraigslistWeb Scraping Craigslist's Engineering Jobs in NY with Scrapy
Stars: ✭ 54 (-30.77%)
Web ScrapingDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Stars: ✭ 153 (+96.15%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+741.03%)
raspagem-de-dados-fatec📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí
Stars: ✭ 22 (-71.79%)
Project TauroA Router WiFi key recovery/cracking tool with a twist.
Stars: ✭ 52 (-33.33%)
Jacinto Ai DevkitTraining & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models
Stars: ✭ 49 (-37.18%)
Mtcnnface detection and alignment with mtcnn
Stars: ✭ 66 (-15.38%)
EyevisAndroid based Vocal Vision for Visually Impaired. Object Detection, Voice Assistance, Optical Character Reader, Read Aloud, Face Recognition, Landmark Recognition, Image Labelling etc.
Stars: ✭ 48 (-38.46%)
MtntCode for the collection and analysis of the MTNT dataset
Stars: ✭ 48 (-38.46%)
FtcvisionComputer Vision library for FIRST Tech Challenge
Stars: ✭ 73 (-6.41%)
Coco Annotator✏️ Web-based image segmentation tool for object detection, localization, and keypoints
Stars: ✭ 1,138 (+1358.97%)
ScriptingPS / Bash / Python / Other scripts For FUN!
Stars: ✭ 47 (-39.74%)
Artooartoo.js - the client-side scraping companion.
Stars: ✭ 1,029 (+1219.23%)
DecapitatedHeadless 'Chrome' Orchestration in R
Stars: ✭ 65 (-16.67%)
Social Media Depression Detector😔 😞 😣 😖 😩 Detect depression on social media using the ssToT method introduced in our ASONAM 2017 paper titled "Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Media"
Stars: ✭ 45 (-42.31%)
Spinenet PytorchThis project is a kind of implementation of SpineNet(CVPR 2020) using mmdetection.
Stars: ✭ 75 (-3.85%)
Ping SmReceive an email or Telegram message as soon as Migros Sanalmarket is available for delivery in your neighborhood.
Stars: ✭ 71 (-8.97%)
Unet SegmentationThe U-Net Segmentation plugin for Fiji (ImageJ)
Stars: ✭ 62 (-20.51%)
Tika PythonTika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
Stars: ✭ 997 (+1178.21%)
EfficientdetEfficientDet (Scalable and Efficient Object Detection) implementation in Keras and Tensorflow
Stars: ✭ 1,116 (+1330.77%)
Actor Google Search ScraperApify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.
Stars: ✭ 38 (-51.28%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (-52.56%)
Flask weather☀️ ☔️ Flask app to auto-detect local weather based off of user's IP address.
Stars: ✭ 70 (-10.26%)
MechamlOCaml functional web scraping library
Stars: ✭ 60 (-23.08%)
AlbumentationsFast image augmentation library and an easy-to-use wrapper around other libraries. Documentation: https://albumentations.ai/docs/ Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
Stars: ✭ 9,353 (+11891.03%)
CattDetecting the temperature from an infrared image
Stars: ✭ 60 (-23.08%)
Cnn Paper2🎨 🎨 深度学习 卷积神经网络教程 :图像识别,目标检测,语义分割,实例分割,人脸识别,神经风格转换,GAN等🎨🎨 https://dataxujing.github.io/CNN-paper2/
Stars: ✭ 77 (-1.28%)
NimqueryNim library for querying HTML using CSS-selectors (like JavaScripts document.querySelector)
Stars: ✭ 75 (-3.85%)
Api StoreContains all the public APIs listed in Phantombuster's API store. Pull requests welcome!
Stars: ✭ 69 (-11.54%)
PypatentSearch for and retrieve US Patent and Trademark Office Patent Data
Stars: ✭ 31 (-60.26%)
Wasm CheckTypeScript / JavaScript library for detect WebAssembly features in node.js & browser
Stars: ✭ 30 (-61.54%)