ryuanimeA free anime streaming , using the jkanime content by scraping the jkanime website.
Stars: ✭ 20 (+33.33%)
estate-crawlerScraping the real estate agencies for up-to-date house listings as soon as they arrive!
Stars: ✭ 20 (+33.33%)
ogePage metadata as a service
Stars: ✭ 22 (+46.67%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (+433.33%)
faexportThe API for Furaffinity you wish existed
Stars: ✭ 61 (+306.67%)
UofT-Timetable-GeneratorA web application that generates timetables for university students at the University of Toronto
Stars: ✭ 34 (+126.67%)
NScrapyNScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider
Stars: ✭ 88 (+486.67%)
Heroku ebooksA script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku
Stars: ✭ 251 (+1573.33%)
VideoRecognition-realtime-autotrainer-alertsState of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.
Stars: ✭ 36 (+140%)
acebaseA fast, low memory, transactional, index & query enabled NoSQL database engine and server for node.js and browser with realtime data change notifications
Stars: ✭ 288 (+1820%)
itemadapterCommon interface for data container classes
Stars: ✭ 47 (+213.33%)
Skrape.itA Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
Stars: ✭ 231 (+1440%)
dorkscoutDorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
Stars: ✭ 189 (+1160%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+1306.67%)
LinkedIn-ScraperA LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!
Stars: ✭ 62 (+313.33%)
Tianyanchapip安装的天眼查爬虫API,指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.
Stars: ✭ 206 (+1273.33%)
browser-poolA Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (+373.33%)
Weibo terminaterFinal Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Stars: ✭ 2,295 (+15200%)
4scannerContinuously search imageboards threads for images/webms and download them
Stars: ✭ 103 (+586.67%)
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: ✭ 196 (+1206.67%)
ad integrationDocumentação para a Importação de Anúncios (API, JSON e XML) da OLX Brasil
Stars: ✭ 36 (+140%)
Node Ytdl CoreYouTube video downloader in javascript.
Stars: ✭ 3,004 (+19926.67%)
grandnode2Free, Open source, Fast, Headless, Multi-tenant eCommerce platform built with .NET Core, MongoDB, AWS DocumentDB, Azure CosmosDB, LiteDB, Vue.js.
Stars: ✭ 626 (+4073.33%)
Thepiratebay💀 The Pirate Bay node.js client
Stars: ✭ 191 (+1173.33%)
quitsiesA persisted drop-in replacement for Memcached, respecting the rules of quitsies.
Stars: ✭ 16 (+6.67%)
pocket-cms☁️ A pocket sized CMS written for nodejs
Stars: ✭ 13 (-13.33%)
PapayaNoSQL Injection Tool to bypass login forms & extract usernames/passwords using regular expressions.
Stars: ✭ 22 (+46.67%)
Recipe-ScraperA JS package for scraping recipes from the web.
Stars: ✭ 78 (+420%)
soosyze🌠 Soosyze CMS is a minimalist content management system in PHP, without database to create and manage your website easily. https://soosyze.com
Stars: ✭ 39 (+160%)
Instagram CrawlerCrawl instagram photos, posts and videos for download.
Stars: ✭ 178 (+1086.67%)
ReadablewebproxyRewriting web proxy and archival tool. At this point, it just tries to download all the things.
Stars: ✭ 172 (+1046.67%)
scavengerScrape and take screenshots of dynamic and static webpages
Stars: ✭ 14 (-6.67%)
Scrape Twitter🐦 Access Twitter data without an API key. [DEPRECATED]
Stars: ✭ 166 (+1006.67%)
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+326.67%)
Datmusic ApiAlternative for VK Audio API
Stars: ✭ 160 (+966.67%)
bolsaBiblioteca feita em Python com o objetivo de facilitar o acesso a dados de seus investimentos na bolsa de valores(B3/CEI) através do Portal CEI.
Stars: ✭ 46 (+206.67%)
Covid19 mobilityCOVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉
Stars: ✭ 156 (+940%)
soda-for-javaSODA (Simple Oracle Document Access) for Java is an Oracle library for writing Java apps that work with JSON (and not only JSON!) in the Oracle Database. SODA allows your Java app to use the Oracle Database as a NoSQL document store.
Stars: ✭ 61 (+306.67%)
PDAP-ScrapersCode relating to scraping public police data.
Stars: ✭ 72 (+380%)
leekDistributed task redisqueue(最简单python分布式函数调度框架)
Stars: ✭ 60 (+300%)
pyspark-algorithmsPySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
Stars: ✭ 72 (+380%)
Scraperwiki PythonScraperWiki Python library for scraping and saving data
Stars: ✭ 146 (+873.33%)
MingMongoDB ODM (Object Document Mapper) with Unit of Works, IdentityMap, Relations and Mongo-In-Memory implementation
Stars: ✭ 19 (+26.67%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+860%)
money-parserPrice and currency parsing utility
Stars: ✭ 26 (+73.33%)
invana-botA Web Crawler that scrapes using YAML and python code.
Stars: ✭ 30 (+100%)
instagram-get-imagesInstagram get images 🌄 (hashtags, account, locations) with puppeteer
Stars: ✭ 69 (+360%)
PTTmineRParallel Searching and Crawling Data from PTT 🚀
Stars: ✭ 31 (+106.67%)
wordpress-scraperSimple, easy-to-use scraper to scrape data from WordPress JSON API
Stars: ✭ 22 (+46.67%)
chainDBA noSQL database based on blockchain technology
Stars: ✭ 13 (-13.33%)
ArticleSpiderCrawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).
Stars: ✭ 34 (+126.67%)
scriptsA collection of random scripts I coded up
Stars: ✭ 17 (+13.33%)