web-crawlerPython Web Crawler with Selenium and PhantomJS
Stars: ✭ 19 (-32.14%)
localForage-cnlocalForage中文仓库,localForage改进了离线存储,提供简洁健壮的API,包括 IndexedDB, WebSQL, 和 localStorage。
Stars: ✭ 201 (+617.86%)
scrapy-LBCAraignée LeBonCoin avec Scrapy et ElasticSearch
Stars: ✭ 14 (-50%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+100%)
acebaseA fast, low memory, transactional, index & query enabled NoSQL database engine and server for node.js and browser with realtime data change notifications
Stars: ✭ 288 (+928.57%)
nyt-first-saidTweets when words are published for the first time in the NYT
Stars: ✭ 222 (+692.86%)
scrapeerEssential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.
Stars: ✭ 81 (+189.29%)
proxy-scraper⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Stars: ✭ 201 (+617.86%)
PyScholarA 'supervised' parser for Google Scholar
Stars: ✭ 74 (+164.29%)
ColegaDondeEstaMiTFMUn bot de Twitter que comparte cada hora un TFM hasta que Cristina Cifuentes enseñe el suyo.
Stars: ✭ 14 (-50%)
Federal-Parliament-ScraperA scraper for obtaining information on the workings of the Belgian Federal Parliament.
Stars: ✭ 18 (-35.71%)
diffbot-php-client[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Stars: ✭ 53 (+89.29%)
kvsLightweight key-value storage library for Browser, Node.js, and In-Memory.
Stars: ✭ 126 (+350%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-28.57%)
scriptsA collection of random scripts I coded up
Stars: ✭ 17 (-39.29%)
scrapetubeGet all videos from a youtube channel, get all videos from a playlist, get all videos that match a search
Stars: ✭ 120 (+328.57%)
roseAnalyse all kinds of data for a TV series
Stars: ✭ 34 (+21.43%)
MangDLThe most inefficient Manga downloader for PC
Stars: ✭ 40 (+42.86%)
scrapersscrapers for building your own image databases
Stars: ✭ 46 (+64.29%)
stweetAdvanced python library to scrap Twitter (tweets, users) from unofficial API
Stars: ✭ 287 (+925%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (+185.71%)
keystore-idbIn-browser key management with IndexedDB and the Web Crypto API
Stars: ✭ 37 (+32.14%)
extract-emailsExtract emails from a given website
Stars: ✭ 58 (+107.14%)
gochanges**[ARCHIVED]** website changes tracker 🔍
Stars: ✭ 12 (-57.14%)
trawlerscraper for facebook, gab, google and tiktok
Stars: ✭ 20 (-28.57%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+364.29%)
Website-downloader💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
Stars: ✭ 615 (+2096.43%)
tinyPornManagerMade for pornhub. Fork from tinyMediaManager v3
Stars: ✭ 57 (+103.57%)
antA web crawler for Go
Stars: ✭ 264 (+842.86%)
PTTmineRParallel Searching and Crawling Data from PTT 🚀
Stars: ✭ 31 (+10.71%)
file-extensionsJSON collection of scraped file extensions, along with their description and type, from FileInfo.com
Stars: ✭ 15 (-46.43%)
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+128.57%)
Pahe.ph-ScraperPahe.ph [Pahe.in] Movies Website Scraper
Stars: ✭ 57 (+103.57%)
wordpress-scraperSimple, easy-to-use scraper to scrape data from WordPress JSON API
Stars: ✭ 22 (-21.43%)
jd-autobuyPython爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,262 (+4407.14%)
pyitauUnofficial client to access your Itaú bank data
Stars: ✭ 28 (+0%)
RedditExtractorA minimalistic R wrapper for the Reddit API
Stars: ✭ 58 (+107.14%)
fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (+1153.57%)
google-scraperThis class can retrieve search results from Google.
Stars: ✭ 33 (+17.86%)
GChanScrape boards and threads from 4chan (8kun WIP). Downloads images, videos and HTML if desired.
Stars: ✭ 31 (+10.71%)
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: ✭ 64 (+128.57%)
INMET-API-temperatureCrawler dos dados metereológicos de estações convencionais do INMET (BDMEP)
Stars: ✭ 32 (+14.29%)
twpyTwitter High level scraper for humans.
Stars: ✭ 58 (+107.14%)
cat-messageFinds cat images/videos/gifs on reddit, sends them to my mom via applescript
Stars: ✭ 35 (+25%)
vsco-scraperEasily allows for scraping a VSCO
Stars: ✭ 106 (+278.57%)
website-to-jsonConverts website to json using jQuery selectors
Stars: ✭ 37 (+32.14%)
gHarvesterProof of concept for a security issue (in my opinion) that I found in accounts.google.com
Stars: ✭ 20 (-28.57%)
barclayscrapeA small app to programmatically mainpulate Barclays online banking
Stars: ✭ 57 (+103.57%)