INMET-API-temperatureCrawler dos dados metereológicos de estações convencionais do INMET (BDMEP)
Stars: ✭ 32 (-5.88%)
UnfurlScraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based ⚡️
Stars: ✭ 193 (+467.65%)
file-extensionsJSON collection of scraped file extensions, along with their description and type, from FileInfo.com
Stars: ✭ 15 (-55.88%)
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: ✭ 190 (+458.82%)
tinyPornManagerMade for pornhub. Fork from tinyMediaManager v3
Stars: ✭ 57 (+67.65%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+520.59%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (+173.53%)
GmdbGMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)
Stars: ✭ 189 (+455.88%)
Unhtml.rsA magic html parser
Stars: ✭ 180 (+429.41%)
cat-messageFinds cat images/videos/gifs on reddit, sends them to my mom via applescript
Stars: ✭ 35 (+2.94%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+402.94%)
proxy-scraper⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Stars: ✭ 201 (+491.18%)
Novel基于 Laravel 5.2 的小说网站
Stars: ✭ 172 (+405.88%)
Scrapelib⛏ a library for scraping things
Stars: ✭ 164 (+382.35%)
scrapetubeGet all videos from a youtube channel, get all videos from a playlist, get all videos that match a search
Stars: ✭ 120 (+252.94%)
OpensanctionsAn open database of international sanctions data, persons of interest and politically exposed persons
Stars: ✭ 157 (+361.76%)
stweetAdvanced python library to scrap Twitter (tweets, users) from unofficial API
Stars: ✭ 287 (+744.12%)
Instagram Scraperscrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Stars: ✭ 2,209 (+6397.06%)
google-scraperThis class can retrieve search results from Google.
Stars: ✭ 33 (-2.94%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (+350%)
PTTmineRParallel Searching and Crawling Data from PTT 🚀
Stars: ✭ 31 (-8.82%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+335.29%)
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: ✭ 64 (+88.24%)
Google2csvGoogle2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file
Stars: ✭ 145 (+326.47%)
scrapy-LBCAraignée LeBonCoin avec Scrapy et ElasticSearch
Stars: ✭ 14 (-58.82%)
Google Play ScraperGoogle play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (+320.59%)
Go Jd京东自动登录,在线商品自动下单
Stars: ✭ 139 (+308.82%)
twpyTwitter High level scraper for humans.
Stars: ✭ 58 (+70.59%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (+302.94%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (+135.29%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+33855.88%)
ScraperA scraper that switches between normal mode and gentleman mode, built on Eletron, React
Stars: ✭ 127 (+273.53%)
PoliteBe nice on the web
Stars: ✭ 253 (+644.12%)
ArxivscraperA python module to scrape arxiv.org for specific date range and categories
Stars: ✭ 121 (+255.88%)
wordpress-scraperSimple, easy-to-use scraper to scrape data from WordPress JSON API
Stars: ✭ 22 (-35.29%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (+244.12%)
Instagram Proxy ApiCORS compliant API to access Instagram's public data
Stars: ✭ 245 (+620.59%)
Ridereceipts🚕 Simple automation desktop app to download and organize your receipts from Uber/Lyft. Try out our new Ride Receipts PRO !
Stars: ✭ 117 (+244.12%)
web-crawlerPython Web Crawler with Selenium and PhantomJS
Stars: ✭ 19 (-44.12%)
HeadlesschromeA Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.
Stars: ✭ 112 (+229.41%)
GetsyA simple browser/client-side web scraper.
Stars: ✭ 238 (+600%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+48044.12%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (+194.12%)
ScrapoxyScrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Stars: ✭ 1,322 (+3788.24%)
Ruiji.netcrawler framework, distributed crawler extractor
Stars: ✭ 220 (+547.06%)
fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (+932.35%)
nyt-first-saidTweets when words are published for the first time in the NYT
Stars: ✭ 222 (+552.94%)
Tianyanchapip安装的天眼查爬虫API,指定的单个/多个企业工商信息一键保存为Excel/JSON格式。A Battery-included Scraper API of Tianyancha, the best Chinese business data and investigation platform.
Stars: ✭ 206 (+505.88%)
Media ScraperScrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+505.88%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+45591.18%)