GosintOSINT Swiss Army Knife
Stars: ✭ 401 (+1236.67%)
Mutual labels: scraper, shodan, spider
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+470%)
Mutual labels: scraper, spider
Not Your Average Web CrawlerA web crawler (for bug hunting) that gathers more than you can imagine.
Stars: ✭ 107 (+256.67%)
Mutual labels: scraper, spider
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+51683.33%)
Mutual labels: scraper, spider
aliexscrapeGet Aliexpress product details in JSON
Stars: ✭ 80 (+166.67%)
Mutual labels: scraper, spider
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+4053.33%)
Mutual labels: scraper, spider
Querylist🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
Stars: ✭ 2,392 (+7873.33%)
Mutual labels: scraper, spider
MailinglistscraperA python web scraper for public email lists.
Stars: ✭ 19 (-36.67%)
Mutual labels: scraper, spider
antA web crawler for Go
Stars: ✭ 264 (+780%)
Mutual labels: scraper, spider
blinkist-m4a-downloaderGrabs all of the audio files from all of the Blinkist books
Stars: ✭ 100 (+233.33%)
Mutual labels: scraper, spider
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+113.33%)
Mutual labels: scraper, spider
Django Dynamic ScraperCreating Scrapy scrapers via the Django admin interface
Stars: ✭ 1,024 (+3313.33%)
Mutual labels: scraper, spider
AvbookAV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+27010%)
Mutual labels: scraper, spider
OpenScraperAn open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (+166.67%)
Mutual labels: scraper, spider
ScrapitScraping scripts for various websites.
Stars: ✭ 25 (-16.67%)
Mutual labels: scraper, spider
Goribot[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Stars: ✭ 190 (+533.33%)
Mutual labels: scraper, spider
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+116.67%)
Mutual labels: scraper, spider
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+2086.67%)
Mutual labels: scraper, spider
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+2503.33%)
Mutual labels: scraper, spider
crawler-chrome-extensions爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
Stars: ✭ 53 (+76.67%)
Mutual labels: scraper, spider