Zhihu Login知乎模拟登录,支持提取验证码和保存 Cookies
Stars: ✭ 340 (+407.46%)
DecryptloginAPIs for loginning some websites by using requests.
Stars: ✭ 1,861 (+2677.61%)
Zhihu fun基于 Selenium 的知乎关键词爬虫
Stars: ✭ 185 (+176.12%)
Zhihu Crawlerzhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
Stars: ✭ 890 (+1228.36%)
DirhuntFind web directories without bruteforce
Stars: ✭ 983 (+1367.16%)
Fund Crawler基于NodeJS的基金数据爬虫,爬取的数据存于github的@nullpointer/fund-data。
Stars: ✭ 46 (-31.34%)
DiskoverFile system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch
Stars: ✭ 977 (+1358.21%)
Auto LighthouseA utility package for automating lighthouse reporting
Stars: ✭ 58 (-13.43%)
Weibo Crawler新浪微博爬虫,用python爬取新浪微博数据,并下载微博图片和微博视频
Stars: ✭ 1,019 (+1420.9%)
Images Web CrawlerThis package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..
Stars: ✭ 51 (-23.88%)
GargantuaThe fast website crawler
Stars: ✭ 35 (-47.76%)
ChemrtronA document viewer; fuzzy match incremental search.
Stars: ✭ 59 (-11.94%)
News Pleasenews-please - an integrated web crawler and information extractor for news that just works.
Stars: ✭ 969 (+1346.27%)
PixevalA Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF
Stars: ✭ 1,031 (+1438.81%)
Vw Crawler🐞简单轻便的Java爬虫框架,只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。
Stars: ✭ 32 (-52.24%)
Hproxyhproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)
Stars: ✭ 62 (-7.46%)
Zhihu ApiZhihu API for Humans
Stars: ✭ 911 (+1259.7%)
AvbookAV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+12038.81%)
PypergrabberFetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.
Stars: ✭ 14 (-79.1%)
Car PricesGolang爬虫 爬取汽车之家 二手车产品库
Stars: ✭ 57 (-14.93%)
Vulnxvulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}
Stars: ✭ 1,009 (+1405.97%)
Sina Stock CrawlerSina stock options crawler with CSV output 新浪上证ETF期权数据爬虫
Stars: ✭ 12 (-82.09%)
Zhihuapi PyUnofficial API for zhihu.
Stars: ✭ 39 (-41.79%)
PixivcrawleriiiA python3 crawler for crawling Pixiv ranking top and any illustrator all artworks
Stars: ✭ 38 (-43.28%)
Zhihu仿知乎网站
Stars: ✭ 60 (-10.45%)
Schannel Qt5A GUI client of schannel powered by therecipe/qt and golang
Stars: ✭ 36 (-46.27%)
Lyrics CrawlerGet the lyrics for the song currently playing on Spotify
Stars: ✭ 49 (-26.87%)
Tumblr CrawlerEasily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片,视频
Stars: ✭ 1,118 (+1568.66%)
NcrawlerWeb Crawler written in C#
Stars: ✭ 34 (-49.25%)
Social ScraperTổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt
Stars: ✭ 47 (-29.85%)
Nodespider[DEPRECATED] Simple, flexible, delightful web crawler/spider package
Stars: ✭ 33 (-50.75%)
BeanbunBeanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman。
Stars: ✭ 1,096 (+1535.82%)
Python crawlerIt's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.
Stars: ✭ 45 (-32.84%)
AutocrawlerGoogle, Naver multiprocess image web crawler (Selenium)
Stars: ✭ 957 (+1328.36%)
Lxspider爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》
Stars: ✭ 60 (-10.45%)
PhotonIncredibly fast crawler designed for OSINT.
Stars: ✭ 8,332 (+12335.82%)
PapercrawlerCrawler used to crawl papers
Stars: ✭ 20 (-70.15%)
CrawlergoA powerful dynamic crawler for web vulnerability scanners
Stars: ✭ 1,088 (+1523.88%)
Onion CrawlerTor website crawler (specific for Alphabay at the time)
Stars: ✭ 15 (-77.61%)
CrawlabDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+12425.37%)
AxegrinderCrawl websites for accessibility issues from the command line.
Stars: ✭ 12 (-82.09%)
CcrawlSimple CORPORA list crawler
Stars: ✭ 11 (-83.58%)
Lizard💐 Full Amazon Automatic Download
Stars: ✭ 41 (-38.81%)
DisecDistributed Image Search Engine Crawler
Stars: ✭ 11 (-83.58%)
Awesome Python Primer自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向
Stars: ✭ 57 (-14.93%)