PttImageSpiderPTT 圖片下載器 (抓取整個看板的圖片,並用文章標題作為資料夾的名稱 ) (使用Scrapy)
Stars: ✭ 16 (-65.96%)
Hivelots of spider (很多爬虫)
Stars: ✭ 110 (+134.04%)
Bilili🍻 bilibili video (including bangumi) and danmaku downloader | B站视频(含番剧)、弹幕下载器
Stars: ✭ 379 (+706.38%)
Bt Btt磁力網站U3C3介紹以及域名更新
Stars: ✭ 261 (+455.32%)
Fiction house小说精品屋是一个多平台(web、安卓app、微信小程序)、功能完善的屏幕自适应小说漫画连载系统,包含精品小说专区、轻小说专区和漫画专区。包括小说/漫画分类、小说/漫画搜索、小说/漫画排行、完本小说/漫画、小说/漫画评分、小说/漫画在线阅读、小说/漫画书架、小说/漫画阅读记录、小说下载、小说弹幕、小说/漫画自动采集/更新/纠错、小说内容自动分享到微博、邮件自动推广、链接自动推送到百度搜索引擎等功能。
Stars: ✭ 2,710 (+5665.96%)
Languagepod101 ScraperPython scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Stars: ✭ 104 (+121.28%)
JssoupJavaScript + BeautifulSoup = JSSoup
Stars: ✭ 203 (+331.91%)
SD-streamsAnime streaming without ads using Beautifulsoup and requests Python
Stars: ✭ 18 (-61.7%)
scraper图片爬取下载工具,极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。
Stars: ✭ 64 (+36.17%)
WhatSoupA web scraper that exports your entire WhatsApp chat history.
Stars: ✭ 86 (+82.98%)
crawlerdetectGolang module to detect bots and crawlers via the user agent
Stars: ✭ 22 (-53.19%)
DeadPool该项目是一个使用celery作为主体框架的爬虫应用,能够灵活的添加爬虫任务,并且同时运行多站点的爬虫工作,所有组件都能够原生支持规模并发和分布式,加上celery原生的分布式调用,实现大规模并发。
Stars: ✭ 38 (-19.15%)
crunchyroll-dlA fast, modern, and beautiful Crunchyroll downloader.
Stars: ✭ 111 (+136.17%)
seenreqGenerate an object for testing if a request is sent, request is Mikeal's request.
Stars: ✭ 42 (-10.64%)
PTTmineRParallel Searching and Crawling Data from PTT 🚀
Stars: ✭ 31 (-34.04%)
Waifu2x-Image-SaverA Firefox extension to download any image and process them with Waifu2x with one click.
Stars: ✭ 13 (-72.34%)
spiderpython 爬虫(amazon, confluence ...)
Stars: ✭ 21 (-55.32%)
Floatplane-DownloaderProject for automatically organizing and downloading Floatplane videos for plex.
Stars: ✭ 94 (+100%)
Google-Images-Search[PYTHON] Search for image using Google Custom Search API and resize & crop afterwards
Stars: ✭ 121 (+157.45%)
fanslySimply scrape / download all the media from an fansly account
Stars: ✭ 351 (+646.81%)
gamesearchA Simple Search Engine to help you find FREE Download Links to your Favourite Games
Stars: ✭ 30 (-36.17%)
OneDriveShareLinkPushAria2Extract download URLs from OneDrive or SharePoint share links and push them to aria2, even on systems without a GUI.
Stars: ✭ 256 (+444.68%)
NovelScraperDownload manager & library for translated light novels.
Stars: ✭ 70 (+48.94%)
feaplat爬虫管理系统,支持集群,弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本
Stars: ✭ 42 (-10.64%)
vsco-scraperEasily allows for scraping a VSCO
Stars: ✭ 106 (+125.53%)
glyphhangerYour web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.
Stars: ✭ 422 (+797.87%)
pip-downloadA wrapper for pip download in offline scenario.
Stars: ✭ 22 (-53.19%)
sedeText-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data
Stars: ✭ 83 (+76.6%)
TikTokDownloader PyWebIO🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+1855.32%)
downloadDateidownloads von Files aus dem Medienpool über PHP oder X-SendFile
Stars: ✭ 30 (-36.17%)
dslrbrowser-iosDSLR Browser iOS app to discover and connect to your Wi-Fi and DLNA enabled (Canon) camera
Stars: ✭ 17 (-63.83%)
s3cr3tA supercharged S3 reverse proxy
Stars: ✭ 55 (+17.02%)
dcard-spiderA spider on Dcard. Strong and speedy.
Stars: ✭ 91 (+93.62%)
bandcamp-dlA browser automation script to batch download your private bandcamp collection.
Stars: ✭ 30 (-36.17%)
ceiba-dlNTU CEIBA 資料下載工具
Stars: ✭ 80 (+70.21%)
MirrySimple Mirror App
Stars: ✭ 18 (-61.7%)
fbdl📥 Download publicly shared videos from Facebook with an ease!
Stars: ✭ 29 (-38.3%)
goSpidersome small project and some articles
Stars: ✭ 56 (+19.15%)
IMDb-Scout-ModAuto search for movie/series on torrent, usenet, ddl, subtitles, streaming, predb and other sites. Adds links to IMDb pages from hundreds various sites. Adds movies/series to Radarr/Sonarr. Adds external ratings from Metacritic, Rotten Tomatoes, Letterboxd, Douban, Allocine. Media Server indicators for Plex, Jellyfin, Emby. Dark theme/style for …
Stars: ✭ 177 (+276.6%)
download water dataDownloader for the Global Surface Water Data of the Copernicus Programme
Stars: ✭ 25 (-46.81%)
php-crawler🕷️ A simple crawler (spider) writen in php just for fun, with zero dependencies
Stars: ✭ 39 (-17.02%)
gathertoolgathertool是golang脚本化开发库,目的是提高对应场景程序开发的效率;轻量级爬虫库,接口测试&压力测试库,DB操作库等。
Stars: ✭ 36 (-23.4%)
web-scraping-with-pythonIn this repository i will expalin how to scrap websites using python programming language with BeautifulSoup and requestsmodulues
Stars: ✭ 44 (-6.38%)