InfinitycrawlerA simple but powerful web crawler library for .NET
Stars: ✭ 97 (-20.49%)
ScriptplayerScriptPlayer is a video player that controls the Fleshlight Launch, The Handy and lots of other toys in sync with videos.
Stars: ✭ 59 (-51.64%)
Aria2aria2 is a lightweight multi-protocol & multi-source, cross platform download utility operated in command-line. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink.
Stars: ✭ 25,001 (+20392.62%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+339.34%)
CrawlergoA powerful dynamic crawler for web vulnerability scanners
Stars: ✭ 1,088 (+791.8%)
XehentaiDoujinshi downloader 绅士漫画下载
Stars: ✭ 504 (+313.11%)
FileSelect files. Download files. Work with file content.
Stars: ✭ 96 (-21.31%)
Youtube Dl ServerWeb / REST interface for downloading youtube videos onto a server.
Stars: ✭ 499 (+309.02%)
Awesome Python Primer自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向
Stars: ✭ 57 (-53.28%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+3828.69%)
Pylinkvalidatorpylinkvalidator is a standalone and pure python link validator and crawler that traverses a web site and reports errors (e.g., 500 and 404 errors) encountered.
Stars: ✭ 109 (-10.66%)
Geeksforgeeks.pdfTopic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)
Stars: ✭ 489 (+300.82%)
Buttonprogressbar IosA small and flexible (well documented) UIButton subclass with animated loading progress, and completion animation.
Stars: ✭ 479 (+292.62%)
VidifyPlay music videos automatically for the songs playing on any device
Stars: ✭ 95 (-22.13%)
Images Web CrawlerThis package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..
Stars: ✭ 51 (-58.2%)
LearnpythonPython的基础练习代码与各种爬虫代码
Stars: ✭ 451 (+269.67%)
Dl courseraA simple, fast, and reliable Coursera crawling & downloading tool
Stars: ✭ 115 (-5.74%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+260.66%)
AltohttpAltoHttp provides fast and easy download management
Stars: ✭ 48 (-60.66%)
BiliduangBilibili 哔哩哔哩视频下载 C# GUI版 - 支持BV 支持4K 支持地区限制下载 支持互动视频 支持无水印 支持弹幕/字幕下载转换 支持课程下载
Stars: ✭ 438 (+259.02%)
ScrapoxyScrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Stars: ✭ 1,322 (+983.61%)
Weibo AnalystSocial media (Weibo) comments analyzing toolbox in Chinese 微博评论分析工具, 实现功能: 1.微博评论数据爬取; 2.分词与关键词提取; 3.词云与词频统计; 4.情感分析; 5.主题聚类
Stars: ✭ 430 (+252.46%)
Social ScraperTổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt
Stars: ✭ 47 (-61.48%)
Runoob Pdf爬取菜鸟教程网站并转PDF__python_crawer_by_chrome
Stars: ✭ 430 (+252.46%)
LumberjackAn automated website accessibility scanner and cli
Stars: ✭ 109 (-10.66%)
Comicbook本项目不再维护,详情可加群了解 https://t.me/onecomicbook
Stars: ✭ 429 (+251.64%)
PixevalA Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF
Stars: ✭ 1,031 (+745.08%)
KtspeechcrawlerAutomatically constructing corpus for automatic speech recognition from YouTube videos
Stars: ✭ 92 (-24.59%)
DotcommonWhat do people have in their dotfiles?
Stars: ✭ 418 (+242.62%)
Yaydlyet another youtube down loader (Git mirror)
Stars: ✭ 45 (-63.11%)
Must Watch CssA useful list of must-watch talks about CSS
Stars: ✭ 3,966 (+3150.82%)
Sentinel CrawlerXenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL for Infrastructure 💫 多语言执行器,分布式爬虫
Stars: ✭ 118 (-3.28%)
Compiler seriesMaterial for the Creating a Compiler video lesson series.
Stars: ✭ 409 (+235.25%)
Haskell Must WatchHuge list of videos, talks, courses for Haskell programming language.
Stars: ✭ 1,019 (+735.25%)
Appupdater🚀 AppUpdater一个专注于App更新,一键傻瓜式集成App版本升级的轻量开源库。(无需担心通知栏适配;无需担心重复点击下载;无需担心App安装等问题;这些AppUpdater都已帮您处理好。)
Stars: ✭ 406 (+232.79%)
Okhttps如艺术一般优雅,像 1、2、3 一样简单,前后端通用,轻量却强大的 HTTP 客户端(同时支持 WebSocket 与 Stomp 协议)
Stars: ✭ 92 (-24.59%)
Pluradl.pyAutomated download of Pluralsight courses
Stars: ✭ 406 (+232.79%)
PhotonIncredibly fast crawler designed for OSINT.
Stars: ✭ 8,332 (+6729.51%)
GosintOSINT Swiss Army Knife
Stars: ✭ 401 (+228.69%)
ContentmanagerAndroid library for getting photo or video from a device gallery, cloud or camera. Working with samsung devices. Made by Stfalcon
Stars: ✭ 108 (-11.48%)
CrawlabDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Stars: ✭ 8,392 (+6778.69%)
GithubupdatesCocoa framework to install application updates from GitHub releases.
Stars: ✭ 393 (+222.13%)
Proxy Pool爬虫代理IP池服务,可供其他爬虫程序通过restapi获取
Stars: ✭ 91 (-25.41%)
Scrapy RedisRedis-based components for Scrapy.
Stars: ✭ 4,998 (+3996.72%)
BeanbunBeanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman。
Stars: ✭ 1,096 (+798.36%)
XsrfprobeThe Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
Stars: ✭ 532 (+336.07%)
Pyptt支援 PTT 還有 PTT2 的 PTT API
Stars: ✭ 527 (+331.97%)
Auto LighthouseA utility package for automating lighthouse reporting
Stars: ✭ 58 (-52.46%)
Go jobs带你了解一下Golang的市场行情
Stars: ✭ 526 (+331.15%)
Haipproxy💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+3992.62%)
Qqmusicspider基于Scrapy的QQ音乐爬虫(QQ Music Spider),爬取歌曲信息、歌词、精彩评论等,并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料
Stars: ✭ 120 (-1.64%)