keenwon / Antcolony
Nodejs实现的一个磁力链接爬虫 http://findit.keenwon.com (原域名http://findit.so )
Stars: ✭ 1,151
Programming Languages
javascript
184084 projects - #8 most used programming language
Projects that are alternatives of or similar to Antcolony
Torrent Discovery
Discover BitTorrent and WebTorrent peers
Stars: ✭ 177 (-84.62%)
Mutual labels: dht, torrent, bittorrent
Snail
基于Java、JavaFX开发的下载工具，支持下载协议：BT（BitTorrent、磁力链接、种子文件）、HLS（M3U8）、FTP、HTTP。人家才不要你的⭐⭐呢，哼
Stars: ✭ 102 (-91.14%)
Mutual labels: dht, torrent, bittorrent
Bt
BitTorrent library and client with DHT, magnet links, encryption and more
Stars: ✭ 2,011 (+74.72%)
Mutual labels: dht, torrent, bittorrent
Dht
dht is used by anacrolix/torrent, and is intended for use as a library in other projects both torrent related and otherwise
Stars: ✭ 184 (-84.01%)
Mutual labels: dht, torrent, bittorrent
Bittorrent Dht
🕸 Simple, robust, BitTorrent DHT implementation
Stars: ✭ 1,004 (-12.77%)
Mutual labels: dht, torrent, bittorrent
bthello
Python3 DHT 磁力种子爬虫 种子解析 种子搜索 演示地址
Stars: ✭ 43 (-96.26%)
Mutual labels: torrent, bittorrent, dht
Webtorrent
⚡️ Streaming torrent client for the web
Stars: ✭ 25,554 (+2120.16%)
Mutual labels: torrent, bittorrent
Radarr
A fork of Sonarr to work with movies à la Couchpotato.
Stars: ✭ 5,707 (+395.83%)
Mutual labels: torrent, bittorrent
Aria2.js
JavaScript library for aria2, "The next generation download utility."
Stars: ✭ 471 (-59.08%)
Mutual labels: dht, bittorrent
Webtorrent Hybrid
WebTorrent (with WebRTC support in Node.js)
Stars: ✭ 422 (-63.34%)
Mutual labels: torrent, bittorrent
Btlet
Some toolkits implements part of BT Protocol, like DHT spider.
Stars: ✭ 54 (-95.31%)
Mutual labels: spider, dht
Torrent
Full-featured BitTorrent client package and utilities
Stars: ✭ 4,138 (+259.51%)
Mutual labels: torrent, bittorrent
Lbry Sdk
The LBRY SDK for building decentralized, censorship resistant, monetized, digital content apps.
Stars: ✭ 7,169 (+522.85%)
Mutual labels: dht, bittorrent
Trackerslistcollection
🎈 Updated daily! A list of popular BitTorrent Trackers! / 每天更新！全网热门 BT Tracker 列表！
Stars: ✭ 9,761 (+748.05%)
Mutual labels: torrent, bittorrent
Biglybt
Feature-filled Bittorrent client based on the Azureus open source project
Stars: ✭ 672 (-41.62%)
Mutual labels: torrent, bittorrent
Phpspidermagnetbittorrent
php实现p2p中DHT网络爬虫，并提供搜索下载
Stars: ✭ 64 (-94.44%)
Mutual labels: dht, bittorrent
AntColony
介绍
AntColony（Github）是findit磁力搜索引擎的核心。用来在DHT网络中，收集活跃资源的infohash，下载并解析资源的种子文件，存入数据库等。AntColony是若干功能的合集，也可以单独运行其中的部分功能，所以起“蚁群”这个名字也是很贴切的（没错，我就是爱动物世界）。主要分一下几块：
- worker：爬虫，收集资源infohash，可以同时启动多个进程的worker，提高效率
- male：根据收集来的infohash去下载种子文件
- female：将种子文件录入数据库
- queen：简单的入口，启动pm2运行worker，male和female
目前启动5个worker使用3000-3004的端口，2个male和1个female。
使用Mongodb储存数据，这没什么好说的；使用pm2维护和监控node进程，也没太多要说的，重点说下Redis。Redis里暂存的数据大概是这样的：
- bucket：比较大的一个K桶
- infohash：就是已经收集到的infohashs（worker收集来的，male会用来下载种子）
- remoteNodes：worker新认识的节点，会依次“拜访”的，目前只保存最新的10w个（一方面我的VPS内存小，另一方面真没必要记录太多）
- sysInfo：记录一些统计信息，例如发出多少次请求，累积收集多少infohashs，目前已经发出15亿次Request，这个频率是可控的，worker 太疯狂的话，VPS扛不住。
安装&运行方法
详细的使用方法请查看部署文档
其他内容查看 http://keenwon.com/1436.html
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].