soulmachine / Crypto Crawlers
Licence: apache-2.0
The All-in-one Solution to crawl data from cryptocurrency exchanges
Stars: ✭ 45
Programming Languages
typescript
32286 projects
crypto-crawlers
The All-in-one Solution to crawl data from cryptocurrency exchanges.
Download Data
For most people, don't bother to run crawlers, I'm publishing data to the following places:
- Baidu NetDisk(百度网盘), code: 3142.
- BitTorrent. See the table below.
Download Links:
| File Name | MD5 | Compressed Size | Original Size | Magnet Link | Comment |
|---|---|---|---|---|---|
| trade-2020-04.zip | ad3dfb4fb1eb0ec7bb7f694ff481c46b | 1.2G | 13G | magnet:?xt=urn:btih:2de10098310245057d6fe1081db0aee88f2e5481&dn=trade-2020-04.zip&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969 | April 2020 |
| trade-2020-05.zip | 81bb33ae9fe8749d574c3a7c3d685978 | 12G | 167.0G | magnet:?xt=urn:btih:69fda39b186d68d60dc22253cd2f4a12b3944a49&dn=trade-2020-05.zip&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969 | May 2020 |
| trade-2020-06.zip | af52e9f828247ce2154fbf5dadfbb2f4 | 6.4G | 94.8G | magnet:?xt=urn:btih:dcdbe1ae0ef476ce374784c63b467b2b6c2a8dd9&dn=trade-2020-06.zip&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969 | June 2020 |
| trade-2020-07.zip | 2a7dd151622c0689582ebf9160143166 | 8.6G | 123.8G | in Baidupan | July 2020 |
| trade-2020-08.zip | b8f69b711d9648d42051bfc66a9cf56b | 16.4G | 215.3G | in Baidupan | August 2020 |
| trade-2020-09.zip | b2209e693022b71ad597cc09042d50c7 | 17.7G | 249.1G | in Baidupan | September 2020 |
The more seeders, the faster speed. Please help each other by seeding.
How to run
1. Prerequisites
- Install NodeJS
- Run a Redis server at
localhost:6379 - Change the
DATA_DIRvariable in.envrcand load this file viadirenv
2. Install typescript and pm2 globally
npm install typescript pm2 -g
3. Compile
npm install
npm run build
4. Run all crawlers
pm2 start pm2.misc.config.json
pm2 start pm2.trade.config.js
Support Me
Please use my referral links to sign up your exchange accounts.
| Exchange | Referral Link |
|---|---|
| Binance | https://www.binance.com/en/register?ref=N957C5RN |
| Huobi | https://www.huobi.fm/en-us/topic/invited/?invite_code=5ds55 |
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].