All Projects → LoomisLoud → Onion Crawler

LoomisLoud / Onion Crawler

Tor website crawler (specific for Alphabay at the time)

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Onion Crawler

Torbot
Dark Web OSINT Tool
Stars: ✭ 821 (+5373.33%)
Mutual labels:  crawler, tor, onion
Freshonions Torscraper
Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (+2220%)
Mutual labels:  crawler, tor, onion
torgo
A Golang library for Tor.
Stars: ✭ 36 (+140%)
Mutual labels:  tor, onion
oniontree
A repository of Tor hidden services.
Stars: ✭ 45 (+200%)
Mutual labels:  tor, onion
go-libp2p-tor-transport
🚧 WIP: tor transport for libp2p
Stars: ✭ 41 (+173.33%)
Mutual labels:  tor, onion
OnionHarvester
A small TOR Onion Address harvester for checking if the address is available or not.
Stars: ✭ 71 (+373.33%)
Mutual labels:  tor, onion
onion-pi
Configures your Raspberry Pi as portable WiFi-WiFi Tor proxy.
Stars: ✭ 13 (-13.33%)
Mutual labels:  tor, onion
TORhunter
Designed to scan and exploit vulnerabilities within Tor hidden services. TORhunter allows most tools to work as normal while resolving .onion
Stars: ✭ 47 (+213.33%)
Mutual labels:  tor, onion
Black Widow
GUI based offensive penetration testing tool (Open Source)
Stars: ✭ 124 (+726.67%)
Mutual labels:  parser, crawler
Hosting
This is a setup for a Tor based shared web hosting server
Stars: ✭ 254 (+1593.33%)
Mutual labels:  tor, onion
narnia
🚧 EXPERIMENTAL 🚧 Secure hidden service webserver
Stars: ✭ 24 (+60%)
Mutual labels:  tor, onion
Hquery.php
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (+1866.67%)
Mutual labels:  parser, crawler
onionfruit
OnionFruit™ Connect - Tor access client with country selection, bridge configuration, pluggable transports and experimental DNS support
Stars: ✭ 150 (+900%)
Mutual labels:  tor, onion
Goose Parser
Universal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+1306.67%)
Mutual labels:  parser, crawler
guessTor
Bruteforces [.onion] domains
Stars: ✭ 78 (+420%)
Mutual labels:  tor, onion
Jssoup
JavaScript + BeautifulSoup = JSSoup
Stars: ✭ 203 (+1253.33%)
Mutual labels:  parser, crawler
vDroid
official re-designed Android wallet 📳
Stars: ✭ 14 (-6.67%)
Mutual labels:  tor, onion
Deepweb Scappering
Discover hidden deepweb pages
Stars: ✭ 40 (+166.67%)
Mutual labels:  crawler, tor
Poopak
POOPAK - TOR Hidden Service Crawler
Stars: ✭ 78 (+420%)
Mutual labels:  crawler, tor
Attacks-on-Tor
Thirteen Years of Tor Attacks
Stars: ✭ 170 (+1033.33%)
Mutual labels:  tor, onion

Onion Website Parser

@rbsteinm and I were hired in order to develop an open-source tool which purpose is to crawl a specific .onion website. It crawls the forum pages of a forum and retrieves some information to store it in a MongoDB.

In order to use it, you need to be running any Linux distribution, use python3.5, install the required libraries: pip3.5 install -r requirements.txt, install the tor browser and provide to the commandline your tor browser folder. Also, remember to fill out the parameters that you need in the credentials section of the python/crawler.py file (login, etc).

Example: ./python/crawler.py path_to/my_tor_browser/folder

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].