Bennington-Distributed-Systems-2017 / Darkdarkgo
Licence: mit
Modeled Google and Bing to build a distributed search engine for the dark web
Stars: ✭ 303
Programming Languages
python
139335 projects - #7 most used programming language
Labels
Projects that are alternatives of or similar to Darkdarkgo
indieweb-search
Source code for the IndieWeb search engine.
Stars: ✭ 16 (-94.72%)
Mutual labels: search-engine
Yuno
Yuno is context based search engine for anime.
Stars: ✭ 320 (+5.61%)
Mutual labels: search-engine
SauceKudasai
Get Anime info by image or URL (uses trace.moe and Anilist for animeinfo)
Stars: ✭ 50 (-83.5%)
Mutual labels: search-engine
Searchcode Server
The offical home of searchcode-server where you can run searchcode locally. Note that master is generally unstable in the sense that it is not a release. Check releases for release versions https://github.com/boyter/searchcode-server/releases
Stars: ✭ 262 (-13.53%)
Mutual labels: search-engine
Fire Detect Yolov4
fire-smoke-detection-dataset and fire-detection-yolov4-v5，火灾检测，烟雾检测
Stars: ✭ 280 (-7.59%)
Mutual labels: darknet
Redisearch
A query and indexing engine for Redis, providing secondary indexing, full-text search, and aggregations.
Stars: ✭ 3,393 (+1019.8%)
Mutual labels: search-engine
darknet.py
darknet.py is a network application with no dependencies other than Python and Tor, useful to anonymize the traffic of linux servers and workstations.
Stars: ✭ 71 (-76.57%)
Mutual labels: darknet
php-search
A Lucene-inspired PHP Search engine library
Stars: ✭ 16 (-94.72%)
Mutual labels: search-engine
fastmorph
Fast corpus search engine originally made for the Corpus of Written Tatar language
Stars: ✭ 14 (-95.38%)
Mutual labels: search-engine
Darksearch
🔍 Search engine for hidden material. Scraping dark web onions, irc logs, deep web etc...
Stars: ✭ 260 (-14.19%)
Mutual labels: search-engine
Itemsapi
Blazingly fast, multi tenant, faceted search API
Stars: ✭ 287 (-5.28%)
Mutual labels: search-engine
Smart Contract Search Engine
Takes a link to a smart contract's raw ABI file and an RPC URL and then indexes all instances of that smart contract
Stars: ✭ 265 (-12.54%)
Mutual labels: search-engine
DarkDarkGo
DarkDarkGo is a scalable search engine for the dark web. The goal of the project is to build a simple, robust search engine from scratch that can search through the dark web content.
Project Status
It is a work in progress. The last time we tested (December 2017), the dark web did not give us enough meaningful results to serve a query. However, each component was working and tested separately. Hence, this project can be used as a foundation to add more interesting features and build a more complex product.
Architecture
Components
- Crawler: Crawls the onion websites
- Index Builder: Builds index chunk
- Index Server: Stores replicated index chunk
- MGMT: Serves as single master, schedules jobs for other servers and executes heartbeats messages
- Front-End: Serves a website with Google-like interface
- Back-End: Express server with caching and aggregation logic
API
Testing
Each component has its own Dockerfile that is ready to be built and tested.
Stargazers over time
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].