GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → vearch → Vearch

vearch / Vearch

Licence: other
A distributed system for embedding-based retrieval

Programming Languages

go
31211 projects - #10 most used programming language

Labels

deep-learningmachine-learningdistributed-systemscloud-native

Projects that are alternatives of or similar to Vearch

Nats Server
High-Performance server for NATS.io, the cloud and edge native messaging system.
Stars: ✭ 10,223 (+987.55%)
Mutual labels:  cloud-native, distributed-systems
Vald
Vald. A Highly Scalable Distributed Vector Search Engine
Stars: ✭ 158 (-83.19%)
Mutual labels:  cloud-native, distributed-systems
Micro
Micro is a distributed cloud operating system
Stars: ✭ 10,778 (+1046.6%)
Mutual labels:  cloud-native, distributed-systems
Gnes
GNES is Generic Neural Elastic Search, a cloud-native semantic search system based on deep neural network.
Stars: ✭ 1,178 (+25.32%)
Mutual labels:  cloud-native, distributed-systems
pixie
Instant Kubernetes-Native Application Observability
Stars: ✭ 3,238 (+244.47%)
Mutual labels:  distributed-systems, cloud-native
Mangle
Git Repository for the Mangle tool
Stars: ✭ 125 (-86.7%)
Mutual labels:  cloud-native, distributed-systems
Akka
Build highly concurrent, distributed, and resilient message-driven applications on the JVM
Stars: ✭ 11,938 (+1170%)
Mutual labels:  cloud-native, distributed-systems
Liftbridge
Lightweight, fault-tolerant message streams.
Stars: ✭ 2,175 (+131.38%)
Mutual labels:  cloud-native, distributed-systems
matrixone
Hyperconverged cloud-edge native database
Stars: ✭ 1,057 (+12.45%)
Mutual labels:  distributed-systems, cloud-native
Go Chassis
a microservice framework for rapid development of micro services in Go with rich eco-system
Stars: ✭ 2,428 (+158.3%)
Mutual labels:  cloud-native, distributed-systems
Juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Stars: ✭ 4,262 (+353.4%)
Mutual labels:  cloud-native, distributed-systems
Service Fabric
Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
Stars: ✭ 2,874 (+205.74%)
Mutual labels:  cloud-native, distributed-systems
Hemera
🔬 Writing reliable & fault-tolerant microservices in Node.js https://hemerajs.github.io/hemera/
Stars: ✭ 773 (-17.77%)
Mutual labels:  cloud-native, distributed-systems
Inlets Operator
Add public LoadBalancers to your local Kubernetes clusters
Stars: ✭ 795 (-15.43%)
Mutual labels:  cloud-native
Microservices Connector
Inter-Service communication framework, support for microservice architecture and distributed system
Stars: ✭ 17 (-98.19%)
Mutual labels:  distributed-systems
Lizardfs
LizardFS is an Open Source Distributed File System licensed under GPLv3.
Stars: ✭ 793 (-15.64%)
Mutual labels:  distributed-systems
Titanoboa
Titanoboa makes complex workflows easy. It is a low-code workflow orchestration platform for JVM - distributed, highly scalable and fault tolerant.
Stars: ✭ 787 (-16.28%)
Mutual labels:  distributed-systems
Abci Host
Clojure host/server for Tendermint's ABCI protocol.
Stars: ✭ 18 (-98.09%)
Mutual labels:  distributed-systems
Quarkus Microservices Poc
Very simplified shop sales system made in a microservices architecture using quarkus
Stars: ✭ 16 (-98.3%)
Mutual labels:  cloud-native
Tidb Operator
TiDB operator creates and manages TiDB clusters running in Kubernetes.
Stars: ✭ 778 (-17.23%)
Mutual labels:  cloud-native
View All Similar Projects ➔

Build Status     Gitter

Overview

Vearch is a scalable distributed system for efficient similarity search of deep learning vectors.

Architecture

arc

  • Data Model

    space, documents, vectors, scalars

  • Components

    Master, Router and PartitionServer

  • Master

    Responsible for schema mananagement, cluster-level metadata, and resource coordination.

  • Router

    Provides RESTful API: create , delete search and update ; request routing, and result merging.

  • PartitionServer (PS)

    Hosts document partitions with raft-based replication.

    Gamma is the core vector search engine implemented based on faiss. It provides the ability of storing, indexing and retrieving the vectors and scalars.

Quick start

docs/img/plugin/main_process.gif

  • One-click binary installation, please see docs/BinaryInstallation.md(中文版).

  • Quickly compile the source codes to build a distributed vector search system with RESTful API, please see docs/SourceCompileDeployment.md.

  • Vearch can be leveraged to build a complete visual search system to index billions of images. The image retrieval plugin for object detection and feature extraction is also required. For more information, please refer to docs/Quickstart.md.

  • Vearch Python SDK enables vearch to use locally. Vearch python sdk can be installed easily by pip install vearch. For more information, please refer to docs/APIPythonSDK.md.

APIs and Use Cases

LowLevelAPI

VisualSearchAPI

PythonSDKAPI

Document

Benchmarks

Publication

Jie Li, Haifeng Liu, Chuanghua Gui, Jianyu chen, Zhenyun Ni, Ning Wang, Yuan Chen, Qiang Liu. The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platform. In the 19th International ACM Middleware Conference, December 10–14, 2018, Rennes, France. https://arxiv.org/abs/1908.07389

Community

You can report bugs or ask questions in the issues page of the repository.

For public discussion of Vearch or for questions, you can also send email to [email protected].

Our slack : https://vearchwrokspace.slack.com

Known Users

Welcome to register the company name in this issue: https://github.com/vearch/vearch/issues/230 (in order of registration)

欢迎在此 issue https://github.com/vearch/vearch/issues/230 中登记公司名称

科大讯飞 飞搜科技 君库科技 爱奇艺 人民科技 趣头条 网易严选 咸唐科技 华为技术 OPPO 汽车之家 芯翌智能 图灵机器人

金山云

License

Licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].