443 Open source projects that are alternatives of or similar to Scanns

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

Live-coding the cluster!

Apache Spark Connector for Azure Cosmos DB

Pandas and Spark DataFrame comparison for humans

Firely's open source FHIR server

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Elasticsearch plugin for nearest neighbor search. Store vectors and run similarity search using exact and approximate algorithms.

Compile-time Language Integrated Queries for Scala

Isolation Forest on Spark

spark ml 算法原理剖析以及具体的源码实现分析

Write your Spark data to Kafka seamlessly

Process Common Crawl data with Python and Spark

Profile and monitor your ML data pipeline end-to-end

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Geospatial Raster support for Spark DataFrames

Vald. A Highly Scalable Distributed Vector Search Engine

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Some useful tips for faiss

Fast Approximate Nearest Neighbor (ANN) searches with a PostgreSQL database.

Apache Spark on AWS Lambda

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Monitor Apache Spark from Jupyter Notebook

Spark Structured Streaming / Kafka / Cassandra / Elastic

Julia binding for Apache Spark

Unified SQL Analytics Engine Based on SparkSQL

Distributed t-SNE via Apache Spark

GeoTrellis for PySpark

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

A better compressed bitset in Java

Fundamentals of Spark with Python (using PySpark), code examples

Spark、Flink等离线任务的调度以及实时任务的监控

Updated repository

A RPC framework leveraging Spark RPC module

DataStax Spark Cassandra Connector

Big Data Ecosystem Docker

Pure python implementation of product quantization for nearest neighbor search

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

Simple and beautiful card component with an elegant spark line, for VueJS.

A repository to keep track of all the code that I end up writing for my blog posts.

State of the Art Natural Language Processing

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

An open-source toolkit for large-scale genomic analysis

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

A Java library implementing practical nearest neighbour search algorithm for multidimensional vectors that operates in sublinear time. It implements Locality-sensitive Hashing (LSH) and multi index hashing for hamming space.

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

HandySpark - bringing pandas-like capabilities to Spark dataframes

Node.js bindings for Apache Spark DataFrame APIs

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

A Clojure dataframe library that runs on Spark

Realtime calculation distributed system. AKA distributed lodash

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning