All Projects → logv → Sybil

logv / Sybil

Licence: other
columnar storage + NoSQL OLAP engine | https://logv.org

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Labels

Projects that are alternatives of or similar to Sybil

metriql
The metrics layer for your data. Join us at https://metriql.com/slack
Stars: ✭ 227 (-15.93%)
Mutual labels:  olap
olap
睿思BI-OLAP开源多维分析系统
Stars: ✭ 101 (-62.59%)
Mutual labels:  olap
duckdb
DuckDB is an in-process SQL OLAP Database Management System
Stars: ✭ 4,707 (+1643.33%)
Mutual labels:  olap
KuiBaDB
Another OLAP database
Stars: ✭ 297 (+10%)
Mutual labels:  olap
arrow-datafusion
Apache Arrow DataFusion SQL Query Engine
Stars: ✭ 2,360 (+774.07%)
Mutual labels:  olap
matrixone
Hyperconverged cloud-edge native database
Stars: ✭ 1,057 (+291.48%)
Mutual labels:  olap
Clickhouse
ClickHouse® is a free analytics DBMS for big data
Stars: ✭ 21,089 (+7710.74%)
Mutual labels:  olap
Guitar
A Simple and Efficient Distributed Multidimensional BI Analysis Engine.
Stars: ✭ 86 (-68.15%)
Mutual labels:  olap
quickstep
Quickstep project
Stars: ✭ 22 (-91.85%)
Mutual labels:  olap
DataWarehouse
从数据仓库到用户画像,从数据建设到数据应用
Stars: ✭ 298 (+10.37%)
Mutual labels:  olap
flock
Flock: A Low-Cost Streaming Query Engine on FaaS Platforms
Stars: ✭ 232 (-14.07%)
Mutual labels:  olap
Papers4DataAchitect
Collect papers for data engineering such as OLTP/OLAP/ETL/DistributedStorage.
Stars: ✭ 17 (-93.7%)
Mutual labels:  olap
OLAP-cube
is an hypercube of data
Stars: ✭ 23 (-91.48%)
Mutual labels:  olap
dlink
Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.
Stars: ✭ 1,535 (+468.52%)
Mutual labels:  olap
hadoop-data-ingestion-tool
OLAP and ETL of Big Data
Stars: ✭ 17 (-93.7%)
Mutual labels:  olap
TT Tech Space
TT Tech Research Notes
Stars: ✭ 21 (-92.22%)
Mutual labels:  olap
cubetl
CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)
Stars: ✭ 21 (-92.22%)
Mutual labels:  olap
prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
Stars: ✭ 54 (-80%)
Mutual labels:  olap
autopivot
AutoPivot automatically creates in-memory OLAP cubes from CSV files, that you can explore from Excel, Tableau or using the embedded ActiveUI web frontend
Stars: ✭ 23 (-91.48%)
Mutual labels:  olap
vinum
Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.
Stars: ✭ 57 (-78.89%)
Mutual labels:  olap

Sybil is an append only analytics datastore with no up front table schema requirements; just log JSON records to a table and run queries. Written in Go, sybil is designed for fast full table scans of multi-dimensional data on one or more machines.

more documentation is available on the wiki and in the repo.

if sybil by itself is uninteresting (who wants to run command line queries, anyways?), sybil is a supported backend for snorkel

advantages

  • Easy to setup and get data inside sybil - just pipe JSON on stdin to sybil
  • Supports histograms (and percentiles), standard deviations and time series roll ups
  • Runs fast full table queries (performance notes)
  • Lower disk usage through per column compression schemes
  • Serverless design with controlled memory usage
  • Per table retention policies (specify max age and/or size of tables)
  • Timestamp resistant query cache (optional) that avoids recomputation

disadvantages

  • JOINS not supported
  • No UPDATE operation on data - only writes

installation

go get github.com/logv/sybil

build status

CircleCI

additional information

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].