HydrographA visual ETL development and debugging tool for big data
Stars: ✭ 144 (+323.53%)
IgniteApache Ignite
Stars: ✭ 4,027 (+11744.12%)
HalodbA fast, log structured key-value store.
Stars: ✭ 370 (+988.24%)
SparklerSpark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
Stars: ✭ 362 (+964.71%)
dislibThe Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.
Stars: ✭ 39 (+14.71%)
BigtopMirror of Apache Bigtop
Stars: ✭ 356 (+947.06%)
Belajarpython.comOpen Source Indonesian Python Programming Tutorial Site
Stars: ✭ 141 (+314.71%)
Devops RoadmapDevOps methodology & roadmap for a devops developer in 2019. Interesting books to learn new technologies.
Stars: ✭ 349 (+926.47%)
StroomStroom is a highly scalable data storage, processing and analysis platform.
Stars: ✭ 344 (+911.76%)
OzoneScalable, redundant, and distributed object store for Apache Hadoop
Stars: ✭ 330 (+870.59%)
lcu-driver🐍 Python3 interface for League of Legends Client API
Stars: ✭ 71 (+108.82%)
PoseidonA search engine which can hold 100 trillion lines of log data.
Stars: ✭ 1,793 (+5173.53%)
Uproot3ROOT I/O in pure Python and NumPy.
Stars: ✭ 312 (+817.65%)
datalake-etl-pipelineSimplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (+14.71%)
MistServerless proxy for Spark cluster
Stars: ✭ 309 (+808.82%)
AcceleratorThe Accelerator is a tool for fast and reproducible processing of large amounts of data.
Stars: ✭ 137 (+302.94%)
HelixMirror of Apache Helix
Stars: ✭ 304 (+794.12%)
CloudbreakA tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.
Stars: ✭ 301 (+785.29%)
Baize白泽自动化运维系统:配置管理、网络探测、资产管理、业务管理、CMDB、CD、DevOps、作业编排、任务编排等功能,未来将添加监控、报警、日志分析、大数据分析等部分内容
Stars: ✭ 296 (+770.59%)
CrateCrateDB is a distributed SQL database that makes it simple to store and analyze
massive amounts of data in real-time.
Stars: ✭ 3,254 (+9470.59%)
HamaMirror of Apache Hama
Stars: ✭ 129 (+279.41%)
Oie ResourcesA curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.
Stars: ✭ 283 (+732.35%)
couchdb-pkgApache CouchDB Packaging support files
Stars: ✭ 24 (-29.41%)
Knowage ServerKnowage is the professional open source suite for modern business analytics over traditional sources and big data systems.
Stars: ✭ 276 (+711.76%)
gan deeplearning4jAutomatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.
Stars: ✭ 19 (-44.12%)
SuccinctEnabling queries on compressed data.
Stars: ✭ 257 (+655.88%)
AzuredatalakeSamples and Docs for Azure Data Lake Store and Analytics
Stars: ✭ 128 (+276.47%)
CookbookThe Data Engineering Cookbook
Stars: ✭ 9,829 (+28808.82%)
Quantitative-Big-Imaging-2018(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018
Stars: ✭ 50 (+47.06%)
bandar-logMonitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Stars: ✭ 20 (-41.18%)
Griffon VmGriffon Data Science Virtual Machine
Stars: ✭ 128 (+276.47%)
bigtableTypeScript Bigtable Client with 🔋🔋 included.
Stars: ✭ 13 (-61.76%)
beekeeperService for automatically managing and cleaning up unreferenced data
Stars: ✭ 43 (+26.47%)
pipelineOONI data processing pipeline
Stars: ✭ 36 (+5.88%)
Mobydq🐳 Tool to automate data quality checks on data pipelines
Stars: ✭ 123 (+261.76%)
mmtf-sparkMethods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.
Stars: ✭ 20 (-41.18%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-61.76%)
Report自动化配置报表平台。演示地址http://58.87.112.247/report 账号 visitor密码123456
Stars: ✭ 123 (+261.76%)
lensMirror of Apache Lens
Stars: ✭ 57 (+67.65%)
FlameStreamDistributed stream processing model and its implementation
Stars: ✭ 14 (-58.82%)
SparkApache Spark - A unified analytics engine for large-scale data processing
Stars: ✭ 31,618 (+92894.12%)
SigmfThe Signal Metadata Format Specification
Stars: ✭ 120 (+252.94%)
rastercuberastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)
Stars: ✭ 15 (-55.88%)
dxramA distributed in-memory key-value storage for billions of small objects.
Stars: ✭ 25 (-26.47%)
yildiz🦄🌟 Graph Database layer on top of Google Bigtable
Stars: ✭ 24 (-29.41%)
GimelBig Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (+535.29%)