ibmpairsopen source tools for interaction with IBM PAIRS:
Stars: ✭ 23 (-93.54%)
awesome-AI-kubernetes❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
Stars: ✭ 95 (-73.31%)
TrinoOfficial repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (+1186.8%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-68.82%)
big dataA collection of tutorials on Hadoop, MapReduce, Spark, Docker
Stars: ✭ 34 (-90.45%)
SmooksAn extensible Java framework for building XML and non-XML streaming applications
Stars: ✭ 293 (-17.7%)
DeltaAn open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.
Stars: ✭ 3,903 (+996.35%)
egisEgis - a handy Ruby interface for AWS Athena
Stars: ✭ 38 (-89.33%)
DatahubThe Metadata Platform for the Modern Data Stack
Stars: ✭ 4,232 (+1088.76%)
bigdata-funA complete (distributed) BigData stack, running in containers
Stars: ✭ 14 (-96.07%)
v6.dooring.public可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.
Stars: ✭ 323 (-9.27%)
TezApache Tez
Stars: ✭ 313 (-12.08%)
spark-acidACID Data Source for Apache Spark based on Hive ACID
Stars: ✭ 91 (-74.44%)
FlinkApache Flink is an open source project of The Apache Software Foundation (ASF).
The Apache Flink project originated from the Stratosphere research project.
Stars: ✭ 17,781 (+4894.66%)
vxqueryMirror of Apache VXQuery
Stars: ✭ 19 (-94.66%)
hotmapWebGL Heatmap Viewer for Big Data and Bioinformatics
Stars: ✭ 13 (-96.35%)
big-sorterJava library that sorts very large files of records by splitting into smaller sorted files and merging
Stars: ✭ 49 (-86.24%)
FluidFluid, elastic data abstraction and acceleration for BigData/AI applications in cloud
Stars: ✭ 265 (-25.56%)
bftkvA distributed key-value storage that's tolerant to Byzantine fault.
Stars: ✭ 27 (-92.42%)
bigstatsrR package for statistical tools with big matrices stored on disk.
Stars: ✭ 139 (-60.96%)
bigtableTypeScript Bigtable Client with 🔋🔋 included.
Stars: ✭ 13 (-96.35%)
falconMirror of Apache Falcon
Stars: ✭ 95 (-73.31%)
CloudbreakA tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.
Stars: ✭ 301 (-15.45%)
pipelineOONI data processing pipeline
Stars: ✭ 36 (-89.89%)
Baize白泽自动化运维系统:配置管理、网络探测、资产管理、业务管理、CMDB、CD、DevOps、作业编排、任务编排等功能,未来将添加监控、报警、日志分析、大数据分析等部分内容
Stars: ✭ 296 (-16.85%)
leaflet heatmap简单的可视化湖州通话数据 假设数据量很大,没法用浏览器直接绘制热力图,把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后,再使用Apache Spark绘制热力图,然后用leafletjs加载OpenStreetMap图层和热力图图层,以达到良好的交互效果。现在使用Apache Spark实现绘制,可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法,并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .
Stars: ✭ 13 (-96.35%)
StroomStroom is a highly scalable data storage, processing and analysis platform.
Stars: ✭ 344 (-3.37%)
lensMirror of Apache Lens
Stars: ✭ 57 (-83.99%)
CrateCrateDB is a distributed SQL database that makes it simple to store and analyze
massive amounts of data in real-time.
Stars: ✭ 3,254 (+814.04%)
Uproot3ROOT I/O in pure Python and NumPy.
Stars: ✭ 312 (-12.36%)
Oie ResourcesA curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.
Stars: ✭ 283 (-20.51%)
alluxio-pyAlluxio Python client - Access Any Data Source with Python
Stars: ✭ 18 (-94.94%)
Devops RoadmapDevOps methodology & roadmap for a devops developer in 2019. Interesting books to learn new technologies.
Stars: ✭ 349 (-1.97%)
Knowage ServerKnowage is the professional open source suite for modern business analytics over traditional sources and big data systems.
Stars: ✭ 276 (-22.47%)
pyparEfficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.
Stars: ✭ 66 (-81.46%)
MistServerless proxy for Spark cluster
Stars: ✭ 309 (-13.2%)
pytorch kmeansImplementation of the k-means algorithm in PyTorch that works for large datasets
Stars: ✭ 38 (-89.33%)
pyspark-cheatsheetPySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (-67.7%)
OzoneScalable, redundant, and distributed object store for Apache Hadoop
Stars: ✭ 330 (-7.3%)
hyper-enginePython library for Bayesian hyper-parameters optimization
Stars: ✭ 80 (-77.53%)
SuccinctEnabling queries on compressed data.
Stars: ✭ 257 (-27.81%)
big-data-liteSamples to the Oracle Big Data Lite VM
Stars: ✭ 41 (-88.48%)
HelixMirror of Apache Helix
Stars: ✭ 304 (-14.61%)
bandar-logMonitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Stars: ✭ 20 (-94.38%)
VespaThe open big data serving engine. https://vespa.ai
Stars: ✭ 3,747 (+952.53%)
Grouparoo🦘 The Grouparoo Monorepo - open source customer data sync framework
Stars: ✭ 334 (-6.18%)
MorpheusMorpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.
Stars: ✭ 303 (-14.89%)
mmtf-workshop-2018Structural Bioinformatics Training Workshop & Hackathon 2018
Stars: ✭ 50 (-85.96%)