263 Open source projects that are alternatives of or similar to teraslice

Hadoop utility to compact small files

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

基于Hadoop的分布式云存储系统 🌴

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Big Data Ecosystem Docker

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Docker image for main Apache Hadoop components (Yarn/Hdfs)

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Mount HDFS with fuse, works with kerberos!

Kafka Connect HDFS connector

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

大数据入门指南 ⭐

Hadoop WebHDFS output plugin for Fluentd

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Mirror of Linkedin's Camus

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A tool and library for easily deploying applications on Apache YARN

大数据学习笔记，学习路线，技术案例整理。

💎🔥大数据学习笔记

一个对用户行为日志进行分析的大数据项目

Fast desktop client for Hadoop Distributed File System

A complete (distributed) BigData stack, running in containers

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

A Java NIO file system provider for HDFS

零基础学习spark，大数据学习

Fundamentals of Spark with Python (using PySpark), code examples

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

A pandas-like deferred expression system, with first-class SQL support

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

同步Hive数据仓库数据到Elasticsearch的小工具

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

基于wifi抓取信息的大数据查询分析系统

Kafka Connect FileSystem Connector

Apache Calcite

Apache Hadoop

Apache Parquet implementation in Rust

Apache Phoenix / Hbase Spring Boot Microservices

Facebook's Hive UDFs

Big Data Toolkit for the JVM

AI on Hadoop

An end-to-end machine learning and data mining framework on Hadoop

HBase客户端数据管理软件

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Install hadoop cluster with ansible

bigdatatutorial

Java开发者或者大数据开发者面试知识点整理

Mirror of Apache Calcite - Avatica

A large-scale entity and relation database supporting aggregation of properties

推荐项目（实时推荐和离线推荐）

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Ephemeral Hadoop clusters using Google Compute Platform

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

Griffon Data Science Virtual Machine

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Apache Nutch is an extensible and scalable web crawler

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

Distributed Java micro-services using ZooKeeper

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version