116 Open source projects that are alternatives of or similar to Hsuntzu

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

LZ77(LZSS) based compression algorithm in base62 for JavaScript.

A native go client for HDFS

📦 Latke application JavaScript and CSS files compression.

BigGAN; Knowledge Distillation; Black-Box; Fast Training; 16x compression

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Make optimisation of images part of your automated build process

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

A complete (distributed) BigData stack, running in containers

Bucketing and partitioning system for Parquet

A pure python HDFS client

Mount HDFS with fuse, works with kerberos!

基于分布式的云笔记（参考某道云笔记），数据存储在redis与hbase中

💎🔥大数据学习笔记

actively maintained fork of html-minifier - minify HTML, CSS and JS code using terser - supports ES6 code

Web tool for Kafka Connect |

The Universal Storage Engine

Divolte Collector

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

⚡ A compression library that implements many compression algorithms such as LZ4, Zstd, LZMA, Snappy, Brotli, GZip, and Deflate. It helps you to improve performance by reducing Memory Usage and Network Traffic for caching.

零基础学习spark，大数据学习

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

A simple JavaScript based client-side image compression algorithm

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Android Gradle Plugin -- Auto Check big image and compress image in building.

The lightweight library for compress image, video, and audio with an awesome experience

Python interface to the TileDB storage manager

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

7zip in python3 with ZStandard, PPMd, LZMA2, LZMA1, Delta, BCJ, BZip2, and Deflate compressions, and AES encryption.

Real Time Analytics and Data Pipelines based on Spark Streaming

Big Data for Data Engineers Coursera Specialization from Yandex

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Kafka Connect HDFS connector

Flume NG Canal source

flutter image compress

大数据入门指南 ⭐

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Easy tools of document, image, file, network, location, color, and media.

🔥🔥🔥Android文件、图片选择器，可按文件夹查找，文件类型查找，支持自定义相机

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

Minikube for big data with Scala and Spark

Transform TypeScript `const` enums

PLzmaSDK is (Portable, Patched, Package, cross-P-latform) Lzma SDK.

基于wifi抓取信息的大数据查询分析系统

ilovepdf.com python API library

A Java NIO file system provider for HDFS

Hadoop WebHDFS output plugin for Fluentd

A pandas-like deferred expression system, with first-class SQL support

CSSO full restructuring minification files to serve your webpack bundles

Create tarball from files

📑 Scripts to repair, verify, OCR, compress, wrangle, crop (etc.) PDFs

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Surprisingly space efficient trie in Golang(11 bits/key; 100 ns/get).

ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部署，具备高性能、工业级部署、端到端体验的特点，并且作为开源套件，满足二次深度开发的需求。

Minify HTML in PHP with just a single class

Mirror of Linkedin's Camus

A library on top of either pex or conda-pack to make your Python code easily available on a cluster