387 Open source projects that are alternatives of or similar to pulse

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

A complete (distributed) BigData stack, running in containers

Code to index HDFS to Solr using MapReduce

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Solr Query Segmenter for structuring unstructured queries

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Command Line Interface (CLI) to export METS/ALTO documents to other formats.

Solr Cloud and ZooKeeper CLI

The open-source IATI datastore for IATI data with RESTful web API providing XML, JSON, CSV output. It extracts and parses IATI XML files referenced in the IATI Registry and powered by Apache Solr.

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

Addax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.

와이빅타 엔지니어링팀의 자료를 정리해두는 곳입니다.

Mount HDFS with fuse, works with kerberos!

Framework for building distributed microserviceies in scala with akka-streams and kafka

Hadoop WebHDFS output plugin for Fluentd

Bitnami Docker Image for Solr

Ansible role to install an Apache Solr (Cloud) server/cluster

Code Library for My Blog

CDH安装手册

No description or website provided.

IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

Dice.com tutorial on using black box optimization algorithms to do relevancy tuning on your Solr Search Engine Configuration from Simon Hughes Dice.com

low-level helpers for Apache Spark libraries and tests

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

OpenRefine reconciliation services for VIAF, ORCID, and Open Library + framework for creating more.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；

Perl Utility Library for my other repos

Learn by doing projects

akka http gremlin 3 websocket connector

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Model complex data transformation pipelines easily

Example on Akka Streams with productive cases

Geographic Place, Date/time, and Pattern entity extraction toolkit along with text extraction from unstructured data and GIS outputters.

A starting point for solr schema, config and xslt.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

A set of commands for managing CDH clusters using Cloudera Manager REST API.

OLAP and ETL of Big Data

Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.

Open-source distribute workflow schedule tools, also support streaming task.

Document Ingestion Framework for Search Systems

A list of examples that involve streaming with Akka Streams and used together with Akka HTTP

No description or website provided.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Docker file for Hadoop 3

Netgen's extra bits for eZ Platform search

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

Demos of how to do custom stream processing using the Akka Streams GraphStages API

🐘 A local Hadoop cluster bootstrapper using Vagrant, Ansible, and Ambari.

clusterdock is a framework for creating Docker-based container clusters

Documentation placeholder and utilities for all the other containers.

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Simple Linux Panel

Fast desktop client for Hadoop Distributed File System