908 Open source projects that are alternatives of or similar to Live_log_analyzer_spark

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Simple and Distributed Machine Learning

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Structural Bioinformatics Training Workshop & Hackathon 2018

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

Some class materials for a data processing course using PySpark

Jupyter magics and kernels for working with remote Spark clusters

pyspark methods to enhance developer productivity 📣 👯 🎉

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Apache (Py)Spark type annotations (stub files).

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Spark examples

Natural Korean Processor for Apache Spark

Apache Spark for data engineers

A framework for writing Spark 2.x applications in a pretty way

Custom state store providers for Apache Spark

Relation Extraction using Deep learning(CNN)

Word2Vec models with Twitter data using Spark. Blog:

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

pyspark🍒🥭 is delicious，just eat it!😋😋

🌐 Interactive Workshop on GeoAnalysis using PySpark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Apache Spark on AWS Lambda

An encrypted data analytics platform

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

一个大数据架构师应该掌握的技能

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

The Internals of Spark SQL

Apache Spark™ and Scala Workshops

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Real-world Spark pipelines examples

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Apache Spark (PySpark) Practice on Real Data

A library that provides useful extensions to Apache Spark and PySpark.

The Internals of Spark Structured Streaming

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Expressive types for Spark.

model-describer : Making machine learning interpretable to humans

Scalable genomic data analysis.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

A flexible, easy to use, automation framework allowing users to integrate their capabilities and devices to cut through the repetitive, tedious tasks slowing them down. #nsacyber

Official Mixpanel Android SDK

A portfolio tracking, analytics, accounting and tax reporting application that protects your privacy

A free tutorial for Apache Spark.

The simplest, fastest way to get business intelligence and analytics to everyone in your company 😋

Support content for my blog

A-Paper-A-Week

📊 Visitor's analytics tracking code for ostr.io service

The daily list of Wikipedia's most-visited articles

The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP

Official Mixpanel JavaScript Client Library

Analytics integration for Redux and ngrx/store

Fathom Lite. Simple, privacy-focused website analytics. Built with Golang & Preact.