146 Open source projects that are alternatives of or similar to jgit-spark-connector

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A tool for building feature stores.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Asynchronous actions for PySpark

Fundamentals of Spark with Python (using PySpark), code examples

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

Simple and Distributed Machine Learning

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Apache (Py)Spark type annotations (stub files).

Word2Vec models with Twitter data using Spark. Blog:

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

HandySpark - bringing pandas-like capabilities to Spark dataframes

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

pyspark methods to enhance developer productivity 📣 👯 🎉

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

Updated repository

Example project implementing best practices for PySpark ETL jobs and applications.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

🐍 Quick reference guide to common patterns & functions in PySpark.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

State of the Art Natural Language Processing

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Spark 2.0 Python Machine Learning examples

Some class materials for a data processing course using PySpark

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

🌐 Interactive Workshop on GeoAnalysis using PySpark

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

A curated list of awesome Apache Spark packages and resources.

LearningApacheSpark

Jupyter magics and kernels for working with remote Spark clusters

Baseline Compose for Clickhouse + Grafana

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Process Common Crawl data with Python and Spark

A simple Spark TDD example

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics

This is a repo documenting the best practices in PySpark.

pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4

A boilerplate for writing PySpark Jobs

pyspark🍒🥭 is delicious，just eat it!😋😋

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

Apache Spark (PySpark) Practice on Real Data

Structural Bioinformatics Training Workshop & Hackathon 2018

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

A library that provides useful extensions to Apache Spark and PySpark.

Código para workshops Spark com ambiente de desenvolvimento em docker

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Relation Extraction using Deep learning(CNN)

🎼 Docker compose files for various kafka stacks

Isolation Forest on Spark

PySpark Code for Hands-on Learners

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

A connector for Apache Spark and PySpark to Dgraph databases.

Apache Spark Connector for Azure Cosmos DB

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin