All Categories → No Category → data-lake

Top 10 data-lake open source projects

Query API for aggregated Zeebe data

✭ 37

kotlin shell graphql data-lake hacktoberfest zeebe zeebe-tool

SparkProgrammingInScala

Apache Spark Course Material

✭ 57

scala big-data spark apache-spark bigdata data-lake datalake spark-sql spark-scala

Data-Engineering-Projects

Personal Data Engineering Projects

✭ 167

Jupyter Notebook python postgres airflow spark cassandra mongodb data-warehouse data-engineering data-lake scrapy data-modeling aws-redshift star-schema ingest-data data-engineering-nanodegree

jobAnalytics and search

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

✭ 25

python TSQL shell aws airflow sql spark analytics s3 jobs pyspark data-engineering data-lake redshift jobseeker jobsearch data-modeling data-pipeline jobscheduler

Demonstration of a Hive Input Format for Iceberg

✭ 22

java hive data-lake iceberg

Herd-MDL, a turnkey managed data lake in the cloud. See https://finraos.github.io/herd-mdl/ for more information.

✭ 11

java shell TSQL python data-lake data-catalog mdl

terraform-module-azure-datalake

Terraform module for an Azure Data Lake

✭ 28

HCL go shell Makefile azure terraform data-lake

Azure-Certification-DP-200

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

analyzing-reddit-sentiment-with-aws

Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.

✭ 40

python real-time reddit sentiment-analysis data-stream tutorials data-lake kinesis-firehose self-learning sentiment-classification amazon-athena aws-glue delivery-stream

smart-data-lake

Smart Automation Tool for building modern Data Lakes and Data Pipelines

✭ 79

scala java shell spark hive hadoop transform-data data-lake data-pipelines deltalake smart-data-lake

1-10 of 10 data-lake projects