689 Open source projects that are alternatives of or similar to Spark Bigquery Connector

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

In this workshop, you'll learn how to install and configure Istio, an open source framework for connecting, securing, and managing microservices, on Google Kubernetes Engine, Google’s hosted Kubernetes product. You will also deploy an Istio-enabled multi-service application

spark summit 2017 SanFrancisco

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Spark on Kubernetes infrastructure Helm charts repo

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. What datasets do you want to be added to Ethereum ETL? Vote here: https://blockchain-etl.convas.io.

Elassandra = Elasticsearch + Apache Cassandra

Run spark calculations from Ammonite

Spark SQL index for Parquet tables

Spark 2.0 Python Machine Learning examples

Universalizando o acesso a dados no Brasil. Docs: https://basedosdados.github.io/mais/

Hands video tracker using the Tensorflow Object Detection API and Faster RCNN model. The data used is the Hand Dataset from University of Oxford.

🐍 Quick reference guide to common patterns & functions in PySpark.

A framework for writing Spark 2.x applications in a pretty way

A service proxy that provides API management capabilities using Google Service Infrastructure.

Webex Bot SDK for Node.js (deprecated in favor of https://github.com/webex/webex-bot-node-framework)

Sample cloud-native application with 10 microservices showcasing Kubernetes, Istio, gRPC and OpenCensus.

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Load data from Kafka to any data warehouse

Custom state store providers for Apache Spark

Machine Learning Platform and Recommendation Engine built on Kubernetes

Spark job for dependency links

Visualize data using relative ordering

Adventures using keras on Google's Cloud ML Engine

Google Cloud Tools for Visual Studio

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

A simple Spark-powered ETL framework that just works 🍺

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

A Tutorial for Serving Tensorflow Models using Kubernetes

Spark RDD with Lucene's query and entity linkage capabilities

Apache Spark Website

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

List of Data Science Cheatsheets to rule the world

Boiler plate framework to use Spark and ZIO together.

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Spark Terasort

"Sentiment analysis" on a live Twitter feed with Apache Spark and Apache Bahir

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

A collection of open-sourced freeswitch modules that I use in various drachtio applications

A luigi powered analytics / warehouse stack

Run Sonatype Nexus Repository Manager OSS on top of Kubernetes (GKE). Includes instructions for automated backups (GCS) and day-to-day usage.

This project is archived, but the idea of Terrastack lives on in the Terraform CDK. - https://github.com/hashicorp/terraform-cdk

GCP Variant Transforms

LINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.

四川大学拓思爱诺用户session行为数据离线分析项目

Data science and Big Data with Python

大数据入门指南 ⭐

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake

An improved implementation of the classical feature selection method: minimum Redundancy and Maximum Relevance (mRMR).

Embulk output plugin to load/insert data into Google BigQuery

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Open-source IoT Platform - Device management, data collection, processing and visualization.

Apache Spark and Apache Kafka integration example

☁️ Go API for open cloud

A Scala kernel for Jupyter