689 Open source projects that are alternatives of or similar to Spark Bigquery Connector

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

☁️ nodejs kafka connect connector for Google BigQuery

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

An upgraded and improved version of the Iris automatic GCP-labeling project

The simplest tool to manage views of BigQuery.

📊 Cube — Open-Source Analytics API for Building Data Apps

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

A Scala API for Apache Beam and Google Cloud Dataflow.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

A collection of Magnolia add-on modules

Distributed Deep learning with Keras & Spark

Kinesis Connector for Structured Streaming

Production Ready Data Integration Product, documentation：

Two-day workshop that covers how to use R to interact databases and Spark

Common solutions and tools developed by Google Cloud's Professional Services team

Google Cloud Client Library for Java

A distributed data processing framework in Haskell.

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

A pandas-like deferred expression system, with first-class SQL support

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

Ruby runtime for Google Cloud Platform

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

A Team Management app for creating tournaments and games for various sports

Get up and running with Jenkins on Google Kubernetes Engine

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

In this workshop, you'll learn how to install and configure Istio, an open source framework for connecting, securing, and managing microservices, on Google Kubernetes Engine, Google’s hosted Kubernetes product. You will also deploy an Istio-enabled multi-service application

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Elassandra = Elasticsearch + Apache Cassandra

Spark SQL index for Parquet tables

Universalizando o acesso a dados no Brasil. Docs: https://basedosdados.github.io/mais/

🐍 Quick reference guide to common patterns & functions in PySpark.

A service proxy that provides API management capabilities using Google Service Infrastructure.

Sample cloud-native application with 10 microservices showcasing Kubernetes, Istio, gRPC and OpenCensus.

Load data from Kafka to any data warehouse

Machine Learning Platform and Recommendation Engine built on Kubernetes

Adventures using keras on Google's Cloud ML Engine

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Spark RDD with Lucene's query and entity linkage capabilities

Source code for James Lee's Aparch Spark with Java course

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Boiler plate framework to use Spark and ZIO together.

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Minimal and free Kubernetes distribution with Terraform

Spark Terasort

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

FFM (Field-Awared Factorization Machine) on Spark

Run Sonatype Nexus Repository Manager OSS on top of Kubernetes (GKE). Includes instructions for automated backups (GCS) and day-to-day usage.

pyspark🍒🥭 is delicious，just eat it!😋😋

extremely distributed machine learning

JHipster Microservices Example using Spring Cloud, Spring Boot, Angular, Docker, and Kubernetes

GCP Variant Transforms