ScioA Scala API for Apache Beam and Google Cloud Dataflow.
Stars: ✭ 2,247 (+2240.63%)
Airflow ToolkitAny Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥 >> [ 🚀, 🚢 ]
Stars: ✭ 51 (-46.87%)
polygon-etlETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
Stars: ✭ 53 (-44.79%)
Ethereum EtlPython scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+895.83%)
Datashare ToolkitDIY commercial datasets on Google Cloud Platform
Stars: ✭ 41 (-57.29%)
primrosePrimrose modeling framework for simple production models
Stars: ✭ 33 (-65.62%)
iris3An upgraded and improved version of the Iris automatic GCP-labeling project
Stars: ✭ 38 (-60.42%)
etlflowEtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.
Stars: ✭ 38 (-60.42%)
bigquery-to-datastoreExport a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
Stars: ✭ 56 (-41.67%)
DataflowTemplatesConvenient Dataflow pipelines for transforming data between cloud data sources
Stars: ✭ 22 (-77.08%)
TesseractA set of libraries for rapidly developing Pipeline driven micro/macroservices.
Stars: ✭ 20 (-79.17%)
dataflow-fsi-exampleUsing Google Cloud, this project is an example of how to detect anomalies in financial, technical indicators by modeling their expected distribution and thus inform when the Relative Strength Indicator (RSI) is unreliable.
Stars: ✭ 26 (-72.92%)
gcp-mlGoogle Cloud Platform Machine Learning Samples
Stars: ✭ 31 (-67.71%)
astroAstro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (-17.71%)
Ethereum Etl AirflowAirflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. What datasets do you want to be added to Ethereum ETL? Vote here: https://blockchain-etl.convas.io.
Stars: ✭ 89 (-7.29%)
argonCampaign Manager 360 and Display & Video 360 Reports to BigQuery connector
Stars: ✭ 31 (-67.71%)
Bitcoin EtlETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 174 (+81.25%)
bigquery-data-lineageReference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Stars: ✭ 112 (+16.67%)
GCPEditorProAmazingly fast and simple ground control points interface. ◎
Stars: ✭ 33 (-65.62%)
ipld-explorer-cli🔎 Explore the IPLD directed acyclic graph with your keyboard
Stars: ✭ 22 (-77.08%)
SwiftCurrentA library for managing complex workflows in Swift
Stars: ✭ 286 (+197.92%)
pubsub clisuper handy google cloud Pub/Sub CLI
Stars: ✭ 32 (-66.67%)
gcp-serviceaccount-controllerThis is a controller to automatically create gcp service accounts an save them into kubernetes secrets
Stars: ✭ 14 (-85.42%)
recent-activityAdd your recent activity to your profile readme!
Stars: ✭ 87 (-9.37%)
sdkHome of the JupiterOne SDK
Stars: ✭ 21 (-78.12%)
logparserEasy parsing of Apache HTTPD and NGINX access logs with Java, Hadoop, Hive, Pig, Flink, Beam, Storm, Drill, ...
Stars: ✭ 139 (+44.79%)
Everything-TechA collection of online resources to help you on your Tech journey.
Stars: ✭ 396 (+312.5%)
gdooGdoo是基于PHP Laravel框架的开源OA/协同办公平台,包含销售管理、日程安排,进销存、数据分析,强大的自定义能力。改进销售管理模式,提升企业执行效率
Stars: ✭ 111 (+15.63%)
webping.cloudTest your network latency to the nearest cloud provider in AWS, Azure, GCP, Alibaba Cloud, IBM Cloud, Oracle Cloud and DigitalOcean directly from your browser.
Stars: ✭ 60 (-37.5%)
spark-on-k8s-gcp-examplesExample Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
Stars: ✭ 36 (-62.5%)
spacesuitAPI Gateway with URL remapping
Stars: ✭ 19 (-80.21%)
ENIGMAThe ENIGMA Toolbox is an open-source repository for accessing 100+ ENIGMA statistical maps, visualizing cortical and subcortical surface data, and relating neuroimaging findings to micro- and macroscale brain organization. 🤠
Stars: ✭ 66 (-31.25%)
cliThe universal GraphQL API and CSPM tool for AWS, Azure, GCP, K8s, and tencent.
Stars: ✭ 811 (+744.79%)
scattersphereJob Coordination API for Tasks
Stars: ✭ 30 (-68.75%)
cliPolyaxon Core Client & CLI to streamline MLOps
Stars: ✭ 18 (-81.25%)
collie-cliCollie CLI allows you to manage your AWS, Azure & GCP cloud landscape through a single view.
Stars: ✭ 152 (+58.33%)
tfeelTwitter sentiment analysis
Stars: ✭ 22 (-77.08%)
sql-repository[PHP 7] SQL Repository implementation
Stars: ✭ 37 (-61.46%)
steep⤴️ Steep Workflow Management System – Run scientific workflows in the Cloud
Stars: ✭ 30 (-68.75%)
cookbookVueJS + NodeJS Evergreen Cookbook
Stars: ✭ 440 (+358.33%)
runiacRun IaC Anywhere With Ease
Stars: ✭ 18 (-81.25%)
cloud-pricing-apiGraphQL API for cloud pricing. Contains over 3M public prices from AWS, Azure and GCP. Self-updates prices via an automated weekly job.
Stars: ✭ 281 (+192.71%)
jifaceA Clojure-idiomatic wrapper around Erlang's JInterface
Stars: ✭ 27 (-71.87%)
learning-hadoop-and-sparkCompanion to Learning Hadoop and Learning Spark courses on Linked In Learning
Stars: ✭ 146 (+52.08%)
xarray-beamDistributed Xarray with Apache Beam
Stars: ✭ 83 (-13.54%)
TanglestashIOTA meets BitTorrent: An algorithm to persist any file onto the tangle of IOTA
Stars: ✭ 46 (-52.08%)
devrelCommon solutions and tools developed for Apigee
Stars: ✭ 121 (+26.04%)
batching-toposortEfficiently sort interdependent tasks into a sequence of concurrently-executable batches
Stars: ✭ 21 (-78.12%)
Networking-and-KubernetesThis is the code repo for Networking and Kubernetes: A Layered Approach. https://learning.oreilly.com/library/view/networking-and-kubernetes/9781492081647/
Stars: ✭ 103 (+7.29%)
dolphinnextA graphical user interface for distributed data processing of high throughput genomics
Stars: ✭ 92 (-4.17%)