All Projects → RiveryIO → rivery_cli

RiveryIO / rivery_cli

Licence: other
Rivery CLI

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to rivery cli

versatile-data-kit
Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.
Stars: ✭ 144 (+800%)
Mutual labels:  etl, dataops, elt, data-pipelines
beneath
Beneath is a serverless real-time data platform ⚡️
Stars: ✭ 65 (+306.25%)
Mutual labels:  etl, dataops, data-pipelines
AirflowDataPipeline
Example of an ETL Pipeline using Airflow
Stars: ✭ 24 (+50%)
Mutual labels:  etl, data-pipelines
astro
Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (+393.75%)
Mutual labels:  etl, elt
dbd
dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
Stars: ✭ 30 (+87.5%)
Mutual labels:  etl, elt
Airbyte
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Stars: ✭ 4,919 (+30643.75%)
Mutual labels:  etl, elt
arthur-redshift-etl
ELT Code for your Data Warehouse
Stars: ✭ 22 (+37.5%)
Mutual labels:  etl, elt
wikirepo
Python based Wikidata framework for easy dataframe extraction
Stars: ✭ 33 (+106.25%)
Mutual labels:  etl, elt
Marklogic Data Hub
The MarkLogic Data Hub: documentation ==>
Stars: ✭ 113 (+606.25%)
Mutual labels:  etl, database-management
Dagster
An orchestration platform for the development, production, and observation of data assets.
Stars: ✭ 4,099 (+25518.75%)
Mutual labels:  etl, data-pipelines
AirflowETL
Blog post on ETL pipelines with Airflow
Stars: ✭ 20 (+25%)
Mutual labels:  etl, data-pipeline
datalake-etl-pipeline
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (+143.75%)
Mutual labels:  etl, data-pipeline
docker-omnidb
OmniDB installed into a Docker container
Stars: ✭ 30 (+87.5%)
Mutual labels:  database-management
mydataharbor
🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步,主要定位是为实时交易系统服务,亦可用于大数据的数据同步(ETL领域)。
Stars: ✭ 28 (+75%)
Mutual labels:  etl
iridium
💎 Growing collection of VS Code extensions with a fancy name
Stars: ✭ 39 (+143.75%)
Mutual labels:  database-management
maxwell-sink
consume maxwell generated message from kafka,export it to another mysql.
Stars: ✭ 16 (+0%)
Mutual labels:  etl
persistity
A persistence framework for game developers
Stars: ✭ 34 (+112.5%)
Mutual labels:  etl
Musical-World
DBMS Mini Project that basically designed for online music player
Stars: ✭ 59 (+268.75%)
Mutual labels:  database-management
PDAP-Scrapers
Code relating to scraping public police data.
Stars: ✭ 72 (+350%)
Mutual labels:  etl
DataBridge.NET
Configurable data bridge for permanent ETL jobs
Stars: ✭ 16 (+0%)
Mutual labels:  etl

Overview

Rivery CLI is an amazing way to manage, deploy, run and edit rivers inside Rivery. The rivers are configured only by .yaml files, as a configuration files, makes this CLI as a basic of Infrastructure As Code (IaC) methodology.

In order to start using the tool, go to the Getting Started page.

Getting started

Requirements

  1. You must have Python 3.6 or later installed. For installation instructions, see the Downloading Python page in Python's Beginner Guide.

  2. An API Token with the following scopes:

    * me:list
    * river:execute
    * river:edit
    * river:list
    * river:delete
    * connection:edit
    * connection:list
    * connection:delete

In order to create a new API token, please refer to our docs

Install

Install Rivery CLI, by using the next command:

pip install -U rivery-cli

Initiate a new project

in order to start new project:

  1. create new project directory, for example in linux base OS:
> mkdir /home/my-project

or in windows:

> mkdir c:\my-project
  1. Go into the my-project directory you've created: cd my-project
  2. run the next command and choose your project name.
> rivery init

Create the first profile

Rivery CLI store defaults and credentials under an "entity" called profile.

Each profile has its name and the configurations under it. Due to every API token refers to specific account+environment inside your Rivery console, and every account+environment pair has its own credentials, it is likely you'll have a profile per each account+environment coupling.

For creating your first profile use the next command:

> rivery configure

And Follow the prompt:

> Please enter your token. (******): ...
> Choose your Region () [...]: ...
> Thank you for entering auth credentials. 
> Please check your profile at: ~/.rivery/auth

And you're good to go!

Issues and Feature Requests

Rivery CLI and IaC engine is fully open source dir. We're getting in warm welcome any issues/features submitted to our end, and encourage the community to contribute in the solution. Please don't hesitate to add any issues/feature request using the repo's Issues section.

Getting start With Rivery

You can check out our product docs at https://docs.rivery.io in order to getting started.

Full documentation

You may find here the full documentation.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].