All Projects → prestodb → Presto Go Client

prestodb / Presto Go Client

Licence: apache-2.0
A Presto client for the Go programming language.

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Projects that are alternatives of or similar to Presto Go Client

Trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Stars: ✭ 4,581 (+2403.28%)
Mutual labels:  sql, big-data, presto
Maha
A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.
Stars: ✭ 101 (-44.81%)
Mutual labels:  sql, big-data, presto
Presto
The official home of the Presto distributed SQL query engine for big data
Stars: ✭ 12,957 (+6980.33%)
Mutual labels:  sql, big-data, presto
Presto Ethereum
Presto Ethereum Connector -- SQL on Ethereum
Stars: ✭ 450 (+145.9%)
Mutual labels:  sql, presto
Metorikku
A simplified, lightweight ETL Framework based on Apache Spark
Stars: ✭ 361 (+97.27%)
Mutual labels:  sql, big-data
Hive
Apache Hive
Stars: ✭ 4,031 (+2102.73%)
Mutual labels:  sql, big-data
bandar-log
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Stars: ✭ 20 (-89.07%)
Mutual labels:  big-data, presto
Phoenix
Mirror of Apache Phoenix
Stars: ✭ 867 (+373.77%)
Mutual labels:  sql, big-data
Beam
Apache Beam is a unified programming model for Batch and Streaming
Stars: ✭ 5,149 (+2713.66%)
Mutual labels:  sql, big-data
Spark
Apache Spark - A unified analytics engine for large-scale data processing
Stars: ✭ 31,618 (+17177.6%)
Mutual labels:  sql, big-data
Docker Trino Cluster
Multiple node presto cluster on docker container
Stars: ✭ 81 (-55.74%)
Mutual labels:  sql, presto
Calcite Avatica
Mirror of Apache Calcite - Avatica
Stars: ✭ 130 (-28.96%)
Mutual labels:  sql, big-data
Sylph
Stream computing platform for bigdata
Stars: ✭ 362 (+97.81%)
Mutual labels:  sql, big-data
Crate
CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.
Stars: ✭ 3,254 (+1678.14%)
Mutual labels:  sql, big-data
Ignite
Apache Ignite
Stars: ✭ 4,027 (+2100.55%)
Mutual labels:  sql, big-data
Bandar Log
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Stars: ✭ 19 (-89.62%)
Mutual labels:  big-data, presto
Clickhouse
ClickHouse® is a free analytics DBMS for big data
Stars: ✭ 21,089 (+11424.04%)
Mutual labels:  sql, big-data
hadoop-data-ingestion-tool
OLAP and ETL of Big Data
Stars: ✭ 17 (-90.71%)
Mutual labels:  big-data, presto
Spark Website
Apache Spark Website
Stars: ✭ 75 (-59.02%)
Mutual labels:  sql, big-data
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-18.03%)
Mutual labels:  sql, big-data

Presto client

A Presto client for the Go programming language.

Build Status GoDoc

Features

  • Native Go implementation
  • Connections over HTTP or HTTPS
  • HTTP Basic and Kerberos authentication
  • Per-query user information for access control
  • Support custom HTTP client (tunable conn pools, timeouts, TLS)
  • Supports conversion from Presto to native Go data types
    • string, sql.NullString
    • int64, presto.NullInt64
    • float64, presto.NullFloat64
    • map, presto.NullMap
    • time.Time, presto.NullTime
    • Up to 3-dimensional arrays to Go slices, of any supported type

Requirements

  • Go 1.8 or newer
  • Presto 0.16x or newer

Installation

You need a working environment with Go installed and $GOPATH set.

Download and install presto database/sql driver:

go get github.com/prestodb/presto-go-client/presto

Make sure you have Git installed and in your $PATH.

Usage

This Presto client is an implementation of Go's database/sql/driver interface. In order to use it, you need to import the package and use the database/sql API then.

Only read operations are supported, such as SHOW and SELECT.

Use presto as driverName and a valid DSN as the dataSourceName.

Example:

import "database/sql"
import _ "github.com/prestodb/presto-go-client/presto"

dsn := "http://[email protected]:8080?catalog=default&schema=test"
db, err := sql.Open("presto", dsn)

Authentication

Both HTTP Basic and Kerberos authentication are supported.

HTTP Basic authentication

If the DSN contains a password, the client enables HTTP Basic authentication by setting the Authorization header in every request to presto.

HTTP Basic authentication is only supported on encrypted connections over HTTPS.

Kerberos authentication

This driver supports Kerberos authentication by setting up the Kerberos fields in the Config struct.

Please refer to the Coordinator Kerberos Authentication for server-side configuration.

System access control and per-query user information

It's possible to pass user information to presto, different from the principal used to authenticate to the coordinator. See the System Access Control documentation for details.

In order to pass user information in queries to presto, you have to add a NamedArg to the query parameters where the key is X-Presto-User. This parameter is used by the driver to inform presto about the user executing the query regardless of the authentication method for the actual connection, and its value is NOT passed to the query.

Example:

db.Query("SELECT * FROM foobar WHERE id=?", 1, sql.Named("X-Presto-User", string("Alice")))

The position of the X-Presto-User NamedArg is irrelevant and does not affect the query in any way.

DSN (Data Source Name)

The Data Source Name is a URL with a mandatory username, and optional query string parameters that are supported by this driver, in the following format:

http[s]://user[:pass]@host[:port][?parameters]

The easiest way to build your DSN is by using the Config.FormatDSN helper function.

The driver supports both HTTP and HTTPS. If you use HTTPS it's recommended that you also provide a custom http.Client that can validate (or skip) the security checks of the server certificate, and/or to configure TLS client authentication.

Parameters

Parameters are case-sensitive

Refer to the Presto Concepts documentation for more information.

source
Type:           string
Valid values:   string describing the source of the connection to presto
Default:        empty

The source parameter is optional, but if used, can help presto admins troubleshoot queries and trace them back to the original client.

catalog
Type:           string
Valid values:   the name of a catalog configured in the presto server
Default:        empty

The catalog parameter defines the presto catalog where schemas exist to organize tables.

schema
Type:           string
Valid values:   the name of an existing schema in the catalog
Default:        empty

The schema parameter defines the presto schema where tables exist. This is also known as namespace in some environments.

session_properties
Type:           string
Valid values:   comma-separated list of key=value session properties
Default:        empty

The session_properties parameter must contain valid parameters accepted by the presto server. Run SHOW SESSION in presto to get the current list.

custom_client
Type:           string
Valid values:   the name of a client previously registered to the driver
Default:        empty (defaults to http.DefaultClient)

The custom_client parameter allows the use of custom http.Client for the communication with presto.

Register your custom client in the driver, then refer to it by name in the DSN, on the call to sql.Open:

foobarClient := &http.Client{
    Transport: &http.Transport{
        Proxy: http.ProxyFromEnvironment,
        DialContext: (&net.Dialer{
            Timeout:   30 * time.Second,
            KeepAlive: 30 * time.Second,
            DualStack: true,
        }).DialContext,
        MaxIdleConns:          100,
        IdleConnTimeout:       90 * time.Second,
        TLSHandshakeTimeout:   10 * time.Second,
        ExpectContinueTimeout: 1 * time.Second,
        TLSClientConfig:       &tls.Config{
        // your config here...
        },
    },
}
presto.RegisterCustomClient("foobar", foobarClient)
db, err := sql.Open("presto", "https://[email protected]:8080?custom_client=foobar")

Examples

http://[email protected]:8080?source=hello&catalog=default&schema=foobar
https://[email protected]:8443?session_properties=query_max_run_time=10m,query_priority=2

License

As described in the LICENSE file.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].