GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → taraslayshchuk → Es2csv

taraslayshchuk / Es2csv

Licence: apache-2.0
Export from an Elasticsearch into a CSV file

Programming Languages

python
139335 projects - #7 most used programming language

Labels

clielasticsearchcsvkibanaexport

Projects that are alternatives of or similar to Es2csv

Elasticsearch Cli
Command line interface for ElasticSearch
Stars: ✭ 70 (-84.95%)
Mutual labels:  cli, elasticsearch, kibana
Jsonexport
{} → 📄 it's easy to convert JSON to CSV
Stars: ✭ 208 (-55.27%)
Mutual labels:  cli, csv, export
elastic-query-export
🚚 Export Data from ElasticSearch to CSV/JSON using a Lucene Query (e.g. from Kibana) or a raw JSON Query string
Stars: ✭ 56 (-87.96%)
Mutual labels:  export, kibana, csv
Cryptotracker
A complete open source system for tracking and visualizing cryptocurrency price movements on leading exchanges
Stars: ✭ 336 (-27.74%)
Mutual labels:  elasticsearch, kibana
Exporttools.bundle
Export tools for Plex
Stars: ✭ 294 (-36.77%)
Mutual labels:  csv, export
Elasticsearch loader
A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch
Stars: ✭ 300 (-35.48%)
Mutual labels:  csv, elasticsearch
K8s Tew
Kubernetes - The Easier Way
Stars: ✭ 269 (-42.15%)
Mutual labels:  elasticsearch, kibana
Elk Docker
Docker configuration for ELK monitoring stack with Curator and Beats data shippers support
Stars: ✭ 342 (-26.45%)
Mutual labels:  elasticsearch, kibana
Kbn network
Network Plugin for Kibana
Stars: ✭ 339 (-27.1%)
Mutual labels:  elasticsearch, kibana
J
❌ Multi-format spreadsheet CLI (now merged in http://github.com/sheetjs/js-xlsx )
Stars: ✭ 343 (-26.24%)
Mutual labels:  cli, csv
Visidata
A terminal spreadsheet multitool for discovering and arranging data
Stars: ✭ 4,606 (+890.54%)
Mutual labels:  cli, csv
Kibana
Your window into the Elastic Stack
Stars: ✭ 16,820 (+3517.2%)
Mutual labels:  elasticsearch, kibana
Ansible Elk
📊 Ansible playbook for setting up an ELK/EFK stack and clients.
Stars: ✭ 284 (-38.92%)
Mutual labels:  elasticsearch, kibana
Sysmonsearch
Investigate suspicious activity by visualizing Sysmon's event log
Stars: ✭ 302 (-35.05%)
Mutual labels:  elasticsearch, kibana
Csvkeychain
Import/export between Apple Keychain.app and plain CSV file.
Stars: ✭ 281 (-39.57%)
Mutual labels:  csv, export
Anon
A UNIX Command To Anonymise Data
Stars: ✭ 341 (-26.67%)
Mutual labels:  cli, csv
Abc
Power of appbase.io via CLI, with nifty imports from your favorite data sources
Stars: ✭ 375 (-19.35%)
Mutual labels:  cli, elasticsearch
Exporter
Lightweight Exporter library
Stars: ✭ 384 (-17.42%)
Mutual labels:  csv, export
Pfelk
pfSense/OPNsense + ELK
Stars: ✭ 417 (-10.32%)
Mutual labels:  elasticsearch, kibana
Helk
The Hunting ELK
Stars: ✭ 3,097 (+566.02%)
Mutual labels:  elasticsearch, kibana
View All Similar Projects ➔

====== es2csv

A CLI tool for exporting data from Elasticsearch into a CSV file

Command line utility, written in Python, for querying Elasticsearch in Lucene query syntax or Query DSL syntax and exporting result as documents into a CSV file. This tool can query bulk docs in multiple indices and get only selected fields, this reduces query execution time.

Quick Look Demo

.. figure:: https://cloud.githubusercontent.com/assets/7491121/12016825/59eb5f82-ad58-11e5-81eb-871a49e39c37.gif

Requirements

| This tool should be used with Elasticsearch 5.x version, for older version please check 2.x release <https://github.com/taraslayshchuk/es2csv/tree/2.x>. | You also need Python 2.7.x <https://www.python.org/downloads/> and pip <https://pip.pypa.io/en/stable/installing/>_.

Installation

From source:

.. code-block:: bash

$ pip install git+https://github.com/taraslayshchuk/es2csv.git

From pip:

.. code-block:: bash

$ pip install es2csv

Usage

.. code-block:: bash

$ es2csv [-h] -q QUERY [-u URL] [-a AUTH] [-i INDEX [INDEX ...]] [-D DOC_TYPE [DOC_TYPE ...]] [-t TAGS [TAGS ...]] -o FILE [-f FIELDS [FIELDS ...]] [-S FIELDS [FIELDS ...]] [-d DELIMITER] [-m INTEGER] [-s INTEGER] [-k] [-r] [-e] [--verify-certs] [--ca-certs CA_CERTS] [--client-cert CLIENT_CERT] [--client-key CLIENT_KEY] [-v] [--debug]

Arguments: -q, --query QUERY Query string in Lucene syntax. [required] -o, --output-file FILE CSV file location. [required] -u, --url URL Elasticsearch host URL. Default is http://localhost:9200. -a, --auth Elasticsearch basic authentication in the form of username:password. -i, --index-prefixes INDEX [INDEX ...] Index name prefix(es). Default is ['logstash-*']. -D, --doc-types DOC_TYPE [DOC_TYPE ...] Document type(s). -t, --tags TAGS [TAGS ...] Query tags. -f, --fields FIELDS [FIELDS ...] List of selected fields in output. Default is ['_all']. -S, --sort FIELDS [FIELDS ...] List of : pairs to sort on. Default is []. -d, --delimiter DELIMITER Delimiter to use in CSV file. Default is ",". -m, --max INTEGER Maximum number of results to return. Default is 0. -s, --scroll-size INTEGER Scroll size for each batch of results. Default is 100. -k, --kibana-nested Format nested fields in Kibana style. -r, --raw-query Switch query format in the Query DSL. -e, --meta-fields Add meta-fields in output. --verify-certs Verify SSL certificates. Default is False. --ca-certs CA_CERTS Location of CA bundle. --client-cert CLIENT_CERT Location of Client Auth cert. --client-key CLIENT_KEY Location of Client Cert Key. -v, --version Show version and exit. --debug Debug mode on. -h, --help show this help message and exit

[ Usage Examples <./docs/EXAMPLES.rst>_ | Release Changelog <./docs/HISTORY.rst>_ ]

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].