All Projects → JuliaData → Arrow.jl

JuliaData / Arrow.jl

Licence: other
Pure Julia implementation of the apache arrow data format (https://arrow.apache.org/)

Programming Languages

julia
2034 projects

Labels

Projects that are alternatives of or similar to Arrow.jl

polars
Fast multi-threaded DataFrame library in Rust | Python | Node.js
Stars: ✭ 6,368 (+6821.74%)
Mutual labels:  arrow
Sketch Connection Flow Arrows
Plugin for generating easy to use connection flow arrows in Sketch
Stars: ✭ 275 (+198.91%)
Mutual labels:  arrow
React Archer
🏹 Draw arrows between React elements 🖋
Stars: ✭ 666 (+623.91%)
Mutual labels:  arrow
vinum
Vinum is a SQL processor for Python, designed for data analysis workflows and in-memory analytics.
Stars: ✭ 57 (-38.04%)
Mutual labels:  arrow
is-arrow-function
Determine if a function is an ES6 arrow function or not.
Stars: ✭ 20 (-78.26%)
Mutual labels:  arrow
Arrow
🏹 Parse JSON with style
Stars: ✭ 355 (+285.87%)
Mutual labels:  arrow
arrow-datafusion
Apache Arrow DataFusion SQL Query Engine
Stars: ✭ 2,360 (+2465.22%)
Mutual labels:  arrow
Arrow
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
Stars: ✭ 8,828 (+9495.65%)
Mutual labels:  arrow
Roapi
Create full-fledged APIs for static datasets without writing a single line of code.
Stars: ✭ 253 (+175%)
Mutual labels:  arrow
Datafusion
DataFusion has now been donated to the Apache Arrow project
Stars: ✭ 611 (+564.13%)
Mutual labels:  arrow
streamlit-vega-lite
A Streamlit component to render interactive Vega, Vega-Lite, and Altair visualizations and access the selected data from Python
Stars: ✭ 59 (-35.87%)
Mutual labels:  arrow
Feather.jl
Read and write feather files in pure Julia
Stars: ✭ 104 (+13.04%)
Mutual labels:  arrow
Cudf
cuDF - GPU DataFrame Library
Stars: ✭ 4,370 (+4650%)
Mutual labels:  arrow
arrow-fx
Λrrow Fx is part of Λrrow, a functional companion to Kotlin's Standard Library
Stars: ✭ 64 (-30.43%)
Mutual labels:  arrow
Android Expandicon
Nice and simple customizable implementation of Google style up/down expand arrow.
Stars: ✭ 871 (+846.74%)
Mutual labels:  arrow
arrow-site
Mirror of Apache Arrow site
Stars: ✭ 16 (-82.61%)
Mutual labels:  arrow
Arrows
Arrows is an animated custom view to give feedback about your UI sliding panels.
Stars: ✭ 338 (+267.39%)
Mutual labels:  arrow
Open Arrow
Open Arrow is an open-source font that contains 112 arrow symbols from U+2190 to U+21ff
Stars: ✭ 89 (-3.26%)
Mutual labels:  arrow
Pre Short Closures
Stars: ✭ 36 (-60.87%)
Mutual labels:  arrow
Arrow
Λrrow - Functional companion to Kotlin's Standard Library
Stars: ✭ 4,771 (+5085.87%)
Mutual labels:  arrow

Arrow

docs CI codecov

deps version pkgeval

This is a pure Julia implementation of the Apache Arrow data standard. This package provides Julia AbstractVector objects for referencing data that conforms to the Arrow standard. This allows users to seamlessly interface Arrow formatted data with a great deal of existing Julia code.

Please see this document for a description of the Arrow memory layout.

Installation

The package can be installed by typing in the following in a Julia REPL:

julia> using Pkg; Pkg.add("Arrow")

or to use the official-apache code that follows the official apache release process, you can do:

julia> using Pkg; Pkg.add(url="https://github.com/apache/arrow", subdir="julia/Arrow.jl")

Difference between this code and the apache/arrow/julia/Arrow repository

The code in the apache/arrow repository is officially part of the apache/arrow project and as such follows the regulated release cadence of the entire project, following standard community voting protocols. The JuliaData/Arrow.jl repository can be viewed as a sort of "dev" or "latest" branch of this code that may release more frequently, but without following official apache release guidelines. The two repositories are synced, however, so any bugfix patches in JuliaData will be upstreamed to apache/arrow for each release.

Format Support

This implementation supports the 1.0 version of the specification, including support for:

  • All primitive data types
  • All nested data types
  • Dictionary encodings and messages
  • Extension types
  • Streaming, file, record batch, and replacement and isdelta dictionary messages

It currently doesn't include support for:

  • Tensors or sparse tensors
  • Flight RPC
  • C data interface

Third-party data formats:

  • csv and parquet support via the existing CSV.jl and Parquet.jl packages
  • Other Tables.jl-compatible packages automatically supported (DataFrames.jl, JSONTables.jl, JuliaDB.jl, SQLite.jl, MySQL.jl, JDBC.jl, ODBC.jl, XLSX.jl, etc.)
  • No current Julia packages support ORC or Avro data formats

See the full documentation for details on reading and writing arrow data.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].