All Projects → rsheftel → raccoon

rsheftel / raccoon

Licence: MIT License
Python DataFrame with fast insert and appends

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects

Projects that are alternatives of or similar to raccoon

Panthera
Data-frames & arrays on Clojure
Stars: ✭ 168 (+162.5%)
Mutual labels:  pandas, dataframe
Eland
Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
Stars: ✭ 235 (+267.19%)
Mutual labels:  pandas, dataframe
Ditching Excel For Python
Functionalities in Excel translated to Python
Stars: ✭ 172 (+168.75%)
Mutual labels:  pandas, dataframe
Jardin
A pandas.DataFrame-based ORM.
Stars: ✭ 81 (+26.56%)
Mutual labels:  pandas, dataframe
hamilton
A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.
Stars: ✭ 612 (+856.25%)
Mutual labels:  pandas, dataframe
Danfojs
danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
Stars: ✭ 1,304 (+1937.5%)
Mutual labels:  pandas, dataframe
Pandasgui
PandasGUI is a GUI for viewing, plotting and analyzing Pandas DataFrames.
Stars: ✭ 2,495 (+3798.44%)
Mutual labels:  pandas, dataframe
Dataframe
C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types, continuous memory storage, and no pointers are involved
Stars: ✭ 828 (+1193.75%)
Mutual labels:  pandas, dataframe
pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
Stars: ✭ 970 (+1415.63%)
Mutual labels:  pandas, dataframe
Styleframe
A library that wraps pandas and openpyxl and allows easy styling of dataframes in excel
Stars: ✭ 252 (+293.75%)
Mutual labels:  pandas, dataframe
Pandas Ta
Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 130+ Indicators
Stars: ✭ 962 (+1403.13%)
Mutual labels:  pandas, dataframe
cognipy
In-memory Graph Database and Knowledge Graph with Natural Language Interface, compatible with Pandas
Stars: ✭ 31 (-51.56%)
Mutual labels:  pandas, dataframe
Boltzmannclean
Fill missing values in Pandas DataFrames using Restricted Boltzmann Machines
Stars: ✭ 23 (-64.06%)
Mutual labels:  pandas, dataframe
Pandahouse
Pandas interface for Clickhouse database
Stars: ✭ 126 (+96.88%)
Mutual labels:  pandas, dataframe
Foxcross
AsyncIO serving for data science models
Stars: ✭ 18 (-71.87%)
Mutual labels:  pandas, dataframe
Mars
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
Stars: ✭ 2,308 (+3506.25%)
Mutual labels:  pandas, dataframe
Pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
Stars: ✭ 647 (+910.94%)
Mutual labels:  pandas, dataframe
Modin
Modin: Speed up your Pandas workflows by changing a single line of code
Stars: ✭ 6,639 (+10273.44%)
Mutual labels:  pandas, dataframe
Koalas
Koalas: pandas API on Apache Spark
Stars: ✭ 3,044 (+4656.25%)
Mutual labels:  pandas, dataframe
saddle
SADDLE: Scala Data Library
Stars: ✭ 23 (-64.06%)
Mutual labels:  pandas, dataframe

raccoon

Python DataFrame with fast insert and appends

https://travis-ci.org/rsheftel/raccoon.svg?branch=master https://coveralls.io/repos/github/rsheftel/raccoon/badge.svg?branch=master Documentation Status

Documentation

http://raccoon.readthedocs.io/en/latest/

Source location

Hosted on GitHub: https://github.com/rsheftel/raccoon

Overview

Raccoon is a lightweight DataFrame and Series implementation inspired by the phenomenal Pandas package for the one use case where Pandas is known to be sub-optimal: DataFrames and Series that grow in size by adding rows frequently in the code. Additionally Raccoon DataFrames and Series can be parametrized to be sorted so that additions to the DataFrame keep the index in sorted order to speed inserts and retrievals.

A simple speed comparison of Raccoon vs Pandas for typical functionality is located in the documentation.

Inspiration

Pandas DataFrames and Series are excellent multi-purpose data structures for data management and analysis. One of the use cases I had was to use DataFrames as a type of in-memory database table. The issue was that this required lots of growing the number rows of the DataFrame, something that is known to be slow in Pandas. The reason it is slow in Pandas is that the underlying data structure is numpy which does a complete copy of the data when the size of the array grows.

Functionality

Raccoon implements what is needed to use the DataFrame as an in memory store of index and column data structure supporting simple and tuple indexes to mimic the hierarchical indexes of Pandas. The methods included are primarily about setting values of the data frame, growing and appending the data frame and getting values from the data frame. The raccoon DataFrame is not intended for math operations like pandas and only limited basic math methods are included.

Underlying Data Structure

Raccoon uses the standard built in lists as its default underlying data structure. There is an option on object construction to use any other drop-in replacement for lists. For example the fast blist package http://stutzbachenterprises.com/blist/ could be used as a list replacement for the underlying data structure.

Why Raccoon?

According to wikipedia some scientists believe the panda is related to the raccoon

Contributing

Contribution in the form of pull requests are welcome. Use pytest to run the test suite. Be sure any new additions come with accompanying tests.

Future

This package serves the needs it was originally created for. Any future additions by myself will be driven by my own needs, but it is completely open source so I encourage anyone to add on and expand.

My hope is that one day Pandas solves the speed problem with growing DataFrames and this package becomes obsolete.

Python Version

Raccoon requires Python 3.4 or greater. Python 2.7 support was eliminated as of version 3.0. If you need to use raccoon with Python 2.7 use any version less than 3.0

Helper scripts

There is helper function to generate these docs from the source code. On windows cd into the docs directory and execute make_docs.bat from the command line. To run the test coverage report run the coverage.sh script.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].