stanford-futuredata / Sparser
Licence: bsd-3-clause
Sparser: Raw Filtering for Faster Analytics over Raw Data
Stars: ✭ 416
Programming Languages
c
50402 projects - #5 most used programming language
sparser
This code base implements Sparser, raw filtering for faster analytics over raw data. Sparser can parse JSON, Avro, and Parquet data up to 22x faster than the state of the art. For more details, check out our paper published at VLDB 2018.
See the demo-repl directory for a brief example. To run it:
# update rapidjson submodule
git submodule init
git submodule update
cd demo-repl
make
./bench /path/to/large/file.json
Then enter 1 at the Sparser> prompt.
Sparser itself is just a header file and only depends on standard C libraries available on most systems.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].