All Projects → y-scope → clp

y-scope / clp

Licence: Apache-2.0 license
Compressed Log Processor (CLP) is a free tool capable of compressing text logs and searching the compressed logs without decompression.

Programming Languages

C++
36643 projects - #6 most used programming language
python
139335 projects - #7 most used programming language
CMake
9771 projects
shell
77523 projects
Dockerfile
14818 projects

Projects that are alternatives of or similar to clp

paq8pxd
No description or website provided.
Stars: ✭ 55 (+12.24%)
Mutual labels:  compression
pcc geo cnn
Learning Convolutional Transforms for Point Cloud Geometry Compression
Stars: ✭ 44 (-10.2%)
Mutual labels:  compression
unzip
Tiny unzip helper class for .NET 3.5 Client Profile and Mono 2.10, written in pure C#.
Stars: ✭ 25 (-48.98%)
Mutual labels:  compression
AudioEffectDynamics
Dynamics Processor (Gate, Compressor & Limiter) for the Teensy Audio Library
Stars: ✭ 23 (-53.06%)
Mutual labels:  compression
vbz compression
VBZ compression plugin for nanopore signal data
Stars: ✭ 31 (-36.73%)
Mutual labels:  compression
DSIN
Deep Image Compression using Decoder Side Information (ECCV 2020)
Stars: ✭ 39 (-20.41%)
Mutual labels:  compression
upload-compression-plugin
Compress and decompress files on https://upload.io/
Stars: ✭ 21 (-57.14%)
Mutual labels:  compression
Perfect-Zip
Perfect Zip compression utility.
Stars: ✭ 20 (-59.18%)
Mutual labels:  compression
minibsdiff
A miniature, portable version of bsdiff.
Stars: ✭ 115 (+134.69%)
Mutual labels:  compression
http compression
🗜️ Deno HTTP compression middleware
Stars: ✭ 34 (-30.61%)
Mutual labels:  compression
zlib
Compression and decompression in the gzip and zlib formats
Stars: ✭ 32 (-34.69%)
Mutual labels:  compression
handlers
Go's HTTP handlers I use in my projects
Stars: ✭ 53 (+8.16%)
Mutual labels:  compression
LZ77-Compressor
A simplified implementation of the LZ77 compression algorithm
Stars: ✭ 70 (+42.86%)
Mutual labels:  compression
hasmin
Hasmin - A Haskell CSS Minifier
Stars: ✭ 55 (+12.24%)
Mutual labels:  compression
raisin
A simple lightweight set of implementations and bindings for compression algorithms written in Go.
Stars: ✭ 17 (-65.31%)
Mutual labels:  compression
ikeapack
Compact data serializer/packer written in Go, intended to produce a cross-language usable format.
Stars: ✭ 18 (-63.27%)
Mutual labels:  compression
JPQ
CIKM'21: JPQ substantially improves the efficiency of Dense Retrieval with 30x compression ratio, 10x CPU speedup and 2x GPU speedup.
Stars: ✭ 39 (-20.41%)
Mutual labels:  compression
srcset.sh
A command line script that generates multiple responsive versions of an image at width breakpoints -- 320,480,640,768,960,1024,1280,1440 pixels wide -- that match common Mobile and widescreen desktop/laptop viewports using Imagemagick's convert utility and outputs the needed <img/> tag
Stars: ✭ 20 (-59.18%)
Mutual labels:  compression
zpacker
very simple LZ77-based compression
Stars: ✭ 15 (-69.39%)
Mutual labels:  compression
AppThinning
Make app thinner. Help you find large files and compress png, gif, jpg, svg files. 应用程序瘦身工具,帮助你找到大文件,压缩png、gif、jpg、svg等文件。
Stars: ✭ 22 (-55.1%)
Mutual labels:  compression

CLP

Compressed Log Processor (CLP) is a tool capable of losslessly compressing text logs and searching the compressed logs without decompression. To learn more about it, you can read our paper.

Getting Started

You can download a release from the releases page or you can build the latest by using the packager.

Project Structure

CLP is currently split across a few different components in the components directory:

  • clp-py-utils contains Python utilities common to several of the other components.
  • compression-job-handler contains code to submit compression jobs to a cluster.
  • core contains code to compress uncompressed logs, decompress compressed logs, and search compressed logs.
  • job-orchestration contains code to schedule compression jobs on the cluster.
  • package-template contains the base directory structure and files of the CLP package.

Packages

The packages held by this repository are:

  1. Docker Image clp/clp-core-dependencies-x86-ubuntu-focal
    • A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Focal x86 environment
  2. Docker Image clp/clp-core-dependencies-x86-ubuntu-bionic
    • A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Bionic x86 environment
  3. Docker Image clp/clp-core-dependencies-x86-centos7.4
    • A docker image containing all the necessary dependencies to build CLP core in a Centos 7.4 x86 environment
  4. Docker Image clp/clp-execution-x86-ubuntu-focal
    • A docker image containing all the necessary dependencies to run the full CLP package in an x86 environment
  5. Docker Image clp/clp-core-x86-ubuntu-focal
    • A docker image containing CLP (clp, clg, clo, etc.) binaries built in an Ubuntu Focal x86 environment

Next Steps

This is our open-source release which we will be constantly updating with bug fixes, features, etc. If you would like a feature or want to report a bug, please file an issue and we'll be happy to engage. We also welcome any contributions!

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].