keith-turner / Ecoji
Projects that are alternatives of or similar to Ecoji
Ecoji ðĢððĶðž
Ecoji encodes data as 1024 emojis. It's base1024 with an emoji character set and it preserves sort order. This repository implements Ecoji using Go. There are links to other implementations below. Visit ecoji.io to try Ecoji in your browser.
Many have asked how Ecoji compares to base64. The short answer is that a string encoded with Ecoji will have more bytes, but fewer visible characters, than the same string encoded with base64. With Ecoji, each visible char represents 10 bits, but each character is multi-byte. With base64 each char represents 6 bits and is one byte. The following table shows encoding sha256 in different ways.
Encoding | Bytes | Characters |
---|---|---|
none | 32 | N/A |
hex | 64 | 64 |
base64 | 44 | 44 |
ecoji | 112 | 28 |
Installing
Ecoji is published on snapcraft.io and can be installed with :
sudo snap install ecoji
Usage
$ ecoji -h
usage: ecoji [OPTIONS]... [FILE]
Encode or decode data as Unicode emojis. ð
Options:
-d, --decode decode data
-w, --wrap=COLS wrap encoded lines after COLS character (default 76).
Use 0 to disable line wrapping
-h, --help Print this message
-v, --version Print version information.
Examples
Encoding:
$ echo "Base64 is so 1999, isn't there something better?" | ecoji
ððĐðĶððððŊððð―ðððąðĨððąðððŪðĩðĒðĨððļððēðĶðķðĒðĨðŪðšððļðŪðžðĶððĨīð
Decoding:
$ echo ððĐðĶððððŊððð―ðððąðĨððąðððŪðĩðĒðĨððļððēðĶðķðĒðĨðŪðšððļðŪðžðĶððĨīð | ecoji -d
Base64 is so 1999, isn't there something better?
Concatenation:
$ echo -n abc | ecoji
ððļðâ
$ echo -n 6789 | ecoji
ðĨðĪ ð ð
$ echo XY | ecoji
ðēðĄðâ
$ echo ððļðâðĨðĪ ð ððēðĄðâ | ecoji -d
abc6789XY
Making Hashes More Interesting
$ cat encode.go | openssl dgst -binary -sha1 | ecoji
ð°ððĄððķðĶ
ðĄðšðððĄðĶððððĶ
$ echo ð°ððĄððķðĶ
ðĄðšðððĄðĶððððĶ | ecoji -d | openssl base64
GhAkTyOY/Pta78KImgvofylL19M=
$ cat encode.go | openssl dgst -binary -sha1 | openssl base64
GhAkTyOY/Pta78KImgvofylL19M=
(If you want to use Ecoji for hashes, consider the dangers inherent in older systems without utf8 emoji support, different fonts, and similar emojis.)
A URL Shortener
Four base1024 emojis can represent 1 trillion unique IDs. In the example below af82dd48f7
represents a 5 byte id for a URL in a key value store like Accumulo. When someone enters the URL, the 5 byte id could be used to obtain the actual URL from the database and then redirect.
$ printf "https://ecoji.io/%s\n" $(echo af82dd48f7 | xxd -r -p | ecoji)
https://ecoji.io/ððð ð
Sorting Ecoji-Encoded Data
Data encoded with Ecoji sorts the same as the input data.
$ echo -n a | ecoji > /tmp/test.ecoji
$ echo -n ab | ecoji >> /tmp/test.ecoji
$ echo -n abc | ecoji >> /tmp/test.ecoji
$ echo -n abcd | ecoji >> /tmp/test.ecoji
$ echo -n ac | ecoji >> /tmp/test.ecoji
$ echo -n b | ecoji >> /tmp/test.ecoji
$ echo -n ba | ecoji >> /tmp/test.ecoji
$ export LC_ALL=C
$ sort /tmp/test.ecoji > /tmp/test-sorted.ecoji
$ diff /tmp/test.ecoji /tmp/test-sorted.ecoji
$ cat /tmp/test-sorted.ecoji
ðâââ
ððēââ
ððļðâ
ððļðĶâ
ððââ
ðâââ
ððĒââ
Implementations
Libraries implementing the Ecoji encoding standard. Submit PR to add a library to the table.
Language | Comments |
---|---|
D | Implementation of Ecoji written in the D programming language. |
Go | This repository offers a Go library package with two functions ecoji.Encode() and ecoji.Decode(). |
Java | Implementation of Ecoji written in Java, usable in any JVM language. |
.NET | Implementation of Ecoji written in C# targeting .NET Standard 2.0: dotnet add package Ecoji . |
PHP | PHP 7.x implementation of Ecoji. Available as rayne/ecoji on Packagist. |
Python | Implementation of Ecoji written in the Python3 programming language. |
Rust | Implementation of Ecoji written in the Rust programming language. |
Swift | Implementation of Ecoji written in the Swift programming language. |
Building
This is my first Go project and I am starting to get my bearings. If you are new to Go I would recommend this video and the tour.
# The following are general Go setup instructions. Ignore if you know Go, I am new to it.
export GOPATH=~/go
export PATH=$GOPATH/bin:$PATH
# This will download Ecoji to $GOPATH/src
go get github.com/keith-turner/ecoji
# This will build the ecoji command and put it in $GOPATH/bin
go install github.com/keith-turner/ecoji/cmd/ecoji