jorgebucaran / Spark.fish
Licence: mit
▁▂▄▆▇█▇▆▄▂▁
Stars: ✭ 229
Programming Languages
shell
77523 projects
Projects that are alternatives of or similar to Spark.fish
Js Spark
Realtime calculation distributed system. AKA distributed lodash
Stars: ✭ 187 (-18.34%)
Mutual labels: spark
Gimel
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (-5.68%)
Mutual labels: spark
Awsm.fish
A curation of prompts, plugins & other resources for Fish. 🐚
Stars: ✭ 2,641 (+1053.28%)
Mutual labels: fish
Kotlin Spark Api
This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
Stars: ✭ 183 (-20.09%)
Mutual labels: spark
Sparkrdma
RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (-6.11%)
Mutual labels: spark
Ballista
Distributed compute platform implemented in Rust, and powered by Apache Arrow.
Stars: ✭ 2,274 (+893.01%)
Mutual labels: spark
Spark Practice
Apache Spark (PySpark) Practice on Real Data
Stars: ✭ 200 (-12.66%)
Mutual labels: spark
Pisces
♓️ Fish shell plugin that helps you to work with paired symbols in the command line
Stars: ✭ 210 (-8.3%)
Mutual labels: fish
Scanns
A scalable nearest neighbor search library in Apache Spark
Stars: ✭ 190 (-17.03%)
Mutual labels: spark
Spark Excel
A Spark plugin for reading Excel files via Apache POI
Stars: ✭ 216 (-5.68%)
Mutual labels: spark
Azuredatabricksbestpractices
Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs
Stars: ✭ 186 (-18.78%)
Mutual labels: spark
Example Spark
Spark, Spark Streaming and Spark SQL unit testing strategies
Stars: ✭ 205 (-10.48%)
Mutual labels: spark
spark.fish
Sparklines for Fish.
Unofficial port of performance.
Installation
Install with Fisher:
fisher install jorgebucaran/spark.fish
Quickstart
You want to visualize a range of numbers right in your terminal.
$ spark 1 2 4 8
▁▂▄█
And here is a sequence of random numbers.
$ seq 64 | sort --random-sort | spark
▅▄▂▇▂▅▆▄▃█▂▅▄▁▆▆▃█▄▁▇▅▂▃▇▃▃▄▇▄▅▆▇▂▅▁▇▁▄▂▆▅▃█▇▆▆▅▆▃▄▄▇▃▂▇█▅▃█▁▂▂▆
You can set the --min=<number>
or --max=<number>
values for your sparkline too.
$ seq 10 20 | spark
▁▂▂▃▄▄▅▆▇▇█
$ seq 10 20 | spark --min=0
▄▅▅▆▆▆▇▇▇██
$ seq 10 20 | spark --min=0 --max=30
▃▄▄▄▄▄▅▅▅▅▆
Wicked Cool Usage
Most of the examples in this section are derived from the original Wicked Cool Usage wiki, ported to Fish.
Line lengths.
$ awk \$0=length (functions --details spark) | spark
▃▆▃▃▃▄▃▂▄▄▄▅▂▄▅▂▆▁▅▂▅▅▃▂▂▆▃█▂▁▁▁
Number of commits in a repo, by author.
$ git shortlog --summary | string match --regex "\d+" | spark
█▁▁▁▃▁▁▄▁▁▁
Total run time of processes.
$ ps -A | string replace --filter --regex -- ".*(\d+):(\d+).*" "\$1 * 3600 + \$2 * 60" | bc | spark
▇▁▂▁▆▁▂▂▁▃▁▃▁▁▁▆▁▁▁▂▁▃▂▁▁▃▁▁▁▁▁▂▁▁▂▁▁▁▁▁▆▂▃▂▁▂▃▁▆▁▁▁▂▁▁▁▁▃▂▂▁▇▁▁▁▁▆
LOC added per commit over the last week.
$ git diff @~7 --numstat | string replace --regex -- "(^\d+).*" "\$1" | spark
▁▁▁▁▁▁▁▁▂▁▁▁▁▁▁▂▂▃█▄▁▁
A moving wave through the terminal.
for i in (seq 100)
for j in (seq (math $COLUMNS - 1))
math "ceil(6 * cos(($i + $j) * pi / 5))"
end | spark | read sparks
echo -n $sparks\r && sleep .1
end
▆▄▂▁▂▄▆▇█▇▆▄▂▁▂▄▆▇█▇▆▄▂▁▂▄▆▇█▇▆▄▂▁▂▄▆▇█▇▆▄▂▁▂▄▆▇█▇▆▄▂▁▂▄▆▇█
Performance
Spark is faster than spark.sh
, reading and writing relatively large datasets under milliseconds.
$ time seq 2000 | sort --random-sort | spark
________________________________________________________
Executed in 27.21 millis fish external
usr time 26.40 millis 0.57 millis 25.83 millis
sys time 4.87 millis 1.58 millis 3.29 millis
$ time seq 2000 | sort --random-sort | spark.sh
________________________________________________________
Executed in 2.73 secs fish external
usr time 2.72 secs 0.33 millis 2.72 secs
sys time 0.02 secs 1.47 millis 0.02 secs
License
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].