All Projects → ctuning → ck-env

ctuning / ck-env

Licence: BSD-3-Clause License
CK repository with components and automation actions to enable portable workflows across diverse platforms including Linux, Windows, MacOS and Android. It includes software detection plugins and meta packages (code, data sets, models, scripts, etc) with the possibility of multiple versions to co-exist in a user or system environment:

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects
C++
36643 projects - #6 most used programming language
HTML
75241 projects
c
50402 projects - #5 most used programming language
CMake
9771 projects

Projects that are alternatives of or similar to ck-env

ck-crowd-scenarios
Public scenarios to crowdsource experiments (such as DNN crowd-benchmarking and crowd-tuning) using Collective Knowledge Framework across diverse mobile devices provided by volunteers. Results are continuously aggregated at the open repository of knowledge:
Stars: ✭ 22 (-67.16%)
Mutual labels:  reproducible-research, collective-knowledge, mobile-devices
wrench
WRENCH: Cyberinfrastructure Simulation Workbench
Stars: ✭ 25 (-62.69%)
Mutual labels:  hpc, reproducible-research
mlx
Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine
Stars: ✭ 132 (+97.01%)
Mutual labels:  models, datasets
json2python-models
Generate Python model classes (pydantic, attrs, dataclasses) based on JSON datasets with typing module support
Stars: ✭ 119 (+77.61%)
Mutual labels:  models, datasets
ck-analytics
Collective Knowledge repository with actions to unify the access to different predictive analytics engines (scipy, R, DNN) from software, command line and web-services via CK JSON API:
Stars: ✭ 35 (-47.76%)
Mutual labels:  reproducible-research, collective-knowledge
software-dev
Coding Standards for the USC Biostats group
Stars: ✭ 33 (-50.75%)
Mutual labels:  hpc, reproducible-research
awflow
Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal computer!
Stars: ✭ 15 (-77.61%)
Mutual labels:  hpc, reproducible-research
Solcrypto
Solidity crypto libraries, ring signatures, proof of knowledge, packed signatures etc. with matching Python implementations for secp256k1 and (alt)BN-256
Stars: ✭ 170 (+153.73%)
Mutual labels:  tools, libraries
farabio
🤖 PyTorch toolkit for biomedical imaging ❤️
Stars: ✭ 48 (-28.36%)
Mutual labels:  models, datasets
inqlude
Command line client for independent Qt library archive
Stars: ✭ 30 (-55.22%)
Mutual labels:  package-manager, libraries
ctuning-programs
Collective Knowledge extension with unified and customizable benchmarks (with extensible JSON meta information) to be easily integrated with customizable and portable Collective Knowledge workflows. You can easily compile and run these benchmarks using different compilers, environments, hardware and OS (Linux, MacOS, Windows, Android). More info:
Stars: ✭ 41 (-38.81%)
Mutual labels:  reproducible-research, collective-knowledge
Vcpkg
C++ Library Manager for Windows, Linux, and MacOS
Stars: ✭ 14,449 (+21465.67%)
Mutual labels:  package-manager, libraries
Spack
A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
Stars: ✭ 2,425 (+3519.4%)
Mutual labels:  package-manager, hpc
Cli
the package manager for JavaScript
Stars: ✭ 5,277 (+7776.12%)
Mutual labels:  package-manager, tools
crowdsource-experiments-using-android-devices
Android application to participate in experiment crowdsourcing (such as workload crowd-benchmarking and crowd-tuning) using Collective Knowledge Framework and open repositories of knowledge:
Stars: ✭ 23 (-65.67%)
Mutual labels:  reproducible-research, mobile-devices
torchgeo
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
Stars: ✭ 1,125 (+1579.1%)
Mutual labels:  models, datasets
Awesome Transit
Community list of transit APIs, apps, datasets, research, and software 🚌🌟🚋🌟🚂
Stars: ✭ 713 (+964.18%)
Mutual labels:  tools, datasets
Awesome Cae
A curated list of awesome CAE frameworks, libraries and software.
Stars: ✭ 148 (+120.9%)
Mutual labels:  tools, libraries
nmodl
Code Generation Framework For NEURON MODeling Language
Stars: ✭ 42 (-37.31%)
Mutual labels:  hpc, compilers
ck-web
Collective Knowledge web extension to browse CK repositories, visualize interactive graphs and articles, render CK-based websites, implement simple web services with JSON API (for example to crowdsource experiments or unify access to DNN). Demos of interactive articles, graphs and crowdsourced experiments:
Stars: ✭ 31 (-53.73%)
Mutual labels:  reproducible-research, collective-knowledge

Fighting the software and hardware chaos

All CK components for AI and ML are now collected in one repository!

This project is hosted by the cTuning foundation (non-profit R&D organization).

compatibility License

Linux & MacOS: Travis Build Status Windows: AppVeyor Build status

This is a Collective Knowledge repository with the functionality to support portable, customizable, reusable and automated workflows. It lets users automatically detect the target platform with already installed software, data and models required for a given workflow using CK software detection plugins and install missing packages in a unified way. Multiple versions of code, data and models can now co-exist in a user or system environment similar to Python virtualenv.

Further info:

Author

Contributors

Shared CK modules with actions

Installation

First install the CK framework as described here.

Then install this CK repository as follows:

 $ ck pull repo:ck-env

 $ ck list soft
 $ ck list package

Usage

You can detect and register in the CK all the instances of GCC and LLVM as follows:

 $ ck detect soft:compiler.gcc
 $ ck detect soft:compiler.llvm

You can now see multiple versions of the detected software registered in the CK as follows:

 $ ck show env

You can then compile and run unified CK benchmarks shared by the community using any of the above compiler instances (GCC, LLVM, ICC ...) and their versions simply as follows:

 $ ck pull repo:ck-autotuning
 $ ck pull repo:ctuning-programs

 $ ck compile program:cbench-automotive-susan --speed
 $ ck run program:cbench-automotive-susan

If you have Android NDK and SDK installed, CK can automatically detect it together with compiler versions (GCC, LLVM), register them and let you compile and run benchmarks on Android simply via:

 $ ck compile program:cbench-automotive-susan --speed --target_os=android21-arm-v7a
 $ ck run program:cbench-automotive-susan --target_os=android21-arm-v7a

You can find further details about our customizable and cross-platform package/environment manager here.

Questions and comments

Please feel free to get in touch with the CK community if you have any questions, suggestions and comments!

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].