All Projects β†’ arvados β†’ Arvados

arvados / Arvados

Licence: other
An open source platform for managing and analyzing biomedical big data

Programming Languages

python
139335 projects - #7 most used programming language
go
31211 projects - #10 most used programming language
ruby
36898 projects - #4 most used programming language

Projects that are alternatives of or similar to Arvados

Externalsecret Operator
An operator to fetch secrets from cloud services and inject them in Kubernetes
Stars: ✭ 177 (-35.4%)
Mutual labels:  aws, cloud, azure, gcp
Pulumi
Pulumi - Developer-First Infrastructure as Code. Your Cloud, Your Language, Your Way πŸš€
Stars: ✭ 10,887 (+3873.36%)
Mutual labels:  aws, cloud, azure, gcp
Terracognita
Reads from existing Cloud Providers (reverse Terraform) and generates your infrastructure as code on Terraform configuration
Stars: ✭ 452 (+64.96%)
Mutual labels:  aws, cloud, azure, gcp
Docker Android
Android in docker solution with noVNC supported and video recording
Stars: ✭ 4,042 (+1375.18%)
Mutual labels:  aws, cloud, azure, gcp
Scoutsuite
Multi-Cloud Security Auditing Tool
Stars: ✭ 3,803 (+1287.96%)
Mutual labels:  aws, cloud, azure, gcp
Cloud Custodian
Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources
Stars: ✭ 3,926 (+1332.85%)
Mutual labels:  aws, cloud, azure, gcp
Docker Swarm
🐳🐳🐳 This repository is part of a blog series on Docker Swarm example using VirtualBox, OVH Openstack, Azure and Amazon Web Services AWS
Stars: ✭ 43 (-84.31%)
Mutual labels:  aws, cloud, azure, cluster
Elasticluster
Create clusters of VMs on the cloud and configure them with Ansible.
Stars: ✭ 298 (+8.76%)
Mutual labels:  cloud, azure, gcp, cluster
Learning Cloud
List of resources - courses, sample code, articles and screencasts for learning AWS, Azure, GCP and Alibaba Cloud
Stars: ✭ 100 (-63.5%)
Mutual labels:  aws, cloud, azure, gcp
Cloudsploit
Cloud Security Posture Management (CSPM)
Stars: ✭ 1,338 (+388.32%)
Mutual labels:  aws, cloud, azure, gcp
Gardener
Kubernetes-native system managing the full lifecycle of conformant Kubernetes clusters as a service on Alicloud, AWS, Azure, GCP, OpenStack, EquinixMetal, vSphere, MetalStack, and Kubevirt with minimal TCO.
Stars: ✭ 2,093 (+663.87%)
Mutual labels:  aws, azure, gcp, cluster
Infracost
Cloud cost estimates for Terraform in pull requestsπŸ’°πŸ“‰ Love your cloud bill!
Stars: ✭ 4,505 (+1544.16%)
Mutual labels:  aws, cloud, gcp, azure
Gcp For Bioinformatics
GCP Essentials for Bioinformatics Researchers
Stars: ✭ 95 (-65.33%)
Mutual labels:  cloud, gcp, bioinformatics, genomics
Terratag
Terratag is a CLI tool that enables users of Terraform to automatically create and maintain tags across their entire set of AWS, Azure, and GCP resources
Stars: ✭ 385 (+40.51%)
Mutual labels:  aws, cloud, azure, gcp
Flowr
Robust and efficient workflows using a simple language agnostic approach
Stars: ✭ 73 (-73.36%)
Mutual labels:  cloud, bioinformatics, workflow, cluster
Go Cloud
The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.
Stars: ✭ 8,124 (+2864.96%)
Mutual labels:  aws, cloud, azure, gcp
Galaxy
Data intensive science for everyone.
Stars: ✭ 812 (+196.35%)
Mutual labels:  workflow-engine, bioinformatics, genomics, workflow
Nextflow
A DSL for data-driven computational pipelines
Stars: ✭ 1,337 (+387.96%)
Mutual labels:  aws, cloud, workflow-engine, bioinformatics
Seldon Server
Machine Learning Platform and Recommendation Engine built on Kubernetes
Stars: ✭ 1,435 (+423.72%)
Mutual labels:  aws, cloud, azure, gcp
Engine
Deploy your apps on any Cloud provider in just a few seconds
Stars: ✭ 1,132 (+313.14%)
Mutual labels:  aws, cloud, azure, gcp

Join the chat at https://gitter.im/arvados/community | Installing Arvados | Installing Client SDKs | Report a bug | Development and Contributing

Arvados is an open source platform for managing, processing, and sharing genomic and other large scientific and biomedical data. With Arvados, bioinformaticians run and scale compute-intensive workflows, developers create biomedical applications, and IT administrators manage large compute and storage resources.

The key components of Arvados are:

  • Keep: Keep is the Arvados storage system for managing and storing large collections of files. Keep combines content addressing and a distributed storage architecture resulting in both high reliability and high throughput. Every file stored in Keep can be accurately verified every time it is retrieved. Keep supports the creation of collections as a flexible way to define data sets without having to re-organize or needlessly copy data. Keep works on a wide range of underlying filesystems and object stores.

  • Crunch: Crunch is the orchestration system for running Common Workflow Language workflows. It is designed to maintain data provenance and workflow reproducibility. Crunch automatically tracks data inputs and outputs through Keep and executes workflow processes in Docker containers. In a cloud environment, Crunch optimizes costs by scaling compute on demand.

  • Workbench: The Workbench web application allows users to interactively access Arvados functionality. It is especially helpful for querying and browsing data, visualizing provenance, and tracking the progress of workflows.

  • Command Line tools: The command line interface (CLI) provides convenient access to Arvados functionality in the Arvados platform from the command line.

  • API and SDKs: Arvados is designed to be integrated with existing infrastructure. All the services in Arvados are accessed through a RESTful API. SDKs are available for Python, Go, R, Perl, Ruby, and Java.

Quick start

To try out Arvados on your local workstation, you can use Arvbox, which provides Arvados components pre-installed in a Docker container (requires Docker 1.9+). After cloning the Arvados git repository:

$ cd arvados/tools/arvbox/bin
$ ./arvbox start localdemo

In this mode you will only be able to connect to Arvbox from the same host. To configure Arvbox to be accessible over a network and for other options see http://doc.arvados.org/install/arvbox.html for details.

Documentation

Complete documentation, including the User Guide, Installation documentation, Administrator documentation and API documentation is available at http://doc.arvados.org/

If you wish to build the Arvados documentation from a local git clone, see doc/README.textile for instructions.

Community

Join the chat at https://gitter.im/arvados/community

The Arvados community channel channel at gitter.im is available for live discussion and support.

The Arvados developement channel channel at gitter.im is used to coordinate development.

The Arvados user mailing list is used to announce new versions and other news.

All participants are expected to abide by the Arvados Code of Conduct.

Reporting bugs

Report a bug on dev.arvados.org.

Development and Contributing

See CONTRIBUTING for information about Arvados development and how to contribute to the Arvados project.

The development road map outlines some of the project priorities over the next twelve months.

Licensing

Arvados is Free Software. See COPYING for information about the open source licenses used in Arvados.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].