All Projects → Azure → Blobporter

Azure / Blobporter

Licence: other
Highly concurrent data transfer tool for Azure Blob Storage.

Programming Languages

go
31211 projects - #10 most used programming language

Projects that are alternatives of or similar to Blobporter

Serverless-File-Validation
Using Azure Serverless products to perform file validation on a per-batch basis
Stars: ✭ 21 (-73.75%)
Mutual labels:  azure-storage
Serverless Microservices Reference Architecture
This reference architecture walks you through the decision-making process involved in designing, developing, and delivering a serverless application using a microservices architecture through hands-on instructions for configuring and deploying all of the architecture's components along the way. The goal is to provide practical hands-on experience in working with several Azure services and the technologies that effectively use them in a cohesive and unified way to build a serverless-based microservices architecture.
Stars: ✭ 270 (+237.5%)
Mutual labels:  azure-storage
Azure Readiness Checklist
This checklist is your guide to the best practices for deploying secure, scalable, and highly available infrastructure in Azure. Before you go live, go through each item, and make sure you haven't missed anything important!
Stars: ✭ 457 (+471.25%)
Mutual labels:  azure-storage
nodejs-postgresql-azure
Repositório responsável pela série de artigos sobre Node.js com PostgreSQL
Stars: ✭ 70 (-12.5%)
Mutual labels:  azure-storage
bot-message-routing
Message routing component for chatbots built with Microsoft Bot Framework C# SDK.
Stars: ✭ 53 (-33.75%)
Mutual labels:  azure-storage
Azure Spring Boot
Spring Boot Starters for Azure services
Stars: ✭ 352 (+340%)
Mutual labels:  azure-storage
NLog.Extensions.AzureStorage
NLog Target for Azure Storage. Uses NLog batch write to optimize writes to Storage.
Stars: ✭ 27 (-66.25%)
Mutual labels:  azure-storage
Azure For Developers Workshop
The Azure cloud is huge and the vast service catalog may appear daunting at first, but it doesn’t have to be!
Stars: ✭ 38 (-52.5%)
Mutual labels:  azure-storage
durable-functions-producer-consumer
Uses Durable Functions' fan out pattern to load N messages across M sessions into various Azure Storage/Messaging services. Includes the ability to consume the messages with another Azure Function & load timing data in to Event Hubs for ingestion in to analytics services like Azure Data Explorer
Stars: ✭ 31 (-61.25%)
Mutual labels:  azure-storage
Skale
High performance distributed data processing engine
Stars: ✭ 390 (+387.5%)
Mutual labels:  azure-storage
fl-image-resize
A library to quickly resize images with Azure Functions
Stars: ✭ 15 (-81.25%)
Mutual labels:  azure-storage
movie-db-java-on-azure
Sample movie database app built using Java on Azure
Stars: ✭ 28 (-65%)
Mutual labels:  azure-storage
Zenko
Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.
Stars: ✭ 353 (+341.25%)
Mutual labels:  azure-storage
azure-storage
Azure Storage module for Nest framework (node.js) ☁️
Stars: ✭ 71 (-11.25%)
Mutual labels:  azure-storage
Azurite
A lightweight server clone of Azure Storage that simulates most of the commands supported by it with minimal dependencies
Stars: ✭ 810 (+912.5%)
Mutual labels:  azure-storage
azure-developer-college
Repository for the Azure Developer College Workshop
Stars: ✭ 16 (-80%)
Mutual labels:  azure-storage
Goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
Stars: ✭ 3,932 (+4815%)
Mutual labels:  azure-storage
Developing Solutions Azure Exam
This repository contains resources for the Exam AZ-203: Developing Solutions for Microsoft Azure. You can find direct links to resources and and practice resources to test yourself ☁️🎓📚
Stars: ✭ 59 (-26.25%)
Mutual labels:  azure-storage
Azure.data.wrappers
Azure Storage Simplified
Stars: ✭ 34 (-57.5%)
Mutual labels:  azure-storage
Storage
💿 Storage abstractions with implementations for .NET/.NET Standard
Stars: ✭ 380 (+375%)
Mutual labels:  azure-storage

BlobPorter

Build Status Go Report Card

Introduction

BlobPorter is a data transfer tool for Azure Blob Storage that maximizes throughput through concurrent reads and writes that can scale up and down independently.

Sources and targets are decoupled, this design enables the composition of various transfer scenarios.

From/To Azure Block Blob Azure Page Blob File (Download)
File (Upload) Yes Yes NA
HTTP/HTTPS* Yes Yes Yes
Azure Block Blob Yes Yes Yes
Azure Page Blob Yes Yes Yes
S3 Endpoint Yes Yes No

* The HTTP/HTTPS source must support HTTP byte ranges and return the file size as a response to a HTTP HEAD request.

What's new (0.6.20) ?

  • Blob to Block Blobs transfers use the Put Block from URL API.
  • Proxy support.
  • Minor fixes and performance improvements.
  • Upgrade to Go 1.11

Documentation

Issues and Feedback

If you have a question or find a bug, open a new issue in this repository. BlobPorter is an OSS project maintained by the contributors.

Contribute

If you would like to become an active contributor to this project please follow the instructions provided in Microsoft Azure Projects Contribution Guidelines.


This project has adopted the [email protected] with any additional questions or comments.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].