All Projects → checkr → s3-sync

checkr / s3-sync

Licence: Apache-2.0 License
Migrating S3 Buckets Across AWS Accounts

Programming Languages

go
31211 projects - #10 most used programming language

Projects that are alternatives of or similar to s3-sync

NYC Taxi Pipeline
Design/Implement stream/batch architecture on NYC taxi data | #DE
Stars: ✭ 16 (-70.91%)
Mutual labels:  s3
s3
No-dependencies, lightweight Amazon S3 connector implementation in pure PHP
Stars: ✭ 26 (-52.73%)
Mutual labels:  s3
herman
Herman is a tool to simplify deployment of AWS Services using ECS and Lambda, and the provisioning of various AWS services.
Stars: ✭ 33 (-40%)
Mutual labels:  s3
s3-db
Document DB API for AWS S3
Stars: ✭ 97 (+76.36%)
Mutual labels:  s3
astro
Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (+43.64%)
Mutual labels:  s3
S4
🔄 Fast and cheap synchronisation of files using Amazon S3
Stars: ✭ 69 (+25.45%)
Mutual labels:  s3
rclone-drive
☁️Simple web cloud storage based on rclone, transform cloud storage (s3, google drive, one drive, dropbox) into own custom web-based storage
Stars: ✭ 30 (-45.45%)
Mutual labels:  s3
apt-golang-s3
An s3 transport method for the apt package management system
Stars: ✭ 33 (-40%)
Mutual labels:  s3
nginx-s3-gateway
NGINX S3 Caching Gateway
Stars: ✭ 124 (+125.45%)
Mutual labels:  s3
laravel-uppy-s3-multipart-upload
Multipart Uploads using Laravel, AWS S3, and Uppy
Stars: ✭ 30 (-45.45%)
Mutual labels:  s3
S4
S4 is 100% S3 compatible storage, accessed through Tor and distributed using IPFS.
Stars: ✭ 67 (+21.82%)
Mutual labels:  s3
GooglePlay-Web-Crawler
Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive
Stars: ✭ 18 (-67.27%)
Mutual labels:  s3
websync
Like `aws s3 sync` with automatic CloudFront invalidations and more.
Stars: ✭ 45 (-18.18%)
Mutual labels:  s3
s3parcp
Faster than s3cp
Stars: ✭ 31 (-43.64%)
Mutual labels:  s3
gitlab-mattermost-backup
A simple backup script for mattermost in gitlab omnibus package
Stars: ✭ 23 (-58.18%)
Mutual labels:  s3
storage
Go library providing common interface for working across multiple cloud storage backends
Stars: ✭ 154 (+180%)
Mutual labels:  s3
punic
Punic is a remote cache CLI built for Carthage and Apple .xcframework
Stars: ✭ 25 (-54.55%)
Mutual labels:  s3
s3-lambda-transcribe-audio-to-text-s3
Transcribe your audio to text with this serverless component
Stars: ✭ 84 (+52.73%)
Mutual labels:  s3
Less3
Less3 is an S3-compatible object storage server that runs on your laptop, servers, just about anywhere!
Stars: ✭ 16 (-70.91%)
Mutual labels:  s3
docker-aws-s3-sync
Docker container to sync a folder to Amazon S3
Stars: ✭ 21 (-61.82%)
Mutual labels:  s3

Migrating S3 Buckets Across AWS Accounts

There are a lot of steeps needed to migrate buckets across accounts and this tool automates them all!

  1. Before running copy config.yaml to config.prod.yaml, fill in the blanks for source and destination account and add buckets you would like to sync.
source:
  account_number: ...
  aws_access_key_id: ...
  aws_secret_access_key: ...
  aws_region: ...

destination:
  account_number: ...
  aws_user: username
  aws_access_key_id: ...
  aws_secret_access_key: ...
  aws_region: ...
  enable_bucket_versioning: true
  sync_sse: AES256

buckets:
  saso-test-1: us-east-1-checkr-saso-test-1
  saso-test-2: us-east-1-checkr-saso-test-2
  1. Run the sync with go run main.go sync --config config.prod.yaml

s3-sync

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].