All Projects → yegor256 → Dynamo Archive

yegor256 / Dynamo Archive

Archive and Restore DynamoDB Tables, from the Command Line

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Dynamo Archive

Dialetus Service
API to Informal dictionary for the idiomatic expressions that each Brazilian region It has
Stars: ✭ 202 (+104.04%)
Mutual labels:  json, dynamodb
Dynamodb Json
DynamoDB json util to load and dump strings of Dynamodb json format to python object and vise-versa
Stars: ✭ 114 (+15.15%)
Mutual labels:  json, dynamodb
Swagger Merger
🔗 Merge multiple swagger files into a swagger file, support JSON/YAML.
Stars: ✭ 94 (-5.05%)
Mutual labels:  json
Diamondb
[WIP] DiamonDB: Rebuild of time series database on AWS.
Stars: ✭ 98 (-1.01%)
Mutual labels:  dynamodb
Pysmi
SNMP MIB parser
Stars: ✭ 96 (-3.03%)
Mutual labels:  json
Awesome Resume For Chinese
📄 适合中文的简历模板收集(LaTeX,HTML/JS and so on)由 @hoochanlon 维护
Stars: ✭ 1,324 (+1237.37%)
Mutual labels:  json
Undictify
Python library providing type-checked function calls at runtime
Stars: ✭ 97 (-2.02%)
Mutual labels:  json
Ssl Checker
Python script that collects SSL/TLS information from hosts
Stars: ✭ 94 (-5.05%)
Mutual labels:  json
Reddit Bot
🤖 Making a Reddit Bot using Python, Heroku and Heroku Postgres.
Stars: ✭ 99 (+0%)
Mutual labels:  json
Php Jsondb
A PHP Class that reads JSON file as a database. Use for sample DBs
Stars: ✭ 96 (-3.03%)
Mutual labels:  json
Fast Serialization
FST: fast java serialization drop in-replacement
Stars: ✭ 1,348 (+1261.62%)
Mutual labels:  json
Json resume
Generates pretty HTML, LaTeX, markdown, with biodata feeded as input in JSON
Stars: ✭ 1,336 (+1249.49%)
Mutual labels:  json
Jsonmasking
Replace fields in json, replacing by something, don't care if property is in depth objects. Very useful to replace passwords credit card number, etc.
Stars: ✭ 95 (-4.04%)
Mutual labels:  json
Schemer
Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
Stars: ✭ 97 (-2.02%)
Mutual labels:  json
Swurg
Parse OpenAPI documents into Burp Suite for automating OpenAPI-based APIs security assessments (approved by PortSwigger for inclusion in their official BApp Store).
Stars: ✭ 94 (-5.05%)
Mutual labels:  json
Javascript Stringify
Stringify is to `eval` as `JSON.stringify` is to `JSON.parse`
Stars: ✭ 98 (-1.01%)
Mutual labels:  json
Restson Rust
Easy-to-use REST client for Rust programming language
Stars: ✭ 93 (-6.06%)
Mutual labels:  json
Play Circe
circe for play
Stars: ✭ 95 (-4.04%)
Mutual labels:  json
Json4s
A single AST to be used by other scala json libraries
Stars: ✭ 1,341 (+1254.55%)
Mutual labels:  json
Crawlerpack
Java 網路資料爬蟲包
Stars: ✭ 99 (+0%)
Mutual labels:  json

DevOps By Rultor.com

Build Status NPM version

There are two simple Node.js scripts that archive and restore an entire AWS Dynamo DB table in JSON format.

Install it first (I assume you have Node.js and Npm installed already):

$ npm install dynamo-archive

Create a user in Amazon IAM and assign a policy to it (how?):

{
  "Statement": [
    {
      "Effect": "Allow",
      "Action": ["dynamodb:Scan", "dynamodb:DescribeTable"],
      "Resource": "arn:aws:dynamodb:us-east-1:019644334823:table/test"
    }
  ]
}

Where 019644334823 if your AWS account number, us-east-1 is AWS region, and test is the name of your Dynamo DB table (can be a *, if you grant access to all tables).

Run it first without arguments and read the output:

$ ./bin/dynamo-archive.js

To restore a table from a JSON file run:

$ ./bin/dynamo-restore.js

Crontab automation

I'd recommend to use this simple bash script to automate backups of your Dynamo DB tables and save them to S3 (I'm using s3cmd):

#/bin/bash

AWS_ACCESS_KEY_ID=AKIAJK.......XWGA5AA
AWS_SECRET_ACCESS_KEY=7aDUFa68GN....................IGcH0zTf3k
#optional endpoint for DynamoDB local
AWS_DYNAMODB_ENDPOINT=http://localhost:8000/
declare -a TABLES=(first second third)
for t in ${TABLES[@]}
do
  dynamo-archive/bin/dynamo-archive.js --table=$t > $t.json
  s3cmd --no-progress put $t.json s3://backup.example.com/dynamo/$t.json
  rm $t.json
done
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].