aws-is-how

• aws-is-how
  • 常见故障排除及支持手册
  • AWS Skill builder
  • AI/ML
    • ML Study
    • SageMaker
    • Jupyter Notebooks
    • Compute vision
    • NLP
    • Translate, Text to speech, Speeck to Text
    • Forecasting
    • Fraud Detection
    • Recommandation
    • Labeling
    • Federated ML
    • Prediction Maintenance
    • ML Hardware
  • Cost
    • Cost Explorer
    • Network cost
    • Tagging
    • Sustainablity
  • Computing
    • EC2
    • Load Balancer
    • System Manager
    • HPC
  • Analytics
    • High Level Data Engineering and Data Analytics
    • Data integration service: Glue
    • Analysis: EMR
    • Stream - Flink and Spark Streaming
    • Stream - Kinesis
    • Stream - Kafka
    • Ad-hoc and Interactive query: Athena
    • Data Warehouse: Redshfit
    • Search and analytics: Elasticsearch Service
    • Governance
    • BI
  • IOT
    • IoT Core
    • IoT Timeseries
    • OEE
    • IoT anaytics
    • Edge
    • OTA
    • AIOT
  • Security
    • Encryption - KMS
    • Credential - Secret Manager
    • Certificate - Certificate Manager
    • Asset Management and Compliance
    • AuthN and AuthZ
    • Sentitive Data
    • Threat detection - GuardDuty
    • WAF
    • Permission - IAM Policy, S3 Policy, RAM Policy
    • Multi accounts structure
    • SIEM and SOC
  • Network
    • VPC
    • Keep private - VPC Endpoint and PrivateLink
    • NAT and proxy
    • Load balancers
    • Cross data center and cloud Leasing Line - Direct Connect and VPN
    • Cross board transfer
    • Cross accounts and Cross VPCs - TGW
    • Acceleration network
    • Edge
    • Network Secuirty
  • DNS
    • Route 53
  • Serverless
    • Serverless Workshop
    • Function as Service - Lambda
    • API Gateway
    • Step function
    • Build the serverless - SAM, Chalice, Serverless framwork, CDK
    • Serverless with AI/ML
  • Migration
    • Journey to Adopt Cloud-Native Architecture
    • Active Directory
    • Database
    • Data migration tool - DMS
    • Data migration tool - 3rd party tool
    • Cross Cloud Migration
    • File migration
  • Storage
    • S3 cross region or cross cloud OSS
    • S3
    • EBS
    • Storage Gatewway
    • EFS and FSx or other shared file system
  • Database
    • RDS
      • RDS usage
      • RDS Cross region, cross account, data replication and backup
      • RDS upgrade
      • RDS Security
      • RDS Performance
    • Graph Database
    • ElastiCache
    • Key-Value and Document
      • DynamoDB
      • MongoDB and DocumentDB
    • Time series
  • Container
    • EKS
      • EKS networking
      • EKS practice
      • Data On EKS
      • DevOps on EKS
    • ECS
    • Fargate
    • Istio, Envoy, App Mesh, Service discovery
    • ECR
  • DevOps
    • Management
    • CI/CD
      • Serverless CICD
      • Container CICD
    • Monitoring and Tracing
    • Logging
    • Change configuration
    • Developer
    • Infra as Code
  • Integration
    • Quque, notification
    • Call Center
    • MQ
    • Email
  • Media
    • Video on Demand
    • Video Streaming
  • Mobile
    • Moible app development
    • GraphQL - AppSync
  • Business continuity
    • Backup
    • DR
      • RDS HA/DR
  • Game
    • GameLift
  • SAP
    • HA/DR
  • Office and business application
    • Workspaces - VDI
  • Metaverse

常见故障排除及支持手册

AWS Skill builder

AI/ML

ML Study

ML入门的知识，以及ML项目中的一些经验总结分享

SageMaker

• SageMaker-Workshop

• SageMaker Learning Series

• Install External Libraries and Kernels in SageMaker Notebook Instances

• CloudFormation to launch SageMaker Notebook on Glue Dev Endpoint

• Invoke SageMaker Notebook via Event

  • Lambda-Trigger-SageMaker-Notebook
  • Scheduling Jupyter notebooks on SageMaker ephemeral instances

• SageMaker input mode: pipe mode and file mode

• Save costs by automatically shutting down idle resources within Amazon SageMaker Studio

• SageMaker Neo supported devices edge devices

Jupyter Notebooks

• A gallery of interesting Jupyter Notebooks

• Set up a Jupyter Notebook Server on deep learning AMI

Compute vision

• Use SageMaker for Automotive Image Classification

• ML Bot Workshop

• IP Camera AI SaaS Solution

• image classification using resnet

• Open CV on Lambda

• Train and deploy OCR model on SageMaker

NLP

• NLP and Text Classification by using blazing text

• Use AWS SageMaker BlazingText to process un-balance data for text multiple classification The git repo

• AI Powered Chatbot

• Chinese-BERT

Translate, Text to speech, Speeck to Text

• 使用 Amazon Translate 自动翻译PPT

Forecasting

• Forecasting scalar (one-dimensional) time series data

• GluonTS for time series data

Fraud Detection

• SageMaker End-to-End Demo- Fraud Detection for Auto Claims and github repo

Recommandation

• Amazon Personalize workshop

• Amazon Personalize Get Start

Labeling

• 使用 Amazon SageMaker Ground Truth 标记 3D 点云 and guide

• [CV Labeling]

  • cvat-on-aws-china
  • CV Labeling: VOTT

Federated ML

• Amazon Redshift ML: Create, train, and deploy machine learning (ML) models using familiar SQL commands

Prediction Maintenance

Using AWS IoT and Amazon SageMaker to do IoT Devices Predictive Maintenance

IoT Time-series Forecasting for Predictive Maintenance

ML Hardware

• Hands-on Deep Learning Inference with Amazon EC2 Inf1 Instance

Cost

Cost Explorer

• Simple generate a report using the AWS Cost Explorer API

• Cost and Usage Report analysis

• Price Calculator

• Price List API

• Get the spot instance price

Network cost

• AWS China region network cost details

• Networking calculator

• How to calculate data transfor cost on AWS

• Understanding AWS Direct Connect multi-account pricing

• Data transfer costs for common architectures

Tagging

• [Tagging when instance and object created]

  • Automatically Tag AWS EC2 Instances and Volumes Similar solution
  • S3 Object Tagging 以及怎么管理Tagging
  • 用S3 Batch Operation 批量对已有对象打标签
  • 写程序基于我们的SDK去打Tag
  • 基于S3 upload Event 触发lambda去对新的对象打标签

• Tagging AWS resources

Sustainablity

• Customer Carbon Footprint Tool

Computing

EC2

• Amazon Linux how to support chinese

• How to connect to Windows EC2 via NICE DCV Client

• How to connect to Linux EC2 via NICE DCV Client

• How to build Graphics Workstation on Amazon EC2 G4 Instances

• Deploying Unreal Engine Pixel Streaming Server on EC2

• EC2 network performance

• Python code attach EC2 EIP

• What does :-1 mean in python

• How to get the IP address under my account

• How can I connect to my Amazon EC2 instance if I lost my SSH key pair after its initial launch

• Change EC2 Time-Zone

• How can I set up a CloudWatch alarm to automatically recover my EC2 instance?

• [Graviton]

  • Graviton 2 workshop (https://github.com/aws-samples/graviton2-workshop)

  • AWS Workshop - Graviton2 China

  • AWS Graviton2-based services

  • 3rd party

  • container

  • GRAVITON2 电商独立站

• Move EC2 instance to other AZ

• Best practices for handling EC2 Spot Instance interruptions

• Upgrade-C4-CentOS-instance-to-C5-instance

• How to share the EC2 AMI

• Keep EC2 primary private IP for a 'new' instance

• Introduce the nitro-enclaves

• Check if a reboot is required after installing Linux updates

• [EC2 detected degradation]

  • How to handle EC2 detected degradation

Load Balancer

• ALB and NLB Route Traffic to Peering VPC

• Domain and Host based routing for ALB

• ALB Redirect Domain

• Hostname-as-Target for Network Load Balancers

• alb troubleshoot 502 errors

• Redirect HTTP requests to HTTPS using an Application Load Balancer

System Manager

• Query for AWS Regions, Endpoints, and More Using AWS Systems Manager Parameter Store

aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name'

aws ssm get-parameters-by-path --path /aws/service/global-infrastructure/regions --output json --profile us-east-1 --region us-east-1 | jq '.Parameters[].Name' | wc -l

• ssm-connection-lost-status

• Session-manager QuickStart

• Manage private EC2 instances without internet access

HPC

• Running CFD on AWS Parrell cluster

• AWS Batch Getting Start demo

• Orchestrating high performance computing with AWS Step Functions and AWS Batch

• [NICE DCV]

  • NICE DCV Guide
  • NICE DCV Connection Gateway - enables users to access a fleet of NICE DCV servers through a single access point to a LAN or VPC
  • NICE DCV Session Manager - the Agents, a Broker and API that makes it easy to build front-end applications that programmatically create and manage the lifecycle of NICE DCV sessions across a fleet of NICE DCV servers

Analytics

High Level Data Engineering and Data Analytics

• AWS Data Engineering Day Workshop

• 数据分析的技术源流

• Analytics Reference Architecture

• Data Science on AWS - Quick Start Workshop

• Build a Lake House Architecture on AWS

• Harness the power of your data with AWS Analytics with Lake House

• Serverless Data Lake Workshop

• Serverless Data Lake Framework WORKSHOP

• BMW Cloud Data Hub: A reference implementation of the modern data architecture on AWS

• Develop and deploy a customized workflow using Autonomous Driving Data Framework (ADDF) on AWS

Data integration service: Glue

• [ETL]

  • Quick demo for Glue ETL + Athena + Superset BI
  • Glue ETL for kinesis / Kafka and RDS MySQL
  • Update and Insert (upsert) Data from AWS Glue
  • Introducing PII data identification and handling using AWS Glue DataBrew

• [Glue Crawler]

  • Glue Crawler handle the CSV contains quote string

• Glue Workshop

  • Building Python modules for Spark ETL workloads using AWS Glue

• [Workflow]

  • Amazon Glue ETL 作业调度工具选型初探
  • Airflow and Glue workflow
  • Deploy an AWS Glue job with an AWS CodePipeline CI/CD pipeline
  • How to unit test and deploy AWS Glue jobs using AWS CodePipeline

• [Catalogs]

  • 如何提供对 AWS Glue 数据目录中资源的跨账户访问权限
  • Replication utility for AWS Glue Data Catalog

• [Delta Lake]

  • Glue and Hudi

Analysis: EMR

• AWS EMR Workshop

• aws-emr-best-practices

• [Develop Code]

  • EMR Notebooks and SageMaker Use EMR notebooks to prepare data for machine learning and call SageMaker from the notebook to train and deploy a machine learning model.
  • Tool to convert spark-submit to StartJobRun EMR on EKS API
  • Submit EMR Job remotely

• [Workflow]

  • Orchestrate an Amazon EMR on Amazon EKS Spark job with AWS Step Functions

• [Install and Delopyment]

  • How can I permanently install a Spark or Scala-based library on an Amazon EMR cluster
  • EMR_On_Graviton2
  • Why use the Glue Catalog v.s other external metastore for Hive

• [EMR on Kubernetes]

  • EMR on EKS Best Practice Guide
  • EMR on EKS workshop

• [Performance and HA]

  • Resolve s3 503 slowdown throttling
  • Hadoop high availability features of HDFS NameNode and YARN ResourceManager in an Amazon EMR cluster
  • Spark 小文件合并功能在 AWS S3 上的应用与实践
  • Amazon EMR实战心得浅谈

• [Security]

  • Introducing Amazon EMR integration with Apache Ranger
  • Enable federated governance using Trino and Apache Ranger on Amazon EMR

Stream - Flink and Spark Streaming

• [Flink on EMR]
  • 可持续性最佳架构实践—基于Spot的Flink作业集群部署与优化

Stream - Kinesis

• How to do analysis and virtulization DynamoDB

• AWS Kinesis Workshop

Stream - Kafka

• AWS Streaming Data Solution for Amazon MSK

• Secure connectivity patterns to access Amazon MSK across AWS Regions

• MSK Workshop

• MSK Connect

  • Run Kafka Connect as Fargate Docker containers and deploy MirrorMaker configuration files
  • MirrorMaker deployment

• Kafka/MSK Cluster connection issue

• Create a low-latency source-to-data lake pipeline using Amazon MSK Connect, Apache Flink, and Apache Hudi

Ad-hoc and Interactive query: Athena

• Automate athena query by lambda and step function

  • Automate run Athena_name_query and prepared_statement

• How to use the Athena to create the complex embeded table and query the table

• Split and search comma separated column in Athena

• Amazon Athena Workshop

  • Athena_access_control

• [Athena Perfomrance]

  • Top 10 Performance Tuning Tips for Amazon Athena
  • Using athena partition projection or glue partition indexes to improve athena query performance

• Use CTAS statements with Amazon Athena to reduce cost and improve performance

• Athena adds cost details to query execution plans

• How to get results from Athena for the past 7 days

Data Warehouse: Redshfit

• Automate Redshift ETL

• Redshift ML

• Create-Redshift-ReadOnly-User

• [Usage]

  • Cross-Account Data Sharing for Amazon Redshift

• [Redshift performance]

  • 使用 Amazon Glue 来调度 Amazon Redshift 跑 TPC-DS Benchmark
  • Cloud DataWarehouse Benchmark

• [CDC to Redshift]

  • Migrating Transactional Data to a Delta Lake using AWS DMS
  • CDC from On-Premises SQL Server to Amazon Redshift

• [ClickHouse and S3]

  • Integrating ClickHouse and S3 Compatible Storage
  • ClickHouse S3 table function

• Scheduling SQL queries on your Amazon Redshift

• [Streaming datawarehouse]

  • Real-time analytics with Amazon Redshift streaming ingestion
  • Streaming ingestion official doc

Search and analytics: Elasticsearch Service

• Loading Streaming Data into Amazon Elasticsearch Service

• Amazon Elasticsearch Service Workshop

• Elasticsearch Service Snapshot Lifecycle

• SAML Authentication for Kibana

• Search DynamoDB Data with Amazon Elasticsearch Service

• Log Hub workshop

• 使用Fluent Bit与Amazon OpenSearch Service构建日志系统

• Simple FAQ Bot

• OpenSearch cross cluster replication - DR or HA

Governance

• Lake Formation Workshop

• Sending Data to an Amazon Kinesis Data Firehose Delivery Stream

• AWS Lake Formation Tag-based access control

• [Data Quality with Deequ]

  • AWS Lab deequ
  • Scala: Test data quality at scale with Deequ
  • Python: Testing data quality at scale with PyDeequ
  • Monitor data quality in your data lake using PyDeequ and AWS Glue
  • Building a serverless data quality and analysis framework with Deequ and AWS Glue

• [Data Quality with Great Expectations]

  • Great Expectations Github
  • Great Expectations Home page
  • Expectations List
  • Provide data reliability in Amazon Redshift at scale using Great Expectations library
  • Monitoring Data Quality in a Data Lake Using Great Expectations and Allure-Built Serverless

• Data Lineage

BI

• Amazon QuickSight Workshop

• Athena integrated with PowerBI Desktop and PowerBI Service

• Integrate Power BI with Amazon Redshift for insights and analytics

IOT

IoT Core

• IoT-Workshop

• AWS IoT Events Quick Start

• Ingest data to IoT core and using lambda write date to RDS PostgreSQL

IoT Timeseries

• IoT Time-series Forecasting for Predictive Maintenance

OEE

• AWS IoT SiteWise Workshop

IoT anaytics

• AWS IoT Analytics Workshop

• AWS IoT Analytics Performance

• Using AWS IoT and Amazon SageMaker to do IoT Devices Predictive Maintenance

• IoT Time-series Forecasting for Predictive Maintenance

Edge

• AWS IoT Greengrass V2 Workshop

OTA

• Building a Scalable Standardized Pipeline for Automotive OTA on AWS

AIOT

• 制造业端到端(AIOT)动手训练营

Security

• AWS Security Hands on Lab - URL need whitelist
• AWS Security Hands on Lab2
• Public Access Consideration
• Curated list of links, references, books videos, tutorials, Exploit, CTFs, Hacking Practices etc. which are related to AWS Security
• An AWS Pentesting tool that lets you use one-liner commands to backdoor an AWS account's resources

Encryption - KMS

• Share-CMK-across-multiple-AWS-accounts
• Using-SM-Key-Algorithm-in-China

Credential - Secret Manager

• Secret Manager quick start demo

• Cross-Accounts-Secrets

Certificate - Certificate Manager

• Upload-SSL-Certificate

• Create certificate using openssl

• Free SSL certificate

• [Validate the ACM certificate]

  • Switch acm certificate validation
  • Troubleshooting acm certificate email validation

Asset Management and Compliance

• How to use the RDK for AWS Config Automation

AuthN and AuthZ

• Connect to Your Existing AD Infrastructure

• Cognito User Pool alternative solution - Authing demo

• Summary the Single-Sign-On cases

  • Enabling Federation to AWS console using Windows Active Directory, ADFS, and SAML 2.0
  • Using IAM federation and Switch role to implement the Single Sign On multiple AWS Accounts
  • Okta-OpenID-AWS-in-the-Browser
  • Enabling custom identity broker access to the AWS console
  • Grant my Active Directory users access to the API or AWS CLI with AD FS
  • Using-temporary-credentials-with-AWS-resources
  • Okta - AWS China multi-account console integration
  • Keycloak on aws

• Automatically rotate IAM user access keys at scale

Sentitive Data

• How to bootstrap sensitive data in EC2 User Data

Threat detection - GuardDuty

• GuardDuty Simulator

WAF

• aws-deployment-with-fortiweb-waf Source Code

• AWS WAF-Workshop

• WAF-Simulation-With-DVWA

• 使用 Amazon WAF 进行 Captcha人机验证

Permission - IAM Policy, S3 Policy, RAM Policy

• Policy evaluation logic

• How can I use permissions boundaries to limit the scope of IAM users and roles and prevent privilege escalation?

• Enforce MFA authentication for IAM users

• How can I use IAM roles to restrict API calls from specific IP addresses

Multi accounts structure

• Accessing and administering the member accounts in your organization

• Share a subnet with other account

SIEM and SOC

• Security Hub quick start
• Customer security findings for security hub

Network

VPC

• How to solve private ip exhaustion with private nat solution

• How do I modify the IPv4 CIDR block of my Amazon VPC

  • How can I modify the CIDR block on my VPC to accommodate more hosts

Keep private - VPC Endpoint and PrivateLink

• How to verify EC2 access S3 via VPC S3 Endpoint?

• Why can’t I connect to an S3 bucket using a gateway VPC endpoint?

• The customer have a private subnet without NAT and want to use ssm vpc endpoint to connected to SSM service

• Using VPC PrivateLink to do cross VPC traffic

NAT and proxy

• How I can setup transparent proxy - squid

• Nginx S3 Reverse Proxy

Load balancers

• NLB-TLS-Termination + Access log

• Current limits of AWS network load balancers

Cross data center and cloud Leasing Line - Direct Connect and VPN

• Direct Connect Cheat sheet

• Direct Connect Monitoring

  • DX_Ping_check

• Amazon Direct Connect inter-region routing for public access resources

• Connect alibaba cloud to aws via vpn

• How to achieve active-active/active-passive Direct Connect connection

Cross board transfer

• Cross region EC2 to EC2 transfering speed testing

Cross accounts and Cross VPCs - TGW

• TGW cross account sharing and inter-connection testing

• VPC-Cross-Account-Connection

Acceleration network

• Using Amazon Global Accelerator to improve cross board request improvement

• Amazon CloudFront Extensions

• Enable the HTTPS access for CloudFront

• Optimizing performance for users in China with Amazon Route 53 and Amazon CloudFront

• CloudFront support HTTP/3

Edge

• Protecting workloads on AWS from the Instance to the Edge

Network Secuirty

• GWLB Example

• Transit Gateway Connect 集成FortiGate安全服务

• How to check the Internet Traffic with VPC Flow?

• [Traffic Mirror]

  • Using VPC Traffic Mirroring to monitor and secure your VPC
  • 借助 VPC Traffic Mirroring 构建网络入侵检测系统

DNS

Route 53

• Route53 in China region

• How do I troubleshoot Route53 geolocation routing issues

• Route53 Routing Policy

• Route53 Resolver

• Route53 cross-account-dns

Serverless

Serverless Workshop

• AWS Serverless Day

• Serverless Patterns Collection

• Serverless coffee workshop

• AWS Serverless SaaS Workshop

Function as Service - Lambda

• Lambda integration

  • Using AWS Lambda with Amazon Kinesis
  • How to put the S3 event to Kafka using lambda
  • Demo how to send the Lambda logs to S3 and ElasticSearch by using Kiensis Firehose
  • Run the serverless wordpress with AWS Lambda and AWS EFS
  • AWS 告警通知到微信
  • Lambda write PostgreSQL
  • Lambda sent email
    • Using Amazon SES
    • Using SendCloud
    • 利用 Lambda 调用 smtp
  • 使用 Lambda 函数URL + CloudFront 实现S3镜像回源

• Lambda usage

  • Schedule-Invoke-Lambda
  • AWS Lambda Custom Runtime for PHP
  • How to clean up the elastic network interface created by Lambda in VPC mode
  • How to get the lambda public IP address
  • How to retrieve the System Manager Parameter Store from lambda
  • Understanding the Different Ways to Invoke Lambda Functions
  • Run web applications on AWS Lambda without changing code

• Lambda cost

  • 使用 Graviton 2优化Serverless车联网架构
  • Optimizing your AWS Lambda costs – Part 1
  • Optimizing your AWS Lambda costs – Part 2

• Lambda performance

  • Understanding AWS Lambda scaling and throughput
  • Lambda provisioned capacity autoscaling的实践

API Gateway

• Build Private API with API Gateway and integrate with VPC resource via API Gateway private integration

• API Gateway for API design patterns

• Understanding VPC links in Amazon API Gateway private integrations

Step function

• Configure Step Functions state machine as a target of Event

Build the serverless - SAM, Chalice, Serverless framwork, CDK

• hello-cdk

• Build and deploy a serverless application with the SAM CLI in China reigon

• SAM templates and lightweight web frameworks

• AWS Serverless Workshop

• Chalice - A framework for writing serverless applications

Serverless with AI/ML

• Create the pandas layer for lambda

• AWS Lambda – Container Image Support

• Lambda invoke AWS Rekgonition

• Lambda OpenCV

Migration

Journey to Adopt Cloud-Native Architecture

• #1 – Preparing your Applications for Hypergrowth
• #2 – Maximizing System Throughput
• #3 – Improved Resilience and Standardized Observability
• #4 – Governing Security at Scale and IAM Baselining
• #5 – Enhancing Threat Detection, Data Protection, and Incident Response

Active Directory

• How to migrate your on-premises domain to AWS Managed AD?

Database

• How to migrate MySQL to Amazon Aurora by Physical backup

• aws-database-migration-samples

• Migrating SQL Server to Amazon RDS using native backup and restore

• Microsoft SQL Server to Amazon S3

• Best practices for migrating PostgreSQL databases to Amazon RDS and Amazon Aurora

• Flink CDC Database Data

• Migrating data to Amazon Aurora with PostgreSQL

Data migration tool - DMS

• DMS Workshop
• AWS Database Migration Workshop scenario based

Data migration tool - 3rd party tool

• Migration-Data-From-AliCloud
• [XData])migration/DataMigration/XData.md

Cross Cloud Migration

Migrate from AliCoud workshop

File migration

• Getting Start Transfer Family

• Transfer Family to access EFS

• SFTP on AWS

Storage

S3 cross region or cross cloud OSS

• How to sync S3 bucket data between global region and China region

• Cross region S3 file download and upload

• S3 trasnfer tool

• s3-benchmark-testing

• Cross cloud OSS sync to S3

• RClone Quickstart

• Synchronize S3 bucket contents with Amazon S3 Batch Replication

S3

• S3 Web Explorer

• S3-Presign-URL

  • Embeded the image in html with S3-Presign-URL

• Uploading to Amazon S3 directly from a web or mobile application

• S3 disale TLS1.1 access or enforce TLS1.2 for in-transit encryption

• 使用 VPC Endpoint 从 VPC 或 IDC 内访问 S3

• Adding and removing object tags with S3 Batch Operations

• S3 inventory usage

• How Trend Micro uses Amazon S3 Object Lambda to help keep sensitive data secure

• Using S3 Intelligent-Tiering

• How to Check S3 object integrity

• 通过 STS Session Tags 来对 AWS 资源进行更灵活的权限控制 - 但是需要一个认证机制去确保userid可信的

EBS

• How do I create a snapshot of an EBS RAID array

• EBS benchmark testing

Storage Gatewway

• storage-gateway-demo and performance testing
• How can I troubleshoot an S3AccessDenied error from my file gateway
• How can I set up a private network connection between a file gateway and Amazon S3
• Resolve an internal error when activating my Storage Gateway

EFS and FSx or other shared file system

• EFS Workshop for GCR

• Amazon FSx for Lustre or Amazon FSx for Windows File Server Workshop

• Amazon FSx for Windows File Server file share on an Amazon EC2 Linux instance You can mount an Amazon FSx for Windows File Server file share on an Amazon EC2 Linux instance that is either joined to your Active Directory or not joined.

• goofys on AWS

• EFS Web Browser for list files and directory

• Global Region Simple File Manager for Amazon EFS

• 基于AWS DataSync 迁移 NetApp NAS上云

Database

RDS

RDS usage

• Amazon Aurora MySQL Database Quick Start Reference Deployment

• RDS common questions

• Use Proxysql for RDS for MySQL or Aurora databases connection pool and Read/Write Split

• Proxy for PostgreSQL

• AWS Bookstore Demo App - Purpose-built databases enable you to create scalable, high-performing, and functional backend infrastructures to power your applications

• [PostgreSQL Logging]

  • 如何使用 Amazon RDS for PostgreSQL 启用查询日志记录 query logging？
  • Working with RDS and Aurora PostgreSQL logs: Part 1
  • Working with RDS and Aurora PostgreSQL logs: Part 2

• RDS mysql max connections

• rds-postgresql ERROR: <module/extension> must be loaded via shared_preload_libraries

• [MySQL 手工分库分表]

  • Amazon Aurora的读写能力扩展之ShardingSphere-Proxy篇
  • 拓展 Aurora的读写能力之Gaea篇

RDS Cross region, cross account, data replication and backup

• MySQL Cross Region Replica

• 通过 Debezium and MSK Connect 一站式解决所有数据库 CDC 问题

• Cross vpc access RDS MySQL via VPC endpoint

• DB Snapshot cross region copy and backup cross region replication

• QuickStart RDS PostgreSQL and backup

• How-to-achive-postgreSQL-Table

RDS upgrade

• Achieving minimum downtime for major version upgrades in Amazon RDS PostgreSQL

• How to Migrate from Amazon RDS Aurora or MySQL to Amazon Aurora Serverless

• Aurora MySQL 5.6 upgrade blog

• Minimum downtime Aurora MySQL5.6 upgrade using clone

RDS Security

• Managing postgresql users and roles

• best-practices-for-working-with-amazon-aurora-serverless

• Securing sensitive data in Amazon RDS

• MySQL validate_password plugin

• Encrypt the Unencrypted RDS

• Disable_RDS_encryption

• RDS MySQL and Aurora MySQL Audit logs

• RDS PostgreSQL and Aurora PostgreSQL Audit

  • pgaudit extention

RDS Performance

• Amazon Aurora Performance Assessment

  • Managing performance and scaling for Amazon Aurora MySQL
  • Managing performance and scaling for Amazon Aurora PostgreSQL
  • "Too Many Connections" error when connecting to my Amazon Aurora MySQL instance

• Automate benchmark tests for Amazon Aurora PostgreSQL

• benchmarking-read-write-speed-on-amazon-aurora-classic-rds-and-local-disk

Graph Database

• Neo4j-On-AWS

• How to use the Neptune to Build Your First Graph Application

• 利用Neptune图数据库构建工厂知识图谱实践

ElastiCache

• Building a fast session store for your online applications with Amazon ElastiCache for Redis

• Database Caching Strategies Using Redis

• 使用Redisson连接Amazon ElastiCache for redis 集群

• ElastiCache for Redis 慢日志可视化平台

• RedisInsight 官方可视化工具

Key-Value and Document

DynamoDB

• DynamoDB labs

• [Migration and Replication]

  • 如何将我的 DynamoDB 表从一个 AWS 账户迁移到另一个账户
  • Streaming Amazon DynamoDB data into a centralized data lake
  • 中国区与 Global 区域 DynamoDB 表双向同步
  • aws-dynamodb-cross-region-replication
  • DynamoDB table initial migration from global to China

• [Security]

  • Securing sensitive data in Amazon DynamoDB

• [Performance]

  • DynamoDB_Pagenation

MongoDB and DocumentDB

• Get-Start-DocumentDB

• DocumentDB performance benchmark

• 利用ChangeStream实现Amazon DocumentDB表级别容灾复制

• Amazon DocumentDB（兼容 MongoDB）增加了对跨区域快照复制的支持

Time series

• Amazon TimeStream Performance Testing

Container

EKS

EKS networking

• 关于Amazon EKS中Service和Ingress深入分析和研究

• 一文看懂 Amazon EKS 中的网络规划

• [How do I use multiple CIDR ranges with Amazon EKS]

  • Check your VPC setting
  • Add the additioal CIDR

• Cluster networking for Amazon EKS worker nodes

EKS practice

• eks-workshop-greater-china

• EKS-Workshop-China

  • EKS in Beijing 3 AZ

• Advanced EKS workshop

• EKS Best Practices Guides

• Windows pod in EKS

• [EKS Managed Group]

  • Overview
  • Quotas
  • Official doc
  • Cluster autoscaler Managed node groups are managed using Amazon EC2 Auto Scaling groups, and are compatible with the Cluster Autoscaler. You can deploy the Cluster Autoscaler to your Amazon EKS cluster and configure it to modify your Amazon EC2 Auto Scaling groups.
  • Vertical Pod Autoscaler
  • Horizontal Pod Autoscaler

Data On EKS

• data-on-eks

DevOps on EKS

• Install SSM Agent on Amazon EKS worker nodes by using Kubernetes DaemonSet

• How can I check, scale, delete, or drain my worker nodes on EKS

• 关于Amazon EKS基于Gitlab的CICD实践

• DataDog for EKS control plane monitoring

• Exclusive Node from EKS ELB

• Securing Kubernetes with Private CA

ECS

• ECS workshop for china region

• ECS quick start demo workshop

• ECR Sync up from global from China and ECS Service Discovery

• How can I create an Application Load Balancer and then register Amazon ECS tasks automatically

• How can I a ECS service serve traffic from multiple port?

• How to launch tomcat server on ECS

• [Amazon ECS firelens]

  • firelens examples
  • firelens demo

• amazon-ecr-cross-region-replication

Fargate

• Recursive Scaling Fargate with Amazon SQS

• aws-fargate-fast-autoscaler

• EKS on Fargate QuickStart

Istio, Envoy, App Mesh, Service discovery

• AWS App Mesh Workshop

• AWS App Mesh ingress and route enhancements

• Running microservices in Amazon EKS with AWS App Mesh and Kong

• [EKS and CloudMap]

  • Introducing AWS Cloud Map MCS Controller for K8s
  • Cross Amazon EKS cluster App Mesh using AWS Cloud Map
  • Cloud Map for serverless applications

ECR

• ecr-cross-region-replication

• ECR Sync up from global from China and ECS Service Discovery

DevOps

Management

• AWS Management Tool stack workshop

• How to make the Trust Advisor Check automatically

[AWS Well-Architected]

• AWS Well-Architected labs
• AWS Well-Architected Labs in Chinese

[Organizing Your AWS Environment Using Multiple Accounts]

• Organizing Your AWS Environment Using Multiple Accounts Whitepaper

• Landing Zone example

• AWS Services Autoscaling

CI/CD

• CodeCommit and - CodeCommit setup

• Codebuild Get Start

• CodePiple Workshop

Serverless CICD

• Serverless CI/CD based on Jenkins

• Lambda CICD with Jenkins and CodeBuild and CodeDeploy

• AWS Serverless CI/CD hands on lab

Container CICD

• 在 AWS 中国区 EKS 上以 GitOps 方式构建 CI/CD 流水线

Monitoring and Tracing

• X-Ray in AWS China region

• AWS DevOps Management Observability workshop

• Accessing the AWS Health API

• 一键部署在钉钉群里自动创建 AWS Support Case 无服务器解决方案

  • Event Bridge rule to capture EC2 status change & AWS health event in different AWS region

• SMS notification for AWS health event

• Add alarms-in-batches for ec2 on cloudwatch

  • Use tags to create and maintain Amazon CloudWatch alarms for Amazon EC2 instances
  • Automatically create a set of CloudWatch alarms with tagging
  • 监控告警一点通：在CloudWatch上为 EC2批量添加告警
  • 企业微信、钉钉接收 Amazon CloudWatch 告警
    • 一键部署企业微信，钉钉，飞书，Slack 告警
    • 一键部署Telegram 告警

• Monitor using Prometheus and Grafana Here is how to deploy Grafana on EKS

• Datadog integration with AWS China

• [Grafana and CloudWatch integration]

  • Grafana AWS CloudWatch data source
  • Grafana cloudwatch plugin

Quota Monitor on AWS

Logging

• How to send CloudWatch logs to S3

• Central Logging on AWS

• How to stream logs from CloudWatch logs to Splunk

• [Log Hub]

  • Log Hub for EKS
  • Log Hub for WAF

Change configuration

• AWS AppConfig Workshop

• AWS Config for resource housekeeping and cost optimization

• Community Config Rules

  • AWS Config related blogs

• Create a Lambda Function for a Cross-Account Config Rule

• How-to-get-public-resources

Developer

• CSV tools

• Python GUI lib

Infra as Code

• How to migrate global cloudformation to China reigon?

• Terraform_Demo

• CloudFormation Stack Set

• AWS Cloud Control API QuickStart

Integration

Quque, notification

• How to build Amazon SNS HTTP Subscription?

• SQS quick start demo for Standard Queue and JMS

• Sent message to SQS queue using Lambda

Call Center

• Use the Amazon Connect to call out the mobile phone

• Automotive Call Center Services Solution Using Amazon Connect

MQ

• AmazonMQ-Workshop
  • Automate RabbitMQ configuration in Amazon MQ
  • consumer_timeout Amazon RabbitMQ 不支持修改
  • [Jenkins 与 RabbitMQ集成]
    • Jenkins 与 RabbitMQ集成 一
    • Jenkins 与 RabbitMQ集成 二
    • Jenkins plugin to connect RabbitMQ then consume messages in queue
    • RabbitMQ Jenkins build trigger

Email

• Amazon Simple Email Service SES Usaga

Media

Video on Demand

• Video on Demand on AWS

Video Streaming

• 无服务器直播解决方案

• Open source web conferencing solution - Jitsi

• Unreal Engine 像素流送在g4dn上实现容器化部署实践

Mobile

Moible app development

• Tutorial: Intro to React – React

GraphQL - AppSync

• AppSync-Workshop

Business continuity

Backup

• Backup FAQ

DR

• Understand resiliency patterns and trade-offs to architect efficiently in the cloud

• [Building a disaster recovery site on AWS for workloads on Google Cloud]

  • Part 1
  • Part 2

RDS HA/DR

• Amazon RDS Under the Hood: Multi-AZ

• • 使用 Amazon RDS for Oracle 配合 Oracle Active Data Guard 建立托管的灾难恢复与只读副本

• RDS MySQL Automated frequency backup

Game

GameLift

• [unreal engine game server]
  • Add Amazon GameLift to an unreal engine game server project - Amazon GameLift
  • Host Unreal Engine UE Game on GameLift

SAP

HA/DR

• SAP云上自适应跨可用区高可用方案
• 基于CloudEndure的新一代云上一键灾备解决方案与最佳实践

Office and business application

Workspaces - VDI

• How to Enable Multi-Factor Authentication for AWS Services by Using AWS Microsoft AD and On-Premises Credentials

Metaverse

• possibilities-of-healthcare-in-the-metaverse
• life-sciences-in-the-metaverse