AWS Fargate & ECS Masterclass

Kalyan Reddy Daida

StackSimplify
 AWS Fargate & ECS
Masterclass
Course Contents

Kalyan Reddy Daida StackSimplify

 Course Outline
• Fargate & ECS - First Steps
• Docker Fundamentals
• Fargate & ECS Fundamentals
• ECR – Elastic Container Registry
• Load Balancing & Service Autoscaling
• Continuous Integration & Continuous Delivery
• Microservices Deployment without Service Discovery
• Microservices Deployment with Service Discovery
• Microservices Deployment with AWS App Mesh and X-Ray
• Microservices Canary Deployment with AWS App Mesh
• CloudFormation for Fargate Deployments

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Introduction

Kalyan Reddy Daida StackSimplify

 ECS & Fargate - Introduction
• ECS – Elastic Container Service
• Fargate – Serverless Container Service
• ECS is a highly scalable, fast, container management service that makes it
easy to run, stop, and manage Docker containers on a cluster.
• We can host our cluster on a serverless infrastructure that is managed by
Amazon ECS by launching our services or tasks using the Fargate launch
type.
• We can use Amazon ECS to schedule the placement of containers across our
cluster based on our resource needs, isolation policies, and availability
requirements.
• Amazon ECS eliminates the need for us to operate our own cluster
management and configuration management systems or worry about
scaling our management infrastructure.

Kalyan Reddy Daida StackSimplify

 ECS & Fargate - Introduction
• Amazon ECS can be used to create a consistent deployment and build
experience, manage, and scale batch and Extract-Transform-Load
(ETL) workloads, and build sophisticated application architectures on
a microservices model.

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
First Steps

Kalyan Reddy Daida StackSimplify

 Fargate or ECS Objects

Task Definition

Cluster
ECS Objects

Service

Task

Kalyan Reddy Daida StackSimplify

 Fargate & ECS – First Steps
• Container Definition
• Nothing but container image and container level settings (Example: Container Image,
Port, registry, Environment Variables to pass to container etc)
• Task Definition
• A task definition is a blueprint for our application and describes one or more containers
through attributes.
• Very few attributes are configured at the task level, but majority of attributes are
configured per container.
• It is a combination of multiple container definitions if we are using more than one
container image in a Task.
• Service
• A service allows you to run and maintain a specified number (the "desired count") of
simultaneous instances of a task definition in an ECS cluster.
• Fargate Cluster
• The infrastructure in a Fargate cluster is fully managed by AWS. Our containers run
without we managing and configuring individual Amazon EC2 instances.
• Task
• A task is the instantiation of a task definition within a cluster.
• After we have created a task definition for our application within Amazon ECS, we can
specify the number of tasks that will run on our cluster (run task directly or configure to
run from a service).
• Each task that uses the Fargate launch type has its own isolation boundary and does not
share the underlying kernel, CPU resources, memory resources, or elastic network
interface with another task.

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Clusters

Kalyan Reddy Daida StackSimplify

 Fargate & ECS Fundamentals – Clusters Introduction

• We have 3 types of cluster templates

available in ECS.
ECS Cluster Types
• Fargate - Serverless
• EC2 – Linux
• EC2 - Windows
• An ECS cluster is a logical grouping of
tasks or services.
• Clusters are Region-specific. Fargate (Serverless) EC2 + Linux EC2 + Windows

• Clusters can contain tasks using both the

Fargate and EC2 launch types.

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Cluster Features

Kalyan Reddy Daida StackSimplify

 Fargate & ECS Fundamentals – Cluster Features
A service allows you to run and maintain a specified number of simultaneous instances
Services of a task definition in an ECS cluster.

Tasks A task is the instantiation of a task definition within a cluster

ECS Instances Will be created when we create the cluster launch type of EC2+Linux or EC2+Windows

CloudWatch Container Insights collects, aggregates, and summarizes metrics and logs
Metrics from your containerized applications and microservices.

Clusters
(Fargate or ECS) Scheduled Tasks Used primarily for long running stateless services and applications.

ECS resources can be tagged with values that we define, to help us organize and
Tags identify them.

Capacity A capacity provider is used in association with a cluster to determine the infrastructure
Providers that a task runs on.

Update Cluster Update the cluster settings primarily leading to Cluster Capacity Providers

Delete Cluster Used to delete ECS EC2 or Fargate Clusters

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Task Definition

Kalyan Reddy Daida StackSimplify

 Fargate & ECS Fundamentals – Task Definition
• Task Definition
• A task definition is required to run Docker containers in Amazon ECS
• A task definition is a blueprint for our application and describes one or more containers through
attributes.
• Some attributes are configured at the task level, but majority of attributes are configured per
container.
• Task Definition Parameters - Core
• The Docker image to use with each container in your task
• How much CPU and memory to use with each task
• The launch type to use, which determines the infrastructure on which our tasks are hosted (EC2 or
Fargate)
• The Docker networking mode to use for the containers in our task (Fargate defaults to awsvpc, where
as EC2 supports docker networking models like Birdged, Host, None and awsvpc too).
• The logging configuration to use for our tasks
• Whether the task should continue to run if the container finishes or fails
• Any data volumes that should be used with the containers in the task
• And many more……..

Kalyan Reddy Daida StackSimplify

 EC2 Launch Task Definition
Task Definitions Type Name Task Definition – Parameters List

Task Role

Healthcheck
Network Mode

Task Execution Environment

Container Name
IAM Role
Environment
Fargate Task Size Image Varibales
Launch Type (Memory, CPU)
Container
Container Private Repo Timeouts
Standard Authentication
Definitions
Network
Service Integration Memory Limits Settings
(Soft, Hard)
Proxy Storage &
Configuration Port Mappings Logging

Log Router Resource Limits

Configuration Advanced

Volumes Docker Labels

Kalyan Reddy Daida StackSimplify

 Fargate & ECS Fundamentals – Task Definition
• Step-1: Create Task Definition
• Task Role
• IAM role that tasks can use to make API requests to authorized AWS services
• Network Mode
• For Fargate we have only option available is awsvpc in addition we will have Docker
Bridge, Docker Host Only and None network modes. We will see them during ECS EC2
Cluster.
• Task Execution Role
• This role is required by tasks to pull container images and publish container logs to
Amazon CloudWatch on our behalf.

Kalyan Reddy Daida StackSimplify

 Fargate & ECS Fundamentals – Task Definition
• Create Task Definition
• Task Size
• The task size allows us to specify a fixed size for our task.
• Task size is required for tasks using the Fargate launch type and is optional for the EC2 launch
type.
• Container level memory settings are optional when task size is set.
• Task size is not supported for Windows containers.
• Container Definition
• Standard Settings
• Container Name
• Image: stacksimplify/dockerintro-springboot-helloworld-rest-api:1.0.0-RELEASE
• Private Repo
• Memory Limits
• Port Mappings
• Advanced Container Configurations
• Storage & Logging: Log Configuration

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Elastic Container Registry - ECR
Kalyan Reddy Daida StackSimplify
 Elastic Container Registry - ECR
• Elastic Container Registry (ECR) is a fully-managed Docker container registry
that makes it easy for developers to store, manage, and deploy Docker
container images.
• ECR is integrated with Elastic Container Service (ECS), simplifying our
development to production workflow.
• ECR eliminates the need to operate our own container repositories or worry
about scaling the underlying infrastructure.
• ECR hosts our images in a highly available and scalable architecture,
allowing us to reliably deploy containers for our applications.
• Integration with AWS Identity and Access Management (IAM) provides
resource-level control of each repository.
• With Amazon ECR, there are no upfront fees or commitments. We pay only
for the amount of data you store in your repositories and data transferred
to the Internet.

Kalyan Reddy Daida StackSimplify

 Elastic Container Registry - ECR
• Benefits
• Full managed
• Secure
• Highly Available
• Simplified Workflow

Kalyan Reddy Daida StackSimplify

 How ECR Works?
Developer
Docker Container

Push Images Elastic Container Service - ECS

Docker Image Pull Docker Container

Pull Images Images
and Run
Containers
Elastic Container Registry - ECR Elastic Kubernetes Service - EKS

Docker Container

On-Premise

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Continuous Integration & Continuous Delivery

CodeCommit CodeBuild CodeDeploy CodePipeline CloudWatch Simple Notification Service

Kalyan Reddy Daida StackSimplify

 Stages in Release Process

Source Build Test Production

• Check-in source • Compile Code & • Integration tests • • Deployment

Deploymenttoto
code build artifacts (war with other production
production
• Peer review new ,jar, container systems. environments
environments
code images, • Load Testing • • Monitor
Monitorcodein
codein
• Pull Request Kubernetes • UI Tests production
productiontoto
process manifest files) • Security Tests quickly
quicklydetect
detect
• Unit Tests • Test Environments errors
errors
(Dev, QA and
Staging)

Kalyan Reddy Daida StackSimplify

 Stages in Release Process

Source Build Test Production

Kalyan Reddy Daida StackSimplify

 Continuous Integration

Source Build Test Production

• Automatically kick off a new release when new code is checked-in

• Build and test code in a consistent, repeatable environment
• Continually have an artifact ready for deployment

Kalyan Reddy Daida StackSimplify

 Continuous Delivery
Source Build Test Production

• Automatically deploy new changes to staging environments fortesting

• Deploy to production safely without affectingcustomers
• Deliver to customers faster
• Increase deployment frequency, and reduce change lead time and change failure
rate
Kalyan Reddy Daida StackSimplify
 AWS Developer Tools or Code Services
Source Build Test Deploy Monitor

AWSCodeCommit AWSCodeBuild AWSCodeBuild + CodeDeploy Fargate Amazon

Third Party or ECS CloudWatch

AWSCodePipeline
Kalyan Reddy Daida StackSimplify
 AWS Developer Tools or Code Services
Source Build Test Deploy Monitor

AWSCodeCommit AWSCodeBuild AWSCodeBuild + Fargate Amazon

Third Party or ECS CloudWatch

AWSCodePipeline
Kalyan Reddy Daida StackSimplify
 AWS CodeCommit

Kalyan Reddy Daida StackSimplify

 AWS CodeCommit - Introduction
• Version Control Service hosted by AWS
• We can privately store and manage documents, source code, and
binary files
• Secure & highly scalable
• Supports standard functionality of Git (CodeCommit supports Git
versions 1.7.9 and later.)
• Uses a static user name and password in addition to standard SSH..

Kalyan Reddy Daida StackSimplify

 CodeCommit – Integration with AWS Services
AWS CodeStar AWS CodeBuild AWS CodePipeline AWS Cloud9 AWS Amplify AWS CloudFormation

AWS CodeCommit

Amazon Simple Notification AWS Key Management AWS Elastic Beanstalk Amazon CloudWatch
AWS CloudTrail
Service Service
Kalyan Reddy Daida StackSimplify
 CodeCommit - Steps
Developer

Local Git
Repo

push

AWS Cloud

AWS CodeCommit

Kalyan Reddy Daida StackSimplify

 AWS CodeBuild

Kalyan Reddy Daida StackSimplify

 CodeBuild - Introduction
• CodeBuild is a fully managed build service in the cloud.
• Compiles our source code, runs unit tests, and produces artifacts
that are ready to deploy.
• Eliminates the need to provision, manage, and scale our own build
servers.
• It provides prepackaged build environments for the most popular
programming languages and build tools such as Apache Maven,
Gradle, and many more.
• We can also customize build environments in CodeBuild to use our
own build tools.
• Scales automatically to meet peak build requests.

Kalyan Reddy Daida StackSimplify

 How to run CodeBuild? How CodeBuild works?

Kalyan Reddy Daida StackSimplify

 Source
Amazon Simple Storage
AWS CodeCommit
Service (S3) GitHub GitHub Enterprise Bitbucket

AWS Managed Image

AWS CodeBuild Amazon CloudWatch

Build Logs
Amazon EC2 Container
Registry

Amazon Simple Notification

Service
External Container
Registry (Docker Amazon Simple Storage Build Notifications
Hub) Service (S3)

Build Environment Build Artifacts AWS CodeBuild Architecture

Kalyan Reddy Daida StackSimplify
 CodeBuild - Steps Developer

Commit code changes

Local Git
Repo
push

AWS Cloud

AWS CodeCommit

AWS CodeBuild Simple Storage

Service (S3)

Kalyan Reddy Daida StackSimplify

 AWS CodePipeline

Kalyan Reddy Daida StackSimplify

 CodePipeline - Introduction
• AWS CodePipeline is a continuous delivery service to model,
visualize, and automate the steps required to release your software.
• Benefits
• We can automate our release processes.
• We can establish a consistent release process.
• We can speed up delivery while improving quality.
• Supports external tools integration for source, build and deploy.
• View progress at a glance
• View pipeline history details.

Kalyan Reddy Daida StackSimplify

AWS CodePipeline Architecture AWS CodePipeline

AWS CodeCommit AWS CloudFormation Amazon Elastic Container

Service

AWS CodeBuild Amazon CloudWatch

Amazon EC2 Container
Registry AWS CodeDeploy
Amazon Elastic Container
Service (Blue/Green)

Simple Storage AWS Elastic Beanstalk

Service (S3)
Jenkins GitHub Webhooks
Simple Storage
Service (S3)
AWS Service Catalog
GitHub

Source Build Deploy Monitor Source Changes

Kalyan Reddy Daida StackSimplify
 Continuous Delivery

Kalyan Reddy Daida ©Amazon StackSimplify

 AWS Cloud
CI CD Process
Developer CloudWatch CodePipeline

Commit code changes

Local Git push S3

Repo
CodeCommit CodeBuild Fargate or ECS Simple Notification
Service
ECR

Staging Production Authorized

Approver

Task Service Container Task Service Container

Definition Definition

Elastic Container Service

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
What are
Microservices?

Kalyan Reddy Daida StackSimplify

 What are Microservices?
• Microservices - also known as the microservice architecture - is an
architectural style that structures an application as a collection of
services that are
• Highly maintainable and testable
• Loosely coupled
• Independently deployable
• Organized around business capabilities
• Owned by a small team

Kalyan Reddy Daida StackSimplify

 Microservices - Benefits
• Developer independence: Small teams work in parallel and can iterate
faster than large teams.
• Isolation and resilience: If a component dies, you spin up another while
and the rest of the application continues to function.
• Scalability: Smaller components take up fewer resources and can be scaled
to meet increasing demand of that component only.
• Lifecycle automation: Individual components are easier to fit into
continuous delivery pipelines and complex deployment scenarios not
possible with monoliths.
• Relationship to the business: Microservice architectures are split along
business domain boundaries, increasing independence and understanding
across the organization.

Kalyan Reddy Daida StackSimplify

 Microservices Deployment on AWS ECS – No Service Discovery

AWS Cloud
User Management
Service

g mt* Task Service Container

rm Amazon RDS
use
Definition
/
Postman services.stacksimplify.com

Client
/n
Elastic Load Balancing (ELB) o ti End User
fic
ati
o n* Notification Service

/n Task
o ti Service Container Simple Email
fic Definition
Email
ati Service (SES)
o n*
API Developer

Kalyan Reddy Daida StackSimplify

 Microservices Deployment on ECS - with Service Discovery
AWS Cloud
User Management
Service

g mt* Task Service Container

rm Amazon RDS
use
Definition
/

/notification*
Postman services.stacksimplify.com

Client
/n
Elastic Load Balancing (ELB) o ti AWS Cloud Map End User
fic Amazon Route 53
ati
o n* Notification Service

/n Task
o ti Service Container Simple Email
fic Definition
Email
ati Service (SES)
o n*
API Developer

Kalyan Reddy Daida StackSimplify

 Microservices – with AWS AppMesh on ECS
AWS Cloud

Postman
UMS Envoy Proxy NS Envoy Proxy
Client
Elastic Load App Mesh
Balancer

User Management Service Notification Service

API User
Proxy To Notification Notification Info AP
Egress 3306 Info API
End User
Create User API Send Notification API
User Management Microservice Notification Microservice

Egress 587
Amazon RDS Simple Email
Service (SES)

Email

Kalyan Reddy Daida StackSimplify

 Microservices – Canary Deployments with AppMesh on ECS
AWS Cloud
App Mesh

Virtual Router

50% Traffic to V1 50% Traffic to V2

Postman
Client UMS Envoy Proxy NS Envoy Proxy – V1 NS Envoy Proxy – V2
Elastic Load
Balancer

User Management Service Notification Service Notification Service

API User Proxy To Notification Notification Info API Notification Info API
Info API – V1 – V2
User Management Microservice Notification Microservice Notification Microservice

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Microservices
Deployment

Kalyan Reddy Daida StackSimplify

 Microservices
• User Management Microservice
• Notification Microservice

Kalyan Reddy Daida StackSimplify

 Microservices

Postman Send Notification

Create User API
Client API

List Users API Email End User

Health Status API

Delete User API

Health Status API

User Management Microservice Notification Microservice

API Developer
Or
API User SMTP
Users DB Server

Kalyan Reddy Daida StackSimplify

 Microservices Deployment on AWS ECS
AWS Cloud
User Management
Service

g mt* Task Service Container

rm Amazon RDS
use
Definition
/
Postman services.stacksimplify.com

Client
/n
Elastic Load Balancing (ELB) o ti End User
fic
ati
o n* Notification Service

/n Task
o ti Service Container Simple Email
fic Definition
Email
ati Service (SES)
o n*
API Developer

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Microservices
Service Discovery

Kalyan Reddy Daida StackSimplify

 Microservices Deployment on ECS with Service Discovery
AWS Cloud
User Management
Service

g mt* Task Service Container

rm Amazon RDS
use
Definition
/

/notification*
Postman services.stacksimplify.com

Client
/n
Elastic Load Balancing (ELB) o ti AWS Cloud Map End User
fic Amazon Route 53
ati
o n* Notification Service

/n Task
o ti Service Container Simple Email
fic Definition
Email
ati Service (SES)
o n*
API Developer

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Cloud Map

Kalyan Reddy Daida StackSimplify

 Complexity of modern architectures

• Wide variety of resources

• Complexity grows exponentially
• Multiple versions and stages coexist
• Infrastructure scales dynamically
• Unhealthy resources are replaced

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 How to find resources to connect to?

Service Discovery
Finding the location of a service provider

myapp: {10.20.30.4:8080, 10.20.30.6:8080}

mylogs: {S3bucket1, S3bucket2}

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 Server-side service discoverypattern

- Connections are proxied

- Discovery is abstracted away
- Availability and capacity impact Request Request
Client Service Provider
- Additional latency
LB +
Register
Service
Service Provider
Registry

Register
Service Provider

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 Client-side service discoverypattern

- Clients connect directly to providers

- Fewer components in the system
- Clients must be registry-aware Request
Client Service Provider
- Client-side load balancing
Register
Query
Service Provider
Register

Service
Service Provider
Registry
Register

Kalyan Reddy Daida StackSimplify

 Existing solutions require setup andmanagement

Service
registry

Service
Registries

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 Build the dynamic map of your cloud

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 AWS Cloud Map - Introduction
• AWS Cloud Map is a cloud resource discovery service.
• With Cloud Map, you can define custom names for your application
resources, and it maintains the updated location of these dynamically
changing resources.
• This increases your application availability because your web service always
discovers the most up-to-date locations of its resources.
• Cloud Map allows you to register any application resources, such as
databases, queues, microservices, and other cloud resources, with custom
names.
• Cloud Map then constantly checks the health of resources to make sure the
location is up-to-date.
• The application can then query the registry for the location of the resources
needed based on the application version and deployment environment.

Kalyan Reddy Daida StackSimplify

 AWS Cloud Map registry
microservices.local

notification-service

• Namespace Name = notification-service

DNS record = A TTL = 60 sec
• Service Health Check = Yes

• Service Instance
ECS Task-1 ECS Task-2 ECS Task-3
172.10.0.1 172.10.0.2 172.10.0.3

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Microservices & App Mesh
Kalyan Reddy Daida StackSimplify
 AWS App Mesh

Refernce: https://aws.amazon.com/app-mesh/

Kalyan Reddy Daida StackSimplify

 Microservices – without AWS AppMesh on ECS

AWS Cloud

User Management Service Notification Service

Proxy To Notification Notification Info AP

Info API
Postman
End User
Client Create User API Send Notification API
Elastic Load
Balancer User Management Microservice Notification Microservice

Simple Email
Amazon RDS
Service (SES)

API User Email

Kalyan Reddy Daida StackSimplify

 Microservices – with AWS AppMesh on ECS
AWS Cloud

Postman
UMS Envoy Proxy NS Envoy Proxy
Client
Elastic Load App Mesh
Balancer

User Management Service Notification Service

API User
Proxy To Notification Notification Info AP
Egress 3306 Info API
End User
Create User API Send Notification API
User Management Microservice Notification Microservice

Egress 587
Amazon RDS Simple Email
Service (SES)

Email

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
Microservices Canary
Deployments with App Mesh
Kalyan Reddy Daida StackSimplify
 Microservices – Canary Deployments with AppMesh on ECS
AWS Cloud
App Mesh

Virtual Router

50% Traffic to V1 50% Traffic to V2

Postman
Client UMS Envoy Proxy NS Envoy Proxy – V1 NS Envoy Proxy – V2
Elastic Load
Balancer

User Management Service Notification Service Notification Service

API User Proxy To Notification Notification Info API Notification Info API
Info API – V1 – V2
User Management Microservice Notification Microservice Notification Microservice

Kalyan Reddy Daida StackSimplify

 AWS Fargate & ECS
CloudFormation
Kalyan Reddy Daida StackSimplify
 Fargate Tasks – Public Subnet in a VPC
AWS Cloud

VPC 10.0.0.0/16

Public subnet

10.0.1.0/24

Task-1 Task Definition

Internet
Internet Elastic Load
Gateway Balancing
Task-2 Service
Fargate Cluster

Kalyan Reddy Daida StackSimplify

 Thank You

Kalyan Reddy Daida StackSimplify