Brkarc-2023 (2018)
Brkarc-2023 (2018)
Building Hybrid
Clouds in Amazon
Web Services with
the CSR 1000v
Chris Hocker, Customer Solutions Architect
Steven Carter, Principal Solutions Architect, Redhat
BRKARC-2023
#CLUS
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Events App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Agenda
• CSR 1000v and AWS Overview
• Cloud Network Architectures
• Advanced Features
• CSR 1000v in Azure
• Automation
• Summary
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
CSR 1000v and AWS
Overview
Cisco Cloud Services Router (CSR) 1000V
Cisco IOS XE Software in a Virtual Network Function Form-Factor
Software
CSR 1000V
• Familiar IOS XE software
Infrastructure Agnostic
• Runs on x86 platforms
App App
• Supported Hypervisors: VMware ESXi, Linux KVM, Citrix Xen,
RP Microsoft Hyper-V, Cisco NFVIS (ISRv) and CSP2100
OS OS DP • Supported Cloud Platforms: Amazon AWS, Microsoft Azure
Performance Elasticity
Virtual Switch • Available licenses range from 10 Mbps to 10 Gbps
Hypervisor • CPU footprint ranges from 1vCPU to 8vCPU
License Options
Server • Term based 1 year, 3 year or 5 year
• PAK and Smart License enabled
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Q: Where can I find the CSR on AWS?
A: In the AWS marketplace!
2. Pick a flavor
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
What are the different CSR 1000V types listed?
1. Cloud Services Router 1000V BYOL
• Can be any tech package and throughput level depending on license purchased from Cisco
and installed on CSR (not all throughputs supported)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Other CSR 1000V License Options
Cisco Smart Licensing Public Cloud Utility-Billing (Eg. Amazon)
CSR 1000V
Call Home
• No up-front purchase required (Hourly)
• By default CR1000 is allocated 4GB RAM, increase RAM by steps of 4GB up to 16GB RAM
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
CSR 1000v Licensing Structure Example:
Pick one option from each column…
IPBase
Technology Package
Throughput License Type 250 Mbps
(See next slide for details)
1-Year
10 Mbps
IPBase
50 Mbps
Term Based License
(1-year, 3-year or 5-year)
100 Mbps
500 Mbps
AppX 1 Gbps
Basic Networking: BGP, OSPF, EIGRP, RIP, ISIS, IPv6, GRE, VRF-LITE, NTP, QoS, BFD
Multicast: IGMP, PIM
IPBase High Availability: HSRP, VRRP, GLBP
(formerly Standard) Addressing: 802.1Q VLAN, EVC, NAT, DHCP, DNS
Basic Security: ACL, AAA, RADIUS, TACACS+
Management: IOS-XE CLI, SSH, Flexible NetFlow, SNMP, EEM, NETCONF
IPBase Plus…
SEC Advanced Security: Zone Based Firewall, IPSec VPN, EZVPN, DMVPN, FlexVPN, SSLVPN,
(formerly Advanced) GETVPN
High Availability: Box-to-box HA for FW and NAT
IPBase Plus…
Advanced Networking: L2TPv3, MPLS, VRF, VXLAN
AppX Application Experience: WCCPv2, AppNAV, NBAR2, AVC, IP SLA
Hybrid Cloud Connectivity: LISP, OTV, VPLS, EoMPLS
AX ALL FEATURES
(formerly Premium)
Feature in Red will not work in AWS/Azure – limitation of public cloud infrastructure(lack of L2 support, Multicast not support)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Reference
CSR 1000V License Throughput Enforcement
• Rate shaper is implemented in the ESP
data path at the root of the QoS hierarchy
15 Mbps 10 Mbps
• All egress traffic is subjected to the shaper G1 ESP G3
• The rate is derived from license
SHAPER
• Throughput limit is global, not per-interface (50)
20 Mbps 15 Mbps
• Shaper does not distinguish between different G2
G4
types of traffic 10Mbps (60-50)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Cisco CSR 1000V Performance on AWS
IOS-XE 16.8.1 release, large packet, with Intel Meltdown and Spectre fix.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Reference
CSR Scale (across all public and private clouds)
IOS-XE 16.8.1
Feature Scale
VRF 4000
NAT 512,000
BFD 500
IPSLA 10,000
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
VPC 101
VPC
• Logically isolated network with its own IP 10.99.0.0/16
Subnet A
range, routes, security, etc.
10.99.1.0/24
• IP ranges (RFC1918) can be overlapping
• Subnets created inside VPC
• Internet gateway (IGW) connects outside IGW Subnet B
and between VPCs 10.99.2.0/24
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
Region and Availability Zone Concepts
• VM (Virtual Machines) is hosted in multiple data centers across the world. A region is
a separate geographic area
• VM instances have to be launched into a specific region. Locating instances close to
end users can reduce latency
• Region is consisted by multiple AZs (Availability Zone). Each AZ is isolated, but AZs
in a region are connected through low latency and high bandwidth links.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
VGW (Virtual Private Gateway)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
VPC Peering
• High Bandwidth VPC to VPC Interconnection
• Share Private IP CIDR routes between the VPCs
• Inter-Region Peering is new
• Point to Point
• No Transit Peering VPC
Dev
VPC
QA
Peering
us-west
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
CSR Advantages over…
Virtual Private Gateway: VPC Peering:
• Scalability • Scalability
• Performance • Performance
• Continuity of Operations • Overlapping CIDR blocks
• Richer routing features • Transitive peering relationships
• Active/Active Tunnels • Multiple peerings per VPC
• Spoke-to-spoke routing • Spoke-to-spoke routing
• Security/Application Visibility • Security/Application Visibility
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
CSR Deployment Models
Application VPC Gateway Transit Hub Router
VPC
AZ1 AZ2
Application VPC Transit Hub
VPC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Application VPC Design Models with CSRs
One Armed Mode
VPC
IGW Router
G1
Public Subnet Private Subnet
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
Application VPC Design Models with CSRs
Two Armed Mode
• Network Subnet
• Both CSR interfaces in the same subnet VPC
IGW Router
• Use VRFs to separate interfaces for terminating tunnels,
local traffic, and management
• Private Subnet VPC Route Table modified to add CSR as G1 G2
gateway
Network Subnet Private Subnet
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Application VPC Design Models with CSRs
Multiple Availability Zone Design Model
Public Private
IGW Subnet Subnet
G1
AZ2
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
No Link Local Broadcast in the VPC
• No Link local multicast or broadcast
• Affected services include:
• IGPs NAT 10.1.1.10
54.x.x.x 10.1.1.10
• HSRP/VRRP
10.1.1.11
• BFD
• Proxy ARP, Gratuitous ARP 10.1.1.12
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
NAT in a VPC
• Will break services that do not work over
NAT, such as GET-VPN
• Tunnel source will be a private address
NAT 10.1.1.10
• Tunnel destination from the perspective of 54.x.x.x 10.1.1.10
VPN peers will be a public address
10.1.1.11
• Assign EC2 elastic IP address so that
address does not change if the CSR1K is 10.1.1.12
shutdown
• Other VPCs see Elastic IP address unless
using VPC peering
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
CSR and VPN Tunnels
• Need to open security groups for IKE (UDP/500) and
ESP (either IP/50 or UDP/4500)
• Disable Src/Dst Check on interfaces with local VPC
traffic
• Use interface name as tunnel source (e.g. Gig1)
• Use VPC route table to direct traffic for VPN Virtual Private Cloud
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
Reference
MTU Considerations
• Jumbo frames (up to 9000 bytes) are allowed within single VPC.
• Traffic going out of a VPC or VPC peering connection has MAX 1500 MTU.
• CSR supports jumbo frames by putting “mtu <1500-9216>” under
interface configuration. However, when CSR sends traffic out of a VPC,
packets will be fragmented if it’s over 1500 bytes.
• Supported instance types:
• General purpose: M3, M4, M5, T2
• Compute optimized: C3, C4, C5, C5 with instance storage, CC2
• Accelerated computing: F1, G2, G3, P2, P3
• Memory optimized: CR1, R3, R4, X1
• Storage optimized: D2, H1, HS1, I2, I3
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/network_mtu.html#jumbo_frame_instances
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
CSR Management Access
• No console in AWS
• Management and remote access of the CSR will
happen over SSH via a private or public IP
address
• Need to open SSH (TCP/22) ingress in the
security group
• Consider using dedicated management interface
• Configuring VRF causes loss of connectivity
• EEM script used to work around.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
Cloud Network
Architectures
Cloud WAN
Reference Architecture
Cloud Cloud
Gateway Apps
IaaS Provider 1
Dedicated
Branch Connections
Enterprise
WAN Cloud Cloud
Co-Lo Gateway Apps
IaaS Provider 2
Internet
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Use Case 1 – Enterprise Extension into AWS
VPC
WAN
Enterprise Network
San Jose
• Connect one or many physical locations into an Amazon VPC. IPSec, DMVPN,
FlexVPN, EZVPN, etc…
• Up to 1,000 concurrent VPN tunnels per CSR.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Use Case 1A – Private App in Public Cloud
Design Options
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
Use Case 1B - Public App in Public Cloud
Subnet 1 Subnet 2
Internet
Internet Users
Corporate Data Center
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
Use Case 2 – VPC Interconnection
• VPCs can be in the same region or different regions, or in other cloud providers
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Across regions, accounts/subscriptions
Transit VPC VPC
Shared
VPC
A
VPC
C
Services
ASR Other
Provider
Networks
Private DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Direct Connect Overview
• Dedicated connection between the enterprise and AWS
• Provides (1) private peering to VPCs and (2) public peering to AWS public services
• Sub-interface on corporate DC router for each service
• BGP peering for route exchange for each service
Cisco
Virtual Private
ISR/ASR
Gateway (VGW)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Direct Connect Topologies (1/2)
Direct Connect
Corporate DC
Virtual Private Cloud
Direct from
Enterprise ISR/ASR VGW
Direct Connect
Corporate DC
Virtual Private Cloud
SP Managed SP VPN
Service
ISR/ASR SP Router
VGW
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Direct Connect Topologies (2/2)
Direct Connect
Corporate DC
Virtual Private Cloud
Co-Lo
Direct from Co-Lo
ISR/ASR ISR/ASR VGW
Direct Connect
Corporate DC Virtual Private Cloud
Co-Lo
Co-Lo Cloud
Exchange
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Direct Connect Peering Requirements Reference
• Each private (VPC) and public connection requires a virtual interface
• BGP peering to AWS for each virtual peering for route exchange
• Can use VRFs to segment peerings into different routing domains
• Typical peering router requirements
• 1GE/10GE interfaces
• Bi-directional line-rate performance
• Sub-interfaces ISR4000 – Up to 2 Gbps
• BGP
• VRFs
• IPSec/Tunnels/Crypto
• High availability features ASR1000 - Up to 200 Gbps
• Netflow/AVC
• QoS (shaping)
• NAT
• Security Features
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Direct Connect With CSR 1000V and Private VIF
• Primary use cases are encryption, Transit VPC, WAN/DMVPN extension, VRF
Extension
• Tunnel endpoints are private IP addresses
• Up to 4.5 Gbps throughput per CSR1K
Connected VPC
Cisco VGW CSR 1000V
Interface CIDR Block
ISR/ASR
IPSec Tunnel
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Direct Connect With CSR 1000V and Public VIF
• Public Virtual Interface
Public Virtual Interface Peering
IPSec Tunnel
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Internet Access Options (1/2)
Local Internet Access Central Internet Access
• EC2 Public IP, Local NAT Instance, or • Leverage existing enterprise internet
Elastic Load Balancer connection and security perimeter
Internet Internet
Security
Private DC Private DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
Internet Access Options (2/2) Co-Lo Internet Access
Direct Internet Access • Leverage local co-lo internet
• Central security enforcement
connectivity
Security Internet
Co-Lo
Security
Transit VPC
Private DC Private DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Advanced Features
DMVPN Design Option 1
Local Internet Access for App Subnets
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
DMVPN Design Option 2
“Full Tunnel” for App Subnets
• Separate routing tables for internet
DMVPN
and App/internal networks
0/0
• Uses front-door “internet” VRF for
connecting to VPN peers
Tun0
• App VMs and Tunnels are in the
global routing table G1 G2
0/0
• App VMs usually will not have local IGW
Public App
internet access or local access to Subnet Subnet
AWS public services
• Can use “route leaking” if desired G1 – internet VRF
• VPC endpoints for S3 service G2, Tun0 - Global
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Reference
Front Door VRF Cisco EEM Applet
event manager applet fvrf
event none
• Common design option for Cisco WAN action 1.0 cli command "enable”
designs. See action 1.1 cli command "conf t”
• http://www.cisco.com/c/dam/en/us/td/doc action 1.2 cli command "interface gig1”
s/solutions/CVD/Feb2016/CVD- action 1.3 cli command "vrf forwarding
internet-vrf”
IWANDesignGuide-FEB16.pdf
action 1.4 cli command "ip address dhcp”
• Can be used to install multiple default action 2.0 cli command "end”
routes
• One to the internet to reach VPN peers Run the Cisco EEM Applet
event manager run fvrf
• One over the tunnel to reach internal
networks
17.24.0.0/2
Tunnel
• Can also be used to resolve recursive 4
routing issues
VPC
peering
• Requires EEM applet
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
CSR Cloud High Availability
VPC
• No virtual IP as with HSRP, since CSR
Subnet
AWS doesn’t allow multicast App
Subnet A
• AWS Route Tables for app
subnets are re-pointed to
opposite CSR
App
• Failure detection is automatic Subnet B
http://www.cisco.com/c/en/us/td/docs/routers/csr1000/software/aws/b_csraws/b_csraws_chapter_0100.html
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
CSR Cloud HA Configuration
Create IAM ReplaceRoute Role
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"ec2:AssociateRouteTable",
"ec2:CreateRoute",
"ec2:CreateRouteTable",
"ec2:DeleteRoute",
"ec2:DeleteRouteTable",
"ec2:DescribeRouteTables",
"ec2:DescribeVpcs",
"ec2:ReplaceRoute",
"ec2:DisassociateRouteTable",
"ec2:ReplaceRouteTableAssociation»
],
"Resource": "*"
}
] }
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
CSR Cloud HA Configuration • IAM role can now be assigned to
EC2 instance after launch
Deploy CSR and Assign IAM Role
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
CSR Cloud HA Configuration
Configure GRE Tunnel, BFD, and EIGRP
interface Tunnel99
passive-interface GigabitEthernet1
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
CSR Cloud HA Configuration (prior to 16.3.1a)
Configure EEM
Reference Example
redundancy redundancy
cloud provider [ aws | azure ] <node-id> cloud provider aws 1
bfd peer <ipaddr> bfd peer 172.24.99.2
route-table <table-id> route-table rtb-631bda06
cidr ip <ipaddr>/<mask> cidr ip 0.0.0.0/0
eni <elastic-network-interface> eni eni-d679128f
region <region-name> region us-west-2
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Extend Segmentation to AWS
Multi-tenant Mission
Network Subnet 1
MPLS PE
PE CSR – MPLS
Core Direct VPN over GRE
Connect Subnet 2
PE
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
Multi-VRF VPCs
Option 1 – Interface per Subnet VPC
• CSR Interfaces Public
Subnet
• Public subnet interface in global table, GE2
App
used for tunnels Subnet A
• VPC Security
• Use VPC network ACLs and/or security
groups to isolate subnets from each
other.
* Number of interfaces supported varies by instance type
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Multi-VRF VPCs
Option 2 - CSR in Public Subnet VPC
• CSR Configuration Public
Subnet
• Single public subnet interface in global App
table Subnet A
VPC Routing
172.24.2.0/24
•
• Single route table for App subnets with a
0/0 route to the CSR public subnet ENI
• VPC Security
• Use VPC network ACLs and/or security
groups to isolate subnets from each
other.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
Reference
PBR Set-VRF Sample Configuration
access-list 100 permit ip 172.24.1.0 interface GigabitEthernet1
0.0.0.255 any
ip vrf receive blue
access-list 101 permit ip 172.24.2.0
0.0.0.255 any ip vrf receive green
! ip address dhcp
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
NAT
• NAT overload to allow private subnet VMs to communicate to internet
• Complex NAT scenarios are possible by assigning secondary private and public
addresses to CSR instances and using these as additional NAT addresses
• NAT pools
• 1:1 NAT Floating IP:
55.128.99.23
• NAT is not stateful between an HA pair in AWS
interface GigabitEthernet1
g1 g2
ip nat outside
interface GigabitEthernet2
172.24.2.0/25 172.24.2.128/25
ip nat inside
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
Enterprise-Wide Application Visibility
• Uses Netflow and IP SLA
• GUI for application visibility
• IP SLA configuration and monitoring
• Extends application visibility to your
cloud border
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Enterprise-Wide Security Visibility
• Uses Netflow
• GUI for security visibility
• Extends application visibility to your cloud: NetFlow
https
• Uncovering Network Reconnaissance
• Finding Internally Spread Malware StealthWatch
Management
• Revealing Data Loss Console
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
IP SLA
• Actively monitor and measure performance
• Collects data about response time, one-way latency, jitter, packet
loss, voice-quality scoring, application performance, and server
response time
• IP SLA events can be used in routing decisions and EEM
ip sla 1
icmp-echo 192.168.1.11 source-ip 172.24.0.4
ip sla schedule 1 start-time now life forever
ip sla responder
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Other Features
• Remote Access VPN – IPSec and SSL VPN
• Zone-Based Firewall
• Encrypted Traffic Analytics
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
Emerging Solutions
Extend Trust Sec into AWS Transit VPC
Dev App 1 Pro App 2 Test
App 3
VPC1 VPC2 VPC3
Transit VPC
ASR
Private DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
Cisco SD-WAN Solution
vManage
APIs
3 rd Party
vAnalytics
Automation
vBond
vSmart Controllers
MPLS 4G
INET
vEdge Routers
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
Cloud onRamp for SaaS
• Optimized Connectivity to SaaS Microsoft
Express
Applications
Cloud Apps
Route
MPLS INET
2 1
vEdge vEdge
Branch DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Cloud onRamp for IaaS – Attached Compute
• WAN to Cloud Extension
• vEdge router joins the fabric and all fabric services are extended
to the IaaS instances, e.g. multipathing, segmentation and QoS vManage
Platform
MPLS INET
vEdge vEdge
Branch DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Cloud onRamp for IaaS – Gateway VPC/VNET
• A pair of vEdge routers is instantiated in Amazon
VPC or Microsoft Azure VNET
BGP BGP BGP
• A pair of standard based IPSec tunnels is stretched
from gateway VPC/VNET to each host VPCs/VNETs Gateway
VPC/VNET
• BGP is established across IPSec tunnels for route
advertisement vManage
Platform
vEdge vEdge
Branch DC
Standard IPSec
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
Coming
ACI Anywhere: On-Prem Connectivity To AWS
Multi-Site
Infra VPC
VM VM VM CSR1000V
AWS Instances
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
CSR 1000v in Azure
Where to Find the CSR 1000v on Azure
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
Cisco CSR 1000V Performance on Public Clouds
IOS-XE 16.8.1 release, large packet, with Intel Meltdown and Spectre fix.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
Azure General Terminology
Azure Concept AWS Related Concept
Virtual Machine EC2 Instance
Region Region
Availability Zone (new) Availability Zone
Availability Set No equivalent
Resource Group Resource Group
Resource Manager Templates Cloud Formation Templates
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
Azure Network Terminology
Azure Concept AWS Related Concept
Virtual Network (VNet) VPC
Network Security Group Security Groups and Network ACL
VNet Route Table VPC Route Table
User-Defined Routes Added VPC Routes
Virtual Network Gateway (VPN or Express Router) VGW
Local Network Gateway CGW
Gateway Subnet Not applicable
ExpressRoute Direct Connect
Public IP Address (Dynamic / Static) Public IP / Elastic IP
Network Virtual Appliance (NVA) EC2 Instance
VNet Peering VPC Peering
Virtual Network Service Endpoint VPC Endpoint
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
Azure Virtual Networks (VNet)
• A VNet logically isolates a network’s own IP range,
Virtual Network
routes, security policies, etc.
CIDR 10.2.0.0/16
• Each subnet created is automatically assigned a route
Subnet A
table that contains system routes:
Local VNet Rule, On-prem rule and Internet Rule 10.2.1.0/24
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
CSR 1000v as Gateway in Azure
• To make deployment of the CSR easy, we insert a set of templates in
the Azure portal to deploy all these resources at once:
172.24.2.0/24
• 2 NIC CSR (currently, the only supported type)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Notable Azure Networking Differences vs AWS
• CSR1K Solution Templates in Marketplace
• VNet Route Tables vs VPC Route Tables
• No equivalent to Internet Gateway in Azure
• Outbound internet connectivity by default in Azure
• VNet Peering allows transit routing
• Availability Sets vs Availability Zones
• Gateway subnet for Express Route
• GRE not supported
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
CSR1000v with VNET Peering
• VNET Peering can be configured to allow transit
routing natively
• UDRs created for spokes that point to CSR as a
gateway.
• Can be specific routes or 0.0.0.0/0
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
Transit VNET with Tunnels Across regions, accounts/subscriptions
A B C
• High Throughput: spoke VPC scales up to
2Gbps, 400K routes on CSR, while 1.25Gbps on …...
VNG Spoke VPC
VNET
Transit VNET
• Application Visibility and Security
• Multi-Cloud: similar design for AWS and Azure Direct Connect
Internet
ASR Other
Provider
Networks
Private DC
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
CSR with Express Route Customer VNET
BGP2
4 CSR1 AZ1
BGP1
3 2 APP Subnet
ExpressRoute VNG 5
GW
ASR subnet
5. Setup the high availability between CSR1 and CSR2. Point your application subnet to either CSR1 or CSR2.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Automation
AWS CloudFormation
• AWS technology to define cloud stacks via a JSON file
• Comparable technologies in OpenStack (Heat) and Azure (RM Templates)
• Can be used to create VPCs or launch EC2 instances into existing VPCs
• For CSR, can be used to initially launch, and then also configure via user data
• Most useful for Day 0
• Template for CSR in GitHub repository
stack
template AWS
CloudFormation
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
IOS-XE 16.3
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Guest Shell Application
Linux Shell Environment On Your Switch or Router
• Maintains IOS-XE system integrity
• Isolated User Space
• Fault Isolation
Linux
• Resource Isolation applications
• On-box rapid prototyping
• Device-level API Integration Guest Shell
• Scripting (Python)
Open Application Container
• Linux Commands
API
• Application Hosting
Network OS
• Integrate into your Linux workflow
• Integrated with IOS-XE
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Guest Shell with On-Box Python for AWS
• Python is the de facto automation language for networking
• Local Scripts and Automation
• Get instance metadata
• Get summary of VPC configuration
• IOS-XE configuration automation
• EEM integration
https://github.com/CiscoDevNet/csr_aws_guestshell
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
Monitor CSR Real-Time Throughput by AWS
Cloud Watch
• Python script in Guest Shell
• Gather CSR throughput by “show platform hardware qfp active datapath utilization”
• Send key metric to AWS Cloud Watch through AWS python SDK boto3
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
Automation Demo
Multi-Site/Cloud Demo
10.1.0.0/16 10.2.0.0/16
host1 host1
- Check Connectivity
- Rollback on failure 10.0.2.0/24
Hub 10.0.0.0/16
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
Ansible
• Open-Source Infrastructure as Code Cloud
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
Summary
Cisco CSR 1000v Summary
• Primary use cases are:
• Enterprise Network Extension
• VPC Interconnection (including Transit VPC)
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
Evaluation Licenses
• , since non-BYOL instances are
pre-licensed as part of the hourly cost.
• By default BYOL instances boot with all features and 1 Mbps throughput.
• 60-day evaluation licenses are self-serve at:
• http://www.cisco.com/go/license
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
Additional Resources
Public Documentation:
• 20+ Demo Videos on CSR 1000V Youtube Channel
https://www.youtube.com/playlist?list=PLCiTBLSYkcoTUS6b4MFthdvhDrseo6MeN
• CSR 1000V Configuration Guide for AWS
http://www.cisco.com/c/en/us/td/docs/routers/csr1000/software/aws/b_csraws.html
• CSR 1000V Configuration Guide for Azure
http://www.cisco.com/c/en/us/td/docs/routers/csr1000/software/azu/b_csr1000config-
azure.html
• Multicloud Design Guides
https://www.cisco.com/c/en/us/solutions/design-zone/cloud-design-guides.html
• AWS VPC Presentations
https://www.youtube.com/user/AmazonWebServices/search?query=VPC
AWS Mailer ([email protected])
Azure Mailer ([email protected])
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
GitHub Repositories
• Ansible Demo
https://github.com/ismc/brkarc-2023_clus2018
• BRKARC-2023 Repo
https://github.com/chrishocker/brkarc-2023
• Ansible Playbooks
• CloudFormation Template
• Other Repos
https://github.com/CiscoDevNet/csr_aws_guestshell
https://github.com/stmosher/AWS-and-Azure-Hybrid-Cloud-Using-Cisco-
CSR1000v-DMVPN_v3.0
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
Related Sessions
Multicloud Networking – Design & Deployment [BRKCLD-3440]
• Wednesday, Jun 13, 10:30 a.m. - 12:00 p.m. | W414C
Extending Enterprise Network into Public Cloud with Cisco CSR1000v
[BRKARC-2749]
• Monday, Jun 11, 04:00 p.m. - 05:30 p.m. | W240AB
Automated VPC Connection Using a Transitive Hub in AWS [CCSCLD-2003]
• Monday, Jun 11, 03:00 p.m. - 04:00 p.m. | W315A
Continuous Integration and Testing for Networks with Ansible [DEVNET-
2076]
• Thursday, Jun 14, 10:30 a.m. - 11:15 a.m.
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
Complete your online session evaluation
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Thank you
#CLUS
#CLUS
Continue
your Demos in
the Cisco
Walk-in
self-paced
Meet the
engineer
Related
sessions
education campus labs 1:1
meetings
#CLUS BRKARC-2023 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 100