Copyright © Apstra, Inc. - 2016 - All Rights Reserved
Jeremy Schulman
@nwkautomaniac
The Datacenter Network
You Wish You Had
It's Yours for the Taking
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
15 min Talk
25 min Demo
5 min Q & A
Agenda
#NoBuzzwords #NoSalesPitch #NoJargon #NoBS
Jeremy Schulman
20 years in networking
Head of Customer Enablement
@ApstraInc
● 10 yrs Software/Eng distributed systems
● 10 yrs Field Systems/Eng
● Open source contributor
network automation (est. 2013)
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Inspiration for this Talk
" There is no such thing as container networking,
there is only networking. "
-- Kelsey Hightower
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
What You'll See Today
How every container IP address can be routed as any
other host in the datacenter network
Use different IP prefixes for different app
types to achieve traffic isolation
INTERNET
app
back-end
app
front-end
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Why is this Approach Important?
Ah-Ha !
Ping!
Cha-Ching !
Developers
DevOps
Network
applications
workload
infrastructure
network infrastructure
and services
scale app features
scale workload capacity
scale network capacity
Deploy
Operate + Grow Business
Design / Build
Maintain Service Uptime
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Why is this Approach Important?
"Less is More"
Reason Developer / DevOps Network
Reduce complexity / magic No container network overlays No datacenter fabric overlays
Use what you know
Keep using containers and
container management tools
Keep using standard routing
and network troubleshooting
tools
No vendor lock-in No container networking lock-in
No network hardware lock-in
No network OS lock-in
Attain situational awareness Quickly determine if network is the cause of application issues
Reduce Complexity • Increase Reliability
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
The Network We Wish We Had
IP Connectivity
Capacity Scaling
Traffic Isolation
Always Available
Expectations
Copyright © Apstra, Inc. - 2016 - All Rights Reserved
Complexity is the Mind Killer
The network is an interrelated collection of
distributed devices and protocols.
Software you didn't write, but have to troubleshoot.
The Problem: The Network We Do Have
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Troubleshooting,
as explained by the Telephone Game
Message In ! Message Out ?!
Imagine each person speaks two different languages …
Now imagine you need to figure out where things go wrong ...
You need to speak *all* the languages *all* the time
Copyright © Apstra, Inc. - 2016 - All Rights Reserved
Simplified Modern Datacenter
● Use one dynamic routing protocol for IP reachability and isolation
● Operate the same routing protocol everywhere, starting at servers
● Route containers as hosts, visible "citizens" in the network
● Leverage emerging automation technologies to manage operations
The Solution: The Network We Can Have
Copyright © Apstra, Inc. - 2016 - All Rights Reserved
The Awesome Demo
Running on My Laptop
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Technology Showcase
● Docker networking
ipvlan in l3-mode
● Docker Swarm with ETCD
● Docker IPAM plugin
● Container IP host route
injection
● Cumulus Linux network OS
● Deployed in a L3
Spine-Leaf Clos Fabric
● Dynamic Routing
● Cumulus VX / VirtualBox
● Universal Network Service
Management
● Datacenter L3 architecture
● Spine / Leaf Clos
● Server / Quagga
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Back-End
Front-End
Datacenter Router
Datacenter Fabric
2 Spine x 3 Leaf
IP Clos Design
Apstra
AOS-Server
Docker
Swarm
203.10.15 / 24
9.1.0.0 / 16
Container IP-Pools
INTERNET
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Container Route Distribution
eth0
datacenter
apps
swarm
node
Quagga
ipam
plugin
container
ip address
monitor
docker
socket
Docker Swarm
Controller
IPAM Server
Infrastructure Servers
1. Routing on the Host (Quagga)
2. Container IPs attached on eth0
3. Quagga peers routes with Leaf
4. Container IPs seen as /32 routes
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
Datacenter Route Distribution
Internet
Servers L3 Clos Fabric Router
BGP
7
1
2
3
5
6
app
back-end
app
front-end
Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved
L3 Clos Fabric RouterServers
Managing IP Routing
71 3 6
Apstra AOS-Server
manages network services
BGP, LLDP, interfaces, etc.
Copyright © Apstra, Inc. - 2016 - All Rights Reserved
The Awesome Demo
Copyright © Apstra, Inc. - 2016 - All Rights Reserved
Jeremy Schulman
@nwkautomaniac
Thank You!

More Related Content

PPTX
A Networking View for the DevOps Crew: SDN
PPTX
Puppet for Networking - Junos
PDF
Automation in Network Lifecycle Management - Bay Area Juniper Meetup
PDF
Python for the Network Nerd
PPTX
Automation intro
PPTX
Sdn not just a buzzword
PPTX
NetDevOps for the Network Dude: How to get started with API's, Ansible and Py...
PDF
[OpenStack Day in Korea 2015] Track 2-3 - 오픈스택 클라우드에 최적화된 네트워크 가상화 '누아지(Nuage)'
A Networking View for the DevOps Crew: SDN
Puppet for Networking - Junos
Automation in Network Lifecycle Management - Bay Area Juniper Meetup
Python for the Network Nerd
Automation intro
Sdn not just a buzzword
NetDevOps for the Network Dude: How to get started with API's, Ansible and Py...
[OpenStack Day in Korea 2015] Track 2-3 - 오픈스택 클라우드에 최적화된 네트워크 가상화 '누아지(Nuage)'

What's hot (20)

PDF
DPDK Architecture Musings - Andy Harvey
PPTX
Intro to Zenoss by Andrew Kirch
PDF
KURMA - A Containerized Container Platform - KubeCon 2016
PDF
Ai dev world utilizing apache pulsar, apache ni fi and minifi for edgeai io...
PPTX
Network infrastructure visibility and analytics with data streaming
PDF
Neutron high availability open stack architecture openstack israel event 2015
PDF
Openstack Neutron and SDN
PDF
[OpenStack Day in Korea 2015] Track 3-6 - Archiectural Overview of the Open S...
PDF
Mastering OpenStack - Episode 13 - Network Design
PDF
Matt Bruzek - Monitoring Your Public Cloud With Nagios
PDF
OpenStack Astara
PPTX
Automation for cloud
PPT
Nagios Conference 2014 - Dave Williams - Multi-Tenant Nagios Monitoring
PDF
Learning the basics of Apache NiFi for iot OSS Europe 2020
PPTX
Nagios Conference 2014 - Sam Lansing - Advanced Features of Nagios XI
PPTX
Cloud Computing Open Stack Compute Node
PPTX
OpenStack 101 - All Things Open 2015
PDF
TripleO
PDF
Inside Architecture of Neutron
PDF
Using the FLaNK Stack for edge ai (flink, nifi, kafka, kudu)
DPDK Architecture Musings - Andy Harvey
Intro to Zenoss by Andrew Kirch
KURMA - A Containerized Container Platform - KubeCon 2016
Ai dev world utilizing apache pulsar, apache ni fi and minifi for edgeai io...
Network infrastructure visibility and analytics with data streaming
Neutron high availability open stack architecture openstack israel event 2015
Openstack Neutron and SDN
[OpenStack Day in Korea 2015] Track 3-6 - Archiectural Overview of the Open S...
Mastering OpenStack - Episode 13 - Network Design
Matt Bruzek - Monitoring Your Public Cloud With Nagios
OpenStack Astara
Automation for cloud
Nagios Conference 2014 - Dave Williams - Multi-Tenant Nagios Monitoring
Learning the basics of Apache NiFi for iot OSS Europe 2020
Nagios Conference 2014 - Sam Lansing - Advanced Features of Nagios XI
Cloud Computing Open Stack Compute Node
OpenStack 101 - All Things Open 2015
TripleO
Inside Architecture of Neutron
Using the FLaNK Stack for edge ai (flink, nifi, kafka, kudu)
Ad

Viewers also liked (20)

PDF
The Rules of Network Automation - Interop/NYC 2014
PPTX
A Network Engineer's Approach to Automation
PDF
Interop 2015: Hardly Enough Theory, Barley Enough Code
PPTX
Network Automation - Interconnection tools
PPTX
Storage and hyper v - the choices you can make and the things you need to kno...
PPTX
Attacking Web Applications
PPTX
Managing Hyper-V With PowerShell
PPTX
Using Git/Gerrit and Jenkins to Manage the Code Review Processord
PPTX
Python (Jinja2) Templates for Network Automation
PDF
Introduction of Mesosphere DCOS
PPTX
Open Source MANO(OSM)
PDF
Router and Switches Cisco
PPTX
Next Generation Network Developer Skills
PPTX
Hyper V And Scvmm Best Practis
PDF
BigTec web-scale software defined Datacenter
PPTX
How Much Does it Cost to Build a Mobile App for iPhone & Android?
PPTX
Test-Driven-Development for Networking: Making CI Work for You by Colin McNam...
DOC
My Project Report Documentation with Abstract & Snapshots
PDF
How to Make Money With Your Photoshop Editing Skills
PDF
Complete Guide to Seo Footprints
The Rules of Network Automation - Interop/NYC 2014
A Network Engineer's Approach to Automation
Interop 2015: Hardly Enough Theory, Barley Enough Code
Network Automation - Interconnection tools
Storage and hyper v - the choices you can make and the things you need to kno...
Attacking Web Applications
Managing Hyper-V With PowerShell
Using Git/Gerrit and Jenkins to Manage the Code Review Processord
Python (Jinja2) Templates for Network Automation
Introduction of Mesosphere DCOS
Open Source MANO(OSM)
Router and Switches Cisco
Next Generation Network Developer Skills
Hyper V And Scvmm Best Practis
BigTec web-scale software defined Datacenter
How Much Does it Cost to Build a Mobile App for iPhone & Android?
Test-Driven-Development for Networking: Making CI Work for You by Colin McNam...
My Project Report Documentation with Abstract & Snapshots
How to Make Money With Your Photoshop Editing Skills
Complete Guide to Seo Footprints
Ad

Similar to The Datacenter Network You Wish You Had (20)

PPTX
Network Architecture for Containers
PPTX
Secure Your Containers: What Network Admins Should Know When Moving Into Prod...
PDF
Pets vs. Cattle: The Elastic Cloud Story
PDF
DevOps for networking boost your organization's growth by incorporating netwo...
PDF
Devops For Networking Steven Armstrong Armstrong Steven
PDF
When DevOps and Networking Intersect by Brent Salisbury of socketplane.io
PDF
Immediate download DevOps for networking boost your organization's growth by ...
PDF
PDF DevOps for networking boost your organization's growth by incorporating n...
PPTX
Deep-Dive on Container Networking Architectures - Frans van Rooyen - Dell EMC...
PDF
Enterprise-Grade Networking in OpenStack
PDF
Who Needs Network Management in a Cloud Native Environment?
PPTX
AWS User Group 5/12 meetup - ECS
PPTX
Infrastructure API Lightning Talk by Jeremy Pollard of box.com
PDF
AWS re:Invnet Highlights for VCs
PPTX
When networks meets apps (open stack atlanta)
PPTX
When Networks Meet Apps, Samuel Bercovici & Nati Shalom
PDF
Complete Download DevOps for networking boost your organization's growth by i...
PPTX
CON410 - Deep Dive into Container Networking (re:Invent 2018)
PDF
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...
PDF
Azure meetup cloud native concepts - may 28th 2018
Network Architecture for Containers
Secure Your Containers: What Network Admins Should Know When Moving Into Prod...
Pets vs. Cattle: The Elastic Cloud Story
DevOps for networking boost your organization's growth by incorporating netwo...
Devops For Networking Steven Armstrong Armstrong Steven
When DevOps and Networking Intersect by Brent Salisbury of socketplane.io
Immediate download DevOps for networking boost your organization's growth by ...
PDF DevOps for networking boost your organization's growth by incorporating n...
Deep-Dive on Container Networking Architectures - Frans van Rooyen - Dell EMC...
Enterprise-Grade Networking in OpenStack
Who Needs Network Management in a Cloud Native Environment?
AWS User Group 5/12 meetup - ECS
Infrastructure API Lightning Talk by Jeremy Pollard of box.com
AWS re:Invnet Highlights for VCs
When networks meets apps (open stack atlanta)
When Networks Meet Apps, Samuel Bercovici & Nati Shalom
Complete Download DevOps for networking boost your organization's growth by i...
CON410 - Deep Dive into Container Networking (re:Invent 2018)
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...
Azure meetup cloud native concepts - may 28th 2018

Recently uploaded (20)

PDF
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
PDF
Auditboard EB SOX Playbook 2023 edition.
PPTX
Build automations faster and more reliably with UiPath ScreenPlay
PDF
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
PDF
SaaS reusability assessment using machine learning techniques
PDF
Introduction to MCP and A2A Protocols: Enabling Agent Communication
PDF
CEH Module 2 Footprinting CEH V13, concepts
PDF
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
PPTX
Presentation - Principles of Instructional Design.pptx
PDF
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
PDF
Connector Corner: Transform Unstructured Documents with Agentic Automation
PDF
Lung cancer patients survival prediction using outlier detection and optimize...
PDF
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PDF
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
PDF
MENA-ECEONOMIC-CONTEXT-VC MENA-ECEONOMIC
PDF
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
PDF
EIS-Webinar-Regulated-Industries-2025-08.pdf
PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
substrate PowerPoint Presentation basic one
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
Auditboard EB SOX Playbook 2023 edition.
Build automations faster and more reliably with UiPath ScreenPlay
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
SaaS reusability assessment using machine learning techniques
Introduction to MCP and A2A Protocols: Enabling Agent Communication
CEH Module 2 Footprinting CEH V13, concepts
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
Presentation - Principles of Instructional Design.pptx
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
Connector Corner: Transform Unstructured Documents with Agentic Automation
Lung cancer patients survival prediction using outlier detection and optimize...
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
Basics of Cloud Computing - Cloud Ecosystem
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
MENA-ECEONOMIC-CONTEXT-VC MENA-ECEONOMIC
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
EIS-Webinar-Regulated-Industries-2025-08.pdf
4 layer Arch & Reference Arch of IoT.pdf
substrate PowerPoint Presentation basic one

The Datacenter Network You Wish You Had

  • 1. Copyright © Apstra, Inc. - 2016 - All Rights Reserved Jeremy Schulman @nwkautomaniac The Datacenter Network You Wish You Had It's Yours for the Taking
  • 2. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved 15 min Talk 25 min Demo 5 min Q & A Agenda #NoBuzzwords #NoSalesPitch #NoJargon #NoBS Jeremy Schulman 20 years in networking Head of Customer Enablement @ApstraInc ● 10 yrs Software/Eng distributed systems ● 10 yrs Field Systems/Eng ● Open source contributor network automation (est. 2013)
  • 3. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Inspiration for this Talk " There is no such thing as container networking, there is only networking. " -- Kelsey Hightower
  • 4. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved What You'll See Today How every container IP address can be routed as any other host in the datacenter network Use different IP prefixes for different app types to achieve traffic isolation INTERNET app back-end app front-end
  • 5. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Why is this Approach Important? Ah-Ha ! Ping! Cha-Ching ! Developers DevOps Network applications workload infrastructure network infrastructure and services scale app features scale workload capacity scale network capacity Deploy Operate + Grow Business Design / Build Maintain Service Uptime
  • 6. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Why is this Approach Important? "Less is More" Reason Developer / DevOps Network Reduce complexity / magic No container network overlays No datacenter fabric overlays Use what you know Keep using containers and container management tools Keep using standard routing and network troubleshooting tools No vendor lock-in No container networking lock-in No network hardware lock-in No network OS lock-in Attain situational awareness Quickly determine if network is the cause of application issues Reduce Complexity • Increase Reliability
  • 7. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved The Network We Wish We Had IP Connectivity Capacity Scaling Traffic Isolation Always Available Expectations
  • 8. Copyright © Apstra, Inc. - 2016 - All Rights Reserved Complexity is the Mind Killer The network is an interrelated collection of distributed devices and protocols. Software you didn't write, but have to troubleshoot. The Problem: The Network We Do Have
  • 9. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Troubleshooting, as explained by the Telephone Game Message In ! Message Out ?! Imagine each person speaks two different languages … Now imagine you need to figure out where things go wrong ... You need to speak *all* the languages *all* the time
  • 10. Copyright © Apstra, Inc. - 2016 - All Rights Reserved Simplified Modern Datacenter ● Use one dynamic routing protocol for IP reachability and isolation ● Operate the same routing protocol everywhere, starting at servers ● Route containers as hosts, visible "citizens" in the network ● Leverage emerging automation technologies to manage operations The Solution: The Network We Can Have
  • 11. Copyright © Apstra, Inc. - 2016 - All Rights Reserved The Awesome Demo Running on My Laptop
  • 12. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Technology Showcase ● Docker networking ipvlan in l3-mode ● Docker Swarm with ETCD ● Docker IPAM plugin ● Container IP host route injection ● Cumulus Linux network OS ● Deployed in a L3 Spine-Leaf Clos Fabric ● Dynamic Routing ● Cumulus VX / VirtualBox ● Universal Network Service Management ● Datacenter L3 architecture ● Spine / Leaf Clos ● Server / Quagga
  • 13. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Back-End Front-End Datacenter Router Datacenter Fabric 2 Spine x 3 Leaf IP Clos Design Apstra AOS-Server Docker Swarm 203.10.15 / 24 9.1.0.0 / 16 Container IP-Pools INTERNET
  • 14. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Container Route Distribution eth0 datacenter apps swarm node Quagga ipam plugin container ip address monitor docker socket Docker Swarm Controller IPAM Server Infrastructure Servers 1. Routing on the Host (Quagga) 2. Container IPs attached on eth0 3. Quagga peers routes with Leaf 4. Container IPs seen as /32 routes
  • 15. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved Datacenter Route Distribution Internet Servers L3 Clos Fabric Router BGP 7 1 2 3 5 6 app back-end app front-end
  • 16. Copyright © Apstra, Inc. - 2016 - All Rights ReservedCopyright © Apstra, Inc. - 2016 - All Rights Reserved L3 Clos Fabric RouterServers Managing IP Routing 71 3 6 Apstra AOS-Server manages network services BGP, LLDP, interfaces, etc.
  • 17. Copyright © Apstra, Inc. - 2016 - All Rights Reserved The Awesome Demo
  • 18. Copyright © Apstra, Inc. - 2016 - All Rights Reserved Jeremy Schulman @nwkautomaniac Thank You!