Juniper Apstra 4.2.

1
EVE-NG Virtual Lab Demo
Video series companion guide

VIDEO 7: DAY-1 OVER-THE-TOP DC

INTERCONNECT

Colin Doyle, Sr. CE AMER

See the complete video walkthrough on YouTube
at: https://www.youtube.com/@5minutejunos
Ask questions at the Juniper Elevate Community
using the hashtag #5minutejunos

Adapted from v4.0.0 documentation originally

compiled by:
© 2024 Juniper Networks - Raymond Lam, SSE APAC
 Agenda
Prepping your Lab

Day-0 Fabric Onboarding Day-1 Service Provisioning

• Virtual Device Profile Verification • Create Routing Zones
• Virtual Device Profile Cloning • Create Virtual Networks
• Onboarding Virtual Nodes • Assign Virtual Network to Switchports
• Create ASN Pool and IP Pools • Add Server Links
• Create Logical Devices and Interface Maps • Data Center Interconnect
• Create Rack Types • DCI Addendum: Direct Peering
• Create Templates • Core/WAN Connectivity
• Create Blueprints • Internet Connectivity

Day-2 Operational Scenarios Future Documentation

• Incorrect Cable Patch (RCA, LLDP Link • Firewall Service Chaining
Discovery, Time Voyager) • Cluster with Service Block
• Config Deviation Checking • Type-5 Route (fabric integrated)
• Apply custom config through Configlet with MNHA
• View Telemetry Data • VLAN Stitching
• Hardware Replacement • vEvo Fabric

© 2024 Juniper Networks 2

 Day-1 Service
Provisioning
• Create Routing Zones
• Create Virtual Networks
• Assign Virtual Network to Switchports
• Add Testing Hosts
• Data Center Interconnect (OTT)
• DCI Addendum – Direct Peering
• Core Connectivity
• Internet Connectivity

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
We will be provisioning an Over-The-Top (OTT) DCI for this lab. The border leafs
will peer with the external vMX routers to exchange fabric loopback reachability
routes. Once the border leafs in each fabric have loopback reachability, we can
peer them directly to exchange routes between DC fabrics.

Below diagram illustrates the topology of the data center after this section.
Unmanaged by Apstra, created in blueprints as external generic systems

eBGP peer, preconfigured in the setup

ext-rtr1 ext-rtr2

External links added in this

section to exchange loopback
ge-0/0/3 ge-0/0/3 address ge-0/0/3 ge-0/0/3
A- A- B- B-
border1 border2 border1 border2

A-spine1 A-spine2 B-spine1 B-spine2

A-leaf1 A-leaf2 B-leaf1 B-leaf2

© 2024 Juniper Networks 4

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged > Physical >
Topology and click “border_rack_dc_a_001_leaf1”
• Click the checkbox for the border rack node and
select “Add internal/external generic system”
• Create a new external generic system called ext-
rtr1, select “None” for the device representation,
and click “Next”
• Select port 3 on each border leaf, click the port icon
followed by the “Add Link” button for each, then
click “Create”
• Click the "ext-router", open the properties page and
edit its ASN, update it to 65001. If you skip this
step, Apstra will ask you to assign a ASN resource
pool to external generic system at later stage
• Go to Blueprints > DC-A > Staged > Policies >
Routing Policies, and click “Create Routing Policy”
• Name: ext-router-policy
• Import Policy: Extra Only
• Extra Import
Prefix GE
Mask
Routes:
LE
Mask
Actio
n

192.168.1.0/24 32 Deny

0.0.0.0/0 32 Permi
t

• Export Policy: Loopbacks only

© 2024 Juniper Networks
Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Go to Blueprints > DC-A > Staged >
Connectivity Templates and create a new
template called "ext-router-ct"

• Follow the screenshots to create the connectivity

template

• Assign the connectivity template to the ge-0/0/3

interface of both border leaf switches

• Go to Blueprints > DC-A > Staged > Physical,

edit the Link IP’s – To Generic resource, and add
the External Link IP Pool

• Go to Blueprints > DC-A > Staged > Virtual >

Protocol Sessions, get the ASN/IP address of
border leaf switches and IP address of external
router links

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Commit the Blueprint for DC-A

• Repeat the steps for DC-B:

• create an external generic system ext-rtr2

① ②
• add two links connecting to ge-0/0/3 of border1
and border2

• assign ASN 65002 to the external router

• create routing policy ext-router-policy (Import

“Extra Only”, deny 192.168.2.0/24 GE 32,
permit 0.0.0.0/0 GE 32, export only loopbacks)

• create connectivity template ext-router-ct

• assign the connectivity template to ge-0/0/3 of

border1 and border2

• assign External Link IP address pool to generic

systems

• get the ASN and IP address of border leaf

switches and external router

© 2024 Juniper Networks

Data Center Interconnect #1 – Underlay
• Login to ext-rtr1 and ext-rtr2, and then apply interface and routing configuration to establish underlay BGP connectivity to
EVPN fabric

• set
ext-rtr1
systemconfiguration
root-authentication plain-text-password (Juniper) (set local root password)
set system host-name ext-rtr1 (set local hostname)
delete chassis (stop auto-configure script)
set interfaces lo0.0 family inet address 172.31.0.0/32 (set local loopback address)
set interfaces ge-0/0/0.0 family inet address 10.100.100.0/31 (interface to ext-rtr2)
set interfaces ge-0/0/1.0 family inet address 10.3.0.1/31 (interface to A-border1)
set interfaces ge-0/0/2.0 family inet address 10.3.0.3/31 (interface to A-border2)
set routing-options autonomous-system 65001 (local ASN)
set protocols bgp group DCI neighbor 10.100.100.1 peer-as 65002 (BGP neighbor to ext-rtr2)
set protocols bgp group ebgp neighbor 10.3.0.0 peer-as 65102 (BGP neighbor to A-border1)
set protocols bgp group ebgp neighbor 10.3.0.2 peer-as 65103 (BGP neighbor to A-border2)

© 2024 Juniper Networks 22

Data Center Interconnect #1 – Underlay
• Login to ext-rtr1 and ext-rtr2, and then apply interface and routing configuration to establish underlay BGP connectivity to
EVPN fabric

• set
ext-rtr2
systemconfiguration
root-authentication plain-text-password (Juniper) (set local root password)
set system host-name ext-rtr2 (set local hostname)
delete chassis (stop auto-configure script)
set interfaces lo0.0 family inet address 172.31.0.1/32 (set local loopback address)
set interfaces ge-0/0/0.0 family inet address 10.100.100.1/31 (interface to ext-rtr1)
set interfaces ge-0/0/1.0 family inet address 10.3.0.5/31 (interface to B-border1)
set interfaces ge-0/0/2.0 family inet address 10.3.0.7/31 (interface to B-border2)
set routing-options autonomous-system 65002 (local ASN)
set protocols bgp group DCI neighbor 10.100.100.0 peer-as 65001 (BGP neighbor to ext-rtr1)
set protocols bgp group ebgp neighbor 10.3.0.4 peer-as 65202 (BGP neighbor to B-border1)
set protocols bgp group ebgp neighbor 10.3.0.6 peer-as 65203 (BGP neighbor to B-border2)

• Login to Spine, Border Leaf, and Leaf switches to verify the route table, you should be able to see the loopback address routes
from another data center

© 2024 Juniper Networks 23

Data Center Interconnect #1 – Underlay

© 2024 Juniper Networks 24

Data Center Interconnect #2 – Overlay
After exchanging the loopback addresses between data centers, we will create a
remote EVPN gateway in each blueprint to establish the EVPN BGP sessions
between border leaf switches.

The below diagram illustrates the topology of the data center after this section.

ext-rtr1 ext-rtr2
OTT EVPN BGP sessions created in
this section to exchange EVPN
routes

A- A- B- B-
border1 border2 border1 border2

A-spine1 A-spine2 B-spine1 B-spine2

A-leaf1 A-leaf2 B-leaf1 B-leaf2

© 2024 Juniper Networks 25

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Active > Physical >
Nodes and note the Loopback IP’s and ASN’s for the
border leaf switches

• Go to Blueprints > DC-A > Staged > DCI > Over the
Top or External Gateways, click “Create Over the Top
or External Gateway” button, then define the border
leaf switches in DC-B as the remote EVPN gateways
using the following table

Name IP Address ASN Local Gateway

B-border1 192.168.2.2 65202 border_rack_dc-a-
001_leaf1

B-border2 192.168.2.3 65203 border_rack_dc-a-

001_leaf2

• Commit the Blueprint

Repeat for DC-B by recording DC-A’s loopback and ASN assignments

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Active > Physical >
Nodes and note the Loopback IP’s and ASN’s for the
border leaf switches

• Go to Blueprints > DC-A > Staged > DCI > Over

the Top or External Gateways, click “Create Over
the Top or External Gateway” button, then define
the border leaf switches in DC-B as the remote
EVPN gateways using the following table

Name IP Address ASN Local Gateway

B-border1 192.168.2.2 65202 border_rack_dc-a-
001_leaf1

B-border2 192.168.2.3 65203 border_rack_dc-a-

001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Active > Physical >
Nodes and note the Loopback IP’s and ASN’s for the
border leaf switches

• Go to Blueprints > DC-A > Staged > DCI > Over

the Top or External Gateways, click “Create Over
the Top or External Gateway” button, then define
the border leaf switches in DC-B as the remote
EVPN gateways using the following table

Name IP Address ASN Local Gateway

B-border1 192.168.2.2 65202 border_rack_dc-a-
001_leaf1

B-border2 192.168.2.3 65203 border_rack_dc-a-

001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Active > Physical >
Nodes and note the Loopback IP’s and ASN’s for the
border leaf switches

• Go to Blueprints > DC-A > Staged > DCI > Over

the Top or External Gateways, click “Create Over
the Top or External Gateway” button, then define
the border leaf switches in DC-B as the remote
EVPN gateways using the following table

Name IP Address ASN Local Gateway

B-border1 192.168.2.2 65202 border_rack_dc-a-
001_leaf1

B-border2 192.168.2.3 65203 border_rack_dc-a-

001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Active > Physical >
Nodes and note the Loopback IP’s and ASN’s for the
border leaf switches

• Go to Blueprints > DC-A > Staged > DCI > Over

the Top or External Gateways, click “Create Over
the Top or External Gateway” button, then define
the border leaf switches in DC-B as the remote
EVPN gateways using the following table

Name IP Address ASN Local Gateway

B-border1 192.168.2.2 65202 border_rack_dc-a-
001_leaf1

B-border2 192.168.2.3 65203 border_rack_dc-a-

001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Staged > DCI >
Settings, click “Modify Settings” button, and
change the ESI MAC msb value from 2 to 4

• Go to Blueprints > DC-B > Staged > DCI > Over

the Top or External Gateways and create EVPN
BGP sessions between the local border leafs and the
border leafs in DC-A
Name IP Address ASN Local Gateway
A- 192.168.1.2 65102 border_rack_dc-b-
border1 001_leaf1

A- 192.168.1.3 65103 border_rack_dc-b-

border2 001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Data Center Interconnect #2 – Overlay
• Go to Blueprints > DC-B > Staged > DCI > Settings,
click “Modify Settings” button, and change the ESI
MAC msb value from 2 to 4

• Go to Blueprints > DC-B > Staged > DCI > Over

the Top or External Gateways and create EVPN
BGP sessions between the local border leafs and the
border leafs in DC-A
Name IP Address ASN Local Gateway
A- 192.168.1.2 65102 border_rack_dc-b-
border1 001_leaf1

A- 192.168.1.3 65103 border_rack_dc-b-

border2 001_leaf2

• Commit the Blueprint

© 2024 Juniper Networks

 Initial Setup Complete!
Congratulations! You have built a simple, single-tenant, multi-fabric Apstra lab!
The intent of your operational fabrics are shown below.
The following sections focus on enhancements to your lab such as direct DCI
peering between spines, WAN/Core connectivity, and some business value
demonstrations focused on common operational scenarios.

DC-A Blueprint DC-B Blueprint

Tenant-1 Stretch L2 OTT DCI Tenant-1
Routing Routing
Zone Zone

vn101 vn101
ae1 (192.168.101.0/24) ae1 (192.168.101.0/24)

vn102 vn103
(192.168.102.0/24) ae2 (192.168.103.0/24) ae2
To A-leaf1 To A-leaf2 To A-leaf1 To A-leaf2 To A-leaf1 To B-leaf1 To B-leaf2 To B-leaf1 To B-
ge-0/0/7 ge-0/0/7 ge-0/0/8 ge-0/0/8 ge-0/0/9 ge-0/0/7 ge-0/0/7 ge-0/0/8 leaf2
A-bms- A-bms- B-bms- B-bms-ge-0/0/8
A-bms-
1_bridg 2_bridg 1_bridg 2_bridg
3
e vSRX e vSRX 192.168.101.33 e vSRX e vSRX

uMate uMate uMate uMate

A-bms- A-bms- B-bms- B-bms-
1 2 1 2
192.168.101.11 192.168.102.22 192.168.101.44 192.168.103.55
© 2024 Juniper Networks 33