BGP Protocol & Configuration

Scalable Infrastructure Workshop AfNOG2010

Border Gateway Protocol (BGP4)

Case Study 1, Exercise 1: Single upstream Part 6: BGP Protocol Basics Part 7: BGP Protocol - more detail Case Study 2, Exercise 2: Local peer Part 8: Routing Policy and Filtering Exercise 3: Filtering on AS-path Exercise 4: Filtering on prefix-list Part 9: More detail than you want Exercise 5: Interior BGP Part 10: BGP and Network Design

BGP Case Study 1 and Exercise 1

Small ISP with one upstream provider

Case Study 1: Small ISP with one upstream provider

Local network May have multiple POPs Line to Internet

International line providing transit connectivity Very, very expensive

Case Study 1: Small ISP with one upstream provider

BGP to other large ISPs Provider P

IGP routes inside

Static routes to small customers

Static default route to provider Small ISP A Static or IGP routes inside

Case Study 1: Routing Protocols

Static routes or IGP inside small ISP A Static default route from small ISP A to upstream provider P IGP inside upstream provider P The two IGPs do not know about each other BGP between upstream provider P and outside world

Case Study 1: BGP is not needed

No need for BGP between small ISP A and upstream provider P The outside world does not need to care about the link between provider P and customer A Hiding that information from the outside world helps with scaling We will do an exercise using BGP even though it is not needed

Exercise 1: Upstream provider with small customers

This is not a realistic exercise In reality, a single-homed network would not use BGP Exercise 2 will be more realistic, adding a connection between two small ISPs in the same country

Exercise 1: Upstream provider & small customers

Provider AS 100
A

AS 1 AS 3 AS 5 AS 7

AS 2 AS 4 AS 6 AS 8

C E
G I K

D F
H J L

AS 9
AS 11

AS 10
AS 12

M AS 13

AS 14 N

Exercise 1: BGP configuration

Refer to BGP cheat sheet Connect cable to upstream provider router bgp for your AS number BGP network statement for your network BGP neighbor for upstream provider (IP address [Link], remote AS 100)

(Your workshop instructor will provide point to point link addresses)

Do the same for IPv6

Exercise 1: Transit through upstream provider

Instructors configure AS 100 to send you all routes to other classroom ASes, and a default route

You can send traffic through AS 100 to more distant destinations In other words, AS 100 provides transit service to you

Exercise 1: What you should see

You should see routes to all other classroom networks Try:

show show show show

ip route to see IPv4 routing table ipv6 route to see IPv6 routing table ip bgp to see IPv4 BGP table bgp ipv6 to see IPv6 BGP table

Look at the next hop and AS path Try some pings and traceroutes.

Exercise 1: Did BGP network statement work?

BGP network statement has no effect unless route exists in IGP (or static route) You might need to add a static route to make it work

IPv4: ip route x.x.x.x m.m.m.m Null0 250 IPv6: ipv6 route x:x::/60 Null0 250 Smaller is less important Default for a static route is 1

250 is the administrative distance

BGP Part 6
BGP Protocol Basics
Terminology General Operation Interior/Exterior BGP

BGP Protocol Basics

Peering
A C

AS 100
B

AS 101
D E

Routing Protocol used between ASes

If you arent connected to multiple ASes you dont need BGP

AS 102

Runs over TCP

BGP Protocol Basics

Uses Incremental updates

sends one copy of the RIB at the beginning, then sends changes as they happen keeps track of the AS path of routing information

Path Vector protocol

Many options for policy enforcement

Terminology

Neighbour

Configured BGP peer

NLRI network layer reachability information Reachability information for an IP address & mask 32 bit integer to uniquely identify router Comes from Loopback or Highest IP address configured on the router NLRI advertised by a neighbour

NLRI/Prefix

Router-ID

Route/Path

Terminology

Transit carrying network traffic across a network, usually for a fee Peering exchanging routing information and traffic

your customers and your peers customers network information only. not your peers peers; not your peers providers. BGP neighbour, whether or not transit is provided

Peering also has another meaning:

Default where to send traffic when there is no explicit route in the routing table

BGP Basics
Each AS originates a set of NLRI (routing announcements) NLRI is exchanged between BGP peers Can have multiple paths for a given prefix BGP picks the best path and installs in the IP forwarding table Policies applied (through attributes) influences BGP path selection

Interior BGP vs. Exterior BGP

Interior BGP (iBGP)

Exterior BGP (eBGP)

Between routers in the same AS Often between routers that are far apart Should be a full mesh: every iBGP router talks to all other iBGP routers in the same AS

Between routers in different ASes Almost always between directly-connected routers (ethernet, serial line, etc.)

BGP Peers
A C

AS 100
[Link]/24

AS 101
[Link]/24

B BGP Peers exchange Update messages containing Network Layer Reachability Information (NLRI)
BGP Update Messages

D E

AS 102
[Link]/24

BGP Peers External (eBGP)

A C

AS 100
[Link]/24

AS 101
[Link]/24

B BGP speakers are called peers Peers in different ASs are called External Peers
eBGP TCP/IP Peer Connection

D E

AS 102
[Link]/24

Note: eBGP Peers normally should be directly connected.

BGP Peers Internal (iBGP)

A C

AS 100
[Link]/24

AS 101
[Link]/24

B BGP speakers are called peers Peers in the same AS are called Internal Peers
iBGP TCP/IP Peer Connection

D E

AS 102
[Link]/24

Note: iBGP Peers dont have to be directly connected.

Configuring eBGP peers

BGP peering sessions are established using the BGP neighbor command

eBGP is configured when AS numbers are different

AS 100
A
.2

eBGP TCP Connection

AS 101
C
.2

[Link]/30

[Link]/30

.1

.2

.1

[Link]/30

.1

interface Serial 0 ip address [Link] [Link] router bgp 100 network [Link] mask [Link] neighbor [Link] remote-as 101

interface Serial 0 ip address [Link] [Link] router bgp 101 network [Link] mask [Link] neighbor [Link] remote-as 100

Configuring iBGP peers

BGP peering sessions are established using the BGP neighbor command

iBGP is configured when AS numbers are the same

AS 100
[Link]/30

AS 101
iBGP TCP Connection .1

.2

[Link]/30

.2

.1

.2

[Link]/30

.1

interface Serial 1 ip address [Link] [Link]

interface Serial 1 ip address [Link] [Link] router bgp 101 network [Link] mask [Link] neighbor [Link] remote-as 101

router bgp 101 network [Link] mask [Link] neighbor [Link] remote-as 101

Configuring iBGP peers: Full mesh

Each iBGP speaker must peer with every other iBGP speaker in the AS

AS 100
A B

iBGP TCP/IP Peer Connection

Configuring iBGP peers: Loopback interface

Loopback interfaces are normally used as the iBGP peer connection end-points

[Link]

AS 100

[Link]

[Link]

iBGP TCP/IP Peer Connection

Configuring iBGP peers

[Link]

AS 100

[Link]

[Link] interface loopback 0 ip address [Link] [Link] router bgp 100 network [Link] mask [Link] neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0 neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0

Configuring iBGP peers

[Link]

AS 100

[Link]

[Link]

iBGP TCP/IP Peer Connection

interface loopback 0 ip address [Link] [Link] router bgp 100 network [Link] mask [Link] neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0 neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0

Configuring iBGP peers

[Link]

AS 100

[Link]

[Link]

interface loopback 0 ip address [Link] [Link] router bgp 100 network [Link] mask [Link] neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0 neighbor [Link] remote-as 100 neighbor [Link] update-source loopback0

BGP Part 7
BGP Protocol A little more detail

BGP Updates NLRI

Network Layer Reachability Information Used to advertise feasible routes Composed of:

Network Prefix Mask Length

BGP Updates Attributes

Used to convey information associated with NLRI

AS path Next hop Local preference Multi-Exit Discriminator (MED) Community Origin Aggregator

AS-Path Attribute
Sequence of ASes a route has traversed Loop detection Apply policy

AS 300 AS 400
[Link]/16 Network [Link]/16 [Link]/16 [Link]/16 Path 300 200 100 300 200 300 400

AS 200
[Link]/16

AS 100
[Link]/16

Network Path [Link]/16 300 200 100 [Link]/16 300 200

AS 500

AS-Path (with 16 and 32-bit ASNs)

Internet with 16-bit and 32-bit ASNs AS-PATH length maintained
AS 300 AS 400
[Link]/16

AS 70000
[Link]/16

AS 80000
[Link]/16

[Link]/16 300 23456 23456 [Link]/16 300 23456

AS 90000

[Link]/16 [Link]/16 [Link]/16

300 70000 80000 300 70000 300 400

Next Hop Attribute

AS 300
AS 200
[Link]/16 B
.2 [Link]/30

[Link]/16
.2

.1

E
BGP Update Messages

Network Next-Hop [Link]/16 [Link]

Path 100

.1

AS 100
[Link]/16

Next hop to reach a network Usually a local network is the next hop in eBGP session

Next Hop Attribute

AS 300
AS 200
[Link]/16 B
.2 [Link]/30

[Link]/16
.2

.1

E
BGP Update Messages

Network Next-Hop [Link]/16 [Link] [Link]/16 [Link]

Path 200 200 100

.1

AS 100
[Link]/16

Next hop to reach a network Usually a local network is the next hop in eBGP session Next Hop updated between eBGP Peers

Next Hop Attribute

AS 300
AS 200
[Link]/16 B
.2 [Link]/30

[Link]/16
.2

.1

E
BGP Update Messages

.1

Network Next-Hop [Link]/16 [Link] [Link]/16 [Link]

Path 200 200 100

AS 100
[Link]/16

Next hop not changed between iBGP peers

Next Hop Attribute (more)

IGP is used to carry route to next hops Recursive route look-up

BGP looks into IGP to find out next hop information BGP is not permitted to use a BGP route as the next hop

Unlinks BGP from actual physical topology Allows IGP to make intelligent forwarding decision

Next Hop Best Practice

Cisco IOS default is for external next-hop to be propagated unchanged to iBGP peers

This means that IGP has to carry external next-hops Forgetting means external network is invisible With many eBGP peers, it is extra load on IGP

ISP best practice is to change external next-hop to be that of the local router
neighbor x.x.x.x next-hop-self

Community Attribute
32-bit number Conventionally written as two 16-bit numbers separated by colon

First half is usually an AS number ISP determines the meaning (if any) of the second half Used by administratively-defined filters Not directly used by BGP protocol (except for a few well known communities)

Carried in BGP protocol messages

BGP Updates: Withdrawn Routes

Used to withdraw network reachability Each withdrawn route is composed of:

Network Prefix Mask Length

BGP Updates: Withdrawn Routes

AS 123
.1 [Link]/24 .2

AS 321
BGP Update Message

Withdraw Routes [Link]/24

Connectivity lost

[Link]/24

Network Next-Hop Path [Link]/16 [Link] 321 200 [Link]/24 [Link] 321

BGP Routing Information Base

BGP RIB
Network *>i160.10.1.0/24 *>i160.10.3.0/24 Next-Hop [Link] [Link] Path i i

D D D R S

[Link]/24 [Link]/24 [Link]/24 [Link]/16 [Link]/24

router bgp 100 network [Link] [Link] network [Link] [Link] no auto-summary

Route Table

BGP network commands are normally used to populate the BGP RIB with routes from the Route Table

BGP Routing Information Base

BGP RIB
Network *> [Link]/16 * i s> [Link]/24 s> [Link]/24 Next-Hop [Link] [Link] [Link] [Link] Path i i i i

router bgp 100 network [Link] [Link] aggregate-address [Link] [Link] summary-only no auto-summary
D D D R S [Link]/24 [Link]/24 [Link]/24 [Link]/16 [Link]/24

Route Table

BGP aggregate-address commands may be used to install summary routes in the BGP RIB

BGP Routing Information Base

BGP RIB
Network *> [Link]/16 * i s> [Link]/24 s> [Link]/24 *> [Link]/24 Next-Hop [Link] [Link] [Link] [Link] [Link] Path i i i i ?

router bgp 100 network [Link] [Link] redistribute static route-map foo no auto-summary
D D D R S [Link]/24 [Link]/24 [Link]/24 [Link]/16 [Link]/24

access-list 1 permit [Link] [Link] route-map foo permit 10 match ip address 1

Route Table

BGP redistribute commands can also be used to populate the BGP RIB with routes from the Route Table

BGP Routing Information Base

IN Process BGP RIB
Network *>i160.10.1.0/24 *>i160.10.3.0/24 * > [Link]/16 Next-Hop [Link] [Link] [Link] Path i i 100 i

OUT Process

Update

Update

Network Next-Hop [Link]/16 [Link]

Path 100

BGP in process
receives path information from peers results of BGP path selection placed in the BGP table best path flagged (denoted by >)

BGP Routing Information Base

IN Process BGP RIB
Network *>i160.10.1.0/24 *>i160.10.3.0/24 *> [Link]/16 Next-Hop [Link] [Link] [Link] Path i i 100

OUT Process

Update

Update

Network [Link]/24 [Link]/24 [Link]/16

Next-Hop [Link] [Link] [Link]

Path 200 200 200 100

BGP out process

builds update using info from RIB may modify update based on config Sends update to peers

BGP Routing Information Base

BGP RIB
Network *>i160.10.1.0/24 *>i160.10.3.0/24 *> [Link]/16 Next-Hop [Link] [Link] [Link] Path i i 100

D D D R S B

[Link]/24 [Link]/24 [Link]/24 [Link]/16 [Link]/24 [Link]/16

Best paths installed in routing table if:

prefix and prefix length are unique lowest protocol distance

Route Table

An Example
AS200 F

[Link]/8
A

AS3561

B C

AS21

D AS101 E AS675

Learns about [Link]/8 from F & D

BGP Case Study 2 and Exercise 2

Small ISPs in the same locality connect to each other

Case Study 2: Another ISP in the same country

Similar setup Traffic between you and them goes over

Your expensive line Their expensive line Same language/culture Traffic between your and their customers

Traffic can be significant

This wastes money

Case Study 2: Another ISP in the same country

Europe or USA

Upstream ISP

Expensive links Small ISP Small ISP

Africa

Case Study 2: Bringing down costs

Local (national) links are usually much cheaper than international ones Might be interesting to get direct link between you and them

Saving traffic on expensive lines

better performance, cheaper

No need to send traffic to other ISP down the street via New York!

Case Study 2: Keeping Local Traffic Local

Europe or USA

Upstream ISP

Small ISP

Small ISP

Africa

Exercise 2: Connect to another local ISP

Provider AS 100
A C E G B D F H

AS 1 Connections to local peers AS 3 AS 5 AS 7 AS 9 AS 11

AS 2 AS 4 AS 6 AS 8 AS 10 AS 12

I
K

J
L

Transit to provider

M AS 13

AS 14 N

Exercise 2: BGP configuration

Refer to BGP cheat sheet. Add to previous configuration. Connect cable to local peer. No filters yet.

Exercise 2: What you should see

You should see multiple routes to each destination

direct route to your peer transit route through provider (AS 100) any more?

Exercise 2: What you should see

To see forwarding table, try:

IPv4: show ip route IPv6: show ipv6 route IPv4: show ip bgp IPv6: show bgp ipv6

To see BGP information, try:

Look at the next hop and AS path Try some pings and traceroutes.

Exercise 2: Do you see transit routes through your peers?

Are your peer ASes sending you transit routes as well as peering routes?

Do you want transit through them?

Are you sending transit routes to your peers?

Do you want your peers to have transit through you?

We will fix this later

BGP Part 8
Routing Policy Filtering

Terminology: Policy

Where do you want your traffic to go?

It is difficult to get what you want, but you can try

Control of how you accept and send routing updates to neighbors

prefer cheaper connections, load-sharing, etc.

Accepting routes from some ISPs and not others Sending some routes to some ISPs and not others Preferring routes from some ISPs over others

Routing Policy

Why?

To steer traffic through preferred paths Inbound/Outbound prefix filtering To enforce Customer-ISP agreements
AS based route filtering filter list Prefix based route filtering prefix list BGP attribute modification route maps Complex route filtering route maps

How?

Filter list rules: Regular Expressions

Regular Expression is a pattern to match against an input string Used to match against AS-path attribute ex: ^3561_.*_100_.*_1$ Flexible enough to generate complex filter list rules

Regular expressions (cisco specific)

^ $ _ matches start matches end matches start, or end, or space (boundary between words or numbers) .* matches anything (0 or more characters) .+ matches anything (1 or more characters) [0-9] matches any number between 0 and 9 ^$ matches the local AS There are many more possibilities

Filter list using as-path access list

Listen to routes originated by AS 3561. Implicit deny everything else inbound. Dont announce routes originated by AS 35, but announce everything else (outbound).
ip as-path access-list 1 permit _3561$ ip as-path access-list 2 deny _35$ ip as-path access-list 2 permit .*
router bgp 100 neighbor [Link] remote-as 33 neighbor [Link] filter-list 1 in neighbor [Link] filter-list 2 out

Policy Control Prefix Lists

Per neighbor prefix filter

incremental configuration

High performance access list Inbound or Outbound Based upon network numbers (using CIDR address/mask format) First relevant allow or deny rule wins Implicit Deny All as last entry in list

Prefix Lists Examples

Deny default route

ip prefix-list Example deny [Link]/0

Permit the prefix [Link]/8

ip prefix-list Example permit [Link]/8

Deny the prefix [Link]/12, and all morespecific routes

ip prefix-list Example deny [Link]/12 ge 12 ge 12 means prefix length /12 or longer. For example, [Link]/16 will also be denied.

In [Link]/8, allow any /24 or shorter prefixes

ip prefix-list Example permit [Link]/8 le 24 This will not allow any /25, /26, /27, /28, /29, /30, /31 or /32

Prefix Lists More Examples

In 192/8 deny /25 and above

ip prefix-list Example deny [Link]/8 ge 25

This denies all prefix sizes /25, /26, /27, /28, /29, /30, /31 and /32 in the address block [Link]/8 It has the same effect as the previous example

In 192/8 permit prefixes between /12 and /20

ip prefix-list Example permit [Link]/8 ge 12 le 20

This denies all prefix sizes /8, /9, /10, /11, /21, /22 and higher in the address block [Link]/8 ip prefix-list Example [Link]/0 le 32

Permit all prefixes

Policy Control Using Prefix Lists

Example Configuration
router bgp 200 network [Link] neighbor [Link] remote-as 210 neighbor [Link] prefix-list PEER-IN in neighbor [Link] prefix-list PEER-OUT out ! ip prefix-list PEER-IN deny [Link]/16 ip prefix-list PEER-IN permit [Link]/0 le 32 ip prefix-list PEER-OUT permit [Link]/16 ip prefix-list PEER-OUT deny [Link]/0 le 32

Accept everything except our network from our peer Send only our network to our peer

Prefix-lists in IPv6

Prefix-lists in IPv6 work the same way as they do in IPv4

Caveat: ipv6 prefix-lists cannot be used for ipv4 neighbours - and vice-versa Syntax is very similar, for example:
ip prefix-list ipv4-ebgp permit [Link]/0 le 32 ip prefix-list v4out permit [Link]/16 ! ipv6 prefix-list ipv6-ebgp permit ::/0 le 128 ipv6 prefix-list v6out permit [Link]/32

Policy Control Route Maps

A route-map is like a program for Cisco IOS Has line numbers, like programs Each line is a separate condition/action Concept is basically:
if match then do expression and exit else if match then do expression and exit else etc

Route-map match & set clauses

Match Clauses

Set Clauses

AS-path Community IP address

AS-path prepend Community Local-Preference MED Origin Weight Others...

Route Map: Example One

router bgp 300 neighbor [Link] remote-as 100 neighbor [Link] route-map SETCOMMUNITY out ! route-map SETCOMMUNITY permit 10 match ip address 1 match community 1 set community 300:100 ! access-list 1 permit [Link] ip community-list 1 permit 100:200

Route Map: Example Two

Example Configuration as AS PATH prepend

router bgp 300 network [Link] neighbor [Link] remote-as 100 neighbor [Link] route-map SETPATH out ! route-map SETPATH permit 10 set as-path prepend 300 300

Use your own AS number for prepending

Otherwise BGP loop detection will cause disconnects

BGP Exercise 3
Filtering peer routes using ASpath regular expression

Exercise 3: Filtering peer routes using AS-path

Provider AS 100
A C E G

AS 1

AS 2

B D F H

AS 7 AS 9 AS 11

Filter all routes here!

AS 5

Connections to local peers

AS 3

AS 4 AS 6 AS 8 AS 10 AS 12

I
K
Transit to provider Not filtering here yet

J
L
Transit to provider Not filtering here yet

M AS 13

AS 14 N

Exercise 3: Filtering peer routes using AS-path

Create ip as-path access-list <number> to match your peers routes

ip as-path access-list 1 permit ^1$

Create ip as-path access-list <number> to match your own routes

ip as-path access-list 2 permit ^$ neighbor <address> filter-list 1 in neighbor <address> filter-list 2 out As-path filters are protocol independent, so the same filter can be applied to both IPv4 and IPv6 peers! neighbor <upstream-addr> filter-list 2 out

Apply the filters to both IPv4 and IPv6 peers:

Apply the outbound filter to the AS100 upstream

Exercise 3: What you should see

From peers: only their routes, no transit

They send all routes, but you filter

They will ignore the transit routes if you mistakenly send them

To peers: your routes

From upstream: all routes To upstream: your routes, no transit

Exercise 3: Did it work?

IPv4 show commands:

show ip route your forwarding table show ip bgp your BGP table show ip bgp neighbor xxx received-routes from your neighbour before filtering show ip bgp neighbor xxx routes from neighbour, after filtering show ip bgp neighbor advertised-routes to neighbour, after filtering

Exercise 3: Did it work?

IPv6 show commands:

show ipv6 route your forwarding table show bgp ipv6 your BGP table show bgp ipv6 neighbor xxx received-routes from your neighbour before filtering show bgp ipv6 neighbor xxx routes from neighbour, after filtering show bgp ipv6 neighbor advertised-routes to neighbour, after filtering

BGP Exercise 4
Filtering peer routes using prefix-lists

Exercise 4: Filtering peer routes using prefix-lists

Provider AS 100
A C E G

AS 1 Connections to local peers AS 3 AS 5 AS 7 AS 9 AS 11

AS 2 AS 4 Filter all routes here! AS 6 AS 8 AS 10 AS 12

B D F H

I
K
Transit to provider Not filtering here yet

J
L
Transit to provider Not filtering here yet

M AS 13

AS 14 N

Exercise 4: Filtering peer routes using prefix-list

Create ip prefix-list my-routes to match your own routes Create ip prefix-list peer-as-xxx to match your peers routes Apply the filters to your peers

neighbor xxx prefix-list my-routes out neighbor xxx prefix-list peer-as-xxx in

Apply the outbound filter to your upstream provider

neighbor xxx prefix-list my-routes out

Exercise 4: Filtering peer routes using prefix-list

Create ipv6 prefix-list myv6-routes to match your own routes Create ipv6 prefix-list peer-as-xxx-v6 to match your peers routes Apply the filters to your IPv6 peers

neighbor xxx prefix-list myv6-routes out neighbor xxx prefix-list peer-as-xxx-v6 in

Apply the outbound filter to your upstream provider

neighbor xxx prefix-list myv6-routes out

Exercise 4: What you should see

From peers: only their routes, no transit To peers: only your routes, no transit From upstream: all routes To upstream: only your routes, no transit

We still trust the upstream provider too much. Should filter it too!

See ip prefix-list sanity-filter and ipv6 prefix-list v6sanity-filter in the cheat sheet

Exercise 4: Did it work?

IPv4 show commands:

show ip route your forwarding table show ip bgp your BGP table show ip bgp neighbor xxx received-routes from your neighbour before filtering show ip bgp neighbor xxx routes from neighbour, after filtering show ip bgp neighbor advertised-routes to neighbour, after filtering

Exercise 4: Did it work?

IPv6 show commands:

show ipv6 route your routing table show bgp ipv6 your BGP table show bgp ipv6 neighbor xxx received-routes from your neighbour before filtering show bgp ipv6 neighbor xxx routes from neighbour, after filtering show bgp ipv6 neighbor advertised-routes to neighbour, after filtering

BGP Part 9
More detail than you want
BGP Attributes Synchronization Path Selection

BGP Path Attributes: Why ?

Encoded as Type, Length & Value (TLV) Transitive/Non-Transitive attributes Some are mandatory Used in path selection To apply policy for steering traffic

BGP Attributes

Used to convey information associated with NLRI

AS path Next hop Local preference Multi-Exit Discriminator (MED) Community Origin Aggregator

Local Preference
Not used by eBGP, mandatory for iBGP Default value of 100 on Cisco IOS Local to an AS Used to prefer one exit over another Path with highest local preference wins

Local Preference
AS 100
[Link]/16

AS 200
D
500 800

AS 300
E

A
[Link]/16 > [Link]/16 500 800

AS 400
C

Multi-Exit Discriminator
Non-transitive Represented as a numerical value

Range 0x0 0xffffffff

Used to convey relative preference of entry points to an AS Comparable if the paths are from the same AS Path with the lowest MED wins IGP metric can be conveyed as MED

Multi-Exit Discriminator (MED)

AS 200

C
[Link]/24 2000

preferred
[Link]/24 1000

B
[Link]/24

AS 201

Origin

Conveys the origin of the prefix

Historical attribute
IGP from BGP network statement

Three values:

E.g. network [Link]

EGP redistributed from EGP (not used today) Incomplete redistributed from another routing protocol

E.g. redistribute static

IGP < EGP < incomplete

Lowest origin code wins

Weight
Not really an attribute Used when there is more than one route to same destination Local to the router on which it is assigned, and not propagated in routing updates Default is 32768 for paths that the router originates and zero for other paths Routes with a higher weight are preferred when there are multiple routes to the same destination

Communities
Transitive, Non-mandatory Represented as a numeric value

0x0 0xffffffff Internet convention is ASn:<0-65535>

Used to group destinations Each destination could be member of multiple communities Flexibility to scope a set of prefixes within or across AS for applying policy

Communities
Community

Service Provider AS 200

C D

Local Preference 90 120

200:90 200:120

Community:200:90

Community:200:120

B
[Link]/24

Customer AS 201

Well-Known Communities

Several well known communities

[Link]/assignments/bgp-well-known-communities

no-export

65535:65281 65535:65282 65535:65283 65535:65284

do not advertise to any eBGP peers

no-advertise

do not advertise to any BGP peer

do not advertise outside local AS (only used with confederations) do not advertise to bi-lateral peers (RFC3765)

no-export-subconfed

no-peer

No-Export Community
[Link]/16 105.7.X.X No-Export

105.7.X.X

A B C E

D AS 200 F G

[Link]/16

AS 100

AS100 announces aggregate and subprefixes

Intention is to improve loadsharing by leaking subprefixes

Subprefixes marked with no-export community Router G in AS200 does not announce prefixes with noexport community set

Administrative Distance

Routes can be learned via more than one protocol

Used to discriminate between them

Route with lowest distance installed in forwarding table BGP defaults

Local routes originated on router: 200 iBGP routes: 200 eBGP routes: 20

Does not influence the BGP path selection algorithm but influences whether BGP learned routes enter the forwarding table

Synchronization
1880

690

A
D

C OSPF
35/8

209

C is not running BGP A wont advertised 35/8 to D until the IGP is in sync Turn synchronization off!
router bgp 1880 no synchronization

Synchronization

In Cisco IOS, BGP does not advertise a route before all routers in the AS have learned it via an IGP

Default in IOS prior to 12.4; very unhelpful to most ISPs

Disable synchronization if:

AS doesnt pass traffic from one AS to another, or All transit routers in AS run BGP, or iBGP is used across backbone
so, always use no synchronization

You should always use iBGP

BGP route selection (bestpath)

Route has to be synchronized

Only if synchronization is enabled Prefix must be in forwarding table Next-hop must be in forwarding table

Next-hop has to be accessible

Largest weight Largest local preference

BGP route selection (bestpath)

Locally sourced

Via redistribute or network statement

Number of ASes in the AS-PATH attribute IGP < EGP < incomplete

Shortest AS path length

Lowest origin

Lowest MED

Compared from paths from the same AS

BGP route selection (bestpath)

External before internal

Choose external path before internal

Lower IGP metric, nearest exit to router

Closest next-hop

Lowest router ID Lowest IP address of neighbour

BGP Route Selection...

AS 100

AS 200
D

AS 300
Increase AS path attribute length by at least 1

AS 400s Policy to reach AS100 AS 200 preferred path AS 300 backup

AS 400

BGP Exercise 5
Internal BGP (iBGP)

Exercise 5: Configure iBGP

Tables join into pairs, with two routers per AS Each AS has two upstream providers ISIS and iBGP within your AS eBGP to your upstream provider Filter everything!

Exercise 5: Configure iBGP

Provider AS 100
A
C E G I K M

Provider AS 200 AS 2 AS 4 AS 6 AS 8 AS 10 AS 12 AS 14
B D F H J L N

Exercise 5: Configure iBGP

The two routers in your AS should talk iBGP to each other

no filtering here use update-source loopback 0

One of your routers talks eBGP to AS 100, and one talks to AS 200.

Filter! Send only your routes Accept all except bogus routes (sanity-filter)

Exercise 5: What you should see

Directly from AS 100: routes to entire classroom Directly from AS 200: routes to entire classroom From your iBGP neighbour: indirect routes through AS 100 or AS 200 to entire classroom Which route do you prefer?

BGP Part 10
BGP and Network Design

Stub AS
Enterprise network, or small ISP Typically no need for BGP Point default towards the ISP ISP advertises the stub network to Internet Policy confined within ISP policy

Stub AS

AS 101
Provider

Customer

AS 100

Multihomed AS
Enterprise network or small ISP Only border routers speak BGP iBGP only between border routers Rest of network either has:

exterior routes redistributed in a controlled fashion into IGP or use defaults (much preferred!)

Multi-homed AS
AS 100
provider

AS 300
A
B D
provider

AS 200
customer

More details on multihoming coming up...

Service Provider Network

iBGP used to carrier exterior routes

No redistribution into IGP

IGP used to track topology inside your network Full iBGP mesh required

Every router in ISP backbone should talk iBGP to every other router This has scaling problems, and solutions (e.g. route reflectors)

Common Service Provider Network

AS 100

A B C

AS 200

provider
E

AS 300

AS 400

Load-sharing single path

Router A:
interface loopback 0 ip address [Link] [Link] ! router bgp 100 neighbor [Link] remote-as 200 neighbor [Link] update-source loopback0 neighbor [Link] ebgp-multihop 2 ! ip route [Link] [Link] <DMZ-link1> ip route [Link] [Link] <DMZ-link2>

Loopback 0 [Link]

AS100

Loopback 0 [Link]

AS200

Load-sharing multiple paths from the same AS

Router A:
router bgp 100 neighbor [Link] remote-as 200 neighbor [Link] remote-as 200 maximum-paths 2

100

200

Note: A still only advertises one best path to ibgp peers

Redundancy Multi-homing
Reliable connection to Internet 3 common cases of multi-homing

default from all providers customer + default from all providers full routes from all providers comes from upstream providers, or allocated directly from registries

Address Space

Default from all providers

Low memory/CPU solution Provider sends BGP default

provider is selected based on IGP metric

Inbound traffic decided by providers policy

Can influence using outbound policy, example: AS-path prepend

Default from all providers

Provider AS 200
D
Receive default from upstreams

Provider AS 300
E A B
Receive default from upstreams

AS 400
C

Customer prefixes plus default from all providers

Medium memory and CPU solution Granular routing for customer routes, default for the rest

Route directly to customers as those have specific policies

Inbound traffic decided by providers policies

Can influence using outbound policy

Customer routes from all providers

Customer
[Link]/16

AS 100

Provider AS 200
D E

Provider
AS 300

C chooses shortest AS path

AS 400
C

Full routes from all providers

More memory/CPU Fine grained routing control Usually transit ASes take full routes

Usually pervasive BGP

Full routes from all providers

AS 100 AS 500

AS 200
D A B E

AS 300

C chooses shortest AS path

AS 400
C

Best Practices IGP in Backbone

IGP connects your backbone together, not your clients routes

Clients routes go into iBGP Hosting and service LANs go into iBGP Dial/Broadband/Wireless pools go into iBGP The fewer prefixes in the IGP the better

IGP must converge quickly

IGP should carry netmask information OSPF, IS-IS, EIGRP

Best Practices iBGP in Backbone

iBGP runs between all routers in backbone Configuration essentials:

Runs between loopbacks Next-hop-self Send-community Passwords All non-infrastructure prefixes go here

Best Practices... Connecting to a customer

Static routes

You control directly No route flaps Strongly discouraged You must filter your customers info Route flaps Private AS for those who multihome on to your backbone Public AS for the rest

Shared routing protocol or leaking

BGP for multi-homed customers

Best Practices... Connecting to other ISPs

Advertise only what you serve Take back as little as you can Take the shortest exit Aggregate your routes!!

Consult RIPE-399 document for recommendations: [Link]

FILTER! FILTER! FILTER!

Best Practices... The Internet Exchange

Long distance connectivity is:

Expensive Slow (speed of light limitations) Congested

Connect to several providers at a single point

Cheap Fast

More details later!

Summary

We have learned about:

BGP Protocol Basics Routing Policy and Filtering BGP Best Path Computation Typical BGP topologies Routing Policy BGP Network Design Redundancy/Load sharing Some best practices