B Cisco Nexus 9000 Series NX-OS Interfaces Configuration Guide 7x Chapter 0111
B Cisco Nexus 9000 Series NX-OS Interfaces Configuration Guide 7x Chapter 0111
This chapter describes how to configure port channels and to apply and configure the Link Aggregation
Control Protocol (LACP) for more efficient use of port channels in the Cisco NX-OS devices.
On a single switch, the port-channel compatibility parameters must be the same among all the port-channel
members on the physical switch.
• About Port Channels, on page 1
• Port Channels, on page 2
• Port-Channel Interfaces, on page 3
• Basic Settings, on page 3
• Compatibility Requirements, on page 4
• Load Balancing Using Port Channels, on page 6
• Symmetric Hashing, on page 7
• Guidelines and Limitations for ECMP, on page 7
• Resilient Hashing, on page 8
• GTP Tunnel Load Balancing, on page 8
• LACP, on page 9
• Prerequisites for Port Channeling, on page 15
• Guidelines and Limitations, on page 15
• Default Settings, on page 17
• Configuring Port Channels, on page 18
A Layer 2 port channel interface and it's member ports can have different STP parameters. Changing the STP
parameters of the port channel does not impact the STP parameters of the member ports because a port channel
interface takes precedence if the member ports are bundled.
Note After a Layer 2 port becomes part of a port channel, all switchport configurations must be done on the port
channel; you can no longer apply switchport configurations to individual port-channel members. You cannot
apply Layer 3 configurations to an individual port-channel member either; you must apply the configuration
to the entire port channel.
You can use static port channels, with no associated aggregation protocol, for a simplified configuration.
For more flexibility, you can use the Link Aggregation Control Protocol (LACP), which is defined in IEEE
802.3ad. When you use LACP, the link passes protocol packets. You cannot configure LACP on shared
interfaces.
See the LACP Overview section for information about LACP.
Port Channels
A port channel bundles physical links into a channel group to create a single logical link that provides the
aggregate bandwidth of up to 32 physical links. If a member port within a port channel fails, the traffic
previously carried over the failed link switches to the remaining member ports within the port channel.
However, you can enable the LACP to use port channels more flexibly. Configuring port channels with LACP
and static port channels require a slightly different procedure (see the “Configuring Port Channels” section).
Note The device does not support Port Aggregation Protocol (PAgP) for port channels.
Each port can be in only one port channel. All the ports in a port channel must be compatible; they must use
the same speed and duplex mode (see the “Compatibility Requirements” section). When you run static port
channels with no aggregation protocol, the physical links are all in the on channel mode; you cannot change
this mode without enabling LACP (see the “Port-Channel Modes” section).
You can create port channels directly by creating the port-channel interface, or you can create a channel group
that acts to aggregate individual ports into a bundle. When you associate an interface with a channel group,
the software creates a matching port channel automatically if the port channel does not already exist. In this
instance, the port channel assumes the Layer 2 or Layer 3 configuration of the first interface. You can also
create the port channel first. In this instance, the Cisco NX-OS software creates an empty channel group with
the same channel number as the port channel and takes the default Layer 2 or Layer 3 configuration, as well
as the compatibility configuration (see the “Compatibility Requirements” section).
Note The port channel is operationally up when at least one of the member ports is up and that port’s status is
channeling. The port channel is operationally down when all member ports are operationally down.
Port-Channel Interfaces
The following shows port-channel interfaces.
Figure 1: Port-Channel Interfaces
You can classify port-channel interfaces as Layer 2 or Layer 3 interfaces. In addition, you can configure Layer
2 port channels in either access or trunk mode. Layer 3 port-channel interfaces have routed ports as channel
members.
You can configure a Layer 3 port channel with a static MAC address. If you do not configure this value, the
Layer 3 port channel uses the router MAC of the first channel member to come up. See the Cisco Nexus 9000
Series NX-OS Layer 2 Switching Configuration Guide for information about configuring static MAC addresses
on Layer 3 port channels.
See the "Configuring Layer 2 Interfaces" chapter for information about configuring Layer 2 ports in access
or trunk mode and the "Configuring Layer 3 Interfaces" chapter for information about configuring Layer 3
interfaces and subinterfaces.
Basic Settings
You can configure the following basic settings for the port-channel interface:
• Bandwidth—Use this setting for informational purposes only; this setting is to be used by higher-level
protocols.
• Delay—Use this setting for informational purposes only; this setting is to be used by higher-level protocols.
• Description
• Duplex
• IP addresses
• Maximum Transmission Unit (MTU)
• Shutdown
• Speed
Compatibility Requirements
When you add an interface to a channel group, the software checks certain interface attributes to ensure that
the interface is compatible with the channel group. For example, you cannot add a Layer 3 interface to a Layer
2 channel group. The Cisco NX-OS software also checks a number of operational attributes for an interface
before allowing that interface to participate in the port-channel aggregation.
The compatibility check includes the following operational attributes:
• Network layer
• (Link) speed capability
• Speed configuration
• Duplex capability
• Duplex configuration
• Port mode
• Access VLAN
• Trunk native VLAN
• Tagged or untagged
• Allowed VLAN list
• MTU size
• SPAN—Cannot be a SPAN source or a destination port
• Storm control
• Flow-control capability
• Flow-control configuration
• Media type, either copper or fiber
Use the show port-channel compatibility-parameters command to see the full list of compatibility checks
that the Cisco NX-OS uses.
You can only add interfaces configured with the channel mode set to on to static port channels, and you can
only add interfaces configured with the channel mode as active or passive to port channels that are running
LACP. You can configure these attributes on an individual member port. If you configure a member port with
an incompatible attribute, the software suspends that port in the port channel.
Alternatively, you can force ports with incompatible parameters to join the port channel if the following
parameters are the same:
• (Link) speed capability
• Speed configuration
• Duplex capability
• Duplex configuration
• Flow-control capability
• Flow-control configuration
When the interface joins a port channel, some of its individual parameters are removed and replaced with the
values on the port channel as follows:
• Bandwidth
• Delay
• Extended Authentication Protocol over UDP
• VRF
• IP address
• MAC address
• Spanning Tree Protocol
• NAC
• Service policy
• Access control lists (ACLs)
Many interface parameters remain unaffected when the interface joins or leaves a port channel as follows:
• Beacon
• Description
• CDP
• LACP port priority
• Debounce
• UDLD
• MDIX
• Rate mode
• Shutdown
• SNMP trap
Note When you delete the port channel, the software sets all member interfaces as if they were removed from the
port channel.
See the “LACP Marker Responders” section for information about port-channel modes.
Non-IP and Layer 3 port channels both follow the configured load-balancing method, using the source,
destination, or source and destination parameters. For example, when you configure load balancing to use the
source IP address, all non-IP traffic uses the source MAC address to load balance the traffic while the Layer
3 traffic load balances the traffic using the source IP address. Similarly, when you configure the destination
MAC address as the load-balancing method, all Layer 3 traffic uses the destination IP address while the non-IP
traffic load balances using the destination MAC address.
The unicast and multicast traffic is load-balanced across port-channel links based on configured load-balancing
algorithm displayed in show port-channel load-balancing command output.
The multicast traffic uses the following methods for load balancing with port channels:
• Multicast traffic with Layer 4 information—Source IP address, source port, destination IP address,
destination port
• Multicast traffic without Layer 4 information—Source IP address, destination IP address
• Non-IP multicast traffic—Source MAC address, destination MAC address
Note Devices that run Cisco IOS can optimize the behavior of the member ports ASICs if a failure of a single
member occurred by running the port-channel hash-distribution command. The Cisco Nexus 9000 Series
device performs this optimization by default and does not require or support this command. Cisco NX-OS
does support the customization of the load-balancing criteria on port channels through the port-channel
load-balance command for the entire device.
Symmetric Hashing
To be able to effectively monitor traffic on a port channel, it is essential that each interface connected to a
port channel receives both forward and reverse traffic flows. Normally, there is no guarantee that the forward
and reverse traffic flows will use the same physical interface. However, when you enable symmetric hashing
on the port channel, bidirectional traffic is forced to use the same physical interface and each physical interface
in the port channel is effectively mapped to a set of flows.
When symmetric hashing is enabled, the parameters used for hashing, such as the source and destination IP
address, are normalized before they are entered into the hashing algorithm. This process ensures that when
the parameters are reversed (the source on the forward traffic becomes the destination on the reverse traffic),
the hash output is the same. Therefore, the same interface is chosen.
Only the following load-balancing algorithms support symmetric hashing:
• src-dst ip
• src-dst ip-l4port
• The port-channel load-balance command can overwrite the ip load-share command. It is better to
enter the port-channel load-balance command which helps to set both the IP and MAC parameters.
• There are no options to force the hashing algorithm based on the IP/Layer 4 port. The default MAC
configuration is always programmed as a part of the port channel configuration.
• ECMP resilient hashing is not supported for traffic flows over tunnel.
Resilient Hashing
With the exponential increase in the number of physical links used in data centers, there is also the potential
for an increase in the number of failed physical links. In static hashing systems that are used for load balancing
flows across members of port channels or Equal Cost Multipath (ECMP) groups, each flow is hashed to a
link. If a link fails, all flows are rehashed across the remaining working links. This rehashing of flows to links
results in some packets being delivered out of order even for those flows that were not hashed to the failed
link.
This rehashing also occurs when a link is added to the port channel or Equal Cost Multipath (ECMP) group.
All flows are rehashed across the new number of links, which results in some packets being delivered out of
order.
Resilient hashing maps flows to physical ports and it is supported for both ECMP groups and port channel
interfaces.
If a physical link fails, the flows originally assigned to the failed link are redistributed uniformly among the
remaining working links. The existing flows through the working links are not rehashed and hence are not
impacted.
Resilient hashing supports IPv4 and IPv6 unicast traffic, but it does not support IPv4 multicast traffic.
Resilient hashing is supported on all the Cisco Nexus 9000 Series platforms. (NX-OS 7.0(3)I3(1) release and
later). Beginning Cisco NX-OS Release 9.3(3), resilient hashing is supported on Cisco Nexus 92160YC-X,
92304QC, 9272Q, 9232C, 9236C, 92300YC switches.
Beginning Cisco Nexus Release 7.0(3)I7(4), GTP Tunnel Load Balancing is supported on Cisco Nexus
9300-FX and 9364C platform switches.
This feature overrides the source and destination port information with the 32-bit TEID value that is present
in GTPU packets.
GTP tunnel load balancing feature adds support for:
• GTP with IPv4/IPv6 transport header on physical interface
• GTP traffic over TE tunnel
• GTPU with UDP port 2152
The ip load-sharing address source-destination gtpu command enables the GTP tunnel load balancing.
To know the egress interface for GTP traffic after load balancing, use show cef {ipv4 | ipv6} exact-route
command with TEID in place of L4 protocol source and destination port number. Use 16MSBist of TEID in
source port and 16LSBits of TEID in destination port.
LACP
LACP allows you to configure up to 16 interfaces into a port channel.
LACP Overview
The Link Aggregation Control Protocol (LACP) for Ethernet is defined in IEEE 802.1AX and IEEE 802.3ad.
This protocol controls how physical ports are bundled together to form one logical channel.
Note You must enable LACP before you can use LACP. By default, LACP is disabled. See the “Enabling LACP”
section for information about enabling LACP.
The system automatically takes a checkpoint before disabling the feature, and you can roll back to this
checkpoint. See the Cisco Nexus 9000 Series NX-OS System Management Configuration Guide for information
about rollbacks and checkpoints.
The following figure shows how individual links can be combined into LACP port channels and channel
groups as well as function as individual links.
Note When you delete the port channel, the software automatically deletes the associated channel group. All member
interfaces revert to their original configuration.
Note If you downgrade a Cisco Nexus 9500 series switch that is configured to use LACP vPC convergence feature,
that runs Cisco NX-OS Release 7.0(3)I7(5) to a lower release, the configuration is removed. You must configure
the LACP vPC convergence feature again when you upgrade the switch.
You cannot disable LACP while any LACP configurations are present.
Port-Channel Modes
Individual interfaces in port channels are configured with channel modes. When you run static port channels
with no aggregation protocol, the channel mode is always set to on. After you enable LACP globally on the
device, you enable LACP for each channel by setting the channel mode for each interface to either active or
passive. You can configure channel mode for individual links in the LACP channel group when you are
adding the links to the channel group
Note You must enable LACP globally before you can configure an interface in either the active or passive channel
mode.
Both the passive and active modes allow LACP to negotiate between ports to determine if they can form a
port channel based on criteria such as the port speed and the trunking state.The passive mode is useful when
you do not know whether the remote system, or partner, supports LACP.
Two devices can form an LACP port channel when their ports are in different LACP modes if the modes are
compatible as in the following example:
Passive Passive Cannot form a port channel because no ports can initiate
negotiation.
LACP ID Parameters
This section describes the LACP parameters.
Note The LACP system ID is the combination of the LACP system priority value and the MAC address.
Table 3: Port Channels with LACP Enabled and Static Port Channels
• Not supported on Cisco Nexus 9500 Switches and FEX HIF and FEX fabric ports.
The LACP MaxBundle defines the maximum number of bundled ports allowed in a LACP port channel.
The LACP MaxBundle feature does the following:
• Defines an upper limit on the number of bundled ports in an LACP port channel.
• Allows hot-standby ports with fewer bundled ports. (For example, in an LACP port channel with five
ports, you can designate two of those ports as hot-standby ports.)
Note The minimum links and maxbundle feature works only with LACP port channels. However, the device allows
you to configure this feature in non-LACP port channels, but the feature is not operational.
Virtualization Support
You must configure the member ports and other port channel-related configuration from the virtual device
context (VDC) that contains the port channel and member ports. You can use the numbers from 1 to 4096 in
each VDC to number the port channels.
All ports in one port channel must be in the same VDC. When you are using LACP, all possible 8 active ports
and all possible 8 standby ports must be in the same VDC.
Note You must configure load balancing using port channels in the default VDC. See the “Load Balancing Using
Port Channels” section for more information about load balancing.
High Availability
Port channels provide high availability by load balancing traffic across multiple ports. If a physical port fails,
the port channel is still operational if there is an active member in the port channel. You can bundle ports
from different modules and create a port channel that remains operational even if a module fails because the
settings are common across the module.
Port channels support stateful and stateless restarts. A stateful restart occurs on a supervisor switchover. After
the switchover, the Cisco NX-OS software applies the runtime configuration after the switchover.
The port channel goes down if the operational ports fall below the configured minimum links number.
Note See the Cisco Nexus 9000 Series NX-OS High Availability and Redundancy Guide for complete information
about high-availability features.
• Do not put shared and dedicated ports into the same port channel. (See the “Configuring Basic Interface
Parameters” chapter for information about shared and dedicated ports.)
• For Layer 2 port channels, ports with different STP port path costs can form a port channel if they are
compatibly configured with each other. See the “Compatibility Requirements” section for more information
about the compatibility requirements.
• In STP, the port-channel cost is based on the aggregated bandwidth of the port members.
• After you configure a port channel, the configuration that you apply to the port channel interface affects
the port channel member ports. The configuration that you apply to the member ports affects only the
member port where you apply the configuration.
• LACP does not support half-duplex mode. Half-duplex ports in LACP port channels are put in the
suspended state.
• Do not configure ports that belong to a port channel group as private VLAN ports. While a port is part
of the private VLAN configuration, the port channel configuration becomes inactive.
• Channel member ports cannot be a source or destination SPAN port.
• Port-channels are not supported on generation 1 100G line cards (N9K-X9408PC-CFP2) or generic
expansion modules (N9K-M4PC-CFP2).
• Port-channels are supported on devices with generation 2 (and later) 100G interfaces. (7.0(3)I3(1) and
later)
• The port channel might be affected by the limitations of the Application Leaf Engine (ALE) uplink ports
on Cisco Nexus 9300 and 9500 Series devices:Limitations for ALE Uplink Ports
• Resilient hashing for port channels is not supported on Cisco Nexus 9200, Cisco Nexus 9300-EX, and
Cisco Nexus 9500 switches with 9700-EX line cards.
• In Cisco NX-OS Release 7.0(3)I4(1), resilient hashing (port-channel load-balancing resiliency) and
VXLAN configurations are not compatible with VTEPs using ALE uplink ports.
• The maximum number of subinterfaces for a port is 511. The maximum number of subinterfaces for a
satellite/FEX port is 63.
• On a Cisco Nexus 92300YC switch, the first 24 ports that are part of the same quadrant. All the ports in
the same quadrant must have same speed. Having different speed on ports in a quadrant is not supported.
Following are the first 24 ports on the Cisco Nexus 92300YC switch that share same quadrant:
• 1,4,7,10
• 2,5,8,11
• 3,6,9,12
• 13,16,19,22
• 14,17,20,23
• 15,18,21,24
• On a Cisco Nexus 9500 switch with a X96136YC-R line card, the ports 17–48 are part of the same
quadrant. Ports in the same quadrant must have same speed (1/10G or 25G) on all ports. Having different
speed on ports in a quadrant is not supported. If you set different speed in any of the ports in a quadrant,
the ports go into error disable state. Interfaces in same quadrant are:
• 17–20
• 21–24
• 25–28
• 29–32
• 33–36
• 37–40
• 41–44
• 45–48
• Beginning Cisco NX-OS Release 7.0(3)I7(8), you can use interface port-channel all command to select
all the available parent port channel interfaces in the system and then apply any subcommand to all the
member ports.
Note The subcommands impacts the FEX and VPC ports as well. For example, a shut
subcommand may shutdown any connected FEX or vPC ports.
• If you have layer 2 and layer 3 port channels in a switch some commands may not be applicable to both
the layer 2 and layer 3 port channels. In those instances, the configuration may not be applied properly.
• Use the interface port-channel all command only on similar type of port channels in a switch. This
command works on parent interfaces. However the command may not work if port channel sub interfaces
are present.
Default Settings
The following table lists the default settings for port-channel parameters.
Parameters Default
Load balancing method for Layer 3 interfaces Source and destination IP address
Load balancing method for Layer 2 interfaces Source and destination MAC address
LACP Disabled
Parameters Default
Channel mode on
Maxbundle 32
Note See the "Configuring Basic Interface Parameters” chapter for information about configuring the maximum
transmission unit (MTU) for the port-channel interface. See the “Configuring Layer 3 Interfaces” chapter for
information about configuring IPv4 and IPv6 addresses on the port-channel interface.
Note If you are familiar with the Cisco IOS CLI, be aware that the Cisco NX-OS commands for this feature might
differ from the Cisco IOS commands that you would use.
Note When the port channel is created before the channel group, the port channel should be configured with all of
the interface attributes that the member interfaces are configured with. Use the switchport mode trunk
{allowed vlan vlan-id | native vlan-id} command to configure the members.
This is required only when the channel group members are Layer 2 ports (switchport) and trunks (switchport
mode trunk).
Note Use the no interface port-channel command to remove the port channel and delete the associated channel
group.
Command Purpose
no interface port-channel channel-number Removes the port channel and deletes the
associated channel group.
Example:
switch(config)# no interface port-channel 1
Procedure
Step 3 show port-channel summary (Optional) Displays information about the port
channel.
Example:
switch(config-router)# show port-channel
summary
Example
This example shows how to create a port channel:
switch# configure terminal
switch (config)# interface port-channel 1
See the “Compatibility Requirements” section for details on how the interface configuration changes
when you delete the port channel.
Note Use the no channel-group command to remove the port from the channel group.
Command Purpose
Procedure
Step 2 interface type slot/port Specifies the interface that you want to add to
a channel group, and enters the interface
Example:
configuration mode.
switch(config)# interface ethernet 1/4
switch(config-if)#
Step 5 switchport trunk {allowed vlan vlan-id | (Optional) Configures necessary parameters for
native vlan-id} a Layer 2 trunk port.
Example:
switch(config)# switchport trunk native
3
switch(config-if)#
Step 6 channel-group channel-number [force] [mode Configures the port in a channel group and sets
{on | active | passive}] the mode. The channel-number range is from 1
to 4096. This command creates the port channel
Example:
associated with this channel group if the port
• switch(config-if)# channel-group 5 channel does not already exist. All static
port-channel interfaces are set to mode on. You
• switch(config-if)# channel-group 5
force must set all LACP-enabled port-channel
interfaces to active or passive. The default
mode is on.
(Optional) Forces an interface with some
incompatible configurations to join the channel.
The forced interface must have the same speed,
duplex, and flow control settings as the channel
group.
Note The force option fails if the port
has a QoS policy mismatch with
the other members of the port
channel.
Example
This example shows how to add a Layer 2 Ethernet interface 1/4 to channel group 5:
switch# configure terminal
switch (config)# interface ethernet 1/4
switch(config-if)# switchport
switch(config-if)# channel-group 5
Note Use the no channel-group command to remove the port from the channel group. The port reverts to its original
configuration. You must reconfigure the IP addresses for this port.
Command Purpose
Procedure
Step 2 interface type slot/port Specifies the interface that you want to add to
a channel group, and enters the interface
Example:
configuration mode.
switch(config)# interface ethernet 1/4
switch(config-if)#
Step 4 channel-group channel-number [force] [mode Configures the port in a channel group and sets
{on | active | passive}] the mode. The channel-number range is from 1
to 4096. The Cisco NX-OS software creates the
Example:
port channel associated with this channel group
• switch(config-if)# channel-group 5 if the port channel does not already exist.
• switch(config-if)# channel-group 5 (Optional) Forces an interface with some
force incompatible configurations to join the channel.
The forced interface must have the same speed,
duplex, and flow control settings as the channel
group.
Example
This example shows how to add a Layer 3 Ethernet interface 1/5 to channel group 6 in on mode:
switch# configure terminal
switch (config)# interface ethernet 1/5
switch(config-if)# switchport
switch(config-if)# channel-group 6
This example shows how to create a Layer 3 port-channel interface and assign the IP address:
switch# configure terminal
switch (config)# interface port-channel 4
switch(config-if)# ip address 192.0.2.1/8
Procedure
Step 5 show running-config interface port-channel Displays the running configuration of the port
all channels for which the new configuration is
applied.
Example:
switch(config-if-range)# show
running-config interface port-channel
all
switch(config-if-range)#
Example
This example shows how to apply a port channel configuration to all member port channels:
switch(config-if-range)#
switch(config-if-range)# sh run int po all
See the “Compatibility Requirements” section for details on how the interface configuration changes
when you delete the port channel.
Procedure
Step 2 interface port-channel channel-number Specifies the port-channel interface that you
want to configure, and enters the interface
Example:
mode.
switch(config)# interface port-channel
2
switch(config-if)#
Step 6 show interface port-channel channel-number (Optional) Displays interface information for
the specified port channel.
Example:
switch# show interface port-channel 2
Example
This example shows how to configure the informational parameters of the bandwidth and delay for
port channel 5:
switch# configure terminal
switch (config)# interface port-channel 5
switch(config-if)# bandwidth 60000000
switch(config-if)# delay 10000
switch(config-if)#
Procedure
Step 2 interface port-channel channel-number Specifies the port-channel interface that you
want to configure, and enters the interface
Example:
mode.
switch(config)# interface port-channel
2
switch(config-if)#
Step 5 show interface port-channel channel-number (Optional) Displays interface information for
the specified port channel.
Example:
switch(config-router)# show interface
port-channel 2
Example
This example shows how to bring up the interface for port channel 2:
switch# configure terminal
switch (config)# interface port-channel 2
switch(config-if)# no shutdown
Procedure
Step 2 interface port-channel channel-number Specifies the port-channel interface that you
want to configure, and enters the interface
Example:
mode.
switch(config)# interface port-channel
2
switch(config-if)#
Step 5 show interface port-channel channel-number (Optional) Displays interface information for
the specified port channel.
Example:
switch# show interface port-channel 2
Example
This example shows how to add a description to port channel 2:
switch# configure terminal
switch (config)# interface port-channel 2
switch(config-if)# description engineering
Procedure
Step 2 interface port-channel channel-number Specifies the port-channel interface that you
want to configure, and enters the interface
Example:
mode.
switch(config)# interface port-channel
2
switch(config-if)#
Step 4 duplex {auto | full | half} Sets the duplex for the port-channel interface.
The default is auto for autonegotiation.
Example:
switch(config-if)# speed auto
switch(config-if)#
Step 6 show interface port-channel channel-number (Optional) Displays interface information for
the specified port channel.
Example:
switch# show interface port-channel 2
Example
This example shows how to set port channel 2 to 100 Mb/s:
switch# configure terminal
switch (config)# interface port-channel 2
switch(config-if)# speed 100
Note Use the no port-channel load-balance command to restore the default load-balancing algorithm of
source-dest-mac for non-IP traffic and source-dest-ip for IP traffic.
Command Purpose
Procedure
Step 2 port-channel load-balance method {dst ip | Specifies the load-balancing algorithm for the
dst ip-gre | dst ip-l4port | dst ip-l4port-vlan device. The range depends on the device. The
| dst ip-vlan | dst l4port | dst mac | src ip | src default for Layer 3 is src-dst ip-l4port for both
ip-gre | src ip-l4port | src ip-l4port-vlan | src IPv4 and IPv6, and the default for non-IP is
ip-vlan | src l4port | src mac | src-dst ip | src-dst mac.
src-dst ip-gre | src-dst ip-l4port [symmetric]
Note Only the following load-balancing
| src-dst ip-l4port-vlan | src-dst ip-vlan |
algorithms support symmetric
src-dst l4port | src-dst mac} [fex {fex-range
hashing:
| all}] [rotate rotate]
• src-dst ip
Example:
• switch(config)#port-channel • src-dst ip-l4port
load-balance src-dst mac
switch(config)#
• switch(config)#no port-channel
load-balance src-dst mac
switch(config)#
Enabling LACP
LACP is disabled by default; you must enable LACP before you begin LACP configuration. You cannot
disable LACP while any LACP configuration is present.
LACP learns the capabilities of LAN port groups dynamically and informs the other LAN ports. Once LACP
identifies correctly matched Ethernet links, it group the links into a port channel. The port channel is then
added to the spanning tree as a single bridge port.
To configure LACP, you must do the following:
Procedure
Example
This example shows how to enable LACP:
switch# configure terminal
switch (config)# feature lacp
Procedure
Step 3 channel-group number mode {active | on | Specifies the port mode for the link in a port
passive} channel. After LACP is enabled, you configure
each link or the entire channel as active or
Example:
passive.
switch(config-if)# channel-group 5 mode
active When you run port channels with no associated
aggregation protocol, the port-channel mode is
always on.
The default port-channel mode is on.
Example
This example shows how to set the LACP-enabled interface to the active port-channel mode for
Ethernet interface 1/4 in channel group 5:
switch# configure terminal
switch (config)# interface ethernet 1/4
switch(config-if)# channel-group 5 mode active
Note Use the no lacp min-links command to restore the default port-channel minimum links configuration.
Command Purpose
Procedure
Step 2 interface port-channel number Specifies the interface to configure, and enters
the interface configuration mode.
Example:
switch(config)# interface port-channel
3
switch(config-if)#
Step 4 show running-config interface port-channel (Optional) Displays the port-channel minimum
number links configuration.
Example:
switch(config-if)# show running-config
interface port-channel 3
Example
This example shows how to configure the minimum number of port-channel member interfaces to
be up/active for the port-channel to be up/active:
switch# configure terminal
switch(config)# interface port-channel 3
switch(config-if)# lacp min-links 3
Note Use the no lacp max-bundle command to restore the default port-channel max-bundle configuration.
Command Purpose
Procedure
Step 2 interface port-channel number Specifies the interface to configure, and enters
the interface configuration mode.
Example:
switch(config)# interface port-channel
3
switch(config-if)#
Example
This example shows how to configure the port channel interface max-bundle:
switch# configure terminal
switch(config)# interface port-channel 3
switch(config-if)# lacp max-bundle 3
Note We do not recommend changing the LACP timer rate. HA and SSO are not supported when the LACP fast
rate timer is configured.
Note Configuring lacp rate fast is not recommended on the vPC Peer-Links. When lacp rate fast is configured
on the vPC Peer-Link member interfaces, an alert is displayed in the syslog messages only when the LACP
logging level is set to 5.
Procedure
Step 2 interface type slot/port Specifies the interface to configure and enters
the interface configuration mode.
Example:
Step 3 lacp rate fast Configures the fast rate (one second) at which
LACP control packets are sent to an
Example:
LACP-supported interface.
switch(config-if)# lacp rate fast
To reset the timeout rate to its default, use the
no form of the command.
Example
This example shows how to configure the LACP fast rate on Ethernet interface 1/4:
switch# configure terminal
switch (config)# interface ethernet 1/4
switch(config-if)# lacp rate fast
This example shows how to restore the LACP default rate (30 seconds) on Ethernet interface 1/4.
switch# configure terminal
switch (config)# interface ethernet 1/4
switch(config-if)# no lacp rate fast
Procedure
Step 2 lacp system-priority priority Configures the system priority for use with
LACP. Valid values are from 1 through 65535,
Example:
and higher numbers have a lower priority. The
switch(config)# lacp system-priority default value is 32768.
40000
Note Each VDC has a different LACP
system ID because the software
adds the MAC address to this
configured value.
Example
This example shows how to set the LACP system priority to 2500:
switch# configure terminal
switch(config)# lacp system-priority 2500
Procedure
Step 2 interface type slot/port Specifies the interface that you want to add to
a channel group, and enters the interface
Example:
configuration mode.
switch(config)# interface ethernet 1/4
switch(config-if)#
Step 3 lacp port-priority priority Configures the port priority for use with LACP.
Valid values are from 1 through 65535, and
Example:
higher numbers have a lower priority. The
switch(config-if)# lacp port-priority default value is 32768.
40000
Example
This example shows how to set the LACP port priority for Ethernet interface 1/4 to 40000:
switch# configure terminal
switch (config)# interface ethernet 1/4
switch(config-if)# lacp port-priority 40000
Procedure
Step 2 lacp system-mac mac-address role role-value Specifies the MAC address to use in the LACP
protocol exchanges. The role is optional.
Example:
Primary is the default.
switch(config)# lacp system-mac
000a.000b.000c role primary
switch(config)# lacp system-mac
000a.000b.000c role secondary
Step 3 (Optional) show lacp system-identifier Displays the configured MAC address.
Example:
switch(config)# show lacp
system-identifier
Step 4 copy running-config startup-config Copies the running configuration to the startup
configuration.
Example:
switch(config)# copy running-config
startup-config
Example
The following example shows how to configure the role of a switch as primary.
Switch1# sh lacp system-identifier
32768,0-b-0-b-0-b
Switch1# sh run | grep lacp
feature lacp
lacp system-mac 000b.000b.000b role primary
The following example shows how to configure the role of a switch as secondary.
Switch2# sh lacp system-identifier
32768,0-b-0-b-0-b
Switch2# sh run | grep lacp
feature lacp
lacp system-mac 000b.000b.000b role secondary
Note The port channel has to be in the administratively down state before the command can be run.
Procedure
Step 2 interface port-channel number Specifies the port channel interface to configure
and enters the interface configuration mode.
Example:
switch(config)# interface port-channel
1
switch(config-if)#
Example
This example shows how to disable LACP graceful convergence on a port channel:
switch# configure terminal
switch (config)# interface port-channel 1
switch(config-if)# shutdown
switch(config-if)# no lacp graceful-convergence
switch(config-if)# no shutdown
Procedure
Step 2 interface port-channel number Specifies the port channel interface to configure
and enters the interface configuration mode.
Example:
switch(config)# interface port-channel
1
switch(config-if)#
Example
This example shows how to enable LACP graceful convergence on a port channel:
switch# configure terminal
switch (config)# interface port-channel 1
switch(config-if)# shutdown
switch(config-if)# lacp graceful-convergence
switch(config-if)# no shutdown
Note You should only enter the lacp suspend-individual command on edge ports. The port channel has to be in
the administratively down state before you can use this command.
Procedure
Example
This example shows how to disable LACP individual port suspension on a port channel:
switch# configure terminal
switch (config)# interface port-channel 1
switch(config-if)# shutdown
switch(config-if)# no lacp suspend-individual
switch(config-if)# no shutdown
Procedure
Example
This example shows how to reenable the LACP individual port suspension on a port channel:
switch# configure terminal
switch (config)# interface port-channel 1
switch(config-if)# shutdown
switch(config-if)# lacp suspend-individual
switch(config-if)# no shutdown
Note For vPC, you must enable the delayed LACP on both vPC switches.
Note For vPC, when the delayed LACP port is on the primary switch and the primary switch fails to boot, you need
to remove the vPC configuration on the delayed LACP port-channel of the acting primary switch and flap the
port-channel for a new port to be chosen as the delayed LACP port on the existing port-channel.
Procedure
Step 2 interface port-channel number Specifies the port channel interface to configure
and enters the interface configuration mode.
Example
The following example configures delayed LACP.
Procedure
Example
This example shows how to configure hash distribution at the global level:
switch# configure terminal
switch(config)# no port-channel hash-distribution fixed
Procedure
Step 2 interface port-channel {channel-number | Specifies the interface to configure, and enters
range} the interface configuration mode.
Example:
switch# interface port-channel 4
switch(config-if)#
Example
This example shows how to configure hash distribution as a global-level command:
switch# configure terminal
switch(config)# no port-channel hash-distribution fixed
Procedure
Step 2 hardware profile ecmp resilient Enables ECMP resilient hashing and displays
the following: Warning: The command will
Example:
take effect after next reload.
switch(config)# hardware profile ecmp
resilient Note This command is not supported
on Cisco Nexus 9808 platform
switches.
Step 3 copy running-config startup-config Copies the running configuration to the startup
configuration.
Example:
switch(config)# copy running-config
startup-config
Procedure
Step 3 copy running-config startup-config Copies the running configuration to the startup
configuration.
Example:
switch(config)# copy running-config
startup-config
Note ECMP load balancing based on inner NVGRE header is supported only on N9K-C9504-FM-E,
N9K-C9508-FM-E, N9K-C9516-FM-E, N9K-C9516-FM-E2 devices.
Procedure
Step 2 (Optional) show ip load-sharing Displays the ECMP load-sharing algorithm for
data traffic.
Example:
switch(config)# show ip load-sharing
IPv4/IPv6 ECMP load sharing:
Universal-id (Random Seed): 398176901
Load-share mode : address
source-destination port
source-destination inner all infra-mode
GRE-Outer hash is disabled
Concatenation is disabled
Rotate: 32
Command Purpose
switch(config)# show running-config | grep Displays the enabled status.
"hardware profile ecmp resilient
hardware profile ecmp resilient
switch(config)#
Command Purpose
load- interval {interval seconds {1 | 2 | 3}} Sets three different sampling intervals to bit-rate and
packet-rate statistics.
show port-channel compatibility-parameters Displays the parameters that must be the same among
the member ports in order to join a port channel.
show port-channel database [interface Displays the aggregation state for one or more
port-channel channel-number] port-channel interfaces.
show port-channel load-balance Displays the type of load balancing in use for port
channels.
show port-channel traffic Displays the traffic statistics for port channels.
show port-channel usage Displays the range of used and unused channel
numbers.
show running-config interface port-channel Displays information about the running configuration
channel-number of the port-channel.
Command Purpose
load- interval {interval seconds {1 | 2 | 3}} Sets three different sampling intervals to bit-rate and
packet-rate statistics.
show interface counters [module module] Displays input and output octets unicast packets,
multicast packets, and broadcast packets.
show interface counters detailed [all] Displays input packets, bytes, and multicast and output
packets and bytes.
show interface counters errors [module module] Displays information about the number of error
packets.
This example shows how to add two Layer 3 interfaces to a channel group. The Cisco NX-OS software
automatically creates the port channel:
Related Documents
Related Topic Document Title