Example: Configuring multi-tier M-LAG+spine gateways+ECMP paths to the external network

Spine

S12500X-AF

R2825

S12500G-AF

R7625

Border or leaf

S6800, S6860

R6710

S6805, S6825, S6850, S9850, S9820-64H, S9820-8C

R6710

S6890

R2825

S6812, S6813

F6628P22 and higher

Leaf 1 (S6800)

Leaf 2 (S6800)

Configuration method

Description

Remarks

interface FortyGigE1/0/52

interface FortyGigE1/0/52

Manual

Enter the interface view for the keepalive link.

N/A

port link-mode route

port link-mode route

Manual

Configure the interface for keepalive detection to operate in route mode as a Layer 3 interface.

N/A

ip address 1.0.0.1 255.255.255.252

ip address 1.0.0.2 255.255.255.252

Manual

Assign an IP address to the keepalive interface.

N/A

quit

quit

Manual

Return to system view.

N/A

m-lag system-mac 00e0-fc00-5800

m-lag system-mac 00e0-fc00-5800

Manual

Set the MAC address of the M-LAG system.

You must assign the same M-LAG system MAC address to the member devices in an M-LAG system system.

m-lag system-number 1

m-lag system-number 2

Manual

Set the M-LAG system number.

You must assign different M-LAG system numbers to the member devices in an M-LAG system system.

m-lag system-priority 100

m-lag system-priority 100

Manual

(Optional.) Set the M-LAG system priority.

You must set the same M-LAG system priority on the member devices in an M-LAG system system.

The default M-LAG system priority is 32768. The smaller the value, the higher the priority.

m-lag standalone enable

m-lag standalone enable

Manual

Enable M-LAG standalone mode.

N/A

m-lag keepalive ip destination 1.0.0.2 source 1.0.0.1

m-lag keepalive ip destination 1.0.0.1 source 1.0.0.2

Manual

Configure the destination and source IP addresses of keepalive packets.

Exclude the interfaces providing the source and destination IP addresses from the shutdown action by M-LAG MAD.

m-lag mad exclude interface FortyGigE1/0/52

m-lag mad exclude interface FortyGigE1/0/52

Manual

Exclude the keepalive interface from the shutdown action by M-LAG MAD.

N/A

m-lag restore-delay 300

m-lag restore-delay 300

Manual

Set the data restoration interval.

This parameter ensures that forwarding entry synchronization finishes before interfaces are brought up.

interface Bridge-Aggregation1

interface Bridge-Aggregation1

Manual

Create a Layer 2 aggregate interface and enter its view.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan all

port trunk permit vlan all

Manual

Configure the trunk interface to permit all VLANs.

N/A

interface FortyGigE1/0/51

interface FortyGigE1/0/51

Manual

Enter interface view.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan all

port trunk permit vlan all

Manual

Configure the trunk interface to permit all VLANs.

N/A

port link-aggregation group 1

port link-aggregation group 1

Manual

Assign the interface to aggregation group 1.

N/A

interface Bridge-Aggregation1

interface Bridge-Aggregation1

Manual

Enter Layer 2 aggregate interface view.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port m-lag peer-link 1

port m-lag peer-link 1

Manual

Specify the aggregate interface as a peer-link interface.

N/A

undo mac-address static source-check enable

undo mac-address static source-check enable

Manual

Disable static source check.

Disable static source check on the peer-link interface and spine-facing uplink interfaces.

Leaf 1 (S6800)

Leaf 2 (S6800)

Configuration method

Description

Remarks

VLAN 21

VLAN 21

Manual

Create VLAN 21.

N/A

quit

quit

Manual

Return to the previous view.

N/A

interface Bridge-Aggregation101

interface Bridge-Aggregation101

Manual

Create an aggregate interface and enter its view. This interface will be assigned to a server-facing M-LAG group.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port m-lag group 1

port m-lag group 1

Manual

Assign the aggregate interface to M-LAG group 1.

N/A

port lacp system-priority 101

port lacp system-priority 100

Manual

Set the LACP priority.

Set different LACP priorities for different M-LAG member devices, so that only member ports with a higher priority are selected upon brain split.

quit

quit

Manual

Return to the previous view.

N/A

interface Ten-GigabitEthernet1/0/1

interface Ten-GigabitEthernet 1/0/1

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

port link-aggregation group 101

port link-aggregation group 101

Manual

Assign the interface to aggregation group 101.

N/A

quit

quit

Manual

Return to the previous view.

N/A

interface FortyGigE1/0/53

interface FortyGigE1/0/53

Manual

Enter the view of an M-LAG aggregation member port.

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

Leaf 1 (S6800)

Leaf 2 (S6800)

Configuration method

Description

Remarks

interface Bridge-Aggregation102

interface Bridge-Aggregation102

Manual

Create an aggregate interface to be assigned to an M-LAG system group and enter aggregate interface view.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port m-lag group 2

port m-lag group 2

Manual

Assign the aggregate interface to M-LAG group 2.

N/A

port lacp system-priority 101

port lacp system-priority 100

Manual

Set the LACP priority.

Set different LACP priorities for different M-LAG member devices, so that only member ports with a higher priority are selected upon brain split.

quit

quit

Manual

Return to the previous view.

N/A

interface FortyGigE1/0/49

interface FortyGigE1/0/49

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

port link-aggregation group 102

port link-aggregation group 102

Manual

Assign the interface to aggregation group 102.

N/A

interface FortyGigE1/0/50

interface FortyGigE1/0/50

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

port link-aggregation group 102

port link-aggregation group 102

Manual

Assign the interface to aggregation group 102.

N/A

quit

quit

Manual

Return to the previous view.

N/A

Spine 1

Spine 2

Configuration method

Description

Remarks

interface HundredGigE2/0/2

interface HundredGigE2/0/2

Manual

Enter the interface view for the keepalive link.

N/A

port link-mode route

port link-mode route

Manual

Configure the interface for keepalive detection to operate in route mode as a Layer 3 interface.

N/A

ip address 2.0.0.1 255.255.255.252

ip address 2.0.0.2 255.255.255.252

Manual

Assign an IP address to the interface.

N/A

quit

quit

Manual

Return to system view.

N/A

m-lag restore-delay 300

m-lag restore-delay 300

Manual

Set the data restoration interval.

Set this parameter to 200 on a fixed-port device.

m-lag role priority 100

m-lag role priority 101

Manual

Set M-LAG role priority.

The M-LAG member devices negotiate their M-LAG roles based on the M-LAG role priority. The smaller the value, the higher the priority to be the primary M-LAG devices.

m-lag system-mac 542b-de0c-0300

m-lag system-mac 542b-de0c-0300

Manual

Set the MAC address of the M-LAG system.

You must assign the same M-LAG system MAC address to the member devices in an M-LAG system system.

m-lag system-number 1

m-lag system-number 2

Manual

Set the M-LAG system number.

You must assign different M-LAG system numbers to the member devices in an M-LAG system system.

m-lag system-priority 100

m-lag system-priority 100

Manual

(Optional.) Set the M-LAG system priority.

You must set the same M-LAG system priority on the member devices in an M-LAG system system.

The default M-LAG system priority is 32768. The smaller the value, the higher the priority.

m-lag standalone enable

m-lag standalone enable

Manual

Enable M-LAG standalone mode.

N/A

m-lag keepalive ip destination 2.0.0.2 source 2.0.0.1

m-lag keepalive ip destination 2.0.0.1 source 2.0.0.2

Manual

Configure the destination and source IP addresses of keepalive packets.

Specify a VPN instance according to the network environment.

For the interfaces that will be shut down by M-LAG MAD, exclude them from the M-LAG MAD DOWN action as needed.

m-lag mad exclude interface HundredGigE2/0/2

m-lag mad exclude interface HundredGigE2/0/2

Manual

Exclude the keepalive interface from the shutdown action by M-LAG MAD.

N/A

interface Bridge-Aggregation 1

interface Bridge-Aggregation 1

Manual

Create Bridge-Aggregation 1.

N/A

quit

quit

Manual

Return to system view.

N/A

interface HundredGigE2/0/1

interface HundredGigE2/0/1

Manual

Enter the view of a member port of the peer-link interface.

N/A

port link-aggregation group 1

port link-aggregation group 1

Manual

Assign the interface to aggregation group 1.

N/A

quit

quit

Manual

Return to the previous view.

N/A

interface Bridge-Aggregation 1

interface Bridge-Aggregation 1

Manual

Enter the view of Bridge-Aggregation 1.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port m-lag peer-link 1

port m-lag peer-link 1

Manual

Specify the aggregate interface as a peer-link interface.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan all

port trunk permit vlan all

Manual

Configure the trunk interface to permit all VLANs.

N/A

port trunk pvid vlan 4094

port trunk pvid vlan 4094

Manual

Set the PVID to 4094 for the trunk interface.

N/A

Spine 1

Spine 2

Configuration method

Description

Remarks

Vlan 21 31

Vlan 21 31

Manual

Create VLANs.

N/A

quit

quit

Manual

Return to system view.

N/A

interface Bridge-Aggregation102

interface Bridge-Aggregation102

Manual

Enter the view of the M-LAG group member aggregate interface connected to Leaf 1 and Leaf 2.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port lacp system-priority 101

port lacp system-priority 100

Manual

Set the LACP priority.

Set different LACP priorities for different M-LAG member devices, so that only member ports with a higher priority are selected upon brain split.

port m-lag group 2

port m-lag group 2

Manual

Assign the aggregate interface to M-LAG group 2.

N/A

interface FortyGigE 3/0/1

interface FortyGigE 3/0/1

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

port link-aggregation group 102

port link-aggregation group 102

Manual

Assign the interface to aggregation group 1.02

N/A

interface FortyGigE 3/0/2

interface FortyGigE 3/0/2

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 21

port trunk permit vlan 21

Manual

Assign the trunk interface to VLAN 21.

N/A

port link-aggregation group 102

port link-aggregation group 102

Manual

Assign the interface to aggregation group 1.02

N/A

quit

quit

Manual

Return to system view.

N/A

interface Bridge-Aggregation103

interface Bridge-Aggregation103

Manual

Enter the view of the M-LAG group member aggregate interface connected to Leaf 3 and Leaf 4.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 31

port trunk permit vlan 31

Manual

Assign the trunk interface to VLAN 31.

N/A

link-aggregation mode dynamic

link-aggregation mode dynamic

Manual

Configure the aggregate interface to operate in dynamic mode.

N/A

port lacp system-priority 101

port lacp system-priority 100

Manual

Set the LACP priority.

Set different LACP priorities for different M-LAG member devices, so that only member ports with a higher priority are selected upon brain split.

port m-lag group 3

port m-lag group 3

Manual

Assign the aggregate interface to M-LAG group 2.

N/A

interface FortyGigE 3/0/3

interface FortyGigE 3/0/3

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 31

port trunk permit vlan 31

Manual

Assign the trunk interface to VLAN 31.

N/A

port link-aggregation group 103

port link-aggregation group 103

Manual

Assign the interface to aggregation group 1.03

N/A

interface FortyGigE3/0/4

interface FortyGigE3/0/4

Manual

Enter the view of an M-LAG aggregation member port.

N/A

port link-type trunk

port link-type trunk

Manual

Set the link type of the interface to trunk.

N/A

port trunk permit vlan 31

port trunk permit vlan 31

Manual

Assign the trunk interface to VLAN 31.

N/A

port link-aggregation group 103

port link-aggregation group 103

Manual

Assign the interface to aggregation group 1.03

N/A

quit

quit

Manual

Return to the previous view.

N/A

routing-interface base-mac 3c8c-4003-8ba5

routing-interface base-mac 3c8c-4003-8b41

Manual

Configure the base MAC address.

The base MAC address of Spine 2 is equal to that of Spine 1 + 0X64.

This step only applies to S12500X-AF and S6890 switches.

interface Vlan-interface21

interface Vlan-interface21

Manual

Create the VLAN interface of VLAN 21, the service VLAN on Leaf 1 and Leaf 2.

N/A

ip address 21.1.1.1 255.255.255.0

ip address 21.1.1.1 255.255.255.0

Manual

Assign an IP address to the interface.

N/A

mac-address 3c8c-4003-8c08

mac-address 3c8c-4003-8c08

Manual

Assign a MAC address to the interface.

N/A

quit

quit

Manual

Return to the previous view.

N/A

m-lag mad exclude interface Vlan-interface21

m-lag mad exclude interface Vlan-interface21

Manual

Exclude the VLAN interface from the M-LAG MAD DOWN action.

N/A

interface Vlan-interface31

interface Vlan-interface31

Manual

Create the VLAN interface of VLAN 31, the service VLAN on Leaf 3 and Leaf 4.

N/A

ip address 31.1.1.1 255.255.255.0

ip address 31.1.1.1 255.255.255.0

Manual

Assign an IP address to the interface.

N/A

mac-address 3c8c-4003-8c09

mac-address 3c8c-4003-8c09

Manual

Assign a MAC address to the interface.

N/A

quit

quit

Manual

Return to system view.

N/A

m-lag mad exclude interface Vlan-interface31

m-lag mad exclude interface Vlan-interface31

Manual

Exclude the VLAN interface from the M-LAG MAD DOWN action.

N/A

ospf 1 router-id 2.1.1.1

ospf 1 router-id 2.1.1.2

Manual

Start an OSPF process.

import-route direct

import-route direct

Manual

Redistribute direct routes.

area 0.0.0.0

area 0.0.0.0

Manual

Create an OSPF area.

interface HundredGigE1/0/5

interface HundredGigE2/0/3

Manual

Enter the view of the router-facing interface.

port link-mode route

port link-mode route

Manual

Configure the interface for keepalive detection to operate in route mode as a Layer 3 interface.

ip address 25.1.1.1 255.255.255.0

ip address 23.1.1.1 255.255.255.0

Manual

Assign an IP address to the interface.

ospf 1 area 0.0.0.0

ospf 1 area 0.0.0.0

Manual

Enable OSPF on the interface.

quit

quit

Manual

Return to system view.

Vlan 2000

Vlan 2000

Manual

Create the east-west failover VLAN.

quit

quit

Manual

Return to system view.

interface Vlan-interface2000

interface Vlan-interface2000

Manual

Create the VLAN interface of the east-west failover VLAN.

ip address 192.168.2.1 255.255.255.252

ip address 192.168.2.2 255.255.255.252

Manual

Assign an IP address to the interface.

ospf 1 area 0.0.0.0

ospf 1 area 0.0.0.0

Manual

Enable OSPF on the VLAN interface.

ospf 1 router-id 3.1.1.1

Manual

Start an OSPF process.

area 0.0.0.0

Manual

Create an OSPF area.

interface HundredGigE1/0/25

Manual

Enter the view of the interface connected to Spine 1.

port link-mode route

Manual

Configure the interface for keepalive detection to operate in route mode as a Layer 3 interface.

ip address 25.1.1.2 24

Manual

Assign an IP address to the interface connected to Spine 1.

ospf 1 area 0.0.0.0

Manual

Enable OSPF on the interface.

quit

Manual

N/A

interface HundredGigE1/0/26

Manual

Enter the view of the interface connected to Spine 2.

port link-mode route

Manual

Configure the interface for keepalive detection to operate in route mode as a Layer 3 interface.

ip address 23.1.1.2 24

Manual

Assign an IP address to the interface connected to Spine 2.

ospf 1 area 0.0.0.0

Manual

Enable OSPF on the interface.

U-4-201

IPv4 known unicast

East-west across leaf M-LAG systems

Server A > Leaf 1 & Leaf 2 > Spine 1 & Spine 2 > Leaf 3 & Leaf 4 > Server B

Bond4+ tester

Light

Layer 3 forwarding between PMs.

U-4-202

IPv4 known unicast

East-west across leaf M-LAG systems

Server B > Leaf 1 & Leaf 2 > Spine 1 & Spine 2 > Leaf 1 & Leaf 2 > Server A

Bond4+ tester

Light

Layer 3 forwarding between PMs.

U-4-203

IPv4 known unicast

South-north

Server A > Leaf 1 & Leaf 2 > Spine 1 & Spine 2 > Router

Bond4+ tester

Light

Layer 3 forwarding between PMs and the external network.

U-4-204

IPv4 known unicast

South-north

Router > Spine 1 & Spine 2 > Leaf 1 & Leaf 2 > Server A

Bond4+ tester

Light

Layer 3 forwarding between PMs and the external network.

U-4-205

IPv4 known unicast

East-west across leaf M-LAG systems

Server C > Leaf 1 > Spine 1 & Spine 2 > Leaf 3 & Leaf 4 > Server B

Bond4+ tester

Light

Layer 3 forwarding between PMs.

U-4-206

IPv4 known unicast

East-west across leaf M-LAG systems

Server B > Leaf 3 & Leaf 4 > Spine 1 & Spine 2 > Leaf 1 > Server C

Bond4+ tester

Light

Layer 3 forwarding between PMs.

U-4-207

IPv4 known unicast

South-north

Server C > Leaf 1 > Spine 1 & Spine 2 > Router

Bond4+ tester

Light

Layer 3 forwarding between PMs and the external network.

U-4-208

IPv4 known unicast

South-north

Router > Spine 1 & Spine 2 > Leaf 1 > Server C

Bond4+ tester

Light

Layer 3 forwarding between PMs and the external network.

M-LAG system at the spine or leaf tier

Single point of failure on M-LAG member links

≤ 500 ms

Single point of failure restored on M-LAG member links

0 ms

Peer link failure

For M-LAG member links: ≤ 500 ms

For a link attached to a single-homed device:

·     If the M-LAG MAD DOWN action is not triggered on the attached M-LAG member device, east-west traffic resumes after the peer link recovers.

·     If the M-LAG MAD DOWN action has been triggered on the attached M-LAG member device, traffic resumes after the peer link and the single-homed link recover.

Peer link failure restored

0 ms

Keepalive link failure

0 ms

Keepalive link failure restored

0 ms

Keepalive link and peer link failure

≤ 5000 ms

Keepalive link and peer link restored

≤ 1000 ms

Upgrading the devices

≤ 500 ms (legacy method, in which two M-LAG member devices are separately upgraded)

Expanding the network

0 ms

Replacing hardware

Fixed-port device: ≤ 500 ms

Modular device:

·     Device replacement: ≤ 1000 ms.

·     Switching fabric module replacement: 0 ms.

·     Service module replacement: ≤ 500 ms.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display device

display device

Displays device information.

display boot-loader

display boot-loader

Displays current software images and startup software images.

display version

display version

Displays system version information.

display m-lag summary

display m-lag summary

Displays summary information about the peer-link interface and M-LAG interfaces.

display m-lag system

display m-lag system

Displays the M-LAG system settings.

display m-lag keepalive

display m-lag keepalive

Displays M-LAG keepalive packet statistics.

display m-lag role

display m-lag role

Displays M-LAG role information.

display m-lag consistency { type1 | type2 }

display m-lag consistency { type1 | type2 }

Displays information about the configuration consistency check done by M-LAG.

display m-lag consistency-check status

display m-lag consistency-check status

Displays the configuration consistency check status.

display interface Bridge-Aggregation [ brief ]

display interface Bridge-Aggregation [ brief ]

Displays information about Layer 2 aggregate interfaces.

display stp brief

display stp brief

Displays brief spanning tree status and statistics.