04-Layer 2—LAN Switching Configuration Guide

HomeSupportSwitchesS6550X-HI SeriesConfigure & DeployConfiguration GuidesH3C S6550X-HI Configuration Guides-R1116Pxx-6W10004-Layer 2—LAN Switching Configuration Guide
02-Ethernet link aggregation configuration
Title Size Download
02-Ethernet link aggregation configuration 400.57 KB

Contents

Configuring Ethernet link aggregation· 1

About Ethernet link aggregation· 1

Ethernet link aggregation application scenario· 1

Aggregate interface, aggregation group, and member port 1

Operational key· 2

Configuration types· 2

Link aggregation modes· 2

How static link aggregation works· 3

Dynamic link aggregation· 4

How dynamic link aggregation works· 7

Edge aggregate interface· 9

Load sharing modes for link aggregation groups· 9

S-MLAG·· 9

Restrictions and guidelines: Mixed use of manual and automatic link aggregation configuration· 10

Ethernet link aggregation tasks at a glance· 10

Configuring the system ID·· 11

Configuring a manual link aggregation· 12

Restrictions and guidelines for aggregation group configuration· 12

Configuring a Layer 2 aggregation group· 13

Configuring a Layer 3 aggregation group· 14

Configuring a 1+1 backup aggregation group· 15

About 1+1 backup link aggregation· 15

1+1 backup link aggregation tasks at a glance· 16

Configuring a static 1+1 backup aggregation group· 16

Specifying a primary member port 17

Setting the reversion delay· 17

Configuring a 1+1 backup aggregation group to place its secondary member port in down state· 18

Performing a primary/secondary member port switchover 18

Configuring automatic link aggregation· 19

Configuring S-MLAG·· 19

Configuring an aggregate interface· 20

Configuring the basic parameters of an aggregate interface· 20

Configuring jumbo frame support 21

Setting the MTU of an aggregate interface· 22

Configuring an edge aggregate interface· 22

Restoring the default settings for an aggregate interface· 22

Setting the minimum and maximum numbers of Selected ports for an aggregation group· 23

Setting the minimum percentage of Selected ports in an aggregation group· 24

Configuring the link aggregation capability of the device· 25

Disabling the default action of selecting a Selected port for dynamic aggregation groups that have not received LACPDUs  25

Configuring a dynamic aggregation group to use port speed as the prioritized criterion for reference port selection  26

Ignoring port speed in setting the aggregation states of member ports· 27

Configuring load sharing for link aggregation groups· 27

Setting static load sharing modes for link aggregation groups· 27

Isolating aggregate interfaces on the device· 28

Enabling BFD for an aggregation group· 28

Verifying and maintaining Ethernet link aggregation· 30

Displaying the link aggregation capability of the device· 30

Verifying aggregate interface and aggregation member port running status· 30

Displaying the local system ID·· 30

Displaying link-aggregation load sharing information· 30

Displaying and clearing interface statistics· 30

Clearing LACP statistics for link aggregation member ports· 31

Ethernet link aggregation configuration examples· 31

Example: Configuring a Layer 2 static aggregation group· 31

Example: Configuring a Layer 2 dynamic aggregation group· 33

Example: Configuring a Layer 2 edge aggregate interface· 35

Example: Configuring a Layer 3 static aggregation group· 36

Example: Configuring a Layer 3 dynamic aggregation group· 37

Example: Configuring S-MLAG·· 38


Configuring Ethernet link aggregation

About Ethernet link aggregation

Ethernet link aggregation bundles multiple physical Ethernet links into one logical link (called an aggregate link). Link aggregation provides the following benefits:

·     Increased bandwidth beyond the limits of a single individual link. In an aggregate link, traffic is distributed across the member ports.

·     Improved link reliability. The member ports dynamically back up one another. When a member port fails, its traffic is automatically switched to other member ports.

Ethernet link aggregation application scenario

As shown in Figure 1, Device A and Device B are connected by three physical Ethernet links. These physical Ethernet links are combined into an aggregate link called link aggregation 1. The bandwidth of this aggregate link can reach up to the total bandwidth of the three physical Ethernet links. At the same time, the three Ethernet links back up one another. When a physical Ethernet link fails, the traffic transmitted on the failed link is switched to the other two links.

Figure 1 Ethernet link aggregation diagram

Aggregate interface, aggregation group, and member port

Each link aggregation is represented by a logical aggregate interface. Each aggregate interface has an automatically created aggregation group, which contains member ports to be used for aggregation. The type and number of an aggregation group are the same as its aggregate interface.

Supported aggregate interface types

An aggregate interface can be one of the following types:

·     Layer 2—A Layer 2 aggregate interface is created manually. The member ports in a Layer 2 aggregation group can only be Layer 2 Ethernet interfaces.

·     Layer 3—A Layer 3 aggregate interface is created manually. The member ports in its Layer 3 aggregation group can only be Layer 3 Ethernet interfaces.

The port rate of an aggregate interface equals the total rate of its Selected member ports. Its duplex mode is the same as that of the Selected member ports. For more information about Selected member ports, see "Aggregation states of member ports in an aggregation group."

Aggregation states of member ports in an aggregation group

A member port in an aggregation group can be in any of the following aggregation states:

·     Selected—A Selected port can forward traffic.

·     Unselected—An Unselected port cannot forward traffic.

·     Individual—An Individual port can forward traffic as a normal physical port. This state is peculiar to the member ports of edge aggregate interfaces. A member port is placed in Individual state if it has not received LACPDUs before the first expiration of the LACP timeout timer after either of the following event occurs:

¡     The aggregate interface is configured as an edge aggregate interface.

¡     The member port goes down and then comes up after it is placed in Unselected or Selected state.

For more information about edge aggregate interfaces, see "Edge aggregate interface."

Operational key

When aggregating ports, the system automatically assigns each port an operational key based on port information, such as port rate and duplex mode. Any change to this information triggers a recalculation of the operational key.

In an aggregation group, all Selected ports have the same operational key.

Configuration types

Port configuration includes the attribute configuration and protocol configuration. Attribute configuration affects the aggregation state of the port but the protocol configuration does not.

Attribute configuration

To become a Selected port, a member port must have the same attribute configuration as the aggregate interface. Table 1 describes the attribute configuration.

Table 1 Attribute configuration

Feature

Attribute configuration

Port isolation

Membership of the port in an isolation group.

Isolation group number.

VLAN

VLAN attribute settings:

·     Permitted VLAN IDs.

·     PVID.

·     Link type (trunk, hybrid, or access).

·     IP subnet-based VLAN configuration.

·     Protocol-based VLAN configuration.

·     VLAN tagging mode.

For information about VLANs, see "Configuring VLANs."

Protocol configuration

Protocol configuration of a member port does not affect the aggregation state of the member port. MAC address learning and spanning tree settings are examples of the protocol configuration.

Link aggregation modes

An aggregation group operates in one of the following modes:

·     Static—Static aggregation is stable. An aggregation group in static mode is called a static aggregation group. The aggregation states of the member ports in a static aggregation group are not affected by the peer ports.

·     Dynamic—An aggregation group in dynamic mode is called a dynamic aggregation group. Dynamic aggregation is implemented through IEEE 802.3ad Link Aggregation Control Protocol (LACP). The local system and the peer system automatically maintain the aggregation states of the member ports. Dynamic link aggregation reduces the administrators' workload.

How static link aggregation works

Reference port selection process

When setting the aggregation states of the ports in an aggregation group, the system automatically chooses a member port as the reference port. A Selected port must have the same operational key and attribute configurations as the reference port.

The system chooses a reference port from the member ports in up state.

The candidate reference ports are organized into different priority levels following these rules:

1.     In descending order of port priority.

2.     Full duplex.

3.     In descending order of speed.

4.     Half duplex.

5.     In descending order of speed.

From the candidate ports with the same attribute configurations as the aggregate interface, the one with the highest priority level is chosen as the reference port.

·     If multiple ports have the same priority level, the port that has been Selected (if any) is chosen. If multiple ports with the same priority level have been Selected, the one with the smallest port number is chosen.

·     If multiple ports have the same priority level and none of them has been Selected, the port with the smallest port number is chosen.

Setting the aggregation state of each member port

After the reference port is chosen, the system sets the aggregation state of each member port in the static aggregation group.

Figure 2 Setting the aggregation state of a member port in a static aggregation group

After the limit on Selected ports is reached, the aggregation state of a new member port varies by following conditions:

·     The port is placed in Unselected state if the port and the Selected ports have the same port priority. This mechanism prevents traffic interruption on the existing Selected ports. A device reboot can cause the device to recalculate the aggregation states of member ports.

·     The port is placed in Selected state when the following conditions are met:

¡     The port and the Selected ports have different port priorities, and the port has a higher port priority than a minimum of one Selected port.

¡     The port has the same attribute configurations as the aggregate interface.

Any operational key or attribute configuration change might affect the aggregation states of link aggregation member ports.

Dynamic link aggregation

About LACP

Dynamic aggregation is implemented through IEEE 802.3ad Link Aggregation Control Protocol (LACP).

LACP uses LACPDUs to exchange aggregation information between LACP-enabled devices. Each member port in a dynamic aggregation group can exchange information with its peer. When a member port receives an LACPDU, it compares the received information with information received on the other member ports. In this way, the two systems reach an agreement on which ports are placed in Selected state.

LACP functions

LACP offers basic LACP functions and extended LACP functions, as described in Table 2.

Table 2 Basic and extended LACP functions

Category

Description

Basic LACP functions

Implemented through the basic LACPDU fields, including the LACP system priority, system MAC address, port priority, port number, and operational key.

Extended LACP functions

Implemented by extending the LACPDU with new TLV fields.

LACP operating modes

LACP can operate in active or passive mode.

When LACP is operating in passive mode on a local member port and its peer port, both ports cannot send LACPDUs. When LACP is operating in active mode on either end of a link, both ports can send LACPDUs.

LACP priorities

LACP priorities include LACP system priority and port priority, as described in Table 3. The smaller the priority value, the higher the priority.

Table 3 LACP priorities

Type

Description

LACP system  priority

Used by two peer devices (or systems) to determine which one is superior in link aggregation.

In dynamic link aggregation, the system that has higher LACP system priority sets the Selected state of member ports on its side. The system that has lower priority sets the aggregation state of local member ports the same as their respective peer ports.

Port priority

Determines the likelihood of a member port to be a Selected port on a system. A port with a higher port priority is more likely to become Selected.

LACP timeout interval

The LACP timeout interval specifies how long a member port waits to receive LACPDUs from the peer port. If a local member port has not received LACPDUs from the peer within the LACP timeout interval, the member port considers the peer as failed.

The LACP timeout interval also determines the LACPDU sending rate of the peer. LACP timeout intervals include the following types:

·     Short timeout interval—3 seconds. If you use the short timeout interval, the peer sends one LACPDU per second.

·     Long timeout interval—90 seconds. If you use the long timeout interval, the peer sends one LACPDU every 30 seconds.

Methods to assign interfaces to a dynamic link aggregation group

You can use one of the following methods to assign interfaces to a dynamic link aggregation group:

·     Manual assignment—Manually assign interfaces to the dynamic link aggregation group.

·     Automatic assignment—Enable automatic assignment on interfaces to have them automatically join a dynamic link aggregation group depending on the peer information in the received LACPDUs.

 

 

NOTE:

When you use automatic assignment on one end, you must use manual assignment on the other end.

You also can use automatic link aggregation for two devices to automatically create a dynamic link aggregation between them by using LLDP.

Automatic member port assignment

This feature automates the assignment of aggregation member ports to an aggregation group. You can use this feature when setting up an aggregate link to a server.

As shown in Figure 3, an interface enabled with automatic assignment joins a dynamic aggregation group based on the peer information in the LACPDUs received from the aggregation peer. If none of the existing dynamic aggregation groups is qualified, the device automatically creates a new dynamic aggregation group, Then, the device assigns the interface to that group and synchronizes the interface's attribute configurations to the aggregate interface.

A dynamic aggregation group that contains automatically assigned member ports selects a reference port and Selected ports as described in "How dynamic link aggregation works." The assignment methods of member ports do not change the processes of reference port selection and Selected port selection.

Figure 3 Automatic member port assignment process

Automatic link aggregation

Automatic link aggregation enables two devices to automatically create a dynamic link aggregation between them by using LLDP.

After you enable automatic link aggregation and LLDP on two connected devices, they automatically establish a dynamic link aggregation based on the information in incoming LLDP frames. The devices each automatically create a dynamic aggregate interface and assign the redundant ports connected to the peer to the aggregation group of that interface. When assigning the first member port to the aggregate group, the device synchronizes the member port's attribute configuration to the aggregate interface.

An automatically created dynamic aggregation group selects a reference port and Selected ports as described in "How dynamic link aggregation works." The aggregation group creation methods do not change the processes of reference port selection and Selected port selection.

 

IMPORTANT

IMPORTANT:

As a best practice to ensure correct operation of dynamic aggregation groups, do not use automatic link aggregation and automatic member port assignment together.

How dynamic link aggregation works

Choosing a reference port

The system chooses a reference port from the member ports in up state. A Selected port must have the same operational key and attribute configurations as the reference port.

The local system (the actor) and the peer system (the partner) negotiate a reference port by using the following workflow:

1.     The two systems determine the system with the smaller system ID.

A system ID contains the LACP system priority and the system MAC address.

a.     The two systems compare their LACP priority values.

The lower the LACP priority, the smaller the system ID. If the LACP priority values are the same, the two systems proceed to step b.

b.     The two systems compare their MAC addresses.

The lower the MAC address, the smaller the system ID.

2.     The system with the smaller system ID chooses the port with the smallest port ID as the reference port.

A port ID contains a port priority and a port number. The lower the port priority, the smaller the port ID.

a.     The system chooses the port with the lowest priority value as the reference port.

If the ports have the same priority, the system proceeds to step b.

b.     The system compares their port numbers.

The smaller the port number, the smaller the port ID.

The port with the smallest port number and the same attribute configurations as the aggregate interface is chosen as the reference port.

 

 

NOTE:

To identify the port numbers of aggregation member ports, execute the display link-aggregation verbose command and examine the Index field in the command output.

Setting the aggregation state of each member port

After the reference port is chosen, the system with the smaller system ID sets the state of each member port on its side.

Figure 4 Setting the state of a member port in a dynamic aggregation group

 

The system with the greater system ID can detect the aggregation state changes on the peer system. The system with the greater system ID sets the aggregation state of local member ports the same as their peer ports.

When you aggregate interfaces in dynamic mode, follow these guidelines:

·     A dynamic link aggregation group chooses only full-duplex ports as the Selected ports.

·     For stable aggregation and service continuity, do not change the operational key or attribute configurations on any member port.

·     When a member port changes to the Selected or Unselected state, its peer port changes to the same aggregation state.

·     After the Selected port limit is reached, a newly joining port becomes a Selected port if it is more eligible than a current Selected port.

Edge aggregate interface

Dynamic link aggregation fails on a server-facing aggregate interface if dynamic link aggregation is configured only on the device. The device forwards traffic by using only one of the physical ports that are connected to the server.

To improve link reliability, configure the aggregate interface as an edge aggregate interface. This feature enables all member ports of the aggregation group to forward traffic. When a member port fails, its traffic is automatically switched to other member ports.

After dynamic link aggregation is configured on the server, the device can receive LACPDUs from the server. Then, link aggregation between the device and the server operates correctly.

An edge aggregate interface takes effect only when it is configured on an aggregate interface corresponding to a dynamic aggregation group.

Load sharing modes for link aggregation groups

In a link aggregation group, traffic can be load shared across the Selected ports based on any of the following modes:

·     Per-flow load sharing—Distributes traffic on a per-flow basis. The load sharing mode classifies packets into flows and forwards packets of the same flow on the same link. This mode can be one of or a combination of the following hashing keys:

¡     Ingress port.

¡     Source or destination IP.

¡     Source or destination MAC.

¡     Source or destination port number.

¡     Protocol number.

·     Packet type-based load sharing—Automatically selects a load sharing mode depending on the packet type. For example, the load sharing mode differs between IPv4 packets and Layer 2 packets. This mode is also called the flexible mode.

S-MLAG

Simple multichassis link aggregation (S-MLAG) enhances dynamic link aggregation to establish an aggregation that spans multiple standalone devices to a remote device.

An S-MLAG multichassis aggregation connects one dynamic Layer 2 aggregate interface on each S-MLAG device to the remote device, as shown in Figure 5.

S-MLAG uses an S-MLAG group to manage the aggregate interfaces for each aggregation, and it runs LACP to maintain each aggregation as does dynamic link aggregation. To the remote device, the S-MLAG devices appear as one peer aggregation system.

Figure 5 S-MLAG application scenario

Restrictions and guidelines: Mixed use of manual and automatic link aggregation configuration

To avoid unexpected aggregation issues, do not use manual assignment, automatic assignment, and automatic link aggregation in any combination. If you use any two of these features in combination, an automatically assigned member port might move between aggregation groups or undesirably change from Selected to Unselected in some situations.

Ethernet link aggregation tasks at a glance

To configure Ethernet link aggregation, perform the following tasks:

1.     Configuring the system ID

2.     Configuring link aggregations

¡     Configuring a manual link aggregation

¡     Configuring a 1+1 backup aggregation group

¡     Configuring automatic link aggregation

¡     Configuring S-MLAG

3.     (Optional.) Configuring an aggregate interface

¡     Configuring the basic parameters of an aggregate interface

¡     Configuring jumbo frame support

¡     Setting the MTU of an aggregate interface

¡     Configuring an edge aggregate interface

An edge aggregate interface uses all member ports to forward traffic when the aggregation peer is not enabled with dynamic link aggregation.

¡     Restoring the default settings for an aggregate interface

4.     (Optional.) Adjusting aggregation states of link aggregation member ports

¡     Setting the minimum and maximum numbers of Selected ports for an aggregation group

¡     Setting the minimum percentage of Selected ports in an aggregation group

¡     Configuring the link aggregation capability of the device

To modify the maximum number of aggregation groups and the maximum number of Selected ports per aggregation group, perform this task.

¡     Disabling the default action of selecting a Selected port for dynamic aggregation groups that have not received LACPDUs

¡     Configuring a dynamic aggregation group to use port speed as the prioritized criterion for reference port selection

¡     Ignoring port speed in setting the aggregation states of member ports

5.     (Optional.) Configuring load sharing for link aggregation groups

¡     Setting static load sharing modes for link aggregation groups

6.     (Optional.) Optimizing traffic forwarding

¡     Isolating aggregate interfaces on the device

7.     (Optional.) Enabling BFD for an aggregation group

Configuring the system ID

About this task

The two ends of a dynamic aggregate link choose a reference port from the end with a smaller system ID.

The system ID contains the LACP system priority and LACP system MAC address. Two devices use the following rules to compare their system IDs:

·     If their system IDs contain different LACP system priorities, the system ID with a smaller LACP system priority value is smaller.

·     If their system IDs contain the same LACP system priority, the system ID with a lower LACP system MAC address is smaller.

To view the LACP system MAC address and LACP system priority, execute the display link-aggregation verbose command.

You can configure the system ID globally and in aggregate interface view. The global system ID takes effect on all aggregation groups, and an aggregate-interface-specific system ID takes precedence over the global system ID.

Restrictions and guidelines

Member devices in an S-MLAG system must use the same LACP system priority and LACP system MAC address.

For member ports to be selected correctly, do not modify the LACP system priority and LACP system MAC address after a dynamic link aggregation is established.

Procedure

1.     Enter system view.

system-view

2.     Set the LACP system MAC address globally.

lacp system-mac mac-address

By default, the LACP system MAC address is the bridge MAC address of the device.

3.     Set the LACP system priority globally.

lacp system-priority priority

By default, the LACP system priority is 32768.

4.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

5.     Set the LACP system MAC address on the aggregate interface.

port lacp system-mac mac-address

By default, the LACP system MAC address is the bridge MAC address of the device.

6.     Set the LACP system priority on the aggregate interface.

port lacp system-priority priority

By default, the LACP system priority is 32768.

Configuring a manual link aggregation

Restrictions and guidelines for aggregation group configuration

Layer 2 aggregation group restrictions

You cannot assign an interface to a Layer 2 aggregation group if that interface has been forcibly brought up by using the port up-mode command. For more information about forcibly bringing up a fiber port, see Ethernet interface configuration in Interface Configuration Guide.

Aggregation member port restrictions

Deleting an aggregate interface also deletes its aggregation group and causes all member ports to leave the aggregation group.

An interface cannot join an aggregation group if it has different attribute configurations from the aggregate interface. After joining an aggregation group, an interface inherits the attribute configurations on the aggregate interface. You can modify the attribute configurations only on the aggregate interface.

Do not assign a reflector port for port mirroring to an aggregation group. For more information about reflector ports, see Network Management and Monitoring Configuration Guide.

You cannot assign monitor ports for port mirroring to an aggregation group.

Attribute and protocol configuration restrictions

For a link aggregation, attribute configurations are configurable only on the aggregate interface and are automatically synchronized to all member ports. You cannot configure attribute configurations on a member port until it is removed from the link aggregation group. The configurations that have been synchronized from the aggregate interface are retained on the member ports even after the aggregate interface is deleted.

If an attribute setting on the aggregate interface fails to be synchronized to a Selected member port, the port might change to the Unselected state.

The protocol configurations for an aggregate interface take effect only on the current aggregate interface. The protocol configurations for a member port take effect only when the port leaves its aggregation group.

Configuration consistency requirements

You must configure the same aggregation mode at the two ends of an aggregate link.

·     For a successful static aggregation, make sure the ports at both ends of each link are in the same aggregation state.

·     For a successful dynamic aggregation:

¡     Make sure the ports at both ends of a link are assigned to the correct aggregation group. The two ends can automatically negotiate the aggregation state of each member port.

¡     If you use automatic interface assignment on one end, you must use manual assignment on the other end.

Configuring a Layer 2 aggregation group

Configuring a Layer 2 static aggregation group

1.     Enter system view.

system-view

2.     Create a Layer 2 aggregate interface and enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

When you create a Layer 2 aggregate interface, the system automatically creates a Layer 2 static aggregation group numbered the same as that interface.

3.     Configure the aggregation group to operate in static mode.

link-aggregation mode static

By default, an aggregation group operates in static mode.

4.     Return to system view.

quit

5.     Assign an interface to the Layer 2 aggregation group:

a.     Enter Layer 2 Ethernet interface view.

interface interface-type interface-number

b.     Assign the interface to the Layer 2 aggregation group.

port link-aggregation group group-id [ force ]

Repeat the substeps to assign more interfaces to the aggregation group.

To synchronize the attribute configurations from the aggregate interface when the current interface joins the aggregation group, specify the force keyword.

6.     (Optional.) Set the port priority of the interface.

link-aggregation port-priority priority

The default port priority of an interface is 32768.

Configuring a Layer 2 dynamic aggregation group

1.     Enter system view.

system-view

2.     Create a Layer 2 aggregate interface and enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

When you create a Layer 2 aggregate interface, the system automatically creates a Layer 2 static aggregation group numbered the same as that interface.

3.     Configure the aggregation group to operate in dynamic mode.

link-aggregation mode dynamic

By default, an aggregation group operates in static mode.

4.     Return to system view.

quit

5.     Assign an interface to the Layer 2 aggregation group:

a.     Enter Layer 2 Ethernet interface view.

interface interface-type interface-number

b.     Assign the interface to the Layer 2 aggregation group or enable automatic assignment on that interface.

port link-aggregation group { group-id [ force ] | auto [ group-id ] }

Repeat these two substeps to assign more Layer 2 Ethernet interfaces to the aggregation group.

To synchronize the attribute configurations from the aggregate interface when the current interface joins the aggregation group, specify the force keyword.

To enable automatic assignment, specify the auto keyword. As a best practice, do not modify the configuration on an automatically created aggregate interface or its member ports.

6.     Set the LACP operating mode for the interface.

¡     Set the LACP operating mode to passive.

lacp mode passive

¡     Set the LACP operating mode to active.

undo lacp mode

By default, LACP is operating in active mode.

7.     (Optional.) Set the port priority for the interface.

link-aggregation port-priority priority

The default setting is 32768.

8.     (Optional.) Set the short LACP timeout interval (3 seconds) for the interface.

lacp period short

By default, the long LACP timeout interval (90 seconds) is used by the interface.

Configuring a Layer 3 aggregation group

Configuring a Layer 3 static aggregation group

1.     Enter system view.

system-view

2.     Create a Layer 3 aggregate interface and enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

When you create a Layer 3 aggregate interface, the system automatically creates a Layer 3 static aggregation group numbered the same as that interface.

3.     Configure the aggregation group to operate in static mode.

link-aggregation mode static

By default, an aggregation group operates in static mode.

4.     Return to system view.

quit

5.     Assign an interface to the Layer 3 aggregation group:

a.     Enter Layer 3 Ethernet interface view.

interface interface-type interface-number

b.     Assign the interface to the Layer 3 aggregation group.

port link-aggregation group group-id

Repeat the substeps to assign more interfaces to the aggregation group.

6.     (Optional.) Set the port priority of the interface.

link-aggregation port-priority priority

The default port priority of an interface is 32768.

Configuring a Layer 3 dynamic aggregation group

1.     Enter system view.

system-view

2.     Create a Layer 3 aggregate interface and enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

When you create a Layer 3 aggregate interface, the system automatically creates a Layer 3 static aggregation group numbered the same as that interface.

3.     Configure the aggregation group to operate in dynamic mode.

link-aggregation mode dynamic

By default, an aggregation group operates in static mode.

4.     Return to system view.

quit

5.     Assign an interface to the Layer 3 aggregation group:

a.     Enter Layer 3 Ethernet interface view.

interface interface-type interface-number

b.     Assign the interface to the Layer 3 aggregation group or enable automatic assignment on that interface.

port link-aggregation group { group-id | auto [ group-id ] }

Repeat these two substeps to assign more Layer 3 Ethernet interfaces to the aggregation group.

To enable automatic assignment, specify the auto keyword. As a best practice, do not modify the configuration on an automatically created aggregate interface or its member ports.

6.     Set the LACP operating mode for the interface.

¡     Set the LACP operating mode to passive.

lacp mode passive

¡     Set the LACP operating mode to active.

undo lacp mode

By default, LACP is operating in active mode.

7.     (Optional.) Set the port priority of the interface.

link-aggregation port-priority priority

The default setting is 32768.

8.     (Optional.) Set the short LACP timeout interval (3 seconds) for the interface.

lacp period short

By default, the long LACP timeout interval (90 seconds) is used by the interface.

Configuring a 1+1 backup aggregation group

About 1+1 backup link aggregation

As shown in Figure 6, a 1+1 backup aggregation group is used on a CE that is dualhomed to PEs for high availability of services. A 1+1 backup aggregation group is a static Layer 3 aggregation group that contains one primary member port and one secondary member port. The primary member port is placed in Selected state to forward all traffic, and the secondary member port is placed in Unselected state as a standby.

Figure 6 Application scenarios for 1+1 backup link aggregation

 

1+1 backup link aggregation tasks at a glance

To configure a 1+1 backup aggregation group, perform the following tasks:

1.     Configuring a static 1+1 backup aggregation group

2.     (Optional.) Specifying a primary member port

3.     (Optional.) Setting the reversion delay

4.     (Optional.) Configuring a 1+1 backup aggregation group to place its secondary member port in down state

5.     (Optional.) Performing a primary/secondary member port switchover

Configuring a static 1+1 backup aggregation group

Restrictions and guidelines

A 1+1 backup aggregation group can contain a maximum of two member ports.

Procedure

1.     Enter system view.

system-view

2.     Create a Layer 3 aggregate interface and enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Set the aggregation mode to static 1+1 backup.

link-aggregation mode static backup

4.     Return to system view.

quit

5.     Assign an interface to the Layer 3 aggregation group:

a.     Enter Layer 3 Ethernet interface view.

interface interface-type interface-number

b.     Assign the interface to the Layer 3 aggregation group.

port link-aggregation group group-id

Repeat these two substeps to assign more interfaces to the aggregation group.

6.     (Optional.) Set the port priority of the interface.

link-aggregation port-priority priority

The default port priority of an interface is 32768.

Specifying a primary member port

About this task

In a 1+1 backup aggregation group, the primary member port is placed in Selected state to forward all traffic, and the secondary member port is placed in Unselected state as a standby. You can specify a primary member port or let the system to select a primary member port. If you specify a primary member port for a 1+1 backup aggregation group, the aggregation group can revert to the primary member port when that port recovers from failure. As a best practice, manually specify a primary member port.

If you do not specify a primary member port for an aggregation group, the system acts as follows:

·     Assigns the primary role to the reference port If the member ports join the aggregation group simultaneously.

·     Assigns the primary role to the member port that first becomes Selected if the member ports join the aggregation group successively.

Restrictions and guidelines

You cannot perform this task on a port that is not an aggregation group member or is in an aggregation group not operating in 1+1 backup mode.

A 1+1 backup aggregation group can have only one primary member port.

Procedure

1.     Enter system view.

system-view

2.     Enter Layer 3 Ethernet interface view.

interface interface-type interface-number

3.     Assign the primary role to the interface.

link-aggregation primary-port

By default, a member port is not assigned the primary role in a 1+1 backup aggregation group.

Setting the reversion delay

About this task

The reversion delay is the time a 1+1 backup aggregation group must wait before reverting to the primary member port after that port recovers from failure. This timer prevents link flapping from causing frequent primary/secondary member port switchovers.

Restrictions and guidelines

For the reversion delay to take effect on an aggregation group, first configure the aggregation group to operate in 1+1 backup mode and manually specify its primary member port.

Procedure

1.     Enter system view.

system-view

2.     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Set the reversion delay.

link-aggregation reversion delay time-value

By default, a 1+1 backup aggregation group reverts to the primary member port immediately after that port recovers from failure.

Configuring a 1+1 backup aggregation group to place its secondary member port in down state

About this task

If the peer for a 1+1 backup aggregation group is unaware of the member port roles, it might send traffic to the secondary member port, and traffic loss occurs consequently. To prevent traffic loss, configure the aggregation group to place its secondary member port in down state. This allows the peer and local ends to use only up ports to transmit traffic.

Restrictions and guidelines

For this feature to take effect on an aggregation group, first configure the aggregation group to operate in 1+1 backup mode.

Procedure

1.     Enter system view.

system-view

2.     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Configure the aggregation group to place its secondary member port in down state.

link-aggregation secondary-down

By default, the secondary member port in a 1+1 backup aggregation group is in Unselected state.

Performing a primary/secondary member port switchover

About this task

Perform this task to switch member port roles for a 1+1 backup aggregation group whose primary member port is set by the system when the state of peer ports changes.

Restrictions and guidelines

This task might cause traffic loss. Make sure you are fully aware of the impacts of this task when you perform it on a live network.

If the link-aggregation secondary-down command has been executed for a 1+1 backup aggregation group, this task brings up the down secondary member port for it to take over the primary role.

Before you perform this task for a 1+1 backup aggregation group, verify that the following requirements are met:

·     The aggregation group contains one Selected port and one Unselected port.

·     The primary member port is set by the system.

·     The secondary member port can become Selected.

Procedure

1.     Enter system view.

system-view

2.     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Perform a primary/secondary member port switchover.

link-aggregation switchover

Configuring automatic link aggregation

About this task

You can use automatic link aggregation to aggregate the redundant physical links between devices to ease management and increase bandwidth and availability.

Restrictions and guidelines

On an interface, the port link-aggregation group setting takes precedence over automatic link aggregation. The interface will not be added to the aggregation group of an automatically created aggregate interface if it has been the member port of a manually created aggregate interface.

To ensure correct operation of an automatically created aggregate interface ,do not modify the configuration on the member ports of its aggregation group. Doing so might cause the member ports to be removed from the aggregation group.

As a best practice to ensure correct operation of dynamic aggregation groups, do not use automatic link aggregation and automatic member port assignment together.

Prerequisites

Before you configure automatic link aggregation, enable LLDP on the peer devices.

Procedure

1.     Enter system view.

system-view

2.     Enable automatic link aggregation.

link-aggregation auto-aggregation enable

By default, automatic link aggregation is disabled.

Configuring S-MLAG

Restrictions and guidelines

Use S-MLAG only to establish aggregate links with servers.

Each S-MLAG group can contain only one aggregate interface on each device.

On S-MLAG devices, make sure the member ports in an aggregation group have the same speed and duplex mode. Inconsistency in these settings might cause reference port reselection and interrupt traffic forwarding when new member ports join the aggregation group.

Do not configure the following settings on S-MLAG devices:

·     Maximum or minimum number of Selected ports.

·     Automatic member port assignment.

·     Ignoring port speed in setting the aggregation states of member ports.

·     Spanning tree. For more information about spanning tree, see "Configuring spanning tree protocols."

As a best practice, maintain consistency across S-MLAG devices in service feature configuration.

Prerequisites

Configure the link aggregation settings other than S-MLAG settings on each S-MLAG device. Make sure the settings are consistent across the S-MLAG devices.

Procedure

1.     Enter system view.

system-view

2.     Set the LACP system MAC address.

lacp system-mac mac-address

By default, the LACP system MAC address is the bridge MAC address of the device.

All S-MLAG devices must use the same LACP system MAC address.

3.     Set the LACP system priority.

lacp system-priority priority

By default, the LACP system priority is 32768.

All S-MLAG devices must use the same LACP system priority.

4.     Set the LACP system number.

lacp system-number number

By default, the LACP system number is not set.

You must assign a unique LACP system number to each S-MLAG device.

5.     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

6.     Set the link aggregation mode to dynamic.

link-aggregation mode dynamic

By default, an aggregation group operates in static mode.

7.     Assign the aggregate interface to an S-MLAG group.

port s-mlag group group-id

By default, an aggregate interface is not assigned to any S-MLAG group.

Configuring an aggregate interface

Most settings that can be made on Layer 2 or Layer 3 Ethernet interfaces can also be made on Layer 2 or Layer 3 aggregate interfaces.

Configuring the basic parameters of an aggregate interface

About this task

Shutting down or bringing up an aggregate interface changes the aggregation states of the member ports in the aggregation group of the aggregate interface.

·     When you shut down the aggregate interface, all Selected ports become Unselected, and all aggregation member ports become down.

·     When you bring up the aggregate interface, the system recalculates the aggregation states of all aggregation member ports.

For more information about the description, bandwidth, and shutdown commands, see common interface commands in Interface Command Reference.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Configure the interface description.

description text

By default, the description of an interface is interface-name Interface.

You can configure the description of an aggregate interface for administration purposes, for example, describing the purpose of the interface.

4.     Set the expected bandwidth for the interface.

bandwidth bandwidth-value

By default, the expected bandwidth (in kbps) is not configured.

The expected bandwidth is an informational parameter used only by higher-layer protocols for calculation. You cannot adjust the actual bandwidth of an interface by using this command.

5.     Shut down the interface.

shutdown

 

CAUTION

CAUTION:

The shutdown command will disconnect all links established on an interface. Make sure you are fully aware of the impacts of this command when you use it on a live network.

 

Configuring jumbo frame support

About this task

An aggregate interface might receive frames larger than 1536 bytes during high-throughput data exchanges, such as file transfers. These frames are called jumbo frames.

How an aggregate interface processes jumbo frames depends on whether jumbo frame support is enabled on the interface.

·     If configured to deny jumbo frames, the aggregate interface discards jumbo frames.

·     If enabled with jumbo frame support, the aggregate interface performs the following operations:

¡     Processes jumbo frames that are within the allowed length.

¡     Discards jumbo frames that exceed the allowed length.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Allow jumbo frames.

jumboframe enable [ size ]

By default, an aggregate interface allows jumbo frames with a maximum length of 10304 bytes to pass through.

If you execute this command multiple times, the most recent configuration takes effect.

Setting the MTU of an aggregate interface

About this task

The MTU of an interface affects IP packets fragmentation and reassembly on the interface.

Procedure

1.     Enter system view.

system-view

2.     Enter interface view.

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Set the MTU.

mtu size

The default setting is 1500 bytes.

Configuring an edge aggregate interface

Restrictions and guidelines

This configuration takes effect only on aggregate interfaces in dynamic mode.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Configure the aggregate interface as an edge aggregate interface.

lacp edge-port

By default, an aggregate interface does not operate as an edge aggregate interface.

Restoring the default settings for an aggregate interface

Restrictions and guidelines

CAUTION

CAUTION:

The default command might interrupt ongoing network services. Make sure you are fully aware of the impacts of this command when you execute it on a live network.

The default command might fail to restore the default settings for some commands for reasons such as command dependencies and system restrictions.

To resolve this issue:

1.     Use the display this command in interface view to identify these commands.

2.     Use their undo forms or follow the command reference to restore their default settings.

3.     If the restoration attempt still fails, follow the error message instructions to resolve the issue.

For more information about the default command, see common interface commands in Interface Command Reference.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Restore the default settings for the aggregate interface.

default

Setting the minimum and maximum numbers of Selected ports for an aggregation group

About this task

The bandwidth of an aggregate link increases as the number of Selected member ports increases. To avoid congestion, you can set the minimum number of Selected ports required for bringing up an aggregate interface.

This minimum threshold setting affects the aggregation states of aggregation member ports and the state of the aggregate interface.

·     When the number of member ports eligible to be Selected ports is smaller than the minimum threshold, the following events occur:

¡     The eligible member ports are placed in Unselected state.

¡     The link layer state of the aggregate interface becomes down.

·     When the number of member ports eligible to be Selected ports reaches or exceeds the minimum threshold, the following events occur:

¡     The eligible member ports are placed in Selected state.

¡     The link layer state of the aggregate interface becomes up.

The maximum number of Selected ports allowed in an aggregation group is limited by either manual configuration or hardware limitation, whichever value is smaller.

You can implement backup between two ports by performing the following tasks:

·     Assigning two ports to an aggregation group.

·     Setting the maximum number of Selected ports to 1 for the aggregation group.

Then, only one Selected port is allowed in the aggregation group, and the Unselected port acts as a backup port.

Restrictions and guidelines

For an aggregation group, the maximum number of Selected ports must be equal to or higher than the minimum number of Selected ports.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Set the minimum number of Selected ports for the aggregation group.

link-aggregation selected-port minimum min-number

By default, the minimum number of Selected ports is not specified for an aggregation group.

4.     Set the maximum number of Selected ports for the aggregation group.

link-aggregation selected-port maximum max-number [ lacp-sync ]

By default, the maximum number of Selected ports for an aggregation group is 8.

For a static aggregate link, you must set the maximum number of Selected ports to the same value at its two ends.

For a dynamic aggregate link, you must set the maximum number of Selected ports to the same value at its two ends if you do not specify the lacp-sync keyword. If you specify this keyword, the two ends of the aggregate link compare their maximum Selected port number settings and use the smaller value.

Setting the minimum percentage of Selected ports in an aggregation group

About this task

The minimum number of Selected ports in an aggregation group equals the higher one of the following values:

·     The number of member ports in the aggregation group multiplied by the minimum percentage of Selected ports.

·     The limit set by using the link-aggregation selected-port minimum command.

Restrictions and guidelines

After you perform this task, aggregate interface flapping might occur when ports join or leave an aggregation group. Make sure you are fully aware of the impacts of this command when you execute it on a live network.

If you set the minimum percentage of Selected ports for the aggregation group, do not set the maximum number of Selected ports. If you set the maximum number of Selected ports, the calculated minimum number of Selected ports might be larger than the maximum number of Selected ports.

You must set the same minimum percentage of Selected ports at the two ends of an aggregate link.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface.

interface route-aggregation { interface-number }

3.     Set the minimum percentage of Selected ports.

link-aggregation selected-port minimum percentage number

By default, the minimum percentage of Selected ports is not set for an aggregation group.

Configuring the link aggregation capability of the device

About this task

Perform this task to modify the maximum number of aggregation groups and the maximum number of Selected ports per aggregation group.

Restrictions and guidelines

After you configure the link aggregation capability of the device, save the configuration and reboot the device for the configuration to take effect. Before rebooting the device, make sure you know the possible impact on the network.

For link aggregation to operate correctly, set the same link aggregation capability at both ends of an aggregate link.

The maximum number of Selected ports in an aggregation group is limited by one of the following values, whichever value is smaller:

·     Maximum number set by using the link-aggregation selected-port maximum command.

·     Maximum number of Selected ports allowed by the link aggregation capability.

Procedure

1.     Enter system view.

system-view

2.     Configure the link aggregation capability of the device.

link-aggregation capability max-group max-group-number max-selected-port max-selected-port-number

By default, the device can have a maximum of 128 aggregation groups, and each aggregation group can have a maximum of 8 Selected ports.

Disabling the default action of selecting a Selected port for dynamic aggregation groups that have not received LACPDUs

About this task

The default port selection action applies to dynamic aggregation groups.

This action automatically chooses the port with the lowest ID from among all up member ports as a Selected port if none of them has received LACPDUs before the LACP timeout interval expires.

After this action is disabled, a dynamic aggregation group will not have any Selected ports to forward traffic if it has not received LACPDUs before the LACP timeout interval expires.

Procedure

1.     Enter system view.

system-view

2.     Disable the default port selection action.

lacp default-selected-port disable

By default, the default port selection action is enabled for dynamic aggregation groups.

Configuring a dynamic aggregation group to use port speed as the prioritized criterion for reference port selection

About this task

Perform this task to ensure that a dynamic aggregation group selects a high-speed member port as the reference port. After you perform this task, the reference port will be selected based on the criteria in order of device ID, port speed, and port ID.

Restrictions and guidelines

Changing reference port selection criteria might cause transient traffic interruption. Make sure you understand the impact of this task on your network.

You must perform this task at both ends of the aggregate link so the peer aggregation systems use the same criteria for reference port selection.

As a best practice, shut down the peer aggregate interfaces before you execute this command and bring up the interfaces after this command is executed on both of them.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Specify port speed as the prioritized criterion for reference port selection.

lacp select speed

By default, port ID is the prioritized criterion for reference port selection of a dynamic aggregation group.

Ignoring port speed in setting the aggregation states of member ports

About this task

This feature allows ports at a different speed than the reference port to become Selected by ignoring the port speed during operational key calculation.

You must configure the same port speed ignoring setting at the two ends of a static configuration to ensure that the peer ports are placed in the same aggregation state. This requirement does not apply to a dynamic aggregation, on which the two ends negotiate the aggregation state of the peer ports automatically.

Restrictions and guidelines

Make sure you are fully aware of the impacts of this feature when you use it on a live network.

·     This feature might cause traffic loss on Selected ports operating at a speed lower than the other Selected ports in the aggregation group when traffic is distributed among the ports.

·     When you enable or disable this feature on an aggregate interface, the operational key changes and the aggregate interface flaps temporarily.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     Configure the aggregation group to ignore port speed in setting the aggregation states of member ports.

link-aggregation ignore speed

By default, an aggregation group does not ignore port speed in setting the aggregation states of member ports.

Configuring load sharing for link aggregation groups

Setting static load sharing modes for link aggregation groups

About this task

You can set the global load sharing mode only.

Restrictions and guidelines

When you configure gloal load sharing modes on the device, follow these restrictions and guidelines:

·     The device does not support distributing traffic based on IP protocol types.

·     If you distribute traffic based on ingress ports, any combination of ingress ports together with other hashing keys is not supported.

·     Any combination of the hashing keys except IP protocol types and ingress ports is supported.

Setting the global link-aggregation load sharing mode

1.     Enter system view.

system-view

2.     Set the global link-aggregation load sharing mode.

link-aggregation global load-sharing mode { destination-ip | destination-mac | destination-port | ingress-port | source-ip | source-mac | source-port } *

By default, the device distributes traffic based on the source and destination MAC addresses, source and destination IP addresses, and source and destination port numbers on aggregate links.

Isolating aggregate interfaces on the device

About this task

Aggregate interface isolation gracefully changes member ports of all dynamic aggregate interfaces to Unselected state. The member ports of the counterpart aggregation groups will also be placed in Unselected state.

Restrictions and guidelines

This feature takes effect only on dynamic aggregate interfaces.It cannot isolate static aggregate interfaces.

Procedure

1.     Enter system view.

system-view

2.     Isolate aggregate interfaces.

link-aggregation lacp isolate

By default, aggregate interfaces are not isolated.

To remove DR interface isolation, execute the undo form of this command.

Enabling BFD for an aggregation group

About this task

You can use BFD to monitor member link status in an aggregation group. After you enable BFD on an aggregate interface, each Selected port in the aggregation group establishes a BFD session with its peer port. BFD operates differently depending on the aggregation mode.

·     BFD on a static aggregation—When BFD detects a link failure, BFD notifies the Ethernet link aggregation module that the peer port is unreachable. The local port is then placed in Unselected state. However, the BFD session between the local and peer ports remains, and the local port keeps sending BFD packets. When BFD on the local port receives packets from the peer port upon link recovery, BFD notifies the Ethernet link aggregation module that the peer port is reachable. Then, the local port is placed in Selected state again. This mechanism ensures that the local and peer ports of a static aggregate link have the same aggregation state.

·     BFD on a dynamic aggregation—When BFD detects a link failure, BFD notifies the Ethernet link aggregation module that the peer port is unreachable. At the same time, BFD clears the session and stops sending BFD packets. When the local port is placed in Selected state again upon link recovery, the local port establishes a new session with the peer port and BFD notifies the Ethernet link aggregation module that the peer port is reachable. Because BFD provides fast failure detection, the local and peer systems of a dynamic aggregate link can negotiate the aggregation state of their member ports faster.

For more information about BFD, see High Availability Configuration Guide.

For BFD to operate correctly on an aggregate link whose remote end is a third-party device that implements BFD differently from the device, enable If BFD compatible mode. With BFD compatible mode enabled, all member ports in an aggregation group establish BFD sessions with their peer ports. The BFD sessions are not deleted or re-established when the aggregation states of the member ports change.

Restrictions and guidelines

When you enable BFD for an aggregation group, follow these restrictions and guidelines:

·     Make sure the source and destination IP addresses are reversed between the two ends of an aggregate link. For example, if you execute link-aggregation bfd ipv4 source 1.1.1.1 destination 2.2.2.2 at the local end, execute link-aggregation bfd ipv4 source 2.2.2.2 destination 1.1.1.1 at the peer end. The source and destination IP addresses cannot be the same.

·     The BFD parameters configured on an aggregate interface take effect on all BFD sessions established by the member ports in its aggregation group. BFD on a link aggregation supports only control packet mode for session establishment and maintenance. The two ends of an established BFD session can only operate in Asynchronous mode.

·     As a best practice, do not configure BFD for any protocols on a BFD-enabled aggregate interface.

·     Make sure the number of member ports in a BFD-enabled aggregation group is less than or identical to the number of BFD sessions supported by the device. If the aggregation group contains more member ports than the supported sessions, some Selected ports might change to the Unselected state.

·     If the number of BFD sessions differs between the two ends of an aggregate link, check their settings for inconsistency in the maximum number of Selected ports. You must make sure the two ends have the same setting for the maximum number of Selected ports.

Procedure

1.     Enter system view.

system-view

2.     Enter aggregate interface view.

¡     Enter Layer 2 aggregate interface view.

interface bridge-aggregation interface-number

¡     Enter Layer 3 aggregate interface view.

interface route-aggregation interface-number

3.     (Optional.) Enable BFD compatible mode.

link-aggregation bfd-compatible enable

By default, BFD compatible mode is disabled on aggregate interfaces. Perform this step if the remote aggregation system is a third-party device that implements BFD differently from the local end.

4.     Enable BFD for the aggregation group.

link-aggregation bfd  ipv4 source ipv4-address destination ipv4-address

By default, BFD is disabled for an aggregation group.

Verifying and maintaining Ethernet link aggregation

Displaying the link aggregation capability of the device

To display the link aggregation capability of the device, execute the following command in any view:

display link-aggregation capability

Verifying aggregate interface and aggregation member port running status

Perform all display tasks in any view.

·     Display information about aggregate interfaces.

display interface [ { bridge-aggregation | route-aggregation } [ interface-number ] ] [ brief [ description | down ] ]

·     Display summary information about all aggregation groups.

display link-aggregation summary

·     Display detailed information about aggregation groups.

display link-aggregation verbose [ { bridge-aggregation | route-aggregation } [ interface-number ] ] [ all-configuration ]

·     Display detailed link aggregation information about link aggregation member ports.

display link-aggregation member-port [ interface-list | auto ]

·     Display the aggregation states of aggregation member ports and the reason why a port was placed in Unselected state.

display link-aggregation troubleshooting [ { bridge-aggregation | route-aggregation } [ interface-number ] ]

Displaying the local system ID

To display the local system ID, execute the following command in any view:

display lacp system-id

Displaying link-aggregation load sharing information

Perform all display tasks in any view.

·     Display the global or group-specific link-aggregation load sharing modes.

display link-aggregation load-sharing mode [ interface [ { bridge-aggregation | route-aggregation } interface-number ] ]

Displaying and clearing interface statistics

For more information about the following commands, see common interface commands in Interface Command Reference.

Displaying aggregate interface statistics

Perform all display tasks in any view.

·     Display interface traffic statistics.

display counters { inbound | outbound } interface [ { bridge-aggregation | route-aggregation } [ interface-number ] ]

·     Display traffic rate statistics for interfaces in up state for the most recent statistics polling interval.

display counters rate { inbound | outbound } interface [ { bridge-aggregation | route-aggregation } [ interface-number ] ]

Clearing aggregate interface statistics

To clear statistics for aggregate interfaces, execute the following command in user view:

reset counters interface [ { bridge-aggregation | route-aggregation } [ interface-number ] ]

Clearing LACP statistics for link aggregation member ports

To clear LACP statistics for link aggregation member ports, execute the following command in user view:

reset lacp statistics [ interface interface-list ]

Ethernet link aggregation configuration examples

Example: Configuring a Layer 2 static aggregation group

Network configuration

On the network shown in Figure 7, perform the following tasks:

·     Configure a Layer 2 static aggregation group on both Device A and Device B.

·     Enable VLAN 10 at one end of the aggregate link to communicate with VLAN 10 at the other end.

·     Enable VLAN 20 at one end of the aggregate link to communicate with VLAN 20 at the other end.

Figure 7 Network diagram

Procedure

1.     Configure Device A:

# Create VLAN 10, and assign port Twenty-FiveGigE 1/0/4 to VLAN 10.

<DeviceA> system-view

[DeviceA] vlan 10

[DeviceA-vlan10] port twenty-fivegige 1/0/4

[DeviceA-vlan10] quit

# Create VLAN 20, and assign port Twenty-FiveGigE 1/0/5 to VLAN 20.

[DeviceA] vlan 20

[DeviceA-vlan20] port twenty-fivegige 1/0/5

[DeviceA-vlan20] quit

# Create Layer 2 aggregate interface Bridge-Aggregation 1.

[DeviceA] interface bridge-aggregation 1

[DeviceA-Bridge-Aggregation1] quit

# Assign ports Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 to link aggregation group 1.

[DeviceA] interface twenty-fivegige 1/0/1

[DeviceA-Twenty-FiveGigE1/0/1] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/1] quit

[DeviceA] interface twenty-fivegige 1/0/2

[DeviceA-Twenty-FiveGigE1/0/2] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/2] quit

[DeviceA] interface twenty-fivegige 1/0/3

[DeviceA-Twenty-FiveGigE1/0/3] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/3] quit

# Configure Layer 2 aggregate interface Bridge-Aggregation 1 as a trunk port and assign it to VLANs 10 and 20.

[DeviceA] interface bridge-aggregation 1

[DeviceA-Bridge-Aggregation1] port link-type trunk

[DeviceA-Bridge-Aggregation1] port trunk permit vlan 10 20

[DeviceA-Bridge-Aggregation1] quit

2.     Configure Device B in the same way Device A is configured. (Details not shown.)

Verifying the configuration

# Display detailed information about all aggregation groups on Device A.

[DeviceA] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Bridge-Aggregation1

Aggregation Mode: Static

Loadsharing Type: Shar

Management VLANs: None

  Port             Status  Priority Oper-Key

  WGE1/0/1(R)      S       32768    1

  WGE1/0/2         S       32768    1

  WGE1/0/3         S       32768    1

The output shows that link aggregation group 1 is a Layer 2 static aggregation group that contains three Selected ports.

Example: Configuring a Layer 2 dynamic aggregation group

Network configuration

On the network shown in Figure 8, perform the following tasks:

·     Configure a Layer 2 dynamic aggregation group on both Device A and Device B.

·     Enable VLAN 10 at one end of the aggregate link to communicate with VLAN 10 at the other end.

·     Enable VLAN 20 at one end of the aggregate link to communicate with VLAN 20 at the other end.

Figure 8 Network diagram

Procedure

1.     Configure Device A:

# Create VLAN 10, and assign the port Twenty-FiveGigE 1/0/4 to VLAN 10.

<DeviceA> system-view

[DeviceA] vlan 10

[DeviceA-vlan10] port twenty-fivegige 1/0/4

[DeviceA-vlan10] quit

# Create VLAN 20, and assign the port Twenty-FiveGigE 1/0/5 to VLAN 20.

[DeviceA] vlan 20

[DeviceA-vlan20] port twenty-fivegige 1/0/5

[DeviceA-vlan20] quit

# Create Layer 2 aggregate interface Bridge-Aggregation 1, and set the link aggregation mode to dynamic.

[DeviceA] interface bridge-aggregation 1

[DeviceA-Bridge-Aggregation1] link-aggregation mode dynamic

[DeviceA-Bridge-Aggregation1] quit

# Assign ports Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 to link aggregation group 1.

[DeviceA] interface twenty-fivegige 1/0/1

[DeviceA-Twenty-FiveGigE1/0/1] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/1] quit

[DeviceA] interface twenty-fivegige 1/0/2

[DeviceA-Twenty-FiveGigE1/0/2] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/2] quit

[DeviceA] interface twenty-fivegige 1/0/3

[DeviceA-Twenty-FiveGigE1/0/3] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/3] quit

# Configure Layer 2 aggregate interface Bridge-Aggregation 1 as a trunk port and assign it to VLANs 10 and 20.

[DeviceA] interface bridge-aggregation 1

[DeviceA-Bridge-Aggregation1] port link-type trunk

[DeviceA-Bridge-Aggregation1] port trunk permit vlan 10 20

[DeviceA-Bridge-Aggregation1] quit

2.     Configure Device B in the same way Device A is configured. (Details not shown.)

Verifying the configuration

# Display detailed information about all aggregation groups on Device A.

[DeviceA] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Bridge-Aggregation1

Creation Mode: Manual

Aggregation Mode: Dynamic

Loadsharing Type: Shar

Management VLANs: None

System ID: 0x8000, 000f-e267-6c6a

Local:

  Port                Status   Priority Index    Oper-Key               Flag

  WGE1/0/1(R)         S        32768    11       1                      {ACDEF}

  WGE1/0/2            S        32768    12       1                      {ACDEF}

  WGE1/0/3            S        32768    13       1                      {ACDEF}

Remote:

  Actor               Priority Index    Oper-Key SystemID               Flag

  WGE1/0/1            32768    81       1        0x8000, 000f-e267-57ad {ACDEF}

  WGE1/0/2            32768    82       1        0x8000, 000f-e267-57ad {ACDEF}

  WGE1/0/3            32768    83       1        0x8000, 000f-e267-57ad {ACDEF}

The output shows that link aggregation group 1 is a Layer 2 dynamic aggregation group that contains three Selected ports.

Example: Configuring a Layer 2 edge aggregate interface

Network configuration

As shown in Figure 9, a Layer 2 dynamic aggregation group is configured on the device. The server is not configured with dynamic link aggregation.

Configure an edge aggregate interface so that both Twenty-FiveGigE 1/0/1 and Twenty-FiveGigE 1/0/2 can forward traffic to improve link reliability.

Figure 9 Network diagram

Procedure

# Create Layer 2 aggregate interface Bridge-Aggregation 1, and set the link aggregation mode to dynamic.

<Device> system-view

[Device] interface bridge-aggregation 1

[Device-Bridge-Aggregation1] link-aggregation mode dynamic

# Configure Layer 2 aggregate interface Bridge-Aggregation 1 as an edge aggregate interface.

[Device-Bridge-Aggregation1] lacp edge-port

[Device-Bridge-Aggregation1] quit

# Assign ports Twenty-FiveGigE 1/0/1 and Twenty-FiveGigE 1/0/2 to link aggregation group 1.

[Device] interface twenty-fivegige 1/0/1

[Device-Twenty-FiveGigE1/0/1] port link-aggregation group 1

[Device-Twenty-FiveGigE1/0/1] quit

[Device] interface twenty-fivegige 1/0/2

[Device-Twenty-FiveGigE1/0/2] port link-aggregation group 1

[Device-Twenty-FiveGigE1/0/2] quit

Verifying the configuration

# Display detailed information about all aggregation groups on the device when the server is not configured with dynamic link aggregation.

[Device] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Bridge-Aggregation1

Creation Mode: Manual

Aggregation Mode: Dynamic

Loadsharing Type: Shar

Management VLANs: None

System ID: 0x8000, 000f-e267-6c6a

Local:

  Port                Status   Priority Index    Oper-Key               Flag

  WGE1/0/1            I        32768    11       1                      {AG}

  WGE1/0/2            I        32768    12       1                      {AG}

 

Remote:

  Actor               Priority Index    Oper-Key SystemID               Flag

  WGE1/0/1            32768    81       0        0x8000, 0000-0000-0000 {DEF}

  WGE1/0/2            32768    82       0        0x8000, 0000-0000-0000 {DEF}

The output shows that Twenty-FiveGigE 1/0/1 and Twenty-FiveGigE 1/0/2 are in Individual state when they do not receive LACPDUs from the server. Both Twenty-FiveGigE 1/0/1 and Twenty-FiveGigE 1/0/2 can forward traffic. When one port fails, its traffic is automatically switched to the other port.

Example: Configuring a Layer 3 static aggregation group

Network configuration

On the network shown in Figure 10, perform the following tasks:

·     Configure a Layer 3 static aggregation group on both Device A and Device B.

·     Configure IP addresses and subnet masks for the corresponding Layer 3 aggregate interfaces.

Figure 10 Network diagram

Procedure

1.     Configure Device A:

# Create Layer 3 aggregate interface Route-Aggregation 1, and configure an IP address and subnet mask for the aggregate interface.

<DeviceA> system-view

[DeviceA] interface route-aggregation 1

[DeviceA-Route-Aggregation1] ip address 192.168.1.1 24

[DeviceA-Route-Aggregation1] quit

# Assign Layer 3 Ethernet interfaces Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 to aggregation group 1.

[DeviceA] interface twenty-fivegige 1/0/1

[DeviceA-Twenty-FiveGigE1/0/1] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/1] quit

[DeviceA] interface twenty-fivegige 1/0/2

[DeviceA-Twenty-FiveGigE1/0/2] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/2] quit

[DeviceA] interface twenty-fivegige 1/0/3

[DeviceA-Twenty-FiveGigE1/0/3] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/3] quit

2.     Configure Device B in the same way Device A is configured. (Details not shown.)

Verifying the configuration

# Display detailed information about all aggregation groups on Device A.

[DeviceA] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Route-Aggregation1

Aggregation Mode: Static

Loadsharing Type: Shar

Management VLANs: None

  Port             Status  Priority Oper-Key

  WGE1/0/1(R)      S       32768    1

  WGE1/0/2         S       32768    1

  WGE1/0/3         S       32768    1

The output shows that link aggregation group 1 is a Layer 3 static aggregation group that contains three Selected ports.

Example: Configuring a Layer 3 dynamic aggregation group

Network configuration

On the network shown in Figure 11, perform the following tasks:

·     Configure a Layer 3 dynamic aggregation group on both Device A and Device B.

·     Configure IP addresses and subnet masks for the corresponding Layer 3 aggregate interfaces.

Figure 11 Network diagram

Procedure

1.     Configure Device A:

# Create Layer 3 aggregate interface Route-Aggregation 1.

<DeviceA> system-view

[DeviceA] interface route-aggregation 1

# Set the link aggregation mode to dynamic.

[DeviceA-Route-Aggregation1] link-aggregation mode dynamic

# Configure an IP address and subnet mask for Route-Aggregation 1.

[DeviceA-Route-Aggregation1] ip address 192.168.1.1 24

[DeviceA-Route-Aggregation1] quit

# Assign Layer 3 Ethernet interfaces Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 to aggregation group 1.

[DeviceA] interface twenty-fivegige 1/0/1

[DeviceA-Twenty-FiveGigE1/0/1] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/1] quit

[DeviceA] interface twenty-fivegige 1/0/2

[DeviceA-Twenty-FiveGigE1/0/2] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/2] quit

[DeviceA] interface twenty-fivegige 1/0/3

[DeviceA-Twenty-FiveGigE1/0/3] port link-aggregation group 1

[DeviceA-Twenty-FiveGigE1/0/3] quit

2.     Configure Device B in the same way Device A is configured. (Details not shown.)

Verifying the configuration

# Display detailed information about all aggregation groups on Device A.

[DeviceA] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Route-Aggregation1

Creation Mode: Manual

Aggregation Mode: Dynamic

Loadsharing Type: Shar

Management VLANs: None

System ID: 0x8000, 000f-e267-6c6a

Local:

  Port                Status   Priority Index    Oper-Key               Flag

  WGE1/0/1(R)         S        32768    11       1                      {ACDEF}

  WGE1/0/2            S        32768    12       1                      {ACDEF}

  WGE1/0/3            S        32768    13       1                      {ACDEF}

Remote:

  Actor               Priority Index    Oper-Key SystemID               Flag

  WGE1/0/1            32768    81       1        0x8000, 000f-e267-57ad {ACDEF}

  WGE1/0/2            32768    82       1        0x8000, 000f-e267-57ad {ACDEF}

  WGE1/0/3            32768    83       1        0x8000, 000f-e267-57ad {ACDEF}

The output shows that link aggregation group 1 is a Layer 3 dynamic aggregation group that contains three Selected ports.

Example: Configuring S-MLAG

Network configuration

Device B, Device C, and Device D are standalone devices. As shown in Figure 12, configure Device B, Device C, and Device D as S-MLAG devices to establish a multidevice aggregate link with Device A.

Figure 12 Network diagram

Procedure

1.     Configure Device A:

# Create Layer 2 aggregate interface Bridge-Aggregation 10, and set the link aggregation mode to dynamic.

<DeviceA> system-view

[DeviceA] interface bridge-aggregation 10

[DeviceA-Bridge-Aggregation10] link-aggregation mode dynamic

[DeviceA-Bridge-Aggregation10] quit

# Assign Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 to aggregation group 10.

[DeviceA] interface twenty-fivegige 1/0/1

[DeviceA-Twenty-FiveGigE1/0/1] port link-aggregation group 10

[DeviceA-Twenty-FiveGigE1/0/1] quit

[DeviceA] interface twenty-fivegige 1/0/2

[DeviceA-Twenty-FiveGigE1/0/2] port link-aggregation group 10

[DeviceA-Twenty-FiveGigE1/0/2] quit

[DeviceA] interface twenty-fivegige 1/0/3

[DeviceA-Twenty-FiveGigE1/0/3] port link-aggregation group 10

[DeviceA-Twenty-FiveGigE1/0/3] quit

2.     Configure Device B:

# Set the LACP system MAC address to 0001-0001-0001.

<DeviceB> system-view

[DeviceB] lacp system-mac 1-1-1

# Set the LACP system priority to 123.

[DeviceB] lacp system-priority 123

# Set the LACP system number to 1.

[DeviceB] lacp system-number 1

# Create Layer 2 aggregate interface Bridge-Aggregation 2, and set the link aggregation mode to dynamic.

[DeviceB] interface bridge-aggregation 2

[DeviceB-Bridge-Aggregation2] link-aggregation mode dynamic

# Assign Bridge-Aggregation 2 to S-MLAG group 100.

[DeviceB-Bridge-Aggregation2] port s-mlag group 100

# Assign Twenty-FiveGigE 1/0/1 to aggregation group 2.

[DeviceB] interface twenty-fivegige 1/0/1

[DeviceB-Twenty-FiveGigE1/0/1] port link-aggregation group 2

[DeviceB-Twenty-FiveGigE1/0/1] quit

3.     Configure Device C:

# Set the LACP system MAC address to 0001-0001-0001.

<DeviceC> system-view

[DeviceC] lacp system-mac 1-1-1

# Set the LACP system priority to 123.

[DeviceC] lacp system-priority 123

# Set the LACP system number to 2.

[DeviceC] lacp system-number 2

# Create Layer 2 aggregate interface Bridge-Aggregation 3, and set the link aggregation mode to dynamic.

[DeviceC] interface bridge-aggregation 3

[DeviceC-Bridge-Aggregation3] link-aggregation mode dynamic

# Assign Bridge-Aggregation 3 to S-MLAG group 100.

[DeviceC-Bridge-Aggregation3] port s-mlag group 100

# Assign Twenty-FiveGigE 1/0/1 to aggregation group 3.

[DeviceC] interface twenty-fivegige 1/0/1

[DeviceC-Twenty-FiveGigE1/0/1] port link-aggregation group 3

[DeviceC-Twenty-FiveGigE1/0/1] quit

4.     Configure Device D:

# Set the LACP system MAC address to 0001-0001-0001.

<DeviceD> system-view

[DeviceD] lacp system-mac 1-1-1

# Set the LACP system priority to 123.

[DeviceD] lacp system-priority 123

# Set the LACP system number to 3.

[DeviceD] lacp system-number 3

# Create Layer 2 aggregate interface Bridge-Aggregation 4, and set the link aggregation mode to dynamic.

[DeviceD] interface bridge-aggregation 4

[DeviceD-Bridge-Aggregation4] link-aggregation mode dynamic

# Assign Bridge-Aggregation 4 to S-MLAG group 100.

[DeviceD-Bridge-Aggregation4] port s-mlag group 100

# Assign Twenty-FiveGigE 1/0/1 to aggregation group 4.

[DeviceD] interface twenty-fivegige 1/0/1

[DeviceD-Twenty-FiveGigE1/0/1] port link-aggregation group 4

[DeviceD-Twenty-FiveGigE1/0/1] quit

Verifying the configuration

# Verify that Twenty-FiveGigE 1/0/1 through Twenty-FiveGigE 1/0/3 on Device A are Selected ports.

[DeviceA] display link-aggregation verbose

Loadsharing Type: Shar -- Loadsharing, NonS -- Non-Loadsharing

Port Status: S -- Selected, U -- Unselected, I -- Individual

Port: A -- Auto port, M -- Management port, R -- Reference port

Flags:  A -- LACP_Activity, B -- LACP_Timeout, C -- Aggregation,

        D -- Synchronization, E -- Collecting, F -- Distributing,

        G -- Defaulted, H -- Expired

Role: P -- Primary, S -- Secondary

 

Aggregate Interface: Bridge-Aggregation10

Creation Mode: Manual

Aggregation Mode: Dynamic

Loadsharing Type: Shar

Management VLANs: None

System ID: 0x8000, 40fa-264f-0100

Local:

  Port                Status   Priority Index    Oper-Key               Flag

  WGE1/0/1(R)         S        32768    1        1                      {ACDEF}

  WGE1/0/2            S        32768    2        1                      {ACDEF}

  WGE1/0/3            S        32768    3        1                      {ACDEF}

Remote:

  Actor               Priority Index    Oper-Key SystemID               Flag

  WGE1/0/1            32768    16385    50100    0x7b  , 0001-0001-0001 {ACDEF}

  WGE1/0/2            32768    32769    50100    0x7b  , 0001-0001-0001 {ACDEF}

  WGE1/0/3            32768    49153    50100    0x7b  , 0001-0001-0001 {ACDEF}

 

  • Cloud & AI
  • InterConnect
  • Intelligent Computing
  • Security
  • SMB Products
  • Intelligent Terminal Products
  • Product Support Services
  • Technical Service Solutions
All Services
  • Resource Center
  • Policy
  • Online Help
All Support
  • Become a Partner
  • Partner Resources
  • Partner Business Management
All Partners
  • Profile
  • News & Events
  • Online Exhibition Center
  • Contact Us
All About Us
新华三官网