qm9700 qm9790 1u NDR 400gb S Infiniband Switch Systems User Manual
qm9700 qm9790 1u NDR 400gb S Infiniband Switch Systems User Manual
2
2.16 (Hebrew) הוראות בטיחות בהתקנה......................................................... 49
2.16.1 Air Flow................................................................................... 52
2.16.2 Package Contents ....................................................................... 53
2.16.3 19” System Mounting Options ......................................................... 53
2.17 Tool-Less Rail Kit ............................................................................ 53
2.18 Cable Installation ........................................................................... 62
2.18.1 Power Cable and Cable Retainer ..................................................... 62
2.18.2 Port Cables............................................................................... 64
2.19 Initial Power On ............................................................................. 67
2.20 System Bring-Up of Managed Systems ................................................... 68
2.20.1 Configuring Network Attributes....................................................... 69
2.20.2 Configuring the Switch with ZTP ..................................................... 78
2.20.3 Rerunning the Wizard .................................................................. 78
2.20.4 Starting the Command Line (CLI)..................................................... 78
2.21 FRU Replacements .......................................................................... 79
2.21.1 Power Supply ............................................................................ 79
2.21.2 Fans ....................................................................................... 80
3 Software Management ................................................................ 82
3.1 InfiniBand Subnet Manager ................................................................ 82
3.2 Upgrading Software (on Managed Systems) ............................................. 82
3.3 Updating Firmware on Externally Managed Systems .................................. 83
3.3.1 Updating Firmware In-band (Typical) ................................................ 83
4 Interfaces ............................................................................... 85
4.1 Data Interfaces .............................................................................. 85
4.1.1 Speed ..................................................................................... 85
4.2 RS232 (Console) ............................................................................. 85
4.3 Management ................................................................................. 86
4.4 USB ............................................................................................ 86
4.5 I²C ............................................................................................. 86
4.6 Reset Button ................................................................................. 87
4.7 LEDs ........................................................................................... 87
4.8 LED Notifications............................................................................ 87
4.8.1 System Status LED ...................................................................... 88
4.8.2 Fan Status LED........................................................................... 88
3
4.8.3 Power Supply Status LEDs.............................................................. 89
4.8.4 Unit Identification LED................................................................. 90
4.8.5 Port LEDs ................................................................................. 91
4.9 Inventory Pull-out Tab...................................................................... 92
5 Troubleshooting ........................................................................ 93
6 Specifications........................................................................... 94
7 Appendixes.............................................................................. 95
7.1 Accessory and Replacement Parts ........................................................ 95
7.2 Thermal Threshold Definitions............................................................ 95
7.3 Interface Specifications.................................................................... 96
7.3.1 OSFP Pin Description ................................................................... 96
7.3.2 RJ45 to DB9 Harness Pinout ........................................................... 97
7.4 Disassembly and Disposal .................................................................. 98
7.4.1 Disassembly Procedure ................................................................. 98
7.4.2 Disposal................................................................................... 98
8 Document Revision History ..........................................................100
4
Relevant for Models: QM9700 and QM9790
This manual describes the installation and basic use of the NVIDIA 1U NDR InfiniBand switch systems
based on the NVIDIA Quantum™-2 switch ASIC. This manual is intended for IT managers and system
administrators.
Ordering Information
Related Documentation
Document Description
InfiniBand Architecture The InfiniBand Trade Association (IBTA) InfiniBand® Specification at https://
Specification www.infinibandta.org.
Volume 1 Release 1.5
MLNX-OS® User Manual This document contains information regarding the configuration and
management of the MLNX-OS® software. https://www.nvidia.com/en-us/
networking/ethernet/switch-software/.
Hands-on workshops Visit https://academy.nvidia.com/en/infiniband-customized-training/.
On-site/remote services For any tailor-made service, contact: [email protected].
Revision History
A list of the changes made to this document are provided in Document Revision History.
5
1 Introduction
The NVIDIA Quantum-2-based QM9700 and QM9790 switch systems deliver an unprecedented 64 ports
of NDR 400Gb/s InfiniBand per port in a 1U standard chassis design. A single switch carries an
aggregated bidirectional throughput of 51.2 terabits per second (Tb/s), with a landmark of more
than 66.5 billion packets per second (BPPS) capacity. Supporting the latest NDR technology, NVIDIA
Quantum-2 brings a high-speed, extremely low-latency and scalable solution that incorporates
state-of-the-art technologies such as Remote Direct Memory Access (RDMA), adaptive routing, and
NVIDIA Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)™.Unlike any other
networking solution, NVIDIA InfiniBand provides self-healing network capabilities, as well as quality
of service (QoS), enhanced virtual lane (VL) mapping, and congestion control to provide the highest
overall application throughput. As an ideal rack-mounted InfiniBand solution, the QM9700 and
QM9790 NDR InfiniBand fixed-configuration switches allow maximum flexibility, as they enable a
variety of topologies, including Fat Tree, SlimFly, DragonFly+, multi-dimensional Torus, and more.
They’re also backwards compatible to previous generations and include expansive software
ecosystem support.
By implementing NVIDIA port-split technology, the QM9700 and QM9790 switches provide a double-
density radix for 200Gb/s (NDR200) data speeds, reducing the cost of network design and network
topologies. Supporting up to 128 ports of 200Gb/s, NVIDIA delivers the densest top-of-rack (TOR)
switch available on the market. The QM9700 family of switches enables small to medium-sized
deployments to scale with a two-level Fat Tree topology while reducing power, latency, and space
requirements.
The internally managed QM9700 switch features an on-board subnet manager that enables simple,
out-of-the-box bringup for up to 2,000 nodes. Running the NVIDIA MLNX-OS® software package, the
subnet manager delivers full chassis management through command-line interface (CLI), web-based
user (WebUI), Simple Network Management Protocol (SNMP), or JavaScript Object Notation (JSON)
interfaces.The externally managed QM9790 switch can utilize the advanced NVIDIA Unified Fabric
Manager (UFM®) feature sets to empower data center operators to efficiently provision, monitor,
manage, preventatively troubleshoot, and maintain the modern data center fabric, to realize higher
utilization and reduce overall opex.
6
For additional airflow options, see Airflow.
1.3 Features
For a full feature list, please refer to the system’s product brief. Go to https://www.nvidia.com/en-
us/networking/. In the main menu, click on Products > InfiniBand > Switch Systems, and select the
desired product page.
1.4 Certifications
The list of certifications (such as EMC, Safety and others) per system for different regions of the
world is located on the Mellanox website at http://www.mellanox.com/page/
environmental_compliance.
7
2 Installation
2.1 System Installation and Initialization
Installation and initialization of the system require attention to the normal mechanical, power, and
thermal precautions for rack-mounted equipment.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take
precautions to guarantee proper ventilation in order to maintain good airflow at ambient
temperature.
The installation procedure for the system involves the following phases:
8
Step Procedure See
4 Mount the system into a rack enclosure 19" System Mounting Options
5 Power on the system Initial Power On
6 Perform system bring-up System Bring-Up of Managed Systems
7 Install FRU Replacements, if needed FRU Replacements
9
2.3 Switch Safety Warnings (English)
Installation Instructions
Read all installation instructions before connecting the equipment to the power source.
Heavy Equipment
This equipment is heavy and should be moved using a mechanical lift to avoid injuries.
• For AC powered switch systems: Disconnecting one power supply only disconnects one
module. To isolate the unit completely, all connected power supplies must be disconnected.
Over-temperature
This equipment should not be operated in an area with an ambient temperature exceeding the
maximum value listed in the product specifications. Moreover, to guarantee proper ventilation,
allow at least 8 cm (3 inches) of clearance around the ventilation openings.
10
Double Pole/Neutral Fusing
This system has double pole/neutral fusing. Remove all power cords before opening the cover of this
product or touching any internal parts.
Equipment Installation
This equipment should be installed, replaced, and/or serviced only by trained and qualified
personnel.
Equipment Disposal
Disposal of this equipment should be in accordance to all national laws and regulations.
Installation Codes
This device must be installed according to the latest version of the country national electrical
codes. For North America, equipment must be installed in accordance to the applicable
requirements in the US National Electrical Code and the Canadian Electrical Code.
Battery Replacement
Warning: Replace only with UL Recognized battery, certified for maximum abnormal charging
current not less than 4mA. There is a risk of explosion should the battery be replaced with a battery
of an incorrect type. Dispose of used batteries according to the instructions.
11
For North American power connection, select a power supply cord that is UL Listed and CSA
Certified, 3 - conductor, [16 AWG], terminated with a molded plug rated at 125 V, [13 A], with a
minimum length of 1.5m [six feet] but no longer than 4.5m.
For European connection, select a power supply cord that is internationally harmonized and marked
“<HAR>”, 3 - conductor, minimum 1.0 mm2 wire, rated at 300 V, with a PVC insulated jacket. The
cord must have a molded plug rated at 250 V, 10 A.
Installation Codes
This device must be installed according to the latest version of the country's national electrical
codes. For North America, equipment must be installed in accordance to the applicable
requirements in the US National Electrical Code and the Canadian Electrical Code.
Interconnection of Units
Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP-1 or
DP-2. (Note: when residing in non LPS circuit.)
Overcurrent Protection
A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be
incorporated in the building wiring.
WEEE Directive
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE)
should be collected separately and not disposed of with regular household waste. Dispose of this
product and all of its parts in a responsible and environmentally-friendly way.
12
2.3.1 Taiwan RoHS Declaration - Switch Systems
13
2.4 Nordic Countries Notices
因重量導致的人身受傷
為了安全起見,請安排足夠的人員以合力抬起本產品。
重設備
本設備極重,應使用機械式起重機來搬移,以避免人員受傷。
有觸電的危險
有觸電的危險!拆除風扇模組後,即可接觸到模組空腔內的電源針腳。請勿將工具或機身零件插入
到風扇模組空腔內。
溫度過高
本設備不應在超過所建議的最高環境溫度的區域中運作:45°C (113°F)。此外,為了保證氣流的流
通正常,請在通風口旁保留至少 8 公分 (3 英吋) 的間距。
堆疊機箱
機箱不應堆疊在任何其他設備上。如果機箱掉落,可能造成人員受傷與設備損壞。
複式電源連接時的電擊危險
14
本設備附有備援電源供應器或在適當位置配有空白蓋板。如果是電源供應器空白蓋板,在空白蓋板
已取下或未牢牢固訂的情況下,請勿操作本產品。
雙極/中性保險絲
本系統具有雙極/中性保險絲。請拔掉所有電源線後,再打開本產品的蓋板或碰觸任何內部零件。
多電源輸入座
電擊與能源危害的危險。所有 PSU 均各自獨立。將所有電源供應器斷電,確保交換器平台內部在
電源關閉狀態。
閃電時的電擊危險
在閃電期間,不要使用本設備或連接或拔下纜線。
機架安裝與維修
此產品已安裝在機架中或在機架中維修時,必須採取特定預防措施以確保系統維持穩定。一般您應
該將設備從底部到頂端放滿機架。
設備安裝
本設備僅限由經過訓練與/或合格的人員安裝、更換或維修。
設備棄置
棄置本設備應遵照所有國內法規。
當地與國家電氣法規
請遵照當地與國家電氣法規安裝本設備。
安裝法規
請務必遵循最新版的國家電氣法規,安裝本設備。在北美地區,請務必遵循美國國家電工法規和加
拿大電工法規中的適用規定,安裝本設備。
更換電池
警告:只能以 UL 認可電池,且取得最大異常充電電流低於 4mA 認證的電池進行更換。
若更換錯誤類型的電池,會有爆炸的危險。
請依據指示棄置廢電池。
15
平方公厘,額定值為 300 V,採用 PVC 絕緣的電源線。電源線需有成型插頭,額定值為 250 V, 10
A。
高漏電流
警告: 高漏電流;必須執行地線連接,然後再連接電源供應器。
安裝法規
請務必遵循最新版的國家電氣法規,安裝本設備。在北美地區,請務必遵循美國國家電工法規和加
拿大電工法規中的適用規定,安裝本設備。
互連設備
連接至 RS232 設備和乙太網路介面的纜線必須是 UL 認證類型 DP-1 或 DP-2。(請注意位於非 LPS
電路時).
過電流保護:準備好使用的列名分支電路過電流保護裝置最大額定值 20 A 必須整合在配線中。
噪音级别警告
规格部分中列出的噪音级别代表在标定条件下根据 ISO 7779 标准测量出的产品噪音。实际噪音级
别可能因安装情况而异,影响因素包括但不限于安装所使用的机架数量、安装所占用的整体空间大
小、机架和其他设备所使用的材料及其噪音水平、风扇故障、室温、房间布置以及员工与设备的相
对位置。数据中心所有者应根据 OSHA 标准进行有效的听力保护管理,以便保护员工,使其听力免
受过大噪音的伤害,并避免让员工长时间待在充满噪音的环境中。
请勿将交换机作为机架与工作空间使用
小心:具有滑轨 / 导轨设备不可用作机架或工作空间。导轨不适用于将设备滑出机架使用。
仅限永久安装在最后安置区域时使用,不可用于维修和保养。
WEEE 指令
根据 WEEE 指令 2002/96/EC,所有废弃的电气与电子设备 (EEE),应分开集 中,而且不应与一般
家庭废弃物一起弃置。请以负责和环保的方式弃置本产品及其所有零件。
挪威国家电源限制
本设备仅限连接至挪威的 TN 电源系统和 IT 电源系统。
16
2.5.1 China CCC Warning Statement
17
2.5.2 Taiwan RoHS Declaration - Switch Systems
18
2.6 安裝安全性警告 (Chinese)
安装指示
本设备附有备援电源供应器或在适当位置配有空白盖板。
因重量导致的人身受伤
为了安全起见,请安排足够的人员以合力抬起本产品。
重设备
本设备极重,应使用机械式起重机来搬移,以避免人员受伤。
有触电的危险
有触电的危险!拆除风扇模组后,即可接触到机箱内模组空缺处的电源针脚。请勿将工具或机身零
件放入机箱内风扇模组空缺处。
温度过高
本设备不应在超过所建议的最高环境温度的区域中运作:45°C (113°F)。此外,为了保证气流的流
通正常,请在通风口旁保留至少 8 公分 (3 英吋 ) 的间距。
堆叠机箱
机箱不应堆叠在任何其他设备上。如果机箱掉落,可能造成人员受伤与设备损 坏。
备用电源供应器连接时的电击危险
本设备附有备援电源供应器或在适当位置配有空白盖板。有关电源供应器, 在空白盖板已取下或未
牢牢固定的情况下,请勿操作本产品
双极/中性保险丝
本系统具有双极 / 中性保险丝。请拔掉所有电源线后,再打开本产品的盖板或 碰触任何内部零
件。
多电源输入座
19
电击与能源危害的危险。所有 PSU 均各自独立。请将所有电源供应器断电,以确保交换器设备内
部的电源为关闭状态。
铜缆线的连接与移除
铜电缆重且不易弯折,因此应仔细连接或从连接器端口分离。请参阅电缆制造商了解特殊警告/说
明。
机架安装与维修
此产品已安装在机架中或在机架中维修时,必须采取特定预防措施以确保系统 维持稳定。一般您
应该将设备从底部到顶端放满机架。
设备安装
本设备仅限由经过训练与 / 或合格的人员安装、更换或维修。
设备弃置
弃置本设备应遵照所有国内法规。
当地与国家电气法规
请遵照当地与国家电气法规安装本设备。
安装法规
请务必遵循最新版的国家电气法规,安装本设备。在北美地区,请务必遵循美 国国家电工法规和
加拿大电工法规中的适用规定,安装本设备。
更换电池
警告:只能以 UL 认可电池,且取得最大异常充电电流低于 4mA 认证的电池进 行更换。若更换错
误类型的电池,会有爆炸的危险。请依据指示弃置废电池。
高漏電流
警告: 高漏电流;必须执行地线连接,然后再连接电源供应器。
安装法规
请务必遵循最新版的国家电气法规,安装本设备。在北美地区,请务必遵循美 国国家电工法规和
加拿大电工法规中的适用规定,安装本设备。
20
互连设备
连接至 RS232 设备和乙太网路介面的缆线必须是 UL 认证类型 DP-1 或 DP-2。( 请注意- 若放置于
无 LPS 电路时 )
過電流保護:準備好使用的列名分支電路過電流保護裝置最大額定值 20 A 必須整合在配線中。
噪音级别警告
规格部分中列出的噪音级别代表在标定条件下根据 ISO 7779 标准测量出的产品噪音。实际噪音级
别可能因安装情况而异,影响因素包括但不限于安装所使用的机架数量、安装所占用的整体空间大
小、机架和其他设备所使用的材料及其噪音水平、风扇故障、室温、房间布置以及员工与设备的相
对位置。数据中心所有者应根据 OSHA 标准进行有效的听力保护管理,以便保护员工,使其听力免
受过大噪音的伤害,并避免让员工长时间待在充满噪音的环境中。
切換開關不可用作機架或工作空間
小心:滑軌/導軌安裝設備不可用作機架或工作空間。導軌不適用於將設備滑出機架使用。僅
限永久安裝在最後安置區域時使用,不可用於維修和保養。
WEEE 指令
根據 WEEE 指令 2002/96/EC,所有廢棄的電氣與電子設備 (EEE),應分開集中,而且不應與
一般家庭廢棄物一起棄置。請以負責和環保的方式棄置本產品及其所有零件。
挪威國家電源限制
本設備僅限連接至挪威的 TN 電源系統和 IT 電源系統。
21
2.6.1 China CCC Warning Statement
22
2.6.2 Taiwan RoHS Declaration - Switch Systems
23
2.7 Avertissements de sécurité pour l'installation
(French)
Instructions d'installation
Veuillez lire la totalité des instructions d'installation avant de relier l'équipement au secteur.
Équipement lourd
Cet équipement est lourd et doit être déplacé avec un système de levage mécanique pour
éviter les blessures.
Danger d'électrocution
Danger d'électrocution ! Lorsque le module de ventilation est retiré, les broches d'alimentation
sont exposées dans l'emplacement du module. NE PAS insérer d'outils ou la main dans
l'emplacement du module.
Surchauffe
Cet équipement ne doit pas être en service dans un local dont la température dépasse le
maximum recommandé de 45°C (113°F). En outre et pour garantir une circulation d'air
correcte, laisser un espace d'au moins 8 cm (3") autour des orifices de ventilation.
Fusibles phase/neutre
24
Ce système dispose de fusibles phase/neutre. Débranchez tous les cordons d'alimentation avant
d'ouvrir le capot ou de toucher tout élément à l'intérieur.
Installation de l'équipement
Cet équipement ne doit être installé, remplacé et maintenu que par un personnel formé et
qualifié.
Codes d'installation
Cet appareil doit être installé conformément à la version la plus récente des codes électrique
nationaux. En Amérique du Nord, l'équipement doit être installé en respectant les exigences de
l'US National Electrical Code et du Code canadien de l'électricité.
Remplacement de la batterie
Avertissement: ne remplacer qu'avec une batterie UL, certifiée pour accepter un courant de
charge anormal maximal supérieur ou égal à 4 mA. Si la batterie n'est pas remplacée par un
type correct, il y a un risque d'explosion. Les batteries usagées doivent être mises au rebut
conformément aux instructions.
25
Cordon d'alimentation UL Listed et certifié CSA
Pour le branchement électrique en Amérique du Nord, utiliser un cordon d'alimentation UL
Listed et CSA Certified, à 3 conducteurs [calibre 16 AWG], avec une prise moulée 125 V [13 A],
faisant au moins 1,5 m de long [six pieds] et au plus 4,5 m.
Pour le branchement électrique en Europe, utiliser un cordon d'alimentation au format
international harmonisé (marqué <HAR>), à 3 conducteurs d'au moins 1 mm2 de section, 300 V,
avec une gaine isolante en PVC. Le cordon doit avoir une prise moulée 250 V 10 A.
Codes d'installation
Cet appareil doit être installé conformément à la version la plus récente des codes électrique
nationaux. En Amérique du Nord, l'équipement doit être installé en respectant les exigences de
l'US National Electrical Code et du Code canadien de l'électricité.
Protection contre les surintensités : le câblage de l'immeuble doit intégrer un dispositif certifié
de protection contre les surintensités, calibré à 20 A et aisément accessible.
Le niveau acoustique indiqué dans la section Spécifications correspond au bruit émis par le produit
conformément à la norme ISO 7779 dans des conditions nominales. Le niveau sonore réel peut varier
selon les conditions d’installation, y compris, mais sans s’y limiter, le nombre de racks relatifs à
l’installation, les dimensions globales de l’installation, le rack et les autres équipements et/ou
niveaux de bruit existants, les défauts de ventilation, la température de la pièce, la configuration
de la pièce et la disposition de l’opérateur par rapport à l’équipement. Le propriétaire du Data
Center doit proposer des mesures efficaces de protection auditive en conformité avec la norme
OSHA, de manière à protéger ses employés contre une exposition prolongée au bruit.
26
Directive DEEE
Selon la Directive 2002/96/CE (DEEE), tous les déchets d'équipements électriques et
électroniques (EEE) doivent être collectés séparément et ne pas être mis au rebut avec
les déchets ménagers habituels. Ce produit et toutes ses pièces doivent être mis au rebut
d'une manière responsable, respectant l'environnement.
Schweres Gerät
Dieses Gerät ist schwer und muss mit einem mechanischen Hebegerät verschoben werden, um
Verletzungen zu vermeiden.
Stromschlagrisiko
Stromschlagrisiko! Bei abgenommenem Ventilatormodul sind die Stromkontakte in der
Modulvertiefung zugänglich. Es dürfen KEINE Werkzeuge oder Körperteile in die Vertiefung des
Ventilatormoduls gelangen.
Übertemperatur
Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal
empfohlenen Temperatur von 45°C (113°F) betrieben werden. Es ist ein Luftstrom von 200 LFM
bei maximaler Umgebungstemperatur erforderlich. Außerdem sollten mindestens 8 cm (3 in.)
Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu
gewährleisten.
27
Zweipolig/Neutrale Sicherung
Achtung: Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um
sicherzustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem
Öffnen der Abdeckung dieses Produkts oder dem Berühren der Innenteile.
Mehrere Stromeingänge
Risiko eines Stromschlags und Stomgefahr. Alle Stromversorgungseinheiten sind unabhängig.
Trennen Sie alle Stomversorgungen, um einen abgeschalteten Zustand im Inneren der Switch-
Plattform sicherzustellen.
Geräteinstallation
Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert, ausgetauscht
oder gewartet werden.
Geräteentsorgung
Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestimmungen
erfolgen.
Installationscodes
Dieses Gerät muss entsprechend der aktuellsten Version des National Electrical Code installiert
weden. In Nodamerika muss das Gerät gemäß den geltenden Anforderungen des US National
Electrical Code und des Canadian Electrical Code installiert werden.
28
Akkuaustausch
Warnung: Nur durch von UL anerkannten Akkus ersetzen, die für maximalen anormalen
Ladestrom von nicht weniger als 4mA zertifiziert sind. Es besteht Explosiionsgefahr, wenn der
Akku durch einen Akku eines falschen Typs ersetzt wird. Akkus gemäß den Anweisungen
entsorgen.
Hoher Ableitstrom
WARNUNG: Hohe Ableitstrom; Earth Verbindung, bevor Sie die Verbindung von wesentlicher
Bedeutung werden.
Installationscodes
Dieses Gerät muss installiert sein, entsprechend auf die neueste Version des Landes National
Electrical Code. Für Nordamerika, müssen in Übereinstimmung mit den geltenden Vorschriften
in der US-amerikanischen National Electrical Code und dem Canadian Electrical Code.
29
Achtung: Auf Schieber/Schienen montiertes Gerät ist nicht als Regal oder Arbeitsbereich
zu nutzen. Die Schienen sind nicht dafür bestimmt, die Einheit aus dem Gestell weg zu
ziehen. Sie sind nur für die permanente Installation an einem endgültigen Standort
gedacht, nicht für Instandhaltung und Wartung.
WEEE-Direktive
Gemäß WEEE Directive 2002/96/EC müssen alle elektrischen und elektronischen
Abfallgeräte (EEE) separat gesammelt und nichit mit normalem Haushaltsmüll ensorgt
werden. Dieses Produkt und alle seine Teile in verantwortungsvoller und
umweltfreundlicher Art und Weise entsorgen.
Equipos pesados
Dado que el equipo es pesado, se debe mover únicamente mediante un elevador mecánico,
para evitar lesiones.
Sobretemperatura
No se debe utilizar el equipo en un área con una temperatura ambiente superior a la máxima
recomendada: 45°C. Además, para garantizar una circulación de aire adecuada, se debe dejar
como mínimo un espacio de 8 cm (3 pulgadas) alrededor de las aberturas de ventilación.
30
Apilamiento del chasis
Los chasis no se deben apilar sobre otros equipos. La caída del chasis podría causar lesiones
corporales, así como daños al equipo.
31
Este equipo se debe instalar conforme a los códigos eléctricos locales y nacionales.
Códigos de instalación
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos
nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo
con las disposiciones vigentes del Código Eléctrico Nacional de los EE.UU. y del Código Eléctrico
de Canadá.
Cambio de batería
II y a danger d’explosion s’il y a remplacement incorrect de la batterie. Remplacer uniquement
avec une batterie du même type ou d’un type équivalent recommandé par le
constructeur. Mettre au rebut les batteries usagées conformément aux instructions du
fabricant.
Códigos de instalación
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos
nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo
con las disposiciones vigentes del Código Eléctrico Nacional de los EE.UU. y del Código Eléctrico
de Canadá.
Interconexión de unidades
Los cables para la conexión con las interfaces RS232 y Ethernet de la unidad deben estar
homologados por UL tipo DP-1 o DP-2. (Nota: cuando residen en circuito no de tipo LPS).
32
puede variar en función de las condiciones de instalación, incluido pero no limitado al número
de bastidores en la instalación, el tamaño general de la instalación, el rack y otros niveles de
material y ruido del equipo, los fallos del ventilador, la temperatura ambiente, la configuración
de la sala y la ubicación del empleado en relación con el equipo. El propietario del centro de
datos debe gestionar la conservación efectiva de las audiciones según la norma OSHA para
proteger a los empleados de la exposición prolongada al ruido.
Directiva WEEE
Conforme a la Directiva 2002/96/CE sobre RAEE, todos los residuos de equipos eléctricos y
electrónicos (EEE) se deben recolectar por separado y no se deben eliminar junto con
residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una
manera responsable y respetuosa con el medio ambiente.
Тяжелое оборудование
Это тяжелое оборудование, поэтому его следует перемещать с помощью механического
подъемника во избежание травм.
33
Опасность поражения электрическим током! Когда снят вентиляторный модуль,
существует возможность повреждения контактов питания в его углублении. НЕ вставлять
инструменты или части тела в углубление вентиляторного модуля.
Перегрев
Не эксплуатировать это оборудование в помещении с температурой окружающей среды,
превышающей максимально рекомендуемое значение: 45 °C (113 °F). Более того, для
надлежащей вентиляции следует обеспечить зазор вокруг вентиляционных отверстий не
менее 8 см (3 дюйма).
34
Установка оборудования
Устанавливать, заменять и/или обслуживать это оборудование должен только
подготовленный и квалифицированный персонал.
Утилизация оборудования
Это оборудование утилизируется в соответствии с национальными законами и
постановлениями.
Замена аккумулятора
Осторожно! Заменять только аккумулятором, одобренным организацией UL и
рассчитанным на максимальный аномальный зарядный ток не менее 4 мА. Существует
риск взрыва при замене аккумулятора другим аккумулятором неправильного
типа. Отработавшие аккумуляторы утилизируются в соответствии с указаниями.
35
Защита от перегрузки по току
Цепь подвода питания дожна быть оборудована устройством защитного отключения от сети
на ток 20А, которое находится в легкодоступном месте.
Подсоединение устройств
Для подключения к разъемам RS232 и Ethernet используются кабели типа DP-1 или DP-2,
сертифицированные организацией UL. (Примечание. При подключении к сети без
ограниченного источника электропитания).
Директива WEEE
В соответствии с Директивой 2002/96/EC (WEEE) отходы электрического и
электронного оборудования должны собираться и утилизироваться отдельно от
обычных бытовых отходов. Следует утилизировать это изделие и все его части
ответственным и экологически безопасным способом.
36
Citiţi toate instrucţiunile de instalare înainte de a conecta.
Echipament greu
Acest echipament este greu şi trebuie să fie mutat folosind un dispozitiv mecanic de ridicare
pentru a evita producerea de leziuni.
Temperatură în exces
Acest echipament nu trebuie să fie acţionat într-o zonă unde temperatura ambiantă depăşeşte
valoarea maximă recomandată: 45°C (113°F). În plus, pentru a asigura un flux de aer adecvat,
lăsaţi un spaţiu liber de cel puţin 8 cm (3 inchi) în jurul fantelor de ventilare.
Suprapunerea cadrului
Cadrul nu trebuie să fie suprapus peste niciun alt echipament. În cazul în care cadrul cade,
poate cauza leziuni corporale şi deteriorări ale echipamentului.
37
Risc de şoc electric şi pericol electric. Toate aparatele cu alimentare de la reţea sunt
independente. Deconectaţi toate sursele de alimentare cu energie pentru a asigura decuplarea
în interiorul platformei de comutare.
Instalarea echipamentului
Acest echipament trebuie să fie instalat, înlocuit şi/sau depanat numai de către personal
instruit şi calificat.
Eliminarea echipamentului
Eliminarea acestui echipament trebuie să se realizeze în conformitate cu toate legile şi
regulamentele naţionale.
Codurile ed instalare
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor electrice
naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să fie instalat
conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul electric canadian.
Înlocuirea bateriei
Avertisment: Înlocuiţi numai cu o baterie recunoscută UL, certificată pentru curent de
încărcare anormal maxim de minimum 4 mA
Există risc de explozie în cazul în care bateria este înlocuită cu o baterie necorespunzătoare.
Eliminaţi bateriile folosite în conformitate cu instrucţiunile.
38
Pentru conectarea la o sursă de alimentare pentru America de Nord, selectaţi un cordon de
alimentare care este înregistrat UL şi certificat CSA, cu 3 conductoare, [16 AWG], terminat cu o
fişă turnată, cu putere nominală egală cu 125 V, [13 A], cu o lungime de minimum 1,5 m [şase
picioare], dar nu mai lung de 4,5 m.
Pentru conectarea la o sursă de alimentare în Europa, selectaţi un cordon de alimentare care
este armonizat la nivel internaţional şi marcat „<HAR>”, cu 3 conductoare, cu minimum 2 fire
de 1,0 mm, cu putere nominală egală cu 300 V şi cu o manta izolantă din PVC. Cordonul de
alimentare trebuie să fie prevăzut cu o fişă turnată cu putere nominală egală cu 250 V, 10 A.
Codurile de instalare
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor electrice
naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să fie instalat
conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul electric canadian.
Interconectarea unităţilor
Cablurile pentru conectarea la unitatea RS232 şi la interfeţele Ethernet trebuie să fie de tipul
DP-1 sau DP-2 certificate UL. (Notă- când se regăsesc într-un circuit non-LPS).
39
Directiva DEEE
În conformitate cu Directiva DEEE 2002/96/CE, toate deşeurile de echipamente electrice
şi electronice (EEE) trebuie colectate separat şi nu trebuie eliminate împreună cu
deşeurile menajere obişnuite. Eliminaţi acest produs şi toate componentele sale în mod
responsabil şi ecologic.
Teška oprema
Ova oprema je vrlo teška i treba se premještati pomoću mehaničkog dizala kako bi se izbjegle
ozljede.
Pregrijavanje
Ovom se opremom ne bi trebalo rukovati u područjima s temperaturom okoline koja premašuje
najviše preporučene vrijednosti: 45°C (113°F). Osim toga, kako bi se osigurao odgovarajući
protok zraka, omogućite najmanje 8 cm (3 inča) razmaka oko otvora ventilatora.
Slaganje kućišta
40
Kućište se ne bi trebalo slagati na drugu opremu. Ako kućište padne, može izazvati tjelesne
ozljede i oštećenje opreme.
Dvopolni/neutralni osigurači
Ovaj sustav raspolaže dvopolnim/neutralnim osiguračima. Uklonite sve kabele napajanja prije
otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova.
Instaliranje opreme
Ovu bi opremu trebalo instalirati, zamjenjivati i/ili servisirati samo obučeno i kvalificirano
osoblje.
Odlaganje opreme
Odlaganje opreme trebalo bi se vršiti sukladno nacionalnim zakonima i propisima.
Instalacijski kodovi
41
Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih kodova
države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim zahtjevima
navedenim u US National Electrical Code i Canadian Electrical Code.
Zamjena baterije
Upozorenje: Bateriju zamijenite samo baterijom iz serije UL koja je certificirana za
maksimalnu nepravilnu struju punjenja ne manju od 4 mA
Postoji rizik od eksplozije ako se baterija zamijeni neodgovarajućom vrstom. Odložite prazne
baterije sukladno uputama.
Instalacijski kodovi
Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih kodova
države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim zahtjevima
navedenim u US National Electrical Code i Canadian Electrical Code.
Interkonekcija uređaja
Kabeli za spajanje na jedinicu RS232 i Ethernet sučelja moraju biti s UL certifikatom vrste DP-1
ili DP-2. (Napomena - kad se nalazi u krugu bez LPS vodiča).
42
Pozor: Oprema montirana na klizače/vodilice ne bi se trebala koristiti kao polica ili radna
površina. Vodilice nisu namijenjene za povlačenje uređaja iz ormarića. Služe samo za
trajnu instalaciju na konačnom položaju, a ne za servisiranje i održavanje.
WEEE direktiva
Sukladno WEEE direktivi 2002/96/EZ, sav električni i elektronički otpad (EEE) trebao bi se
prikupljati zasebno i ne bi se trebao odlagati kao običan kućanski otpad. Odlaganje ovog
proizvoda i svih njegovih dijelova vršite na odgovoran i ekološki način.
Apparecchiatura pesante
Questa apparecchiatura è molto pesante e va spostata mediante un sollevatore meccanico, per
evitare lesioni.
Temperatura eccessiva
Questa apparecchiatura non va utilizzata in un’area con una temperatura ambiente superiore a
quella massima consigliata: 45 °C (113 °F). Inoltre, per assicurare un flusso d’aria adeguato,
lasciare almeno 8 cm (3 pollici) di spazio attorno alle aperture di ventilazione.
43
Impilare lo chassis
Kućište se ne bi trebalo slagati na drugu opremu. Ako kućište padne, može izazvati tjelesne
ozljede i oštećenje opreme.
Fusibili fase/neutro
Questo sistema dispone di fusibili fase/neutro. Rimuovere tutti i cavi di alimentazione prima di
aprire il coperchio di questo prodotto o di toccare parti interne.
Installazione dell’apparecchiatura
Questa apparecchiatura va installata, sostituita e/o sottoposta a manutenzione solo da
personale addestrato e qualificato.
Smaltimento dell’apparecchiatura
Lo smaltimento di questa apparecchiatura va effettuato in conformità con tutte le leggi e le
normative nazionali.
44
Codici di installazione
Questo dispositivo va installato in conformità con l’ultima versione dei codici elettrici nazionali
del Paese. Per il Nord America, l’apparecchiatura va installata in conformità con i requisiti
applicabili del “codice elettrico nazionale USA” e del “codice elettrico canadese”.
Codici di installazionei
Questo dispositivo va installato in conformità con l’ultima versione dei codici elettrici nazionali
del Paese. Per il Nord America, l’apparecchiatura va installata in conformità con i requisiti
applicabili del “codice elettrico nazionale USA” e del “codice elettrico canadese”.
45
proprietario del data center dovrebbe adottare misure efficaci di protezione dell'udito secondo
lo standard OSHA per tutelare i dipendenti dalla sovraesposizione al rumore.
Direttiva RAEE
Secondo la direttiva RAEE 2002/96/EC, tutti i rifiuti da apparecchiature elettriche ed
elettroniche (RAEE) vanno raccolti separatamente e non smaltiti nei normali rifiuti
domestici. Smaltire questo prodotto e tutte le sue parti in modo responsabile e rispettoso
dell’ambiente
Ağır Ekipman
Bu ekipman çok ağırdır ve yaralanmaları önlemek için ekipmanın mekanik asansör kullanılarak
taşınması gerekir.
46
Fan modülüyle çıkarılan güç pimlerine modül boşluğu içinde erişilebilir. Fan modülü boşluğuna
alet veya gövde parçaları yerleştirmeyin.
Aşırı ısınma
Bu ekipman, önerilen maksimum ortam sıcaklığını aşan alanlarda çalıştırılmamalıdır: 45 °C (113
°F). Ayrıca, düzgün hava akışı sağlamak için havalandırma deliklerinin etrafında en az 8 cm (3
inç) açıklık bırakılmalıdır.
Şasi İstif
Şasinin diğer herhangi bir ekipmanın üzerine istiflenmemesi gerekir. Şasi düşerse, fiziksel
yaralanmalara ve ekipmanda hasara neden olabilir.
Ekipman Montajı
Ekipmanın yalnızca eğitimli ve nitelikli personel tarafından monte edilmesi, değiştirilmesi ve/
veya bakımının yapılması gerekir.
Ekipmanın Atılması
Bu ekipmanın imhasında tüm ulusal yasalara ve düzenlemelere uyulması gerekir.
47
Yerel ve Ulusal Elektrik Kodları
Bu ekipmanın montajında yerel ve ulusal elektrik kodlarına uyulması gerekir.
Montaj Kodları
Bu cihazın, ülke ulusal elektrik kodlarının son sürümüne göre monte edilmesi gerekir. Kuzey
Amerika için, ekipmanın ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu'nun uygulama
koşullarına göre monte edilmesi gerekir.
Pilin Değiştirilmesi
Uyarı: Yalnızca, maksimum düzgüsüz şarj akımı 4mA'dan az olmayan, UL Onaylı pillerle
değiştirin. Yanlış pil türü ile değiştirildiğinde patlama tehlikesi bulunmaktadır. Kullanılmış
pillerden talimatlara uygun bir şekilde kurtulun.
Montaj Kodlarıi
Bu cihazın, ülke ulusal elektrik kodlarının son sürümüne göre monte edilmesi gerekir. Kuzey
Amerika için, ekipmanın ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu'nun uygulama
koşullarına göre monte edilmesi gerekir.
Aşırı Akım Koruması: Kolayca erişilebilecek 20 V Kayıtlı devre parçası aşırı akım koruma
cihazının bina elektrik şebekesinde kurulu olması gerekir.
48
çalışanları gürültüye uzun süreli ve aşırı maruz kalmaya karşı korumak için OSHA standardına
göre etkili bir işitme koruması yönetimi sağlamalıdır.
WEEE Yönergesi
WEEE Yönergesi 2002/96/EC uyarınca, tüm elektrikli ve elektronik ekipman atıkları (EEE)
ayrı olarak toplanmalı ve evsel atıklarla birlikte çöpe atılmamalıdır. Bu ürün ve tüm
parçaları çevreye dost ve sorumlu bir şekilde imha edilmelidir.
תקן ישראלי
ולעשות שימוש ביחידת חלוקת,יש להתקין את המוצר תוך הקפדה על תקנות החשמל הנהוגות בישראל
32 (כוח העומדת בתקן ישראל )ת”י
49
ציוד כבד
המוצר כבד ,ויש לשנעו באמצעות מעלית מכאנית כדי למנוע חבלה.
סכנת התחשמלות!
סכנת התחשמלות! בעת שיחידת המאוורר מפורקת ,רכיבי חשמל נחשפים בחלל הריק .אין להחדיר כלים או.
איברי גוף לחלל המיועד להרכבת היחידה
התחממות יתר
אין להפעיל את המוצר באיזור שבו טמפרטורת החדר עולה על הטמפרטורה המקסימלית.(113°F) 45°C :
המומלצת
בנוסף ,כדי להבטיח כניסת אוויר תקינה ,יש לוודא כי קיים שטח פנוי של 8ס”מ ) 3אינץ’( לפחות סביב פתחי.
האוורור
ערימת המערכת
אין לערום את המערכת על גבי ציוד אחר .במקרה של נפילה ,עשויים להגרם נזקי גוף ורכוש.
50
כאשר מרכיבים מוצר זה על גבי מדף בארון ,יש לנקוט באמצעי זהירות מיוחדים בכדי להבטיח שיוותר יציב..
ככלל ,יש להתחיל למלא את הארון מהמדף התחתון ,ולהתקדם כלפי מעלה
התקנת המוצר
כל התקנה ,החלפה או טיפול במוצר זה חייבות להתבצע על ידי איש צוות מיומן ומוסמך בלבד.
תקנות התקנה
יש להתקין מערכת זו על פי הגרסה האחרונה של תקנות החשמל המקומיות הנהוגות במדינה .עבור צפון.
אמריקה ,יש להתקין את המערכת בהתאם לתקנות החשמל הלאומיות המיושמות בארה”ב ובקנדה
רמת העוצמה האקוסטית המצוינת בפרק המפרטים מתייחסת לרעש מוצר שנמדד בהתאם לתקן ISO 7779
בתנאים נומינליים .רמת הרעש בפועל עשויה להשתנות בהתאם לתנאי ההתקנה ,הכוללים אך לא מוגבלים
למספר הכונניות בהתקנה ,היקף ההתקנה הכולל ,החומרים שמהם עשויות הכונניות ועשוי שאר הציוד ,וכן רמות
רעש ,תקלות מאוורר ,טמפרטורת ותצורת החדר ומיקום העובד ביחס לציוד .על האחראי על מרכז הנתונים
להנהיג מדיניות יעילה של הגנה על שמיעת העובדים בהתאם לתקן ,OSHAוזאת כדי להגן עליהם מפני חשיפה
מוגזמת וממושכת לרעש.
51
אין להשתמש במערכת כמדף או כשטח עבודה
. אלא, המסילות לא נועדו לשליפת המערכת מהארון. אין להשתמש בציוד כמדף או כשטח עבודה:זהירות
להתקנת המערכת במיקומה הקבוע והסופי בארון
תקנתWEEE
,WEEE 2002/96/EC על פי תקנות
. השלך, בתןם השימוש.יש להשליך את כל פסולת הציוד החשמלי והאלקטרוני בנפרד מפסולת ביתית רגילה
לאשפה את המוצר הזה ואת כל חלקיו באופן אחראי וידידותי לסביבה
• Connector (front) side inlet to power side outlet - marked with red dots that are placed on
the power inlet side.
Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet
• All servers and systems in the same rack should be planned with the same airflow
direction.
• All FRU components need to have the same air flow direction. A mismatch in the air
flow will affect the heat dissipation.
The table below provides an air flow color legend and respective OPN designation.
52
Direction Description and OPN Designation
Power side inlet to connector side outlet. Blue indicators are placed on
the power inlet side.
OPN designation is “-F”.
Connector side inlet to power side outlet. Red indicators are placed on
the power inlet side.
OPN designation is “-R”.
53
Prior to the installation procedure, inspect all rail-kit components and make sure none of
them is missing or damaged. If anything is missing or damaged, contact your NVIDIA
representative at [email protected].
The following parts are included in the tool-less rail kit (see figure below):
• 2x System Rails (A)
• 2x Rack Rails (B)
Prerequisites:
Before mounting the system to the rack, select the way you wish to place the system. Pay attention
to the airflow within the rack cooling, connector and cabling options.
While planning how to place the system, review the two installation options shown in the table
below, and consider the following points:
• Make sure the system air flow is compatible with your installation selection. It is important to
keep the airflow within the rack in the same direction.
• Note that the part of the system to which you choose to attach the rails (the front panel
direction, as demonstrated in Option 1 or the FRUs direction, as demonstrated in Option 2)
will determine the system’s adjustable side. The system’s part to which the brackets are
attached will be adjacent to the cabinet.
• The FRUs, as well as high-speed and MNG cables, must be extracted for replacement as part
of the switch service. Consider this when planning the switch installation.
54
The following steps include illustrations that show front side (ports) installation, yet all
instructions apply to all installation options.
1. Attach the left and right system rails (A) to the switch.
Attaching the System Rails (A) to the Switch
2. Secure the assembly by gently pushing the system chassis’ pins through the slider key holes,
until locking occurs
55
Securing the System in the Switch Rails (A)
3. Mount both of the rack rails (B) into the rack by angularly inserting the brakes located at the
rails edges into the designated slots in the rack unit, as shown in the following figure:
56
Inserting the Rack Rails (B)
4. Align both rack rails (B) to sit horizontally in parallel to the rack assembly. By straightening
the rails' angular position, their breaks will be caught and locked in the rack's slots.
Aligning the Rack Rails (B) Angular The Breaks are Caught and Locked in the
Position Rack's Slots
57
Rack Rails Fully Inserted and Locked in the Rack Assembly
5. Pull the rack rails' telescopic extensions all the way to the rack's opposite side, and insert the
latches at the rails' free edges to the rack's slots. A click should be heard as the spring latches
are fully inserted and locking occurs.
58
Pulling the Rails Telescopic Extensions In
s
e
rt
in
g
t
h
e
S
p
ri
n
g
L
a
tc
h
e
s
t
o
t
h
e
R
a
c
k'
s
Sl
o
ts
At least two people are required to safely mount the system in the rack.
While your installation partner is supporting the system’s weight, perform the following
steps:
6. Slide the rails installed on the system into the channels in the rack rails. Push them forward
until the locking mechanism is activated on both sides, and a click is heard.
7. Tighten the captive screws on both sides to further secure the system to the rack's posts.
Sliding the System's Rails (A) into the Rack Rails (B)
59
Sliding the System Rails (A) into the Rack Rails Tightening the Captive Screws
(B)
4. Press the spring latches on both sides of the rack, and continue to pull the system out until
the rack rails are clear of the system's rails.
60
Pressing the Spring Latches on Both Sides
5. Remove the rails from the system. Release the metal latches and pull out the rails, so the
system's pins will be removed out of the oval slots.
Removing the Rails from the System
6. Remove the rails from the rack by pressing the lock button, and pull the rails outside of the
rack assembly.
61
Pressing the Lock Button to Remove the Rails from the Rack
When installing retainers for the PSUs of the QM97x0 switch systems, please adhere to the following
instructions:
1. Verify the integrity of the retainer assembly, as demonstrated in the below table:- The snaps'
push-pins must have visible edges with no broken or torn parts.
- The shoulders' pins should be in-tact and must not be bent inwards.
62
Proper Condition Improper Condition
2. It is advised to place the PSU on a flat, stable surface. While you secure the PSU in place, use
two thumbs to insert the retainer's two snaps into the designated holes located near the AC
inlet. Make sure that the retainer's plastic loop is facing upwards, as demonstrated in the
below table.
For demonstration purposes, the images in this document show C2P (Connector-to-
Power) airflow PSUs with red latches, yet the instructions apply to P2C (Power-to-
Connector) PSUs with blue latches as well.
3. Push the retainer until the shoulders' pins (in blue circles below) are open and aligned with
the PSU front panel, as shown in the following table:
63
Fully Mated Retainer
4. Make sure that the retainer is fully locked in place by gently attempting to pull it outwards.
5. Open the plastic loop and route the AC cord through it. Locate the loop over the AC cord, as
shown in the following table, and fasten it tightly.
Proper Loop Placement Improper Loop Placement
Each cable retainer can be used once only. Once the retainer has been fully inserted and
the shoulders' pins have been adjusted, the retainer cannot be used again, and should be
discarded if pulled out.
To insert a cable, press the connector into the port receptacle until the connector is firmly seated.
The LED indicator, corresponding to each data port, will light when the physical connection is
established. When a logical connection is made, the relevant port LED will turn on.
64
To remove a cable, disengage the locks and slowly pull the connector away from the port
receptacle. The LED indicator for that port will turn off when the cable is unseated.
For full cabling guidelines, ask your NVIDIA representative for a copy of NVIDIA Cable Management
Guidelines and FAQs Application Note.
Do not force the cable into the cage with more than 40 newtons/9.0 pounds/4kg force.
Greater insertion force may cause damage to the cable or to the cage.
Unused OSFP cages must be closed with the thermal caps supplied with the system.
Cable Orientation
Splitting a port changes the notation of that port from x/y/z to x/y/z/i, with “x/y/z” indicating the
previous notation of the port prior to the split, and “i” indicating the number of the resulting single-
lane port (1,2). Each sub-physical port is then handled as an individual port. For example, splitting
port 1/5/1 into 2 lanes results in ports 1/5/1/1 and 1/5/1/2. For full notation schematics, see Port
Notation Schematics.
The following behavior should be expected when disconnecting a 1:2 splitter cable (from
cages in both the upper and lower rows):
• When you disconnect a cable marked as “1”, the CLI <cage number>/1 will always go
down, and the left LED of the cage will be turned off.
• When you disconnect the cable marked as “2”, the CLI <cage number>/2 will always
go down, and the right LED of the cage will be turned off.
65
Breakout Cable Example
For more information on how to change the system’s profile to allow Split-Ready configuration, how
to change the module type to a split mode, and how to unsplit a split port when using QM9700,
please refer to the "InfiniBand Switching" chapter in the latest MLNX-OS® User Manual. For QM9790,
please refer to latest NVIDIA Firmware Tools (MFT) Documentation.
All NDR ports are splittable. Each OSFP cage contains two NDR ports of 400G, and each
NDR port can be split to two.
Two port notation profiles can be selected for the QM97x0 NDR switch systems. In both cases, each
cage in the system's front panel holds two ports from the same ASIC, and the cage numbers are
global:
1. ASIC/Cage/Port:
66
2. ASIC/Cage/Port/Split:
Two profiles can be selected for the QM97x0 NDR switch systems. The first one defines the system as
a pure 64-port NDR (32 cages) switch. The other profile permits any or all NDR ports to be split into
two 2X (NDR200) ports. The following diagrams attempt to show how the logical ports map onto the
physical NDR ports, as viewed by the IB tools (e.g. ibnetdiscover):
The IB tools report 65 logical ports. Port 65 is an internal port used for the SHARP
Aggregation Node when SHARP is enabled.
Note: The IB tools will report 129 logical ports. Port 129 is an internal port used for the
SHARP Aggregation Node when SHARP is enabled.
The power cords should be standard 3-wire AC power cords including a safety ground and rated for
15A or higher.
The system platform will automatically power on when AC power is applied. There is no
power system. Check all boards, power supplies, and fan tray modules for proper insertion
before plugging in a power cable.
67
It may take up to five minutes to turn on the system. If the System Status LED shows
amber after five minutes, unplug the system and call your NVIDIA representative for
assistance.
4. Check the frontal System Status LEDs and confirm that all of the LEDs show status lights
consistent with normal operation (initially flashing, and then moving to a steady color) as
shown below. For more information, refer to LED Notifications.
System Status LEDs 5 Minutes After Power On
After inserting a power cable and confirming the green System Status LED light is on, make
sure that the Fan Status LED shows green. If the Fan Status LED is not green, unplug the
power connection and check that all fan modules are inserted properly and that the mating
connector of the fan unit is free of any dirt and/or obstacles. If no obstacles were found
and the problem persists, call your NVIDIA representative for assistance.
• Risk of electric shock and energy hazard. The two power supply units are
independent. Disconnect all power supplies to ensure a powered down state inside of
the switch platform.
• ACHTUNG Gafahr des elektrischen Schocks. Entferrnen des Netzsteckers elnes
Netzteils spannungsfrei. Um alle Einhieten spannungsfrei zu machen sind die
Netzstecker aller Netzteile zu entfernen.
• ATTENTION Risque de choc et de danger e’lectriques. Le de’branchment d’une seule
alimentation stabilise’e ne de’branch uniquement qu’un module “Alimentation
Stabilise’e”. Pour isoler completement le module en cause, Il faut de’brancher
toutes les alimentations stabilise’es.
• 電擊與能源危害的危險。所有 PSU 均各自獨立。將所有電源供應器斷電,確保交換器平
台內部在電源關閉狀態。
68
In order to query the system, perform firmware upgrade or other firmware operation. Refer to the
latest Mellanox Firmware tools (MFT) located on https://network.nvidia.com/products/adapter-
software/firmware-tools/.
# flint -d <device> q
2. Compare the results of this command with the latest version for your system posted on
https://network.nvidia.com/products/adapter-software/firmware-tools/.
3. If the current version is not the latest version, follow the directions in the MFT User Manual
to burn the new firmware.
If a user connects through SSH, runs the wizard and turns off DHCP, the connection is immediately
terminated, as the management interface loses its IP address. In such a case, the serial connection
should be used.
69
Make sure to connect to the Console RJ45 port, and not to the (Ethernet) MGT port.
Pay attention to the icons:
Console RJ45
Ethernet MGT
2. Configure a serial terminal program (for example, HyperTerminal, minicom, or Tera Term) on
your host PC with the settings described in the table below. Once you perform that, you
should get the CLI prompt of the system.
Serial Terminal Program Configuration
Parameter Setting
Baud Rate 115200
Data bits 8
Stop bits 1
Parity None
Flow Control None
... .
This terminal is not active for input or output while booting.
Boot Menu .
-------------------------------------------------------------------
0: <image #1>
1: <image #2>
-------------------------------------------------------------------
Highlighted entry is 0:
The boot menu features a countdown timer. It is recommended to allow the timer to run out
by not selecting any of the options.
4. Login as admin and use admin as password. If the machine is still initializing, you might not
be able to access the CLI until initialization completes. As an indication that initialization is
ongoing, a countdown of the number of remaining modules to be configured is displayed in
the following format: “<no. of modules> Modules are being configured”.
5. Go through the Switch Management configuration wizard.
IP Configuration by DHCP
70
Wizard Session Display (Example) Comments
Do you want to use the wizard for initial configuration? yes You must perform this
configuration the first time you
operate the switch or after
resetting the switch to the
factory defaults. Type “y” and
then press <Enter>.
Step 1: Hostname? [switch-1] If you wish to accept the
default hostname, then press
<Enter>. Otherwise, type a
different hostname and press
<Enter>.
Step 2: Use DHCP on mgmt0 interface? [yes] Perform this step to obtain an
IP address for the switch.
(mgmt0 is the management
port of the switch.)
- If you wish the DHCP server
to assign the IP address, type
“yes” and press <Enter>.
If you type “no” (no DHCP),
then you will be asked whether
you wish to use the “zeroconf”
configuration or not. If you
enter “yes” (yes Zeroconf), the
session will continue as shown
in the "IP zeroconf
configuration" table.
If you enter “no” (no
Zeroconf), then you need to
enter a static IP, and the
session will continue as shown
in the "Static IP configuration"
table.
Step 3: Enable IPv6 [yes] Perform this step to enable
IPv6 on management ports.
If you wish to enable IPv6, type
“yes” and press <Enter>.
If you enter “no” (no IPv6),
then you will automatically be
referred to Step 5.
Step 4: Enable IPv6 autoconfig (SLAAC) on mgmt0 interface Perform this step to enable
StateLess address autoconfig
on external management port.
If you wish to enable it, type
“yes” and press <Enter>.
If you wish to disable it, enter
“no”.
Step 5: Use DHCPv6 on mgmt0 interface? [yes] Perform this step to enable
DHCPv6 on the MGMT0
interface.
Step 6: Update time? Perform this step to change the
time configured. Press enter to
leave the current time.
71
Wizard Session Display (Example) Comments
Step 7: Enable password hardening? Perform this step to enable/
disable password hardening on
your machine. If enabled, new
passwords will be checked
upon configured restrictions.
If you wish to enable it, type
“yes” and press <Enter>.
If you wish to disable it, enter
“no”.
Step 8: Admin password (Must be typed)? <new_password> To avoid illegal access to the
machine, please type a
password and then press
<Enter>.
Starting from the 3.8.2000
release, the user must type in
the admin password upon
initial configuration. Due to
Senate Bill No. 327, this stage
is required and cannot be
skipped.
Step 9: Confirm admin password? <new_password> Confirm the password by re-
entering it. Note that password
characters are not printed.
Step 10: Monitor password (Must be typed)? <new_password> To avoid illegal access to the
machine, please type a
password and then press
<Enter>.
Starting from the 3.8.2000
release, the user must type in
the admin password upon
initial configuration. Due to
Senate Bill No. 327, this stage
is required and cannot be
skipped.
Step 11: Confirm monitor password? <new_password> Confirm the password by re-
entering it. Note that password
characters are not printed.
You have entered the following information: The wizard displays a summary
Hostname: <switch name>
Use DHCP on mgmt0 interface: yes of your choices and then asks
Enable IPv6: yes you to confirm the choices or
Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: yes to re-edit them.
Enable DHCPv6 on mgmt0 interface: no
Either press <Enter> to save
Update time: <current time>
Enable password hardening: yes changes and exit, or enter the
Admin password (Enter to leave unchanged): (CHANGED) configuration step number that
To change an answer, enter the step number to return to. you wish to return to.
Otherwise hit <enter> to save changes and exit.
Choice: <Enter> To run the command
Configuration changes saved. “configuration jump-start” you
To return to the wizard from the CLI, enter the “configuration must be in Config mode.
jump-start” command
from configuration mode. Launching CLI...
<switch name> [standalone: master] >
72
Wizard Session Display (Example) Comments
Do you want to use the wizard for initial You must perform this configuration the first time
configuration? yes
you operate the switch or after resetting the
switch to the factory defaults. Type “y” and then
press <Enter>.
Step 1: Hostname? [switch-1] If you wish to accept the default hostname, then
press <Enter>. Otherwise, type a different
hostname and press <Enter>.
Step 2: Use DHCP on mgmt0 interface? [yes] Perform this step to obtain an IP address for the
switch. (mgmt0 is the management port of the
switch.)
If you wish the DHCP server to assign the IP
address, type “yes” and press <Enter>.
If you type “no” (no DHCP), then you will be asked
whether you wish to use the “zeroconf”
configuration or not. If you enter “yes” (yes
Zeroconf), the session will continue as shown in
the IP zeroconf configuration" table.
If you enter “no” (no Zeroconf), then you need to
enter a static IP, and the session will continue as
shown in the "Static IP configuration" table.
Step 3: Enable IPv6 [yes] Perform this step to enable IPv6 on management
ports.
If you wish to enable IPv6, type “yes” and press
<Enter>.
If you enter “no” (no IPv6), then you will
automatically be referred to Step 5.
Step 4: Enable IPv6 autoconfig (SLAAC) on mgmt0 Perform this step to enable StateLess address
interface
autoconfig on external management port.
If you wish to enable it, type “yes” and press
<Enter>.
If you wish to disable it, enter “no”.
Step 5: Use DHCPv6 on mgmt0 interface? [yes] Perform this step to enable DHCPv6 on the MGMT0
interface.
Step 6: Admin password (Press <Enter> to leave To avoid illegal access to the machine, please type
unchanged)? <new_password>
a password and then press <Enter>.
Step 7: Confirm admin password? <new_password> Confirm the password by re-entering it.
(this step only happens if you change the Note that password characters are not printed.
password)
Step 9: HA Chassis Management IP netmask? Perform this step to configure the box IPv4
(Example: [255.255.255.0])
netmask.
If you wish to accept the default value, type “yes”
and press <Enter>.
Otherwise, enter the desired box IPv4 netmask
Step 10: HA Chassis IPv6 address? (Example: Perform this step to configure the box IPv6.
[fdfd:fdfd:7:145::1000:4814])
If you wish to accept the default value, type “yes”
and press <Enter>.
Otherwise, enter the desired box IPv6
73
Wizard Session Display (Example) Comments
Step 11: HA Chassis Management IPv6 masklen? Perform this step to configure the box IPv6
(Example: [33])
masklen.
If you wish to accept the default value, type “yes”
and press <Enter>.
Otherwise, enter the desired box IPv6 masklen.
You have entered the following information: The wizard displays a summary of your choices and
Hostname: <switch name>
Use DHCP on mgmt0 interface: yes then asks you to confirm the choices or to re-edit
Enable IPv6: yes them.
Enable IPv6 autoconfig (SLAAC) on mgmt0 Either press <Enter> to save changes and exit, or
interface: yes
enter the configuration step number that you wish
Enable DHCPv6 on mgmt0 interface: yes
Admin password (Enter to leave unchanged): to return to.
(CHANGED) To run the command “configuration jump-start”
HA Chassis IP address: 10.6.166.200 you must be in Config mode.
HA Chassis Management IP netmask: 255.255.255.0
HA Chassis IPv6 address:
fdfd:fdfd:7:145::1000:4814
HA Chassis Management IPv6 masklen: 33
To change an answer, enter the step number to
return to.
Otherwise hit <enter> to save changes and exit.
Choice: <Enter>
Configuration changes saved.
To return to the wizard from the CLI, enter the
“configuration jump-start” command
from configuration mode. Launching CLI...
<switch name> [standalone: master] >
Static IP Configuration
74
Wizard Session Display (Example)
Do you want to use the wizard for initial configuration? y
Step 1: Hostname? [switch-112126]
Step 2: Use DHCP on mgmt0 interface? [yes] n
Step 3: Use zeroconf on mgmt0 interface? [no]
Step 4: Primary IP address? 192.168.10.4
Mask length may not be zero if address is not zero (interface mgmt0)
Step 5: Netmask? [0.0.0.0] 255.255.255.0
Step 6: Default gateway? 192.168.10.1
Step 7: Primary DNS server?
Step 8: Domain name?
Step 9: Enable IPv6? [yes] yes
Step 10: Enable IPv6 autoconfig (SLAAC) on mgmt0 interface? [no] no
Step 11: Update time? [yyyy/mm/dd hh:mm:ss]
Step 12: Enable password hardening? [yes] yes
Step 13: Admin password (Enter to leave unchanged)?
You have entered the following information:
Hostname: switch-112126
Use DHCP on mgmt0 interface: no
Use zeroconf on mgmt0 interface: no
Primary IP address: 192.168.10.4
Netmask: 255.255.255.0
Default gateway: 192.168.10.1
Primary DNS server:
Domain name:
Enable IPv6: yes
Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: no
Update time: yyyy/mm/dd hh:mm:ss
Enable password hardening: yes
Admin password (Enter to leave unchanged): (unchanged)
To change an answer, enter the step number to return to.
Otherwise hit <enter> to save changes and exit.
Choice:
Configuration changes saved.
To return to the wizard from the CLI, enter the “configuration jump-start” command from configure
mode. Launching CLI...
<hostname>[standalone: master] >
IP Zeroconf Configuration
75
Wizard Session Display (Example)
Configuration wizard
Hostname: switch-112126
Use DHCP on mgmt0 interface: no
Use zeroconf on mgmt0 interface: yes
Default gateway: 192.168.10.1
Primary DNS server:
Domain name:
Enable IPv6: yes
Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: yes
Update time: yyyy/mm/dd hh:mm:ss
Enable password hardening: yes
Admin password (Enter to leave unchanged): (unchanged)
Choice:
To return to the wizard from the CLI, enter the “configuration jump-start”
command from configure mode. Launching CLI...
<hostname> [standalone: master] >
76
Wizard Session Display (Example)
Configuration wizard
1. Hostname: sw-mantaray-201-mgmt1
2. Use DHCP on mgmt0 interface: yes
3. Enable IPv6: yes
4. Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: no
5. Enable DHCPv6 on mgmt0 interface: yes
6. Admin password (Enter to leave unchanged): (unchanged)
7. HA Chassis IP address: 10.6.166.200
8. HA Chassis Management IP netmask: 255.255.255.0
9. HA Chassis IPv6 address: fdfd:fdfd:7:145::1000:4814
10. HA Chassis Management IPv6 masklen: 33
Choice:
Configuration changes saved.
To return to the wizard from the CLI, enter the “configuration jump-start”
command from configure mode. Launching CLI...
<hostname> [standalone: master] >
6. Check the mgmt0 interface configuration before attempting a remote (for example, SSH)
connection to the switch. Specifically, verify the existence of an IP address.
IPv6 address:
fe80::268a:7ff:fe53:3d8e/64
77
Speed : 1000Mb/s (auto)
Duplex : full (auto)
Interface type : ethernet
Interface source: physical
MTU : 1500
HW address : 00:02:c9:11:a1:b2
Rx:
11700449 bytes
55753 packets
0 mcast packets
0 discards
0 errors
0 overruns
0 frame
Tx:
5139846 bytes
28452 packets
0 discards
0 errors
0 overruns
0 carrier
0 collisions
1000 queue len
For more information, please refer to the “Zero-touch Provisioning” section in the "Getting Started"
chapter of the latest MLNX-OS User Manual.
Password:
78
Last login: <time> from <ip-address>
NVIDIA Switch
Please read and accept the End User License Agreement located at:
https://www.mellanox.com/related-docs/prod_management_software/MLNX-OS_EULA.pdf
switch >
For additional information about MLNX-OS, refer to the MLNX-OS User Manual located on https://
docs.nvidia.com/networking/category/mlnxos.
Make sure that the power supply unit that you are NOT replacing is showing all green, for
both the power supply unit and the rear System Status LEDs.
Power supply units have directional air flows similar to the fan module. The fan module
airflow must coincide with the airflow of all of the power supply units. If the power supply
unit airflow direction is different from the fan module airflow direction, the system’s
internal temperature will be affected. For power supply unit air flow direction, refer to Air
Flow.
79
PS Unit Pulled Out
Do not attempt to insert a power supply unit with a power cord connected to it.
2. Insert the power supply unit by sliding it into the opening, until a slight resistance is felt.
3. Continue pressing the power supply unit until it seats completely. The latch will snap into
place, confirming the proper installation.
4. Insert the power cord into the power supply connector.
5. Insert the other end of the power cord into an outlet of the correct voltage.
The green power supply unit indicator should light. If it does not, repeat the whole
procedure to extract the power supply unit and re-insert it.
2.21.2 Fans
The system can fully operate if one fan FRU is dysfunctional. Failure of more than one fan is not
supported.
Make sure that the fans have the air flow that matches the model number. An air flow
opposite to the system design will cause the system to operate at a higher (less than
optimal) temperature. For power supply unit air flow direction, refer to Air Flow.
When replacing a faulty fan unit in an operational switch system, do not leave the slot
unpopulated for more than 60 seconds.
1. Extract the fan by pulling the gold handle outwards. As the fan unit unseats, its status LEDs
will turn off.
80
2. Remove the fan unit.
Fan Module Latches
To remove or replace a fan unit, gently pull out its handle while pushing the latch release with
your index finger.
The green Fan Status LED should light. If not, extract the fan unit and reinsert it. After two
unsuccessful attempts to install the fan unit, power off the system before attempting any
system debug.
81
3 Software Management
Managed systems come with an embedded management CPU card that runs MLNX-OS® management
software. The MLNX-OS systems management package and related documentation can be
downloaded at https://docs.nvidia.com/networking/category/mlnxos.
Each network requires a Subnet Manager to be running in either the system itself (system based) or
on one of the nodes which is connected to the fabric (host based).
No more than two subnet managers are recommended for any single fabric.
The InfiniBand Subnet Manager running on the system supports up to 2048 nodes. If the fabric
includes more than 2048 nodes, you may need to purchase Mellanox's Unified Fabric Manager
(UFM®) software package.
Each subnet needs one subnet manager to discover, activate and manage the subnet.
Each network requires a Subnet Manager to be running in either the system itself (system based) or
on one of the nodes which is connected to the fabric (host based).
The subnet manager (OpenSM) assigns Local IDentifiers (LIDs) to each port connected to the fabric,
and develops a routing table based on the assigned LIDs.
A typical installation using the OFED package will run the OpenSM subnet manager at system start up
after the drivers are loaded. This automatic OpenSM is resident in memory, and sweeps the fabric
approximately every 5 seconds for new adapters to add to the subnet routing tables.
Use the CLI or the GUI in order to perform software upgrades. For further information please refer
to the Upgrading MLNX-OS® Software section in the MLNX-OS Software User Manual.
Be sure to read and follow all of the instructions regarding the updating of the software on your
system.
Managed systems do not require Firmware updating. Firmware updating is done through the MLNX-
OS management software. The system comes standard with a management software module for
system management called Mellanox Operating System (MLNX-OS). MLNX-OS® is installed on all
NVIDIA Mellanox Quantum™ based managed systems. MLNX-OS® includes a CLI, WebUI, SNMP, system
management software and IB management software (OpenSM).
82
The Ethernet ports for remote management connect to Ethernet systems. These systems
must be configured to 100Mb/1Gb/s auto-negotiation.
Firmware updates should normally be conducted in-band. The use of the MTUSB-1 device is intended
for cases of debug or firmware corruption and should be conducted by NVIDIA FAEs or Support
engineers, or by trained users at the customer's site.
Both types of updates require the installation of NVIDIA Mellanox Firmware Tools (MFT) package. The
MFT package and user manual are available for download under https://network.nvidia.com/
products/adapter-software/firmware-tools/. Please select the package that suits your operating
system.
In order to obtain information regarding the externally managed system, you must download the
NVIDIA Mellanox MFT tools from https://network.nvidia.com/products/adapter-software/firmware-
tools/.
Select and download the release that matches your system. Follow the instructions in the User
Manual https://docs.nvidia.com/networking/category/mft to get the tools.
# flint -d <device> q#
3. Compare the results of this command with the latest version for your system posted
on https://network.nvidia.com/support/firmware/firmware-downloads/ (select the
Quantum™ System page).
83
4. If the current version is not the latest version, follow the directions in the MFT User manual
to burn the new firmware inband.
84
4 Interfaces
The systems support the following interfaces:
• Data interfaces - InfiniBand
• 10/100/1000Mb Ethernet management interface (RJ45)*
• USB port (USB Type A)*
• RS232 Console port (RJ45)**
• I²C interface*
• Reset button
• Status and Port LEDs
In order to review the full configuration options matrix, refer to Management Interfaces, PSUs and
Fans.
Each OSFP port consists of 2 logical InfiniBand ports, and can be connected with OSFP cable or
connector for 40/56/100/200/400 Gb/s. The system offers Class 8 (17W) OSFP112 transceivers
support.
4.1.1 Speed
InfiniBand speed is auto-adjusted by the InfiniBand protocol. NVIDIA systems support QDR/FDR/EDR/
HDR/NDR InfiniBand.
• FDR is an InfiniBand data rate, where each lane of a 4X port runs a bit rate of 14.0625Gb/s
with 64b/66b encoding, resulting in an effective bandwidth of 56.25Gb/s.
• EDR is an InfiniBand data rate, where each lane of a 4X port runs a bit rate of 25Gb/s with
64b/66b encoding, resulting in an effective bandwidth of 100Gb/s.
• HDR is an InfiniBand data rate, where each lane of a 4X port runs a bit rate of 50Gb/s with
64b/66b encoding, resulting in an effective bandwidth of 200Gb/s.
• NDR is an InfiniBand data rate, where each lane of a 4X port runs a bit rate of 100Gb/s with
64b/66b encoding, resulting in an effective bandwidth of 400Gb/s.
The Console port is an RS232 serial port on the front side of the chassis that is used for initial
configuration and debugging. Upon first installation of the system, you need to connect a PC to this
85
interface and configure network parameters for remote connections. Refer to Configuring Network
Attributes to view the full procedure.
4.3 Management
The RJ45 Ethernet “MGT” port is labeled .
The Management RJ45 Ethernet ports provide access for remote management. The management
ports are configured with auto-negotiation capabilities by default (100MbE to 1GbE). The
management ports’ network attributes (such as IP Address) need to be pre-configured via the RS232
serial console port or by DHCP before use. Refer to Configuring Network Attributes to view the full
procedure.
4.4 USB
The USB interface is USB3.0 type A compliant and can be used by MLNX-OS software to connect to an
external disk for software upgrade or file management. The connector comes in a standard micro
USB shape. To view the full matrix of micro USB configuration options, refer to Management
Interfaces, PSUs and Fans.
4.5 I²C
The I²C connector is combined with the USB connector, and is located on the front side of the
system. It can be used with the I²C DB9 to micro USB splitting harness.
86
Only original NVIDIA cables supplied with the switch package can be used to connect
a switch system to the server.
Connecting any cable other than the NVIDIA supplied console cable may cause an I²C hang.
Using uncertified cables may damage the I²C interface.
Refer to the Replacement Parts Ordering Numbers appendix for harness details.
Do not use a sharp pointed object such as a needle or a push pin for pressing the
reset button. Use a flat object to push the reset button.
• To reset the system, push the reset button for less than 15 seconds.
• When using an Onyx (MLNX-OS) based system, keeping the reset button pressed for more than
15 seconds will reset the system and the “admin” password, this should allow you to enter
without a password and set a new password for the user “admin”.
4.7 LEDs
See .LED Notifications v1.0.
LEDs Symbols
Power Supply Units LEDs Shows the health of the power Green
supply units.
Unit Identifier LED Lights up on command through Off or blue when identifying a
the CLI. port
87
4.8.1 System Status LED
System Status LED - Front Side
It may take up to five minutes to turn on the system. If the System Status LED shows amber
after five minutes, unplug the system and call your NVIDIA representative for assistance.
88
Fan Status Front LED Assignments
Risk of Electric Shock! With the fan module removed, power pins are accessible within the
module cavity. Do not insert tools or body parts into the fan module cavity.
89
LED Behavior Description Action Required
Solid Green All plugged (one or two) power supplies N/A
are running normally.
Solid Amber One or both of the power supplies are Make sure the power cord is plugged in and
not operational or not powered up/ the active. If the problem resumes, the FRUs
power cord is disconnected. might be faulty, and should then be
replaced.
The power supply status LEDs on the rear side of the system are located on the PSUs themselves.
Each PSU has a single 2 color LED.
90
4.8.5 Port LEDs
Each time you press on the Lane Select Button, the Port LEDs display will switch to a different state,
as follows:
In InfiniBand system mode, the LED indicator, corresponding to each data port, will light orange
when the physical connection is established (that is, when the unit is powered on and a cable is
plugged into the port with the other end of the connector plugged into a functioning port). When a
logical connection is made the LED will change to green. When data is being transferred the light
will blink green.
91
Bandwidth Flashing Frequency in Hz Flashing Frequency in Seconds
0-25% 0.5Hz 1 sec On, 1 sec Off
25-50% 1Hz 0.5 sec On, 0.5 sec Off
50-75% 2Hz 0.25 sec On, 0.25 sec Off
75-100% 4Hz 0.125 sec On, 0.125 sec Off
Pull-out Tab
The images provided here are for illustration purposes only. The may not reflect the latest
version of the product nor all available models.
92
5 Troubleshooting
Problem Symptoms Cause and Solution
Indicato
r
LEDs System Status LED is blinking Cause: MLNX-OS software did not boot properly and only firmware
for more than 5 minutes is running.
Solution: Connect to the system via the console port, and check
the software status. You might need to contact an FAE if the
MLNX-OS software did not load properly.
System Status LED is amber Cause:
• Critical system fault (CPU error, bad firmware)
• Over temperature
Solution:
• Check environmental conditions (room temperature)
Fan Status LED is amber Cause: Possible fan issue
Solution:
• Check that the fan is fully inserted and nothing blocks the
airflow
• Replace the fan FRU if needed
Front PSU Status LED is Cause: Possible PSU issue
amber Solution:
• Check/replace the power cable
• Replace the PSU if needed
The activity LED does not Make sure that there is an SM running in the fabric.
light up (InfiniBand)
System The last software upgrade Solution:
boot failed on x86 based systems • Connect the RS232 connector (CONSOLE) to a laptop.
failure • Push the system’s reset button.
• Press the ArrowUp or ArrowDown key during the system boot.
GRUB menu will appear. For example:
93
6 Specifications
QM9700 and QM9790 Technical Specifications
Feature Value
Mechanical Size: 1.7” (H) x 17.2” (W) x26” (D),
43.6mm (H) x 438mm (W) x 660mm (D)
Mounting: 19” rack mount
Weight: 1 PSU: 13.6 kg
2 PSUs: 14.8 kg
Speed: 40, 56, 100, 200, 400 Gb/s per port
Connector cage: 32 OSFP
Environmental Temperature: Operational:
Forward air flow: 0° to 35°C
Reverse air flow: 0° to 40°C
Non-Operational: -40° to 70°C
Humidity: Operational: 10%-85% non-condensing
Non-Operational: 10%-90% non-condensing
Altitude: 3050m
Noise level: 78.4dBA at room temperature
Regulatory Safety: CB, cTUVus, CE, CU, S-Mark
EMC: EMC: CE, FCC, VCCI, ICES, RCM, WW: CQC, BSMI, KCC,
TEC, ANATEL
RoHS: RoHS compliant
Power Input Voltage: 1x/2x, 200-240Vac, 10A, 50/60Hz
For HVDC:
200-300 VDC 9.5A (for China only)
Global Power Consumption: QM9700:
Typical power with passive cables (ATIS): 747W
Max power with active cables: 1,720W
QM9790
Typical power with passive cables (ATIS): 640W
Max power with active cables: 1,610W
Main Devices CPU (in QM9700 only): Intel® Core™ i3 Coffee Lake
Switch: NVIDIA Quantum™-2 IC
94
7 Appendixes
The document contains the following appendixes:
95
7.3 Interface Specifications
7.3.1 OSFP Pin Description
Net Name PinNum Signal Description
GND 1 Ground
TX2P 2 Transmitter Data Non-Inverted
TX2N 3 Transmitter Data Inverted
GND 4 Ground
TX4P 5 Transmitter Data Non-Inverted
TX4N 6 Transmitter Data Inverted
GND 7 Ground
TX6P 8 Transmitter Data Non-Inverted
TX6N 9 Transmitter Data Inverted
GND 10 Ground
TX8P 11 Transmitter Data Non-Inverted
TX8N 12 Transmitter Data Inverted
GND 13 Ground
SCL 14 2-wire Serial interface clock
VCC1 15 +3.3V Power
VCC1 16 +3.3V Power
LPWn_PRSn 17 PRSn Low-Power Mode / Module Present
GND 18 Ground
RX7N 19 Receiver Data Inverted
RX7P 20 Receiver Data Non-Inverted
GND 21 Ground
RX5N 22 Receiver Data Inverted
RX5P 23 Receiver Data Non-Inverted
GND 24 Ground
RX3N 25 Receiver Data Inverted
RX3P 26 Receiver Data Non-Inverted
GND 27 Ground
RX1N 28 Receiver Data Inverted
RX1P 29 Receiver Data Non-Inverted
GND 30 Ground
GND 31 Ground
RX2P 32 Receiver Data Non-Inverted
96
Net Name PinNum Signal Description
RX2N 33 Receiver Data Inverted
GND 34 Ground
RX4P 35 Receiver Data Non-Inverted
RX4N 36 Receiver Data Inverted
GND 37 Ground
RX6P 38 Receiver Data Non-Inverted
RX6N 39 Receiver Data Inverted
GND 40 Ground
RX8P 41 Receiver Data Non-Inverted
RX8N 42 Receiver Data Inverted
GND 43 Ground
INT_RSTn 44 INT/RSTn Module Interrupt / Module Reset
VCC2 45 +3.3V Power
VCC2 46 +3.3V Power
SDA 47 2-wire Serial interface data
GND 48 Ground
TX7N 49 Transmitter Data Inverted
TX7P 50 Transmitter Data Non-Inverted
GND 51 Ground
TX5N 52 Transmitter Data Inverted
TX5P 53 Transmitter Data Non-Inverted
GND 54 Ground
TX3N 55 Transmitter Data Inverted
TX3P 56 Transmitter Data Non-Inverted
GND 57 Ground
TX1N 58 Transmitter Data Inverted
TX1P 59 Transmitter Data Non-Inverted
GND 60 Ground
97
RJ-45 Console and I²C interfaces are integrated in the same connector. Due to that,
connecting any cable other than the NVIDIA supplied console cable may cause an I²C hang.
Using uncertified cables may damage the I²C interface. Refer to the Replacement Parts
Ordering Numbers appendix for harness details.
Support the weight of the system when you remove the screws so that the system
does not fall.
7.4.2 Disposal
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE)
should be collected separately and not disposed of with regular household waste. Dispose of this
product and all of its parts in a responsible and environmentally friendly way.
98
99
8 Document Revision History
Date Revision Description
April 2023 1.3 Updated Cable Installation.
July 2022 1.2 Updated OPNs in:
• Ordering Information
• Installation
• Accessory and Replacement Parts
Updated Cable Installation.
February 2022 1.1 Updated Cable Installation.
November 2021 1.0 Initial release
100
Notice
This document is provided for information purposes only and shall not be regarded as a warranty of a certain
functionality, condition, or quality of a product. Neither NVIDIA Corporation nor any of its direct or indirect subsidiaries
and affiliates (collectively: “NVIDIA”) make any representations or warranties, expressed or implied, as to the accuracy
or completeness of the information contained in this document and assumes no responsibility for any errors contained
herein. NVIDIA shall have no liability for the consequences or use of such information or for any infringement of patents
or other rights of third parties that may result from its use. This document is not a commitment to develop, release, or
deliver any Material (defined below), code, or functionality.
NVIDIA reserves the right to make corrections, modifications, enhancements, improvements, and any other changes to
this document, at any time without notice. Customer should obtain the latest relevant information before placing orders
and should verify that such information is current and complete.
NVIDIA products are sold subject to the NVIDIA standard terms and conditions of sale supplied at the time of order
acknowledgement, unless otherwise agreed in an individual sales agreement signed by authorized representatives of
NVIDIA and customer (“Terms of Sale”). NVIDIA hereby expressly objects to applying any customer general terms and
conditions with regards to the purchase of the NVIDIA product referenced in this document. No contractual obligations
are formed either directly or indirectly by this document.
NVIDIA products are not designed, authorized, or warranted to be suitable for use in medical, military, aircraft, space, or
life support equipment, nor in applications where failure or malfunction of the NVIDIA product can reasonably be
expected to result in personal injury, death, or property or environmental damage. NVIDIA accepts no liability for
inclusion and/or use of NVIDIA products in such equipment or applications and therefore such inclusion and/or use is at
customer’s own risk.
NVIDIA makes no representation or warranty that products based on this document will be suitable for any specified use.
Testing of all parameters of each product is not necessarily performed by NVIDIA. It is customer’s sole responsibility to
evaluate and determine the applicability of any information contained in this document, ensure the product is suitable
and fit for the application planned by customer, and perform the necessary testing for the application in order to avoid a
default of the application or the product. Weaknesses in customer’s product designs may affect the quality and reliability
of the NVIDIA product and may result in additional or different conditions and/or requirements beyond those contained in
this document. NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or
attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product
designs.
No license, either expressed or implied, is granted under any NVIDIA patent right, copyright, or other NVIDIA intellectual
property right under this document. Information published by NVIDIA regarding third-party products or services does not
constitute a license from NVIDIA to use such products or services or a warranty or endorsement thereof. Use of such
information may require a license from a third party under the patents or other intellectual property rights of the third
party, or a license from NVIDIA under the patents or other intellectual property rights of NVIDIA.
Reproduction of information in this document is permissible only if approved in advance by NVIDIA in writing, reproduced
without alteration and in full compliance with all applicable export laws and regulations, and accompanied by all
associated conditions, limitations, and notices.
THIS DOCUMENT AND ALL NVIDIA DESIGN SPECIFICATIONS, REFERENCE BOARDS, FILES, DRAWINGS, DIAGNOSTICS, LISTS,
AND OTHER DOCUMENTS (TOGETHER AND SEPARATELY, “MATERIALS”) ARE BEING PROVIDED “AS IS.” NVIDIA MAKES NO
WARRANTIES, EXPRESSED, IMPLIED, STATUTORY, OR OTHERWISE WITH RESPECT TO THE MATERIALS, AND EXPRESSLY
DISCLAIMS ALL IMPLIED WARRANTIES OF NONINFRINGEMENT, MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE.
TO THE EXTENT NOT PROHIBITED BY LAW, IN NO EVENT WILL NVIDIA BE LIABLE FOR ANY DAMAGES, INCLUDING WITHOUT
LIMITATION ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES, HOWEVER CAUSED AND
REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF ANY USE OF THIS DOCUMENT, EVEN IF NVIDIA HAS BEEN
ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Notwithstanding any damages that customer might incur for any reason
whatsoever, NVIDIA’s aggregate and cumulative liability towards customer for the products described herein shall be
limited in accordance with the Terms of Sale for the product.
Trademarks
NVIDIA, the NVIDIA logo, and Mellanox are trademarks and/or registered trademarks of NVIDIA Corporation and/
or Mellanox Technologies Ltd. in the U.S. and in other countries. Other company and product names may be trademarks
of the respective companies with which they are associated.
Copyright
© 2024 NVIDIA Corporation & affiliates. All Rights Reserved.