Mellanox Technologies MHRH19C-XSR Bedienungsanleitung

www.mellanox.comConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User ManualP/N:MCX353A-FCBT, MCX353A-FCBS, MCX353A-TCBT, MCX353A-QCBT, MCX354A

Rev 2.4Mellanox Technologies10About this ManualThis User Manual describes Mellanox Technologies ConnectX®-3 VPI Single and Dual QSFP+port PCI Express

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies11Technical SupportCustomers who purchased Mellanox pr

IntroductionRev 2.4Mellanox Technologies121 IntroductionThis is the User Guide for Mellanox Technologies VPI adapter cards based on the ConnectX®-3 VP

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies13Table 5 - Single and Dual-port FDR Adapter CardsNetw

IntroductionRev 2.4Mellanox Technologies141.2 Features and BenefitsTable 6 - FeaturesVirtual Protocol Interconnect (VPI)VPI-enabled adapters facilitat

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies151.3 Operating Systems/Distributions• Citrix XenServe

InterfacesRev 2.4Mellanox Technologies162 InterfacesEach adapter card includes the following interfaces:• “InfiniBand Interface”• “Ethernet Interface”

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies172.3 PCI Express InterfaceThe ConnectX®-3 adapter car

Hardware InstallationRev 2.4Mellanox Technologies183 Hardware Installation3.1 System Requirements3.1.1 HardwareA system with a PCI Express x8 slot is

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies19• The 2 screws saved from the removal of the bracket

Mellanox Technologies350 Oakmead Parkway Suite 100Sunnyvale, CA 94085U.S.A.www.mellanox.comTel: (408) 970-3400Fax: (408) 970-3403Mellanox Technologies

Hardware InstallationRev 2.4Mellanox Technologies20Figure 3: Gasket Location on Adapter Card Figure 4: Gasket Installation 3.4.2.2 Installing the Brac

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies21Figure 5: Placing the Bracket on the Card3. Make sur

Hardware InstallationRev 2.4Mellanox Technologies225. Secure the adapter with the adapter clip or screw.6. Close the system case.3.6 Cables and Module

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies235. Care should be taken as not to impede the air exh

Hardware InstallationRev 2.4Mellanox Technologies243.7.2 On LinuxGet the device location on the PCI bus by running lspci and locating lines with the s

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies254 Driver Installation4.1 Linux DriverFor Linux, down

Driver InstallationRev 2.4Mellanox Technologies264.1.3 Installing Mellanox OFEDMellanox OFED includes an installation script called mlnxofedinstall wh

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies274.1.3.2 Installation ScriptThe usage of the installa

Driver InstallationRev 2.4Mellanox Technologies28Options4.1.3.3 mlnxofedinstall Return Codes-c|-- config <packages config_file> Example o

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies29Table 8 lists the mlnxofedinstall script return code

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies3Table of ContentsTable of Contents . . . . . . . . .

Driver InstallationRev 2.4Mellanox Technologies30 Step 3. Run the installation script../mlnxofedinstallThis program will install the MLNX_OFED_LINUX p

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies31Installing user level RPMs:Preparing...

Driver InstallationRev 2.4Mellanox Technologies32Preparing... ##################################################libmlx4-devel

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies33Preparing... ########################

Driver InstallationRev 2.4Mellanox Technologies34Preparing... ##################################################libibmad-static

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies35Preparing... ########################

Driver InstallationRev 2.4Mellanox Technologies36Preparing... ##################################################dapl-devel-static

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies37Preparing... ########################

Driver InstallationRev 2.4Mellanox Technologies38Preparing... ##################################################mxm

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies39 Step 4. In case the installation script performed f

Rev 2.4Mellanox Technologies44.1 Linux Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .254.1.1

Driver InstallationRev 2.4Mellanox Technologies40Note: For more details on hca_self_test.ofed, see the file hca_self_test.readme under docs/.4.1.4 In

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies41• mlx5_ib driver:•IPoIB:•iSER:•eIPoIB:•SRP•RDS:• The

Driver InstallationRev 2.4Mellanox Technologies42• The installation process unlimits the amount of memory that can be pinned by a user space applicati

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies43 Step 2. Identify your target InfiniBand device for

Driver InstallationRev 2.4Mellanox Technologies444.1.8 Port Type Management on LinuxConnectX ports can be individually configured to work as InfiniBan

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies454.1.9.1 Enabling Auto SensingUpon driver start up:1.

Driver InstallationRev 2.4Mellanox Technologies46 Step 3. Download the .exe image according to the architecture of your machine (see Step 1.). The nam

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies47 Step 4. Click Change and specify the location in wh

Driver InstallationRev 2.4Mellanox Technologies48 Step 6. To complete the extraction, click Finish.4.2.4 Installing MLNX_WinOFThis section provides in

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies49 Step 2. Click Next in the Welcome screen. Step 3. R

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies57.5 MCX353A-FCB[T/S] Specifications . . . . . . . .

Driver InstallationRev 2.4Mellanox Technologies50 Step 4. Select the target folder for the installation. Step 5. The firmware upgrade screen will be d

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies51 Step 6. Configure your system for maximum performan

Driver InstallationRev 2.4Mellanox Technologies52 a. Select the desired feature to install:• OpenSM - installs Windows OpenSM that is required to mang

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies53 b. Click Install to start the installation. Step 8.

Driver InstallationRev 2.4Mellanox Technologies54If the firmware upgrade fails, the following message will be displayed.4.2.4.2 Unattended Installatio

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies554.2.6 Installation ResultsUpon installation completi

Driver InstallationRev 2.4Mellanox Technologies56For further information, please refer to the “OpenSM - Subnet Manager” chapter in the User Manual. 4.

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies57 Step 2. Right-click a Mellanox Local Area Connectio

Driver InstallationRev 2.4Mellanox Technologies58 Step 4. Select the “Use the following IP address:” radio button and enter the desired IP information

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies59Step 2: Right-click on the Mellanox ConnectX VPI net

Rev 2.4Mellanox Technologies6List of FiguresFigure 1: MCX354A-[QFT]CBT Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Driver InstallationRev 2.4Mellanox Technologies60Step 3. In this step, you can perform two different functions: (a) Choose the desired port protocol f

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies614. Verify the driver was installed successfully. 4.4

Updating Adapter Card FirmwareRev 2.4Mellanox Technologies625 Updating Adapter Card FirmwareEach card is shipped with the latest version of qualified

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies63Figure 7: Support Download Assistant1. If a newer fi

TroubleshootingRev 2.4Mellanox Technologies646 Troubleshooting6.1 GeneralServer unable to find the adapter• Ensure that the adapter is placed correctl

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies656.2 LinuxEnvironment Informationcat/etc/issueuname –

TroubleshootingRev 2.4Mellanox Technologies666.3 WindowsEnvironment InformationFrom the Windows desktop choose the Start menu and run: msinfo32To expo

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies677 Specifications7.1 MCX353A-QCBT SpecificationsTable

SpecificationsRev 2.4Mellanox Technologies68b. For both operational and non-operational states.c. Air flow is measured ~1” from the heat sink between

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies697.2 MCX354A-QCBT SpecificationsTable 12 - MCX354A-QC

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies7List of TablesTable 1: Revision History Table . . . .

SpecificationsRev 2.4Mellanox Technologies707.3 MCX353A-TCBT SpecificationsTable 13 - MCX353A-TCBT Specifications TablePhysicalSize: 2.12in. x5.6 in.

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies717.4 MCX354A-TCBT SpecificationsTable 14 - MCX354A-TC

SpecificationsRev 2.4Mellanox Technologies727.5 MCX353A-FCB[T/S] SpecificationsTable 15 - MCX353A-FCB[T/S] Specifications TablePhysicalSize: 2.12in. x

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies737.6 MCX354A-FCB[T/S] SpecificationsTable 16 - MCX354

SpecificationsRev 2.4Mellanox Technologies747.7 Adapter LED OperationThere are two I/O LEDs per port. See Table 17 for different LED functions in Infi

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies757.8 Board Mechanical Drawing and DimensionsFigure 8:

SpecificationsRev 2.4Mellanox Technologies76Figure 9: Mechanical Drawing of the Dual-port MCX354A-[QFT]CBT Adapter Card

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies777.9 Bracket Mechanical DrawingFigure 10: Dual-port T

SpecificationsRev 2.4Mellanox Technologies78Figure 12: Dual-port Short BracketFigure 13: Single-port Short Bracket Port 1LEDSPort 2LEDsPort 1Gasket

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies797.10 Regulatory StatementsFor regulatory statements

Rev 2.4Mellanox Technologies8Revision HistoryThis document was printed on May 29, 2014.Table 1 - Revision History TableDate Rev Comments/ChangesMay 20

Rev 2.4Mellanox Technologies80Appendix A: Interface Connectors PinoutA.1 QSFP+ Connector PinoutFigure 14: Connector and Cage ViewsTable 19 - Connecto

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies81A.2 PCI Express x8 Connector PinoutThe adapter cards

Rev 2.4Mellanox Technologies82Figure 15: PCIe Connector PinoutA.3 I2C-compatible Connector PinoutFigure 16: Compatible Connector Plug and PinoutConnec

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies83Appendix B: Finding the GUID/ MAC and Serial Number

Rev 2.4Mellanox Technologies84Appendix C: Safety Warnings1. Installation Instructions2. Over-temperature3. During Lightning - Electrical Hazard4. Cop

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies85CLASS 1 LASER PRODUCT and reference to the most rece

Rev 2.4Mellanox Technologies86Appendix D: Avertissements de sécurité d’installation (Warnings in French)1. Instructions d’installation 2. Températu

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies878. Exposition au rayonnement grave Mise

Rev 2.4Mellanox Technologies88Appendix E: Sicherheitshinweise (Warnings in German)1. Installationsanleitungen 2. Übertemperatur 3. Bei Gewitter -

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies898. Strahlenkontak Achtung – Nutzung von Ste

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies9August 2012 1.4• Added operational and non-operationa

Rev 2.4Mellanox Technologies90Appendix F: Advertencias de seguridad para la insta-lación (Warnings in Spanish)1. Instrucciones de instalación 2. Sob

ConnectX®-3 VPI Single and Dual QSFP+ Port Adapter Card User Manual Rev 2.4Mellanox Technologies91PRODUCTO LÁSER DE CLASE 1 y referencia a las normas