Mellanox MCX623106AC-CDAT CONNECTX-6 DX EN Adapter Card 100GBE Dual-Port QSFP56 PCIE4.0x16

ConnectX-6 VPI Card 200Gb/s InfiniBand & Ethernet Adapter Card

Featuring In-Network Computing for Enhanced Efficiency and Scalability

ConnectX-6 Virtual Protocol Interconnect (VPI) cards are a groundbreaking addition to the ConnectX series of industry-leading network adapter cards. Providing two ports of 200Gb/s for InfiniBand and Ethernet connectivity, sub-600ns latency and 215 million messages per second, ConnectX-6 VPI cards enable the highest performance and most flexible solution aimed at meeting the continually growing demands of data center applications. In addition to all the existing innovative features of past versions, ConnectX-6 cards offer a number of enhancements to further improve performance and scalability.

ConnectX-6 VPI supports HDR, HDR100, EDR, FDR, QDR, DDR and SDR InfiniBand speeds as well as 200, 100, 50, 40, 25, and 10Gb/s Ethernet speeds.

Benefits:

• Industry-leading throughput, low CPU utilization and high message rate

• Highest performance and most intelligent fabric for compute and storage infrastructures

• Cutting-edge performance in virtualized networks including Network Function Virtualization (NFV)

• Host Chaining technology for economical rack design

• Smart interconnect for x86, Power, Arm, GPU and FPGA-based compute and storage platforms

• Flexible programmable pipeline for new network flows

• Efficient service chaining enablement

• Increased I/O consolidation efficiencies, reducing data center costs & complexity

ConnectX®-6 Dx is a highly secure and advanced smart network interface card (SmartNIC) that accelerates mission-critical cloud and data center applications, including security, virtualization, SDN/NFV, big data, machine learning, and storage. ConnectX-6 Dx provides up to two ports of 100Gb/s or a single port of 200Gb/s Ethernet connectivity and is powered by 50Gb/s (PAM4) or 25/10 Gb/s (NRZ) SerDes technology.

ConnectX-6 Dx features virtual switch (vSwitch) and virtual router (vRouter) hardware accelerations delivering orders-of-magnitude higher performance than softwarebased solutions. ConnectX-6 Dx supports a choice of single-root I/O virtualization (SR-IOV) and VirtIO in hardware, enabling customers to best address their application needs. By offloading cloud networking workloads, ConnectX-6 Dx frees up CPU cores for business applications while reducing total cost-of-ownership.

Features:

• Up to 200Gb/s connectivity per port

• Max bandwidth of 200Gb/s

• Up to 215 million messages/sec

• Sub 0.6usec latency

• OCP 2.0

• FIPS capable

• Advanced storage capabilities including block-level encryption and checksum offloads

• Supports both 50G SerDes (PAM4) and 25G SerDes (NRZ) based ports

• Best-in-class packet pacing with sub-nanosecond accuracy

• PCIe Gen 3.0 and Gen 4.0 support

• RoHS compliant

• ODCC compatible

High Performance Computing Environments

With its NVIDIA In-Network Computing and In-Network Memory capabilities, ConnectX-6 offloads computation even further to the network, saving CPU cycles and increasing network efficiency. ConnectX-6 utilizes remote direct memory access (RDMA) technology as defined in the InfiniBand Trade Association (IBTA) specification, delivering low latency, and high performance. ConnectX-6 enhances RDMA network capabilities even further by delivering end-to-end packet-level flow control.

Machine Learning and Big Data Environments

Data analytics has become an essential function within many enterprise data centers, clouds, and hyperscale platforms. Machine learning (ML) relies on especially high throughput and low latency to train deep neural networks and improve recognition and classification accuracy. With its 200Gb/s throughput, ConnectX-6 is an excellent solution to provide ML applications with the levels of performance and scalability that they require.

Security Including Block-Level Encryption

ConnectX-6 block-level encryption offers a critical innovation to network security. As data in transit is stored or retrieved, it undergoes encryption and decryption. ConnectX-6 hardware offloads the IEEE AES-XTS encryption/decryption from the CPU, saving latency and CPU utilization. It also guarantees protection for users sharing the same resources through the use of dedicated encryption keys.

By performing block storage encryption in the adapter, ConnectX-6 eliminates the need for self-encrypted disks. This gives customers the freedom to choose their preferred storage device, including byte addressable and NVDIMM devices that traditionally do not provide encryption. Moreover, ConnectX-6 can offer Federal Information Processing Standards (FIPS) compliance.

Bring NVMe-oF to Storage Environments

NVMe storage devices are gaining momentum, offering very fast access to storage media. The evolving NVMe over Fabrics (NVMe-oF) protocol leverages RDMA connectivity to remotely access NVMe storage devices efficiently, while keeping the end-to-end NVMe model at lowest latency. With its NVMe-oF target and initiator offloads, ConnectX-6 brings further optimization to NVMe-oF, enhancing CPU utilization and scalability.

Portfolio of Smart Adapters

ConnectX-6 is available in two form factors: low-profile stand-up PCIe and Open Compute Project (OCP) Spec 3.0 cards with QSFP connectors. Single-port, HDR, stand-up PCIe adapters are available based on either ConnectX-6 or ConnectX-6 DE (ConnectX-6 Dx enhanced for HPC applications).

In addition, specific PCIe stand-up cards are available with a cold plate for insertion into liquid-cooled Intel Server System D50TNP platforms.

Socket Direct

ConnectX-6 also provides options for NVIDIA Socket Direct™ configurations, which improves the performance of multi-socket servers by enabling each of their CPUs to access the network through its dedicated PCIe interface. This enables data to bypass the QPI (UPI) and the other CPU, improving latency, performance, and CPU utilization.

Socket Direct also enables NVIDIA GPUDirect® RDMA for all CPU/GPU pairs by ensuring that GPUs are linked to the CPUs closest to the adapter card. Socket Direct enables Intel® DDIO optimization on both sockets by creating a direct connection between the sockets and the adapter card.

Socket Direct technology is enabled by a main card housing the ConnectX-6 and an auxiliary PCIe card bringing in the remaining PCIe lanes. The ConnectX-6 Socket Direct card is installed into two PCIe x16 slots and connected using a harness. The two PCIe x16 slots may also be connected to the same CPU. In this case, the main advantage of the technology lies in delivering 200Gb/s to servers with PCIe Gen3-only support.

Host Management

Host Management includes NC-SI over MCTP over SMBus, and MCTP over PCIe— Baseboard Management Controller (BMC) interface, as well as PLDM for Monitor and Control DSP0248 and PLDM for Firmware Update DSP0267.

Broad Software Support

All ConnectX adapters are supported by a full suite of drivers for major Linux distributions, as well as Microsoft® Windows® Server and VMware vSphere®.

HPC software libraries supported include HPC-X, OpenMPI, MVAPICH, MPICH, OpenSHMEM, PGAS, and varied commercial packages.

Full specification and details can be found in the Product Datasheet PDF file