Meta announces AMD Instinct MI300X for AI Inference and NVIDIA GB200 Catalina

At the OCP Summit 2024, Microsoft announced new AI hardware platforms. Meta has been a driving force in AI for years, and that is increasingly true for Llama and its massive data sets. We have a number of announcements and they are coming quickly. Since we're doing them live, please excuse any typos.

AMD Instinct MI300X at Meta for AI Inference

Meta announced that it has brought the AMD Instinct MI300X to its Grand Teton platform for eight accelerators.

The company also said it is already using these platforms.

NVIDIA GB200 Catalina at Meta

For the next generation, Meta has the NVIDIA GB200 rack called “Catalina” contributed to OCP.

According to Meta it is a 140kW rack. Next, NVIDIA's Ian Buck announces that the GB200 is in full production. NVIDIA also announces that it is bringing its NVIDIA GB200 NVL72 platform to OCP to enable projects like Catalina.

Meta-FBNIC with Marvell

Hopefully we can find these on the show floor, but Meta has its own network card called FBNIC.

This is a network card created with Marvell. For example, it can be split into 4x PCIe Gen5 connections for a multi-host setup. It's a big deal that Facebook is developing its own NICs.

Minipack3 and Cisco 8501 switches

There are two new 51.2T switches. The new Minipack3 is built by Celestica and is based on the Broadcom Tomahawk 5.

Cisco is here with the Cisco 8501. This is a Cisco G200 51.2T switch platform.

What's notable here is that Meta uses Marvell for its network card, but doesn't announce a Marvell Teralynx 10 51.2T switch platform.

Meta Arista CSF Broadcom switches

Meta also has two Arista platforms. There is a Jerico3 switch, the Arista 7700R4C-38PE.

There is another switch, the Arista 7720R4-128PE as a 128-port model. Also key to this slide is that Meta says it's bringing Ethernet to GPUs.

Last words

How cool! Meta brought a lot of new hardware to the AI ​​field. What was noticeable, however, was that non-AI-based calculations were missing from the keynote. Still, this is a big deal for NVIDIA, AMD, Broadcom, Marvell, Arista, Cisco and others. Meta buys a lot of hardware, so these types of rosters end up causing a stir in the industry.