Cliff Robinson

At the AMD AI event where we featured the EPYC 9005 Turin CPU, AMD also launched a new AI GPU, the AMD Instinct MI325X. This accelerator is an upgrade over the MI300X, but it is also one that has changed a bit from when we have seen it previously. AMD also talked about its mid-2025 accelerator, the AMD Instinct MI355X.

Here is a fun one. At OCP Summit 2024, Marvell showed off a functional PCIe Gen7 SerDes running at 128GT/s. This is already working in 3nm process for next-gen chips. Or perhaps better said, next-next-gen chips.

At OCP Summit 2024, we saw a new HPE server. The HPE ProLiant DL384 Gen12 has two NVIDIA GH200 packages onboard and quite a few uncommon things going on. We found this server at the Arm booth for obvious reasons. It is a NVIDIA Grace Hopper Arm server, which makes it a bit different.

Going through OCP Summit 2024 photos, we spotted hte Enfabrica ACF-S. Earlier this year we covered the Enfabrica ACF-S A HUGE Multi-Tbps SuperNIC at Hot Chips 2024. Now, instead of slideware, we also saw the actual chip, and it is a big one.

Today Marvell announced a big multi-year and multi-product win at AWS. This is great for the company as it pushes both interconnect as well as custom silicon solutions. This is also likely a competitive win against Broadcom and Astera Labs in many parts of the business.

This week, Jim Keller’s company signed a big Series D round worth around $693M. While many AI chip companies have ideas, some have silicon, Tenstorrent is taking a different approach to the AI market and it is winning enough to give a $2B valuation to the startup.

Iceotope has a really neat dielectric liquid cooling setup, and it was again showcased at SC24. We saw a demo of lceotope’s KUL EXTREME with the Valvoline Immersion Heat Transfer Fluid DE1 at the show. The booth was dominated by an Aston Martin Formula 1 car, but we still managed to find the liquid cooling.

What a library display can do Date: Wednesday December 11, 2024

This week, Ayar Labs closed a $155M series D round, bringing the company’s total funding to around $370M. For those who do not know Ayar Labs, we have previously featured them on STH. They make a high-speed optical I/O interconnect designed to replace copper in the future.

The NVIDIA Jetson Nano gets a Super upgrade doubling memory bandwidth and increasing TOPS by 57-70% while halving the development kit price