Alex Woodie

The key value (KV) cache has emerged as a major obstacle to rolling out AI services to customers, whether that's children creating animated cat videos or chemists hoping to accelerate scientific discovery.

As part of its Advancing AI launch event two weeks ago, AMD unveiled ROCm.ai, a new “developer experience” that introduces AI coding agents into AMD's ROCm development tools for GPUs. According to AMD, ROCm.ai will dramatically lower the time and effort required to develop highly tuned and performant code. But will have an impact on the market, which is dominated by CUDA, Nvidia's popular development environment?

Anthropic and OpenAI are two of the leading AI model labs, developing what are widely considered to be planet Earth's most capable AI models. So it was a little bit concerning when both companies recently announced that AI models undergoing cybersecurity testing in supposedly secure labs broke out of their sandboxes and attacked innocent third-parties on the Internet.

The AI memory wall has emerged as the biggest bottleneck in executing AI inference workloads. This week at the Future of Memory and Storage Summit, Samsung threw the kitchen sink at the problem, unveiling not only a new type of high-bandwidth memory called zHBM but two new NAND offerings for solid state disks (SSDs), including […]

As part of its open-weights initiative, the DOE says it's hoping “to galvanize the scientific and AI communities around shared infrastructure” and

The Fan-out Fabric Architecture marks a departure from the sixth-generation Xeon processor, Granite Rapids, which offered up to 128 performance cores (P-cores) built using Intel's 3 process node.

The future of optical interconnects is very bright, thanks to the advantages they hold over copper networking in terms of bandwidth, reach, efficiency, and

Anger over the construction of AI data centers has triggered political leaders to call for bans and moratoriums on the construction of new data centers in recent months. Is this […]

GenBio AI is giving it a shot. The company has released AIDO Cell, an AI model that tries to recreate enough of what is happening inside a cell that researchers can experiment with it on a computer.

GPU giant Nvidia has agreed to buy Hugging Face, an AI model, data, collaboration and platform with more than 13 million registered users, for $12.9 billion, according to a report today in The Information. If the deal goes through, it would significantly bolster Nvidia’s AI model business. Hugging Face was founded 10 years ago by […]