AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation

New deployment data from four inference providers shows where the savings actually come from — and what teams should evaluate ...
SiliconANGLE

MLCommons releases results of its latest MLPerf AI inference benchmark test

MLCommons today released the latest results of its MLPerf Inference benchmark test, which compares the speed of artificial intelligence systems from different hardware makers. MLCommons is an industry ...
VentureBeat

How test-time scaling unlocks hidden reasoning abilities in small language models (and allows them to outperform LLMs)

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Very small language models (SLMs) can ...
Unite.AI

Test-Time Scaling: The Secret Sauce Behind the New Wave of PhD-Level Reasoning Models

The field of artificial intelligence has reached a point where simply adding more data or increasing the size of a model is not the best way to make it more intelligent. For the past few years, we ...
EurekAlert!

Common way to test for leaks in large language models may be flawed

This slide shows how a membership inference attack might start. Assessing the product of an app asked to generate an image of a professor teaching students in “the style of” artist Monet could lead to ...