New ORCA results show Gemini leading in practical math, but no AI matches the consistency of a simple calculator.

The last time we did comparative tests of AI models from OpenAI and Google at Ars was in late 2023, when Google’s offering was still called Bard. In the roughly two years since, a lot has happened in ...

The new Mercury 2 AI model uses diffusion reasoning to generate 1,000 tokens per second; it runs about 5x faster than Haiku, speed limits are ...

Bytedance’s video generation model Seedance 2.0 passed the ‘Will Smith eating spaghetti’ test with flying colors, a ...

The most sophisticated AI models in existence today have scored poorly on a new benchmark designed to measure their progress towards artificial general intelligence (AGI) – and brute-force computing ...

Google, OpenAI, DeepSeek, et al. are nowhere near achieving AGI (Artificial General Intelligence), according to a new benchmark. The Arc Prize Foundation, a nonprofit that measures AGI progress, has a ...

Google is following the consumer launch of 2.0 Flash with new preview models that will be available to test in the Gemini app: 2.0 Pro Experimental and 2.0 Flash Thinking Experimental. In December, ...

In a new case study, Hugging Face researchers have demonstrated how small language models (SLMs) can be configured to outperform much larger models. Their findings show that a Llama 3 model with 3B ...

Humans are still way smarter than AI according to this new AGI benchmark. Credit: karetoria / Getty Images Google, OpenAI, DeepSeek, et al. are nowhere near achieving AGI (Artificial General ...