ZDNet

With AI models clobbering every benchmark, it's time for human evaluation

Artificial intelligence has traditionally advanced through automatic accuracy tests in tasks meant to approximate human knowledge. Carefully crafted benchmark tests such as The General Language ...
UPI

AI model achieves human level performance on general intelligence test

Dec. 24 (UPI) --A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure "general intelligence". On December 20, OpenAI's o3 system scored 85% on ...
VentureBeat

Can AI really compete with human data scientists? OpenAI’s new benchmark puts it to the test

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now OpenAI has introduced a new tool to measure ...
Gizmodo

OpenAI Claims Its New Model Reached Human Level on a Test for ‘General Intelligence.’ What Does That Mean?

A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure “general intelligence”. On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI ...
The Conversation

An AI system has reached human level on a test for ‘general intelligence’. Here’s what that means

Michael Timothy Bennett receives funding from the Australian government. Elija Perrier receives funding from the Australian government. A new artificial intelligence (AI) model has just achieved human ...
ExecutiveGov

NIST Seeks Public Input on Draft Best Practices for Automated AI Benchmark Testing

NIST said Friday that its Center for AI Standards and Innovation, or CAISI, released an initial public draft of NIST AI 800-2, “ Practices for Automated Benchmark Evaluations of Language Models ,” and ...