MacMusic  |  PcMusic  |  440 Software  |  440 Forums  |  440TV  |  Zicos
benchmark
Search

Search-capable AI agents may cheat on benchmark tests

Saturday August 23, 2025. 04:32 PM , from TheRegister
Data contamination can make models seem more capable than they really are
Researchers with Scale AI have found that search-based AI models may cheat on benchmark tests by fetching the answers directly from online sources rather than deriving those answers through a 'reasoning' process.…
Read more at TheRegister
https://go.theregister.com/feed/www.theregister.com/2025/08/23/searchcapable_ai_agents_may_cheat/

Related News

benchmark How to avoid the risks of rapidly deploying AI agents InfoWorldAug 26
cheat Japanese Media Groups Sue AI Search Engine Perplexity Over Alleged Copyright Infringement SlashdotAug 26
tests Databricks buys Tecton to give context to AI agents InfoWorldAug 25
may Survey Finds More Python Developers Like PostgreSQL, AI Coding Agents - and Rust for Packages SlashdotAug 25
models Fake CAPTCHA tests trick users into running malware TheRegisterAug 22
search-capable OpenAI Is Challenging Google - While Using Its Search Data SlashdotAug 22
answers GitHub launches Copilot agents panel on GitHub.com InfoWorldAug 21
agents Talk to the bot: Salesforce AI agents could replace US govt employees TheRegisterAug 20
benchmark Do Large Language Models Dream of AI Agents? Wired: Tech.Aug 20
cheat An Exclusive Look at Reliability Labs, Where Google Stress-Tests Pixel Hardware Wired: Tech.Aug 20
tests Druva launches new AI agents to help boost cyber resilience BetaNewsAug 19
may Windows 11 cheat sheet ComputerWorldAug 19
models The successes and challenges of AI agents InfoWorldAug 19
search-capable AI 'Business Agents' Will Kill SaaS by 2030, Says Microsoft SlashdotAug 18
answers Google to pay $36M fine in Australia over anticompetitive Android search deals ComputerWorldAug 18
agents WIRED Tests Dozens of Air Purifiers a Year. Here’s What We Look For (2025) Wired: Tech.Aug 18
benchmark Border Patrol agents mistake innocent disabled teen for MS-13 member, leave bullets as party favors BoingBoingAug 14
cheat Google Sheets cheat sheet: How to get started ComputerWorldAug 14
tests Data Brokers Are Hiding Their Opt-Out Pages From Google Search SlashdotAug 14
may GPT-5 Doesn't Dislike You—It Might Just Need a Benchmark for Emotional Intelligence Wired: Tech.Aug 13
News copyright owned by their original publishers | Copyright © 2004 - 2025 Zicos / 440Network
Current Date
Aug, Tue 26 - 11:52 CEST