يحاول ذهب - حر
AI Models Collapse in Face of Complex Problems
June 09, 2025
|Hindustan Times Delhi
Just days ahead of the much-anticipated Worldwide Developer Conference (WWDC), Apple has released a study titled "The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity", which saw researchers testing 'reasoning' AI models such as Anthropic's Claude, OpenAI's models, DeepSeek RL, and Google's Thinking models to see how far they can scale to replicate human reasoning.

NEW DELHI: Just days ahead of the much-anticipated Worldwide Developer Conference (WWDC), Apple has released a study titled "The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity," which saw researchers testing 'reasoning' AI models such as Anthropic's Claude, OpenAI's models, DeepSeek RL, and Google's Thinking models to see how far they can scale to replicate human reasoning. Spoiler alert—not as much, as the entire AI marketing pitch would have you believe. Could this signal what may be in store for Apple's AI conversation ahead of the keynote?
The study questions the current standard evaluation of Large Reasoning Models (LRMs) using established mathematical and coding benchmarks, arguing they suffer from data contamination and don't reveal insights into reasoning trace structure and quality. Instead, it proposes a controlled experimental test-bed using algorithmic puzzle environments. The limitations of AI benchmarking, and need to evolve, is something we had written about earlier.
هذه القصة من طبعة June 09, 2025 من Hindustan Times Delhi.
اشترك في Magzter GOLD للوصول إلى آلاف القصص المتميزة المنسقة، وأكثر من 9000 مجلة وصحيفة.
هل أنت مشترك بالفعل؟ تسجيل الدخول
المزيد من القصص من Hindustan Times Delhi
Hindustan Times
Google says it has developed quantum computing algorithm in breakthrough
Google said it has developed a computer algorithm that points the way to practical applications for quantum computing and will be able to generate unique data for use with artificial intelligence.
1 min
October 23, 2025
Hindustan Times
NHRC NOTICE TO 3 STATES’ DGPs OVER ATTACK ON JOURNOS
The National Human Rights Commission (NHRC) of India, on Wednesday, took suo motu cognisance of reported attacks on three journalists in Kerala, Manipur, and Tripura.
1 min
October 23, 2025
Hindustan Times
Women in focus as Tejashwi vows job security, salary hike
Rashtriya Janata Dal (RJD) leader Tejashwi Yadav announced on Wednesday that all contractual workers engaged in various Bihar government departments and around 200,000 \"community mobilisers\" among \"Jeevika Didis\" would be made permanent, and given a monthly salary of ₹30,000, if the INDIA bloc comes to power in the upcoming assembly elections.
2 mins
October 23, 2025
Hindustan Times
'Mini secretariats': Construction kicks off in five districts
The Delhi government has stepped up work on “mini secretariats” in five districts across the city—a flagship initiative announced earlier this year by chief minister Rekha Gupta.
1 min
October 23, 2025
Hindustan Times
Rohingya case points to legal vacuum on refugees
True character is revealed not in comfort, but in crisis. And India has passed that test before.
3 mins
October 23, 2025
Hindustan Times
LOW WIND SPEEDS KEEP CAPITAL'S AIR 'VERY POOR'; RELIEF UNLIKELY
Delhi's air quality remained \"very poor\" for the third consecutive day on Wednesday, deteriorating marginally as wind speeds dropped again.
1 min
October 23, 2025
Hindustan Times
IT ministry tightens rules for online content removal
The government has introduced new procedural safeguards to content takedown rules, restricting the power to senior officials and mandating reasoned orders with monthly reviews.
2 mins
October 23, 2025
Hindustan Times
Minors can, on reaching adulthood, cancel sale transactions made by guardians, says top court
The Supreme Court has ruled that minors, on attaining majority, can repudiate sale transactions executed by their guardians without the court's permission, and it is not mandatory for them to move court to cancel such sales.
3 mins
October 23, 2025

Hindustan Times
Why this season is looking very good for Arsenal so far
Gyökeres ends barren run with a brace as Gunners continue good run by dismantling Atletico
3 mins
October 23, 2025
Hindustan Times
Private sector can help address urban flooding
The torrential rains across India this monsoon once again exposed the deep vulnerabilities of its cities.
4 mins
October 23, 2025
Listen
Translate
Change font size