Navigation
Search
|
AI Companies Hit Development Hurdles in Race for Advanced Models
Wednesday November 13, 2024. 03:01 PM , from Slashdot
Google's upcoming Gemini software and Anthropic's Claude 3.5 Opus are facing similar challenges. Google's project is not meeting internal benchmarks, while Anthropic has delayed its model's release, Bloomberg said. Industry insiders cited by the publication pointed to growing scarcity of high-quality training data and mounting operational costs as key obstacles. OpenAI's Orion specifically struggled due to insufficient coding data for training, the report said. OpenAI has moved Orion into post-training refinement but is unlikely to release the system before early 2024. The report adds: AI companies continue to pursue a more-is-better playbook. In their quest to build products that approach the level of human intelligence, tech firms are increasing the amount of computing power, data and time they use to train new models -- and driving up costs in the process. Amodei has said companies will spend $100 million to train a bleeding-edge model this year and that amount will hit $100 billion in the coming years. As costs rise, so do the stakes and expectations for each new model under development. Noah Giansiracusa, an associate professor of mathematics at Bentley University in Waltham, Massachusetts, said AI models will keep improving, but the rate at which that will happen is questionable. 'We got very excited for a brief period of very fast progress,' he said. 'That just wasn't sustainable.' Further reading: OpenAI and Others Seek New Path To Smarter AI as Current Methods Hit Limitations. Read more of this story at Slashdot.
https://slashdot.org/story/24/11/13/1237220/ai-companies-hit-development-hurdles-in-race-for-advance...
Related News |
25 sources
Current Date
Nov, Thu 14 - 17:16 CET
|