Navigation
Search
|
Why enterprises should use small language models
Monday June 2, 2025. 09:06 AM , from ComputerWorld
Small is beautiful
The all-conquering rise of AI in the enterprise has seen much use of large language models (LLMs). This week at InfoWorld, we wrote about LiteLLM: an open-source gateway for unified LLM access that allows developers to integrate a diverse range of LLM models as if they were calling OpenAI’s API, with support for fallbacks, budgets, rate limits, and real-time monitoring of API calls. That’s good for organizations wishing to use multiple LLMs in harness. But many InfoWorld readers of the story wanted to understand the utility of small language models. Smart Answers: the child of our very own proprietary LLM, offered an opinion based on decades of human insights from IT leaders. Despite its LLM background, Smart Answers is happy to espouse the virtues of smaller models. SLMs provide agility, cost-effective resources, and rapid prototyping, while also enhancing the security and privacy of organizational data. They also offer better security and customization. In essence, if you want to keep it in house and under control, an SLM might be the best answer. Find out: Why are enterprises using small language models more often? What’s new in Python? Everybody loves Python. It’s the coding language of the day. This week we reported how to use template strings in Python 3.14, pointing out that these new template strings, or t-strings, give you a much more powerful way to format data than the old-fashioned f-strings. That’s all very cool. But there’s more, and our readers asked Smart Answers for a rundown of all the new features in Python. There’s a lot, with highlights including deferred evaluation of annotations, better error messages, a safe external debugger interface to CPython, and a C API for Python runtime configuration. Find out: What are other major new features in Python 3.14? When is SAP ECC standard support ending? CIOs face a daunting task in migrating their legacy ERP systems to S/4HANA and an entirely new platform in the cloud as the technology vendor’s deadline moves closer. This week (as most weeks) we updated the CIO audience on the road to S/4HANA: How CIOs are managing SAP ECC’s end of support. CIO readers wanted to know one thing: how much time do they have? Find out: When is SAP ECC standard support ending? About Smart Answers Smart Answers is an AI-based chatbot tool designed to help you discover content, answer questions, and go deep on the topics that matter to you. Each week we send you the three most popular questions asked by our readers, and the answers Smart Answers provides. Developed in partnership with Miso.ai, Smart Answers draws only on editorial content from our network of trusted media brands—CIO, Computerworld, CSO, InfoWorld, and Network World—and was trained on questions that a savvy enterprise IT audience would ask. The result is a fast, efficient way for you to get more value from our content.
https://www.computerworld.com/article/3992081/why-enterprises-should-use-small-language-models.html
Related News |
25 sources
Current Date
Jun, Fri 6 - 20:35 CEST
|