Monday, March 10, 2025

Small Language Models (SLMs): A Cost-Effective, Sustainable Option for Higher Education - Tom Mangan, Ed Tech

Small language models, known as SLMs, create intriguing possibilities for higher education leaders looking to take advantage of artificial intelligence and machine learning.  SLMs are miniaturized versions of the large language models (LLMs) that spawned ChatGPT and other flavors of generative AI. For example, compare a smartwatch to a desktop workstation (monitor, keyboard, CPU and mouse): The watch has a sliver of the computing muscle of the PC, but you wouldn’t strap a PC to your wrist to monitor your heart rate while jogging. SLMs can potentially reduce costs and complexity while delivering identifiable  benefits — a welcome advance for institutions grappling with the implications of AI and ML. SLMs also allow creative use cases for network edge devices such as cameras, phones and Internet of Things (IoT) sensors.