Microsoft on Monday (June 23, 2025) unveiled its on-device small language model, Mu, that allows users to change settings through natural language queries. The company said Windows Insiders in the Dev Channel with Copilot+PCs can access Mu.
The AI agent for Settings in Windows 11 was included in the existing search box for a seamless user experience, the company said.
“Mu is fully offloaded onto the Neural Processing Unit (NPU) and responds at over 100 tokens per second, meeting the demanding UX requirements of the agent in Settings scenario,” Vivek Pradeep, VP, Distinguished Engineer at Windows Applied Sciences noted in a company blog.
Trained over multiple phases using Nvidia’s A100 GPUs on Azure Machine Learning, Mu followed a similar technique as Microsoft’s previous small language model family, Phi.
It was pre-trained on “hundreds of billions of the highest-quality educational tokens, to learn language syntax, grammar, semantics and some world knowledge.” Mu was then distilled from the Phi models to enhance accuracy.
