Microsoft unveils new Mu language model aimed at running on PCs

Microsoft"s headquarters in Bucharest, Romania

lcva2

  • Microsoft (NASDAQ:MSFT) on Monday unveiled its new Mu small language model, aimed at running locally on PCs.
  • “Specifically, this is the language model that powers the agent in Settings, available to Windows Insiders in the Dev Channel with Copilot+ PCs, by mapping natural language input queries to Settings function calls,” Microsoft said in a post.
  • The Mu model is “fully offloaded onto the Neural Processing Unit and responds at over 100 tokens per second, meeting the demanding UX requirements of the agent in [a] Settings scenario,” Microsoft added. The model was trained using Nvidia’s (NVDA) A100 GPUs on Azure Machine Learning.
  • The Windows maker added that it worked with its processor partners AMD (AMD), Intel (INTC) and Qualcomm (QCOM) “to ensure that the quantized operations when running Mu were fully optimized for the target NPUs.”
  • Microsoft shares rose fractionally in afternoon trading.

Leave a Reply

Your email address will not be published. Required fields are marked *