Microsoft is upgrading Windows ML in partnership with the llama.cpp and GGUF open-source community, adding experimental native inference for GGUF and ONNX models and releasing the Windows ML Runtime API. The update also introduces Text Generation API and Speech Recognition API, and Microsoft contributed performance optimization code to llama.cpp together with Nvidia.