Microsoft open sources the inference engine at the heart of its Windows machine-learning platform

Following its alliance with Facebook around the Open Neural Network Exchange (ONNX), Microsoft is open-sourcing the ONNX runtime engine for machine learning.
Written by Mary Jo Foley, Senior Contributing Editor

Microsoft is using its annual Connect(); developers conference to make a number of AI-related announcements, including the open sourcing of one of its key pieces of its Windows Machine Learning (Windows ML) platform.

Also: Microsoft's latest Windows 10 19H1 test build adds UI tweaks, fixes

Credit: Microsoft

Microsoft is open sourcing the Open Neural Network Exchange (ONNX) runtime, officials said today, December 4. The ONNX runtime is an inference engine for machine-learning models in the ONNX format. Microsoft is making it available on GitHub so developers can customize and integrate the runtime into their existing systems and compile/build it on a variety of operating systems.

Credit: Microsoft

The ONNX engine is a key piece of Windows ML. Microsoft is building this machine-learning interface into Windows 10 to try to get developers to use trained machine learning models in their Windows apps. The Windows ML inference engine can evaluate trained models locally on Windows devices, instead of requiring developers to run them in the cloud.

Also: Microsoft lifts Windows 10 1809 block after Apple fixes iCloud for Windows

Microsoft and Facebook announced the ONNX format in 2017 in the name of enabling developers to move deep-learning models between different AI frameworks, including its own Cognitive Toolkit (CNTK). More recently, Microsoft officials have started downplaying the Microsoft Cognitive Toolkit, in favor of Facebook's PyTorch and Google's TensorFlow, as reported last month by CNBC.

When I asked Microsoft about CNBC's report, a spokesperson provided the following statement:

"Microsoft believes an open ecosystem will help bring AI to everyone. We're seeing traction for ONNX and Python with developers and data scientists so we are increasing our investments in those areas, while we continue to support Microsoft Cognitive Toolkit. We have nothing else to share at this time."

Microsoft also is making its Azure Machine Learning service generally available as of today, December 4. Azure ML enables developers and data scientists to build, train and deploy machine-learning models. My ZDNet colleague Andrew Brust has more details on Azure ML.

In other AI news, Microsoft is continuing to flesh out its Azure Cognitive Services application-programming interface (API) strategy. Today, Microsoft is adding container support for its Language Understanding API (in preview form). Recently, Microsoft announced it was making available several other of its Cognitive Services APIs in containers to enable developers to bring these AI capabilities offline and to edge devices.

Also: Microsoft patches several versions of Windows 10

In addition, Microsoft is making the custom-translation capability of Translator Text generally available. This API allows customers to use human-translated content to build their own custom translation systems.

A brief history of Microsoft's Surface: Missteps and successes

Previous and related coverage:

How to install, reinstall, upgrade and activate Windows 10

Here's everything you need to know before you repair, reinstall, or upgrade Windows 10, including details about activation and product keys.

After Windows 10 upgrade, do these seven things immediately

You've just upgraded to the most recent version of Windows 10. Before you get back to work, use this checklist to ensure that your privacy and security settings are correct and that you've cut annoyances to a bare minimum.

How to upgrade from Windows 10 Home to Pro for free

You've got a new PC running Windows 10 Home. You want to upgrade to Windows 10 Pro. Here's how to get that upgrade for free. All you need is a Pro/Ultimate product key from an older version of Windows.

Related stories:

Editorial standards