X
Innovation
Why you can trust ZDNET : ZDNET independently tests and researches products to bring you our best recommendations and advice. When you buy through our links, we may earn a commission. Our process

'ZDNET Recommends': What exactly does it mean?

ZDNET's recommendations are based on many hours of testing, research, and comparison shopping. We gather data from the best available sources, including vendor and retailer listings as well as other relevant and independent reviews sites. And we pore over customer reviews to find out what matters to real people who already own and use the products and services we’re assessing.

When you click through from our site to a retailer and buy a product or service, we may earn affiliate commissions. This helps support our work, but does not affect what we cover or how, and it does not affect the price you pay. Neither ZDNET nor the author are compensated for these independent reviews. Indeed, we follow strict guidelines that ensure our editorial content is never influenced by advertisers.

ZDNET's editorial team writes on behalf of you, our reader. Our goal is to deliver the most accurate information and the most knowledgeable advice possible in order to help you make smarter buying decisions on tech gear and a wide array of products and services. Our editors thoroughly review and fact-check every article to ensure that our content meets the highest standards. If we have made an error or published misleading information, we will correct or clarify the article. If you see inaccuracies in our content, please report the mistake via this form.

Close

AWS, DeepLearning.ai aim to bridge scaling gap with machine learning models via Coursera specialization

"Machine learning has a proof of concept to production gap," explained Andrew Ng, founder of DeepLearning.AI and a top instructor on Coursera.
Written by Larry Dignan, Contributor

Amazon Web Services, DeepLearning.ai, and Coursera are looking to bridge the gap between creating and testing machine learning and models and scaling them in production via a three-course specialization.

"Machine learning has a proof of concept to production gap," explained Andrew Ng, founder of DeepLearning.AI and a top instructor on Coursera. The specialization is designed to help developers take a model from a prototype on a laptop to the cloud. "There's just so much stuff to be done when going from 10 users to 1 million," added Ng.

Bratin Saha, vice president and general manager of machine learning services at AWS, said customers have gone from deploying a handful of models to millions in just a few years. "ML is no longer a niche," said Saha, who oversees SageMaker, the machine learning platform that is the fastest growing product at AWS.

Must read:

The specialization course gives an overview of the moving parts (MLOps, DevOps) required to move models into production as well as topics covering accuracy, costs and optimization as prototypes scale.

Primers: What is AI? | What is machine learning? | What is deep learning? | What is artificial general intelligence? 

In an interview with Ng and Saha, we touched on a few notable points about models. A few highlights of our chat:

Should models begin in the cloud from the start to account for scale? Ng said his approach to machine learning models is one based on "use the right tool for the right job." "It's fine to do a proof of concept on a laptop. You need the proof of concept to decide go or no go," said Ng.

Ng added that planning for scale before there's a proof of concept can muddle the process.

Scaling requires skill. Saha said the specialization course is designed to broaden the talent base for machine learning. Both Saha and Ng said there's a shortage of talent that understands how to scale models. "Two years back we'd train models with 20 million parameters. Today it's 100 million. We make 100s of billions of predictions per month," said Saha.

Ng said there is high demand for skilled machine learning practitioners and those people who have deployed a meaningful service in the cloud are even in more short supply. As a result, Saha said all engineers joining Amazon have mandatory machine learning courses.

Machine learning is early in its evolution. Ng said in many ways machine learning rhymes with software development in its early days. "I vaguely remember when software engineering was a mess and now version control is now more mature," said Ng. "I take inspiration from how software emerged as an industry." 

Also: Andrew Ng sees an eternal springtime for AI

Practical Data Science specialization

Coursera

As for the Practical Data Science specialization, here are the key points.

  • The specialization is designed for data-focused developers, scientists, and analysts who are familiar with the Python and SQL programming languages and want to build end-to-end machine learning pipelines.
  • Algorithms for natural language processing and natural language understanding including BERT, GLoVe, ELMo and FastText.
  • The first course covers foundational concepts and exploratory data analysis using Amazon SageMaker Studio as well as other SageMaker services. Automated machine learning will be covered.
  • In the second course, learners will build, train and deploy and end-to-end machine learning pipeline.
  • The third course will cover advanced model training, tuning and deployment techniques. Distributed training, hyper-parameter tuning, and A/B tests will be covered.
  • Managed online lab environments are provided by AWS Partner Vocareum.
Editorial standards