Autonomous testing Is like autonomous driving: The AI needs human assistance

The different levels used describe autonomous vehicles and extent of human assistance required can be used to describe autonomous technology testing.

​Autonomous bus Èrica points the way to a driverless future Autonomous bus Èrica has already transported 4,600 citizens.

Tech and the future of transportation: From here to there

Transportation is about to get a technology-driven reboot. The details are still taking shape, but future transport systems will certainly be connected, data-driven and highly automated.

Read More

The US Society of Automotive Engineers (SAE) has defined a scale to describe the autonomous capabilities that self-driving cars have -- i.e., their levels of automation.

Also: Can humans get a handle on AI?

Level 5 is full automation, which allows self-driving cars to operate with no human assistance. Google and Uber, among others, are aiming to develop level 5 cars, but many consider this to be a moonshot. But from level 0 (no automation) to level 4 (high automation), human assistance is a must; artificial intelligence capabilities, mostly based on deep neural networks, augment the human driver's capabilities. The level of human assistance required diminishes as the levels of automation increase. Audi, BMW, NVIDIA, Tesla, Volvo, and many others are aiming at levels 0 to 4, and today, they are mostly deploying self-driving capabilities in cars at level 2 or slightly higher, so there is still a ways to go.

This framework has another interesting characteristic, one that is common to the Richter scale for earthquakes: Moving from one level to the next follows an exponential function curve. A magnitude 6 earthquake is much more destructive than a magnitude 5 — and many times more destructive than a magnitude 4. 


Must read


In a recent Forrester report, I define the path to autonomous testing based on the SAE framework, given its many analogies:

  1. We need human testers to assist growing levels of automation.
  2. Moving from one level of augmentation and automation to the next follows an exponential function curve, making it especially hard to get to the moonshot of level 5.
  3. Just as the AI in self-driving cars augments human driving capabilities, the AI and automation in testing augment testers' intelligence -- bringing human business and technical testers back to center stage.

So, the battle is on: Who will test SW apps and infused AI apps in the future: business testers, technical testers, or development testers? What can AI augment today (in reality) versus tomorrow (still a myth), and how will AI disrupt testing further?


-- By Diego Lo Giudice, vice president, principal analyst

Companies must embrace automation technology and empower employees to use them or risk falling behind competitors. Watch Forrester's complimentary webinar to understand the challenges that employees and organizations face when implementing automation technologies -- and the skills needed to succeed.

This post originally appeared here.

Previous and related coverage:

What is AI? Everything you need to know

An executive guide to artificial intelligence, from machine learning and general AI to neural networks.

What is deep learning? Everything you need to know

The lowdown on deep learning: from how it relates to the wider field of machine learning through to how to get started with it.

What is machine learning? Everything you need to know

This guide explains what machine learning is, how it is related to artificial intelligence, how it works and why it matters.

What is cloud computing? Everything you need to know about

An introduction to cloud computing right from the basics up to IaaS and PaaS, hybrid, public, and private cloud.