I Don't Know What Happens, But ... Do I Really Need that Explanation?

Abstract

Driving automation systems have provided great benefits to drivers and passengers by reducing fatigue, preventing accidents, and improving user experience. However, the adoption and proper use of such systems largely depend on a driver's understanding of the system's capabilities and limitations. Currently available automated vehicles on the road generally lack explanations for users to understand system malfunctions and incapabilities, which results in user confusion and prevents users from using the system. Additionally, those systems often do not disclose their operational domain, which might make users develop unrealistic reliance on driving automation systems. Providing meaningful explanations is considered as a solution to address those issues. The presented video first showcases some dilemmas that users might encounter while using driving automation systems, followed by scenarios showing explanation options and potential user reactions. With this video, we anticipate eliciting in-depth discussions on how to effectively construct explanations for future automated vehicles.