Towards Multimodal Error Management:Experimental Evaluation of User Strategies in Event of Faulty Application Behavior in Automotive Environments
Gregor McGlaun, Frank Althoff, Manfred Lang, Gerhard Rigoll
In this work, we present the results of a study
analyzing the reactions of subjects on simulated
errors of a dedicated in-car interface for
controlling infotainment and communication
services. The test persons could operate the
system, using different input modalities, such
as natural or command speech as well as head and
hand gestures, or classical tactile paradigms.
In various situational contexts, we scrutinized
the interaction patterns the test participants
applied to overcome different operation tasks.
Moreover, we evaluated individual user behavior
concerning modality transitions and individual
fallback strategies in case of system errors.
Two different error types (Hidden System Errors
and Apparent System Errors) were provoked. As a
result, we found out that initially, i.e. with
the system working properly, most users prefer
tactile or speech interaction. In case of Hidden
System Errors, mostly changes from speech to
tactile interaction and vice versa occurred.
Concerning Apparent System Errors, 87% of the
subjects automatically interrupted or cancelled
their input procedure. 73% of all test persons
who continued interaction, when the reason for
the faulty system behavior was gone, strictly
kept the selected modality. Regarding the given
input vocabulary, none of the subjects selected
head or hand gesture input as the leading