Matthew
Beecher

SURF Closed-loop evaluation of behavior-specific human-machine trust-calibration strategies

Abstract profile. Full document pending author claim.

Authors:

Matthew Beecher

Date Created:

Not specified

Course Title:
Professor:

Not specified

About Paper:

Automation is increasingly used for improving system performance across a broad range of applications. For example, intelligent decision aid systems, designed to aid humans in a variety of tasks, such as navigation. In such systems, it is vital the operator appropriately utilize the decision aid without over or under-reliance. In other words, the operator's trust should be calibrated to the reliability of the decision aid. In prior research, researchers showed that a partially observable Markov decision process (POMDP) model could be used to estimate an operator's trust state by observing their behavior, namely decision-aid reliance. The POMDP was then used to design a near-optimal policy to adapt the user interface transparency displayed by the decision aid to operators' trust to mitigate the consequences of improper reliance. However, this work was limited in that a single POMDP was trained using an aggregated dataset of human data; additional research has identified the presence of two distinct trusting behaviors among the dataset, with two distinct POMDP models trained and associated adaptive transparency policies designed and synthesized. This work aims to implement the two proposed policies in closed-loop (conducted via Amazon Mechanical Turk) and evaluate their efficacy in calibrating trust as compared to the generalized policy. It will utilize a classifier trained to identify operator trust behavior with behavioral data during the experiment to then determine which control policy the operator experiences. This research will illustrate the usefulness of this split modelling approach in a practical setting and open the door for further developments.

Source:

Purdue University / 2023

Topics:

No topics listed

Co-authors:

Matthew Beecher

0