Fig. 2: Quantifying the alignment of AI-based explanations with human explanations. | Communications Medicine

Fig. 2: Quantifying the alignment of AI-based explanations with human explanations.

From: A multi-institutional study using artificial intelligence to provide reliable and fair feedback to surgeons

Fig. 2

A surgical artificial intelligence system (SAIS) can assess the skill of a surgeon based on a surgical video and generate an explanation for such an assessment by highlighting the relative importance of video frames (e.g., via an attention mechanism). Human experts annotate video frames most important for the skill assessment. TWIX is a module which uses human explanations as supervision to explicitly teach an AI system to predict the importance of video frames. We show the alignment of attention and TWIX with human explanations.

Back to article page