Skip to main content

Table 4 Descriptions and equations of metrics used during the analysis of the interpretations

From: Using test-time augmentation to investigate explainable AI: inconsistencies between method, model and human intuition

Method

Implementation

Equations

IG

Captum

Eq. 9

SHAP

Captum

Eq. 10

Attention Maps

Re-implemented

Eq. 3

Rollout

Re-implemented

Eq. 4

Grads

Re-implemented

Eq. 5

AttGrads

Re-implemented

Eq. 6

CAT

Re-implemented

Eq. 7

AttCAT

Re-implemented

Eq. 8

  1. Described are three metrics, what they measure and their equations. \(\phi _i\) is the attribution of token i. Entropy and cosine similarity were calculated only using the atom components