Trinity College Dublin, Department of Computer Science
Nugent, Conor; Cunningham, Pádraig; Doyle, Dónal. 'The Best Way to Instil Confidence is by Being Right An Evaluation of the Effectiveness of Case-Based Explanations in providing User Confidence'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2005-21, 2005, pp15
Computer Science Technical Report TCD-CS-2005-21
Instilling confidence in the abilities of machine learning systems in end-users is seen as critical to their success in real world problems. One way in which this can be achieved is by providing users with
interpretable explanations of the system's predictions. CBR systems have
long been understood to have an inherent transparency that has particular advantages for explanations compared with other machine learning
techniques. However simply suppling the most similar case is often not
enough. In this paper we present a framework for providing interpretable
explanations of CBR systems which includes dynamically created discursive texts explaining the feature-value relationships and a measure of
confidence of the CBR systems prediction being correct. We also present
the results of a preliminary user evaluation we have carried out on the
framework.It is clear from this evaluation that being right is important.
It appears that caveats and notes of caution when the system is uncertain
damage user confidence.
Please note: There is a known bug in some browsers that causes an
error when a user tries to view large pdf file within the browser window.
If you receive the message "The file is damaged and could not be
repaired", please try one of the solutions linked below based on the
browser you are using.
Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.