The Best Way to Instil Confidence is by Being Right An Evaluation of the Effectiveness of Case-Based Explanations in providing User Confidence
File Type:
PDFItem Type:
Technical ReportDate:
2005-02-07Citation:
Nugent, Conor; Cunningham, Padraig; Doyle, Donal. 'The Best Way to Instil Confidence is by Being Right An Evaluation of the Effectiveness of Case-Based Explanations in providing User Confidence'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2005-21, 2005, pp15Download Item:
TCD-CS-2005-21.pdf (PDF) 186.2Kb
Abstract:
Instilling confidence in the abilities of machine learning systems in end-users is seen as critical to their success in real world problems. One way in which this can be achieved is by providing users with
interpretable explanations of the system's predictions. CBR systems have
long been understood to have an inherent transparency that has particular advantages for explanations compared with other machine learning
techniques. However simply suppling the most similar case is often not
enough. In this paper we present a framework for providing interpretable
explanations of CBR systems which includes dynamically created discursive texts explaining the feature-value relationships and a measure of
confidence of the CBR systems prediction being correct. We also present
the results of a preliminary user evaluation we have carried out on the
framework.It is clear from this evaluation that being right is important.
It appears that caveats and notes of caution when the system is uncertain
damage user confidence.
Publisher:
Trinity College Dublin, Department of Computer ScienceType of material:
Technical ReportCollections:
Series/Report no:
Computer Science Technical ReportTCD-CS-2005-21
Availability:
Full text availableKeywords:
Computer ScienceLicences: