The University of Dublin | Trinity College -- Ollscoil Átha Cliath | Coláiste na Tríonóide
Trinity's Access to Research Archive
Home :: Log In :: Submit :: Alerts ::

School of Computer Science and Statistics >
Computer Science >
Computer Science Technical Reports >

Please use this identifier to cite or link to this item:

Title: Generating Estimates of Classification Confidence for a Case-Based Spam Filter
Author: Delany, Sarah Jane
Cunningham, Pádraig
Doyle, Dónal
Keywords: Computer Science
Issue Date: 5-Feb-2005
Publisher: Trinity College Dublin, Department of Computer Science
Citation: Delany, Sarah Jane; Cunningham, Pádraig; Doyle, Doónal. 'Generating Estimates of Classification Confidence for a Case-Based Spam Filter'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2005-20, 2005, pp12
Series/Report no.: Computer Science Technical Report
Abstract: Producing estimates of classification confidence is surprisingly difficult. One might expect that classifiers that can produce numeric classification scores (e.g. k-Nearest Neighbour or Naive Bayes) could readily produce confidence estimates based on thresholds. In fact, this proves not to be the case, probably because these are not probabilistic classifiers in the strict sense. The numeric scores coming from k-Nearest Neighbour or Naive Bayes classifiers are not well correlated with classification confidence. In this paper we describe a case-based spam filtering application that would benefit significantly from an ability to attach confidence predictions to positive classifications (i.e. messages classified as spam). We show that ‘obvious’ confidence metrics for a case-based classifier are not effective. We propose an ensemble-like solution that aggregates a collection of confidence metrics and show that this offers an effective solution in this spam filtering domain.
Appears in Collections:Computer Science Technical Reports

Files in This Item:

File Description SizeFormat
TCD-CS-2005-20.pdf163.04 kBAdobe PDFView/Open

This item is protected by original copyright

Please note: There is a known bug in some browsers that causes an error when a user tries to view large pdf file within the browser window. If you receive the message "The file is damaged and could not be repaired", please try one of the solutions linked below based on the browser you are using.

Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.


Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback