The University of Dublin | Trinity College -- Ollscoil Átha Cliath | Coláiste na Tríonóide
Trinity's Access to Research Archive
Home :: Log In :: Submit :: Alerts ::

School of Computer Science and Statistics >
Computer Science >
Computer Science Technical Reports >

Please use this identifier to cite or link to this item:

Title: Using Early-Stopping to Avoid Overfitting in Wrapper-Based Feature Selection Employing Stochastic Search
Author: Loughrey, John
Cunningham, Pádraig
Keywords: Computer Science
Issue Date: 11-May-2005
Publisher: Trinity College Dublin, Department of Computer Science
Citation: Loughrey, John; Cunningham, Pádraig. 'Using Early-Stopping to Avoid Overfitting in Wrapper-Based Feature Selection Employing Stochastic Search'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2005-37, 2005, pp6
Series/Report no.: Computer Science Technical Report
Abstract: It is acknowledged that overfitting can occur in feature selection using the wrapper method when there is a limited amount of training data available. It has also been shown that the severity of overfitting is related to the intensity of the search algorithm used during this process. In this paper we show that two stochastic search techniques (Simulated Annealing and Genetic Algorithms) that can be used for wrapper-based feature selection are susceptible to overfitting in this way. However, because of their stochastic nature, these algorithms can be stopped early to prevent overfitting. We present a framework that implements early-stopping for both of these stochastic search techniques and we show that this is successful in reducing the effects of overfitting and in increasing generalisation accuracy in most cases.
Appears in Collections:Computer Science Technical Reports

Files in This Item:

File Description SizeFormat
TCD-CS-2005-37.pdf175.69 kBAdobe PDFView/Open

This item is protected by original copyright

Please note: There is a known bug in some browsers that causes an error when a user tries to view large pdf file within the browser window. If you receive the message "The file is damaged and could not be repaired", please try one of the solutions linked below based on the browser you are using.

Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.


Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback