Trinity College Dublin, Department of Computer Science
Loughrey, John; Cunningham, Pádraig. 'Using Early-Stopping to Avoid Overfitting in Wrapper-Based Feature Selection Employing Stochastic Search'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2005-37, 2005, pp6
Computer Science Technical Report TCD-CS-2005-37
It is acknowledged that overfitting can occur in feature selection using the wrapper
method when there is a limited amount of
training data available. It has also been
shown that the severity of overfitting is related to the intensity of the search algorithm used during this process. In this paper we show that two stochastic search techniques (Simulated Annealing and Genetic Algorithms) that can be used for wrapper-based
feature selection are susceptible to overfitting in this way. However, because of their
stochastic nature, these algorithms can be
stopped early to prevent overfitting. We
present a framework that implements early-stopping for both of these stochastic search
techniques and we show that this is successful in reducing the effects of overfitting and
in increasing generalisation accuracy in most
Please note: There is a known bug in some browsers that causes an
error when a user tries to view large pdf file within the browser window.
If you receive the message "The file is damaged and could not be
repaired", please try one of the solutions linked below based on the
browser you are using.
Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.