The University of Dublin | Trinity College -- Ollscoil Átha Cliath | Coláiste na Tríonóide
Trinity's Access to Research Archive
Home :: Log In :: Submit :: Alerts ::

TARA >
School of Computer Science and Statistics >
Computer Science >
Computer Science Technical Reports >

Please use this identifier to cite or link to this item: http://hdl.handle.net/2262/13504

Title: Calibrating Probability Density Forecasts with Multi-objective Search
Author: Carney, Michael
Cunningham, Pádraig
Keywords: Computer Science
Issue Date: 10-Feb-2006
Publisher: Trinity College Dublin, Department of Computer Science
Citation: Carney, Michael; Cunningham, Pádraig. 'Calibrating Probability Density Forecasts with Multi-objective Search'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2006-07, 2006, pp12
Series/Report no.: Computer Science Technical Report
TCD-CS-2006-07
Abstract: In this paper, we show that the optimization of density forecasting models for regression in machine learning can be formulated as a multi-objective problem.We describe the two objectives of sharpness and calibration and suggest suitable scoring metrics for both.We use the popular negative log-likelihood as a measure of sharpness and the probability integral transform as a measure of calibration. We show how optimization on negative log-likelihood alone often results in sub-optimal models. To solve this problem we introduce a multi-objective evolutionary optimization framework that can produce better density forecasts from a prediction users perspective. Our experiments show improvements over state-of-the-art approaches.
URI: https://www.cs.tcd.ie/publications/tech-reports/reports.06/TCD-CS-2006-07.pdf
http://hdl.handle.net/2262/13504
Appears in Collections:Computer Science Technical Reports

Files in This Item:

File Description SizeFormat
TCD-CS-2006-07.pdf290.48 kBAdobe PDFView/Open


This item is protected by original copyright


Please note: There is a known bug in some browsers that causes an error when a user tries to view large pdf file within the browser window. If you receive the message "The file is damaged and could not be repaired", please try one of the solutions linked below based on the browser you are using.

Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.

 

Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback