An Online Framework for Supporting the Evaluation of Personalised Information Retrieval Systems
File Type:
PDFItem Type:
Conference PaperDate:
2011Citation:
Catherine Mulwa, Luca Longo, Séamus Lawless, Mary Sharp and Vincent Wade, An Online Framework for Supporting the Evaluation of Personalised Information Retrieval Systems, iUBICOM 11: The 6th International Workshop on Ubiquitous and Collaborative Computing, Northumbria University, 4 July 2011, BCS, 2011, 75-85Download Item:
An Online Framework for Supporting the Evaluation of Personalised Information Retrieval Systems .pdf (Published (publisher's copy) - Peer Reviewed) 950.0Kb
Abstract:
Scope - Personalised Information Retrieval (PIR) has been gaining attention because it investigates intelligent ways for enhancing content delivery. Web users can have personalised services and more accurate information. Problem - Several PIR systems have been proposed in the literature; however, they have not been properly tested or evaluated. Proposal - The authors propose a generally applicable web-based interface, which provides PIR developers and evaluators with: i) implicit recommendations on how to evaluate a specific PIR system; ii) a repository containing studies on user-centred and layered evaluation studies; iii) recommendations on how to best combine different evaluation methods, metrics and measurement criteria in order to most effectively evaluate their system; iv) a UCE methodology which details how to apply existing UCE techniques; v) a taxonomy of evaluations of adaptive systems; and vi) interface translation support (49 languages supported).
Sponsor
Grant Number
Science Foundation Ireland (SFI)
07/CE/I1142
Author's Homepage:
http://people.tcd.ie/vwadehttp://people.tcd.ie/selawles
http://people.tcd.ie/msharp
Description:
PUBLISHEDNorthumbria University
Other Titles:
iUBICOM 11: The 6th International Workshop on Ubiquitous and Collaborative ComputingPublisher:
BCSType of material:
Conference PaperCollections:
Availability:
Full text availableSubject (TCD):
Intelligent Content & CommunicationsLicences: