The University of Dublin | Trinity College -- Ollscoil Átha Cliath | Coláiste na Tríonóide
Trinity's Access to Research Archive
Home :: Log In :: Submit :: Alerts ::

TARA >
School of Computer Science and Statistics >
Computer Science >
Computer Science (Scholarly Publications) >

Please use this identifier to cite or link to this item: http://hdl.handle.net/2262/62176

Title: A Proposal for the Evaluation of Adaptive Information Retrieval Systems using Simulated Interaction
Author: SHARP, MARY
WADE, VINCENT PATRICK
LAWLESS, SEAMUS
MULWA, CATHERINE
Author's Homepage: http://people.tcd.ie/selawles
http://people.tcd.ie/msharp
http://people.tcd.ie/vwade
http://people.tcd.ie/mulwac
Keywords: Information Storage and Retrieval
Relevance Feedback
Issue Date: 2010
Publisher: ACM
Citation: Catherine Mulwa, Wei Li, Séamus Lawless, and Gareth Jones, A Proposal for the Evaluation of Adaptive Information Retrieval Systems using Simulated Interaction, Workshop on the Simulation of Interaction in Automated Evaluation of Interactive Information Retrieval, SimInt 2010, at the 33rd Annual ACM SIGIR Conference, SIGIR, Geneva, Switzerland., July 19th-23rd, ACM, 2010, 5 - 6
Abstract: The Centre for Next Generation Localisation (CNGL) is involved in building interactive adaptive systems which combine Information Retrieval (IR), Adaptive Hypermedia (AH) and adaptive web techniques and technologies. The complex functionality of these systems coupled with the variety of potential users means that the experiments necessary to evaluate such systems are difficult to plan, implement and execute. This evaluation requires both component-level scientific evaluation and user- based evaluation. Automated replication of experiments and simulation of user interaction would be hugely beneficial in the evaluation of adaptive information retrieval systems (AIRS). This paper proposes a methodology for the evaluation of AIRS which leverages simulated interaction. The hybrid approach detailed combines: (i) user-centred methods for simulating interaction and personalisation; (ii) evaluation metrics that combine Human Computer Interaction (HCI), AH and IR techniques; and (iii) the use of qualitative and quantitative evaluations. The benefits and limitations of evaluations based on user simulations are also discussed.
Description: PUBLISHED
URI: http://hdl.handle.net/2262/62176
Related links: http://www.mansci.uwaterloo.ca/~msmucker/publications/simint10proceedings.pdf
http://www.scss.tcd.ie/seamus.lawless/papers/SIMINT2010.pdf
Appears in Collections:Computer Science (Scholarly Publications)

Files in This Item:

File Description SizeFormat
Paper21CameraReady.pdfPublished (publisher's copy) - Peer Reviewed100.58 kBAdobe PDFView/Open


This item is protected by original copyright


Please note: There is a known bug in some browsers that causes an error when a user tries to view large pdf file within the browser window. If you receive the message "The file is damaged and could not be repaired", please try one of the solutions linked below based on the browser you are using.

Items in TARA are protected by copyright, with all rights reserved, unless otherwise indicated.

 

Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback