 |
Evaluation, Best Practices and Collaboration for Multilingual Information Access
|
Workshop on Novel Methodologies for Evaluation in Information Retrieval30th European Conference for Information Retrieval (ECIR 2008)
|
| 9.00-9.05 | Welcome and Opening Mark Sanderson |
| 9.05-9.50 | Invited Talk |
| 9.50-10.30 | Session 1: Evaluating the User Viewpoint |
| 9.50-10.15 | Towards the Evaluation of Literature Based Discovery Systems Ulises Cervi�o Beresi, Mark Baillie and Ian Ruthven |
| 10.15-10.30 | Changing the Subject - One Way of Measuring Trust in Information Jussi Karlgren |
| 10.30-11.00 | BREAK |
| 11.00-11.20 | Session 2: Experimental Collections for Web Evaluation |
| 11.00-11.10 | A large Time-Aware Web Graph Paolo Boldi, Massimo Santini and Sebastiano Vigna |
| 11.10-11.20 | Compressed Collections for Simulated Crawling Alessio Orlandi and Sebastiano Vigna |
| 11.20-12.10 | Session 3: Evaluation Challenges for New tasks |
| 11.20-11.45 | To Separate or Not to Separate: Reflections about Current GIR Practice Nuno Cardoso and Diana Santos |
| 11.45-12.10 | Dynamic Focused Retrieval of XML Documents and its Evaluation Toshiyuki Shimizu and Masatoshi Yoshikawa |
| 12.10-12.30 | Discussion |
| 12.30-14.00 | LUNCH |
| 14.00-14.40 | Invited Talk Evaluation of the Search Functionality of Enterprise Web Portals Martin Braschler |
| 14.40-15.30 | Session 3b: Evaluation Challenges for New Tasks |
| 14.40-15.05 | Large-Scale Interactive Evaluation of Multilingual Information Access Systems - the iCLEF Flickr Challenge Javier Artiles, Emma Barker, Paul Clough, Julio Gonzalo, Jussi Karlgren, Victor Peinado |
| 15.05-15.30 | How Many Experts? Gianluca Demartini |
| 15.30-16.00 | BREAK |
| 16.00-17.15 | Session 4: Alternative Evaluation Methods |
| 16.00-16.25 | Visual Vectora: An Interactive Visualization Tool for Cumulated Gain-based Retrieval Experiments Kalervo J�rvelin, Illka V�h�m�tt�nen, Heikki Keskustalo |
| 16.25-16.50 | Document Accessibility: Evaluating the Access Afforded to a Document by the Retrieval System Leif Azzopardi, Vishwa Vinay |
| 16.50-17.15 | Angle Seeking as a Scenario for Task-Based Evaluation of Information Access Technologies Emma J. Barker, Joe Polifroni, Marilyn Walker and Robert Gaizauskas |
| 17.15-17.30 | Discussion and Future Directions |
| This website is the sole responsibility of the TrebleCLEF consortium and does not necessarily represent the opinion of the European Commission. The Commission is not responsible for any use that might be made of the data appearing herein. ICT-1-4-1 Digital libraries and technology-enhanced learning. Grant agreement: 215231 |
|