 |
|
|||
| Authors: | Effie Lai-Chong Law, Tomaz Klobucar, Matic Pipan |
| Group: | Communication Systems |
| Type: | Inproceedings |
| Title: | User Effect in Evaluating Personalized Information Retrieval Systems |
| Year: | 2006 |
| Month: | October |
| Pub-Key: | elaw06c |
| Keywords: | search engine, personalization, user effect, usability |
| Publisher: | Springer LNCS |
| Abstract: | Evaluation of personalized information retrieval (IR) systems is challenged by the user effect, which is manifested in terms of users’ inconsistency in relevance judgment, ranking and relevance criteria usage. Two empirical studies on evaluating a personalized search engine were performed. Two types of relative measures computed with different mathematical formulae were compared. The ranking similarity and the randomness of relevance criteria usage were estimated. Results show some undesirable personalization effects. Implications for the future development and research of adaptive IR systems are discussed. |
| Location: | First European Conference for Technology-Enhanced Learning (EC-TEL 2006), 1-4 Oct, Crete, Greece |
| Resources: | [BibTeX] |
