User Simulation for Evaluating Information Access Systems (Foundations and Trends(r) in Information Retrieval)

Balog, Krisztian; Zhai, Chengxiang

ISBN 10: 1638283788 / ISBN 13: 9781638283782

Verlag: Now Publishers, 2024

Beschreibung

Bestandsnummer des Verkäufers 26401471333

Bibliografische Details

Titel: User Simulation for Evaluating Information ...

Verlag: Now Publishers

Erscheinungsdatum: 2024

Einband: Softcover

Zustand: New

Über diesen Titel

Inhaltsangabe:

Information access systems, such as search engines, recommender systems, and conversational assistants, have become integral to our daily lives as they help us satisfy our information needs. However, evaluating the effectiveness of these systems presents a complex scientific challenge, rooted in the difficulty of assessing a system’s overall effectiveness in assisting users to complete tasks through interactive support, and by the substantial variation in user behaviour and preferences. This monograph focuses on providing a thorough understanding of user simulation techniques designed specifically for evaluation purposes. The authors begin with a background of information access system evaluation and explore the diverse applications of user simulation. Subsequently, they systematically review the major research progress in user simulation, covering both general frameworks for designing user simulators, utilizing user simulation for evaluation, and specific models and algorithms for simulating user interactions with search engines, recommender systems, and conversational assistants. Realizing that user simulation is an interdisciplinary research topic, whenever possible, the authors establish connections with related fields, including machine learning, dialogue systems, user modelling, and economics.

This monograph provides a systematic review of user simulation techniques aimed at giving designers methods for successfully evaluating and improving modern information access systems.