English
Related papers

Related papers: Metric Elicitation; Moving from Theory to Practice

200 papers

In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local "hill climbing" rather than more radical…

Information Retrieval · Computer Science 2023-01-31 Mehmet Deniz Türkmen , Matthew Lease , Mucahid Kutlu

Fashion preference is a fuzzy concept that depends on customer taste, prevailing norms in fashion product/style, henceforth used interchangeably, and a customer's perception of utility or fashionability, yet fashion e-retail relies on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Vikram Garg , Girish Sathyanarayana , Sumit Borar , Aruna Rajan

The evaluation of recommendation systems is a complex task. The offline and online evaluation metrics for recommender systems are ambiguous in their true objectives. The majority of recently published papers benchmark their methods using…

Information Retrieval · Computer Science 2023-08-15 Petr Kasalický , Rodrigo Alves , Pavel Kordík

We consider interactive tools that help users search for their most preferred item in a large collection of options. In particular, we examine example-critiquing, a technique for enabling users to incrementally construct preference models…

Artificial Intelligence · Computer Science 2011-10-04 B. Faltings , P. Pu , P. Viappiani

The ultimate goal of any software developer seeking a competitive edge is to meet stakeholders needs and expectations. To achieve this, it is necessary to effectively and accurately manage stakeholders system requirements. The paper…

Software Engineering · Computer Science 2018-03-19 Anupama Prasanth , Sandhia Valsala , Safeeullah Soomro

Multi-access edge computing (MEC) is an emerging paradigm that pushes resources for sensing, communications, computing, storage and intelligence (SCCSI) to the premises closer to the end users, i.e., the edge, so that they could leverage…

Networking and Internet Architecture · Computer Science 2022-04-19 Yiqin Deng , Xianhao Chen , Guangyu Zhu , Yuguang Fang , Zhigang Chen , Xiaoheng Deng

Meta-embedding (ME) learning is an emerging approach that attempts to learn more accurate word embeddings given existing (source) word embeddings as the sole input. Due to their ability to incorporate semantics from multiple source…

Computation and Language · Computer Science 2022-04-26 Danushka Bollegala , James O'Neill

Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additional metrics for considerations such as diversity and…

Information Retrieval · Computer Science 2023-09-13 Michael D. Ekstrand , Ben Carterette , Fernando Diaz

Gaining insights into the preferences of new users and subsequently personalizing recommendations necessitate managing user interactions intelligently, namely, posing pertinent questions to elicit valuable information effectively. In this…

Machine Learning · Computer Science 2023-09-04 Furkan Cantürk , Reyhan Aydoğan

The first part of this thesis focuses on maximizing the overall recommendation accuracy. This accuracy is usually evaluated with some user-oriented metric tailored to the recommendation scenario, but because recommendation is usually…

Information Retrieval · Computer Science 2023-11-14 Roger Zhe Li

Understanding consumer choice is fundamental to marketing and management research, as firms increasingly seek to personalize offerings and optimize customer engagement. Traditional choice modeling frameworks, such as multinomial logit (MNL)…

Machine Learning · Computer Science 2025-03-11 Diego Vallarino

Conversational and question-based recommender systems have gained increasing attention in recent years, with users enabled to converse with the system and better control recommendations. Nevertheless, research in the field is still limited,…

Information Retrieval · Computer Science 2020-06-01 Jie Zou , Yifan Chen , Evangelos Kanoulas

We study the problem of eliciting the preferences of a decision-maker through a moderate number of pairwise comparison queries to make them a high quality recommendation for a specific problem. We are motivated by applications in high…

Optimization and Control · Mathematics 2021-12-09 Phebe Vayanos , Yingxiao Ye , Duncan McElfresh , John Dickerson , Eric Rice

Algorithmic Recourse aims to provide actionable explanations, or recourse plans, to overturn potentially unfavourable decisions taken by automated machine learning models. In this paper, we propose an interaction paradigm based on a guided…

Human-Computer Interaction · Computer Science 2024-07-22 Seyedehdelaram Esfahani , Giovanni De Toni , Bruno Lepri , Andrea Passerini , Katya Tentori , Massimo Zancanaro

This paper introduces CLEO, a novel preference elicitation algorithm capable of recommending complex objects in hybrid domains, characterized by both discrete and continuous attributes and constraints defined over them. The algorithm…

Artificial Intelligence · Computer Science 2015-09-01 Paolo Campigotto , Roberto Battiti , Andrea Passerini

Requirements elicitation requires extensive knowledge and deep understanding of the problem domain where the final system will be situated. However, in many software development projects, analysts are required to elicit the requirements…

Software Engineering · Computer Science 2018-08-20 Zahra Shakeri Hossein Abad , Vincenzo Gervasi , Didar Zowghi , Ken Barker

The effectiveness of recommendation systems is pivotal to user engagement and satisfaction in online platforms. As these recommendation systems increasingly influence user choices, their evaluation transcends mere technical performance and…

Information Retrieval · Computer Science 2024-01-15 Aryan Jadon , Avinash Patil

We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is not known in closed…

Machine Learning · Computer Science 2022-03-23 Zhiyuan Jerry Lin , Raul Astudillo , Peter I. Frazier , Eytan Bakshy

Following recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas…

Information Retrieval · Computer Science 2018-09-05 Thanh Tran , Kyumin Lee , Yiming Liao , Dongwon Lee

Offline evaluation is a popular approach to determine the best algorithm in terms of the chosen quality metric. However, if the chosen metric calculates something unexpected, this miscommunication can lead to poor decisions and wrong…

Information Retrieval · Computer Science 2022-06-28 Yan-Martin Tamm , Rinchin Damdinov , Alexey Vasilev