English
Related papers

Related papers: Uncertainty-Calibrated Recommendations for Low-Act…

200 papers

Cognitive diagnosis models have been widely used in different areas, especially intelligent education, to measure users' proficiency levels on knowledge concepts, based on which users can get personalized instructions. As the measurement is…

Computers and Society · Computer Science 2024-03-25 Fei Wang , Qi Liu , Enhong Chen , Chuanren Liu , Zhenya Huang , Jinze Wu , Shijin Wang

Users who come to recommendation platforms are heterogeneous in activity levels. There usually exists a group of core users who visit the platform regularly and consume a large body of content upon each visit, while others are casual users…

Information Retrieval · Computer Science 2022-04-05 Jianling Wang , Ya Le , Bo Chang , Yuyan Wang , Ed H. Chi , Minmin Chen

Obtaining reliable and accurate quantification of uncertainty estimates from deep neural networks is important in safety-critical applications. A well-calibrated model should be accurate when it is certain about its prediction and indicate…

Machine Learning · Computer Science 2020-12-16 Ranganath Krishnan , Omesh Tickoo

Recommendation systems capable of providing diverse sets of results are a focus of increasing importance, with motivations ranging from fairness to novelty and other aspects of optimizing user experience. One form of diversity of recent…

Data Structures and Algorithms · Computer Science 2024-07-15 Jon Kleinberg , Emily Ryu , Éva Tardos

Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised…

Machine Learning · Statistics 2020-06-11 Jay Heo , Hae Beom Lee , Saehoon Kim , Juho Lee , Kwang Joon Kim , Eunho Yang , Sung Ju Hwang

Trust is a crucial factor affecting the adoption of machine learning (ML) models. Qualitative studies have revealed that end-users, particularly in the medical domain, need models that can express their uncertainty in decision-making…

Machine Learning · Computer Science 2023-04-21 Andrew Houston , Georgina Cosma

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Appropriate reliance is critical to achieving synergistic human-AI collaboration. For instance, when users over-rely on AI assistance, their human-AI team performance is bounded by the model's capability. This work studies how the…

Human-Computer Interaction · Computer Science 2024-01-17 Shiye Cao , Anqi Liu , Chien-Ming Huang

Recommender systems have made significant strides in various industries, primarily driven by extensive efforts to enhance recommendation accuracy. However, this pursuit of accuracy has inadvertently given rise to echo chamber/filter bubble…

Information Retrieval · Computer Science 2024-02-07 Tao Zhang , Luwei Yang , Zhibo Xiao , Wen Jiang , Wei Ning

Quantifying uncertainty and updating reliability are essential for ensuring the safety and performance of engineering systems. This study develops a hierarchical Bayesian modeling (HBM) framework to quantify uncertainty and update…

Methodology · Statistics 2024-12-31 Xinyu Jia , Weinan Hou , Costas Papadimitriou

Autonomous driving systems face the formidable challenge of navigating intricate and dynamic environments with uncertainty. This study presents a unified prediction and planning framework that concurrently models short-term aleatoric…

Robotics · Computer Science 2024-03-05 Wenbo Shao , Jiahui Xu , Zhong Cao , Hong Wang , Jun Li

Societal biases that are contained in retrieved documents have received increased interest. Such biases, which are often prevalent in the training data and learned by the model, can cause societal harms, by misrepresenting certain groups,…

Information Retrieval · Computer Science 2023-09-19 Maria Heuss , Daniel Cohen , Masoud Mansoury , Maarten de Rijke , Carsten Eickhoff

Debiased recommendation has recently attracted increasing attention from both industry and academic communities. Traditional models mostly rely on the inverse propensity score (IPS), which can be hard to estimate and may suffer from the…

Information Retrieval · Computer Science 2022-01-19 Mengyue Yang , Guohao Cai , Furui Liu , Zhenhua Dong , Xiuqiang He , Jianye Hao , Jun Wang , Xu Chen

Current person image retrieval methods have achieved great improvements in accuracy metrics. However, they rarely describe the reliability of the prediction. In this paper, we propose an Uncertainty-Aware Learning (UAL) method to remedy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zhaopeng Dou , Zhongdao Wang , Weihua Chen , Yali Li , Shengjin Wang

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

We introduce Unified Multimodal Uncertain Inference (UMUI), a multimodal inference task spanning text, audio, and video, where models must produce calibrated probability estimates of hypotheses conditioned on a premise in any modality or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dengjia Zhang , Alexander Martin , William Jurayj , Kenton Murray , Benjamin Van Durme , Reno Kriz

Deployed language models must decide not only what to answer but also when not to answer. We present UniCR, a unified framework that turns heterogeneous uncertainty evidence including sequence likelihoods, self-consistency dispersion,…

Computation and Language · Computer Science 2025-12-30 Markus Oehri , Giulia Conti , Kaviraj Pather , Alexandre Rossi , Laia Serra , Adrian Parody , Rogvi Johannesen , Aviaja Petersen , Arben Krasniqi

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

Despite extensive research on neural network calibration, existing methods typically apply global transformations that treat all predictions uniformly, overlooking the heterogeneous reliability of individual predictions. Furthermore, the…

Machine Learning · Computer Science 2025-10-22 Hassan Gharoun , Mohammad Sadegh Khorshidi , Kasra Ranjbarigderi , Fang Chen , Amir H. Gandomi

The high dynamics and heterogeneous interactions in the complicated urban systems have raised the issue of uncertainty quantification in spatiotemporal human mobility, to support critical decision-makings in risk-aware web applications such…

Machine Learning · Computer Science 2021-02-12 Zhengyang Zhou , Yang Wang , Xike Xie , Lei Qiao , Yuantao Li