English
Related papers

Related papers: A Framework for Treating Model Uncertainty in the …

200 papers

AI-driven decision-making systems are becoming instrumental in the public sector, with applications spanning areas like criminal justice, social welfare, financial fraud detection, and public health. While these systems offer great…

Machine Learning · Computer Science 2024-10-15 Unai Fischer-Abaigar , Christoph Kern , Noam Barda , Frauke Kreuter

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

When large language models (LLMs) are asked to perform certain tasks, how can we be sure that their learned representations align with reality? We propose a domain-agnostic framework for systematically evaluating distribution shifts in LLMs…

Computation and Language · Computer Science 2024-10-01 Tanush Chopra , Michael Li , Jacob Haimes

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

Multi-agent LLM frameworks are widely used to accelerate the development of agent systems powered by large language models (LLMs). These frameworks impose distinct architectural structures that govern how agents interact, store information,…

Artificial Intelligence · Computer Science 2026-02-04 Abdelghny Orogat , Ana Rostam , Essam Mansour

Machine learning is central to empirical asset pricing, but portfolio construction still relies on point predictions and largely ignores asset-specific estimation uncertainty. We propose a simple change: sort assets using…

Portfolio Management · Quantitative Finance 2026-01-05 Yan Liu , Ye Luo , Zigan Wang , Xiaowei Zhang

We establish sharp upper and lower bounds for distortion risk metrics under distributional uncertainty. The uncertainty sets are characterized by four key features of the underlying distribution: mean, variance, unimodality, and Wasserstein…

Risk Management · Quantitative Finance 2025-11-13 Peng Liu , Steven Vanduffel , Yi Xia

Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly correlated with performance in real-world applications -- a…

Machine Learning · Computer Science 2024-06-18 Olivier Binette , Jerome P. Reiter

The reproduction of realistic dynamics in financial markets is of great significance, as it enhances our understanding of market evolution beyond other physical processes, and facilitates the development and backtesting of investment…

Multiagent Systems · Computer Science 2025-10-14 Tianlang He , Fengming Zhu , Keyan Lu , Chang Xu , Yang Liu , Weiqing Liu , Fangzhen Lin , S. -H. Gary Chan , Jiang Bian

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

Concentrated liquidity provision in decentralized exchanges presents a fundamental Impulse Control problem. Liquidity Providers (LPs) face a non-trivial trade-off between maximizing fee accrual through tight price-range concentration and…

Machine Learning · Computer Science 2026-03-10 Pranay Anchuri

Machine learning (ML) classification models are increasingly being used in a wide range of applications where it is important that predictions are accompanied by uncertainties, including in climate and earth observation, medical diagnosis…

Machine Learning · Computer Science 2025-11-13 Samuel Bilson , Maurice Cox , Anna Pustogvar , Andrew Thompson

Accurately diagnosing bearing faults is crucial for maintaining the efficient operation of rotating machinery. However, traditional diagnosis methods face challenges due to the diversification of application environments, including…

Signal Processing · Electrical Eng. & Systems 2024-11-06 Laifa Tao , Haifei Liu , Guoao Ning , Wenyan Cao , Bohao Huang , Chen Lu

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Process capability indices such as $C_{pk}$ are widely used for manufacturing decisions, yet are typically applied via deterministic thresholding of finite-sample estimates, ignoring uncertainty and leading to unstable outcomes near the…

Applications · Statistics 2026-04-16 Fei Jiang , Lei Yang

Reward factorization personalizes large language models (LLMs) by decomposing rewards into shared basis functions and user-specific weights. Yet, existing methods estimate user weights from scarce data in isolation and as deterministic…

Computation and Language · Computer Science 2026-04-02 Gyuseok Lee , Wonbin Kweon , Zhenrui Yue , SeongKu Kang , Jiawei Han , Dong Wang

The application of machine learning (ML) techniques in wireless communication domain has seen a tremendous growth over the years especially in the wireless sensing domain. However, the questions surrounding the ML model's inference…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Amit Kachroo , Sai Prashanth Chinnapalli

We present a novel statistical framework for analyzing stereotypes in large language models (LLMs) by systematically estimating the bias and variation in their generation. Current alignment evaluation metrics often overlook stereotypes'…

Computation and Language · Computer Science 2025-05-27 Yiran Liu , Ke Yang , Zehan Qi , Xiao Liu , Yang Yu , ChengXiang Zhai

In behavioral finance, aversion affects investors' judgment of future uncertainty when profit and loss occur. Considering investors' aversion to loss and risk, and the ambiguous uncertainty characterizing asset returns, we construct a…

Optimization and Control · Mathematics 2022-05-06 Xin Zhang

We present a practical framework for detecting errors in LLM-generated SQL by estimating uncertainty at the level of individual nodes in the query's abstract syntax tree (AST). Our approach proceeds in two stages. First, we introduce a…

Machine Learning · Computer Science 2025-11-21 Hilaf Hasson , Ruocheng Guo