English
Related papers

Related papers: Conformal Inference under High-Dimensional Covaria…

200 papers

We address the problem of how to achieve optimal inference in distributed quantile regression without stringent scaling conditions. This is challenging due to the non-smooth nature of the quantile regression (QR) loss function, which…

Methodology · Statistics 2022-08-24 Kean Ming Tan , Heather Battey , Wen-Xin Zhou

Concept drift -- the change of the distribution over time -- poses significant challenges for learning systems and is of central interest for monitoring. Understanding drift is thus paramount, and drift localization -- determining which…

Machine Learning · Computer Science 2026-04-22 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart…

Methodology · Statistics 2023-10-16 Haeseong Moon , Wen-Xin Zhou

High dimensional data analysis for exploration and discovery includes three fundamental tasks: dimensionality reduction, clustering, and visualization. When the three associated tasks are done separately, as is often the case thus far,…

Machine Learning · Computer Science 2020-12-02 Stan Z. Li , Lirong Wu , Zelin Zang

Censored quantile regression (CQR) has become a valuable tool to study the heterogeneous association between a possibly censored outcome and a set of covariates, yet computation and statistical inference for CQR have remained a challenge…

Statistics Theory · Mathematics 2022-10-25 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

We investigate different methods for regularizing quantile regression when predicting either a subset of quantiles or the full inverse CDF. We show that minimizing an expected pinball loss over a continuous distribution of quantiles is a…

Machine Learning · Statistics 2021-02-11 Taman Narayan , Serena Wang , Kevin Canini , Maya Gupta

In this work, we address the problem of determining reliable policies in reinforcement learning (RL), with a focus on optimization under uncertainty and the need for performance guarantees. While classical RL algorithms aim at maximizing…

Machine Learning · Computer Science 2025-10-22 Nadir Farhi

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Data augmentation has been proven to be an effective technique for developing machine learning models that are robust to known classes of distributional shifts (e.g., rotations of images), and alignment regularization is a technique often…

Machine Learning · Computer Science 2022-06-07 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

This paper considers the problem of nonparametric quantile regression under the assumption that the target conditional quantile function is a composition of a sequence of low-dimensional functions. We study the nonparametric quantile…

Statistics Theory · Mathematics 2021-08-03 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Joel L. Horowitz , Jian Huang

Reinforcement Learning (RL) algorithms for safety alignment of Large Language Models (LLMs), such as Direct Preference Optimization (DPO), encounter the challenge of distribution shift. Current approaches typically address this issue…

Computation and Language · Computer Science 2025-06-17 Qiyuan Deng , Xuefeng Bai , Kehai Chen , Yaowei Wang , Liqiang Nie , Min Zhang

Linear Regression is a seminal technique in statistics and machine learning, where the objective is to build linear predictive models between a response (i.e., dependent) variable and one or more predictor (i.e., independent) variables. In…

Computational Geometry · Computer Science 2023-07-19 Suraj Shetiya , Shohedul Hasan , Abolfazl Asudeh , Gautam Das

This paper focuses on the problem of unbounded density ratio estimation -- an understudied yet critical challenge in statistical learning -- and its application to covariate shift adaptation. Much of the existing literature assumes that the…

Machine Learning · Statistics 2026-04-01 Ren-Rui Liu , Jun Fan , Lei Shi , Zheng-Chu Guo

As artificial intelligence (AI) / machine learning (ML) gain widespread adoption, practitioners are increasingly seeking means to quantify and control the risk these systems incur. This challenge is especially salient when such systems have…

Machine Learning · Computer Science 2024-06-06 Drew Prinster , Samuel Stanton , Anqi Liu , Suchi Saria

The rapid proliferation of large language models and natural language processing (NLP) applications creates a crucial need for uncertainty quantification to mitigate risks such as hallucinations and to enhance decision-making reliability in…

Computation and Language · Computer Science 2024-05-06 Margarida M. Campos , António Farinhas , Chrysoula Zerva , Mário A. T. Figueiredo , André F. T. Martins

Convolutional image classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, hindering their deployment in consequential settings. Existing uncertainty quantification techniques,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Anastasios Angelopoulos , Stephen Bates , Jitendra Malik , Michael I. Jordan

We revisit the problem of constructing predictive confidence sets for which we wish to obtain some type of conditional validity. We provide new arguments showing how ``split conformal'' methods achieve near desired coverage levels with high…

Statistics Theory · Mathematics 2025-03-04 John C. Duchi

We study the coverage properties of full conformal regression in the proportional asymptotic regime where the ratio of the dimension and the sample size converges to a constant. In this setting, existing theory tells us only that full…

Statistics Theory · Mathematics 2025-03-03 Isaac Gibbs , Emmanuel J. Candès

Conventional reinforcement learning (RL) algorithms exhibit broad generality in their theoretical formulation and high performance on several challenging domains when combined with powerful function approximation. However, developing RL…

Machine Learning · Computer Science 2023-11-07 Joseph Modayil , Zaheer Abbas

Distribution alignment has many applications in deep learning, including domain adaptation and unsupervised image-to-image translation. Most prior work on unsupervised distribution alignment relies either on minimizing simple non-parametric…

Machine Learning · Computer Science 2020-10-27 Ben Usman , Avneesh Sud , Nick Dufour , Kate Saenko