English
Related papers

Related papers: Minimax Regret Learning for Data with Heterogeneou…

200 papers

We study the kernelized bandit problem, that involves designing an adaptive strategy for querying a noisy zeroth-order-oracle to efficiently learn about the optimizer of an unknown function $f$ with a norm bounded by $M<\infty$ in a…

Machine Learning · Computer Science 2022-03-15 Shubhanshu Shekhar , Tara Javidi

Statistical performance bounds for reinforcement learning (RL) algorithms can be critical for high-stakes applications like healthcare. This paper introduces a new framework for theoretically measuring the performance of such algorithms…

Machine Learning · Computer Science 2018-01-03 Christoph Dann , Tor Lattimore , Emma Brunskill

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

Machine Learning · Computer Science 2019-05-28 Matthew Staib , Stefanie Jegelka

Regret in Large Language Models refers to their explicit regret expression when presented with evidence contradicting their previously generated misinformation. Studying the regret mechanism is crucial for enhancing model reliability and…

Computation and Language · Computer Science 2025-06-19 Xiangxiang Cui , Shu Yang , Tianjin Huang , Wanyu Lin , Lijie Hu , Di Wang

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR). Intuitively, the more references, the better…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Lin Zhang , Xin Li , Dongliang He , Errui Ding , Zhaoxiang Zhang

This paper addresses the critical challenge of stochastic latent heterogeneity in online decision-making, where individuals' responses to actions vary not only with observable contexts but also with unobserved, randomly realized subgroups.…

Machine Learning · Computer Science 2025-11-17 Elynn Chen , Xi Chen , Wenbo Jing , Xiao Liu

Empirical risk minimization (ERM) is a cornerstone of modern machine learning (ML), supported by advances in optimization theory that ensure efficient solutions with provable algorithmic and statistical learning rates. Privacy, memory,…

Machine Learning · Computer Science 2026-04-07 Cheng Fang , Rishabh Dixit , Waheed U. Bajwa , Mert Gurbuzbalaban

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang

Reinforcement Learning (RL) serves as a versatile framework for sequential decision-making, finding applications across diverse domains such as robotics, autonomous driving, recommendation systems, supply chain optimization, biology,…

Machine Learning · Computer Science 2024-08-26 Vaneet Aggarwal , Washim Uddin Mondal , Qinbo Bai

Uncertainty quantification is vital for decision-making and risk assessment in machine learning. Mean-variance regression models, which predict both a mean and residual noise for each data point, provide a simple approach to uncertainty…

Machine Learning · Statistics 2025-12-01 Eliot Wong-Toi , Alex Boyd , Vincent Fortuin , Stephan Mandt

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within…

Machine Learning · Computer Science 2025-06-03 Jiashuo Liu , Peng Cui

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Obtaining accurate class labels is often costly or unreliable, and may also be limited by privacy or other practical conditions. Compared with asking an annotator to provide the exact class, it is often easier to ask whether the true label…

Machine Learning · Computer Science 2026-05-11 Jiaxu Su , Junpeng Li , Changchun Hua , Yana Yang

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular or submodular…

Machine Learning · Computer Science 2023-05-25 Omid Sadeghi , Maryam Fazel

We consider a general statistical learning problem where an unknown fraction of the training data is corrupted. We develop a robust learning method that only requires specifying an upper bound on the corrupted data fraction. The method…

Machine Learning · Statistics 2020-02-10 Muhammad Osama , Dave Zachariah , Peter Stoica

Recent advances in Hierarchical Multi-label Classification (HMC), particularly neurosymbolic-based approaches, have demonstrated improved consistency and accuracy by enforcing constraints on a neural model during training. However, such…

Machine Learning · Computer Science 2025-12-29 Joshua Shay Kricheli , Khoa Vo , Aniruddha Datta , Spencer Ozgur , Paulo Shakarian

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks, carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased…

Information Retrieval · Computer Science 2026-01-22 Miaomiao Cai , Zhijie Zhang , Junfeng Fang , Zhiyong Cheng , Xiang Wang , Meng Wang

To address the shortcomings of real-world datasets, robust learning algorithms have been designed to overcome arbitrary and indiscriminate data corruption. However, practical processes of gathering data may lead to patterns of data…

Machine Learning · Computer Science 2024-05-02 Lunjia Hu , Charlotte Peale , Judy Hanwen Shen