English
Related papers

Related papers: Improved Regret in Stochastic Decision-Theoretic O…

200 papers

We design differentially private algorithms for the problem of prediction with expert advice under dynamic regret, also known as tracking the best expert. Our work addresses three natural types of adversaries, stochastic with shifting…

Machine Learning · Computer Science 2025-03-14 Aadirupa Saha , Vinod Raman , Hilal Asi

We study the Lipschitz bandit problem, where a learner sequentially maximizes an unknown Lipschitz function $f$ over a domain $\mathcal{X} \subset [0,1]^d$ using noisy pointwise evaluations. Existing regret bounds are either worst-case,…

Machine Learning · Statistics 2026-05-29 Marius Potfer , Vianney Perchet

Online kernel selection is a fundamental problem of online kernel methods.In this paper,we study online kernel selection with memory constraint in which the memory of kernel selection and online prediction procedures is limited to a fixed…

Machine Learning · Computer Science 2025-03-25 Junfan Li , Shizhong Liao

In this paper, we investigate one of the most fundamental nonconvex learning problems, ReLU regression, in the Differential Privacy (DP) model. Previous studies on private ReLU regression heavily rely on stringent assumptions, such as…

Machine Learning · Computer Science 2025-06-11 Meng Ding , Mingxi Lei , Shaowei Wang , Tianhang Zheng , Di Wang , Jinhui Xu

We derive the optimal differential privacy (DP) parameters of a mechanism that satisfies a given level of R\'enyi differential privacy (RDP). Our result is based on the joint range of two $f$-divergences that underlie the approximate and…

Information Theory · Computer Science 2020-01-17 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

We consider a stochastic lost-sales inventory control system with a lead time $L$ over a planning horizon $T$. Supply is uncertain, and is a function of the order quantity (due to random yield/capacity, etc). We aim to minimize the…

Optimization and Control · Mathematics 2023-11-01 Boxiao Chen , Jiashuo Jiang , Jiawei Zhang , Zhengyuan Zhou

We consider the problem of the Zinkevich (2003)-style dynamic regret minimization in online learning with exp-concave losses. We show that whenever improper learning is allowed, a Strongly Adaptive online learner achieves the dynamic regret…

Machine Learning · Computer Science 2021-07-06 Dheeraj Baby , Yu-Xiang Wang

In online learning, the dynamic regret metric chooses the reference (optimal) solution that may change over time, while the typical (static) regret metric assumes the reference solution to be constant over the whole time horizon. The…

Machine Learning · Computer Science 2019-09-04 Yawei Zhao , Shuang Qiu , Ji Liu

This paper addresses the critical challenge of stochastic latent heterogeneity in online decision-making, where individuals' responses to actions vary not only with observable contexts but also with unobserved, randomly realized subgroups.…

Machine Learning · Computer Science 2025-11-17 Elynn Chen , Xi Chen , Wenbo Jing , Xiao Liu

We give an oracle-based algorithm for the adversarial contextual bandit problem, where either contexts are drawn i.i.d. or the sequence of contexts is known a priori, but where the losses are picked adversarially. Our algorithm is…

Machine Learning · Computer Science 2016-06-02 Vasilis Syrgkanis , Haipeng Luo , Akshay Krishnamurthy , Robert E. Schapire

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regularly receive proposals for technological innovations and…

Machine Learning · Computer Science 2021-12-24 Nicolò Cesa-Bianchi , Tommaso Cesari , Yishay Mansour , Vianney Perchet

We address the online unconstrained submodular maximization problem (Online USM), in a setting with stochastic bandit feedback. In this framework, a decision-maker receives noisy rewards from a non monotone submodular function taking values…

Machine Learning · Computer Science 2025-02-13 Julien Zhou , Pierre Gaillard , Thibaud Rahier , Julyan Arbel

We study stochastic convex optimization (SCO) with heavy-tailed gradients under pure $\varepsilon$-differential privacy (DP). Instead of assuming a bound on the worst-case Lipschitz parameter of the loss, we assume only a bounded $k$-th…

Machine Learning · Computer Science 2026-05-06 Andrew Lowy

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

We introduce the $\texttt{$k$-experts}$ problem - a generalization of the classic Prediction with Expert's Advice framework. Unlike the classic version, where the learner selects exactly one expert from a pool of $N$ experts at each round,…

Information Theory · Computer Science 2022-02-18 Samrat Mukhopadhyay , Sourav Sahoo , Abhishek Sinha

Sample-efficient offline reinforcement learning (RL) with linear function approximation has recently been studied extensively. Much of prior work has yielded the minimax-optimal bound of $\tilde{\mathcal{O}}(\frac{1}{\sqrt{K}})$, with $K$…

Machine Learning · Computer Science 2023-01-30 Thanh Nguyen-Tang , Ming Yin , Sunil Gupta , Svetha Venkatesh , Raman Arora

We study reinforcement learning with delayed state observation, where the agent observes the current state after some random number of time steps. We propose an algorithm that combines the augmentation method and the upper confidence bound…

Machine Learning · Computer Science 2026-03-05 Harin Lee , Kevin Jamieson

We consider a variant of the online buffer management problem in network switches, called the $k$-frame throughput maximization problem ($k$-FTM). This problem models the situation where a large frame is fragmented into $k$ packets and…

Data Structures and Algorithms · Computer Science 2013-09-23 Jun Kawahara , Koji M. Kobayashi , Shuichi Miyazaki

We revisit the problem of linear regression under a differential privacy constraint. By consolidating existing pieces in the literature, we clarify the correct dependence of the feature, label and coefficient domains in the optimization…

Machine Learning · Statistics 2018-07-10 Yu-Xiang Wang

A constrained version of the online convex optimization (OCO) problem is considered. With slotted time, for each slot, first an action is chosen. Subsequently the loss function and the constraint violation penalty evaluated at the chosen…

Machine Learning · Computer Science 2023-01-25 Rahul Vaze