English
Related papers

Related papers: Concave Statistical Utility Maximization Bandits v…

200 papers

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

We consider finite-horizon restless bandits with multiple pulls per period, which play an important role in recommender systems, active learning, revenue management, and many other areas. While an optimal policy can be computed, in…

Optimization and Control · Mathematics 2021-07-27 Xiangyu Zhang , Peter I. Frazier

Pure exploration in multi-armed bandits has emerged as an important framework for modeling decision-making and search under uncertainty. In modern applications, however, one is often faced with a tremendously large number of options. Even…

Machine Learning · Computer Science 2022-11-22 Parth K. Thaker , Mohit Malu , Nikhil Rao , Gautam Dasarathy

We consider a stochastic multi-armed bandit setting and study the problem of constrained regret minimization over a given time horizon. Each arm is associated with an unknown, possibly multi-dimensional distribution, and the merit of an arm…

Machine Learning · Computer Science 2023-01-05 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Recently, adversarial imitation learning has shown a scalable reward acquisition method for inverse reinforcement learning (IRL) problems. However, estimated reward signals often become uncertain and fail to train a reliable statistical…

Machine Learning · Computer Science 2023-01-06 Dong-Sig Han , Hyunseo Kim , Hyundo Lee , Je-Hwan Ryu , Byoung-Tak Zhang

We consider the problem of tabular infinite horizon concave utility reinforcement learning (CURL) with convex constraints. For this, we propose a model-based learning algorithm that also achieves zero constraint violations. Assuming that…

Machine Learning · Computer Science 2023-11-20 Mridul Agarwal , Qinbo Bai , Vaneet Aggarwal

We study the stochastic multi-armed bandit (MAB) problem in the presence of side-observations across actions that occur as a result of an underlying network structure. In our model, a bipartite graph captures the relationship between…

Machine Learning · Computer Science 2017-07-14 Swapna Buccapatnam , Fang Liu , Atilla Eryilmaz , Ness B. Shroff

We introduce a new setting, optimize-and-estimate structured bandits. Here, a policy must select a batch of arms, each characterized by its own context, that would allow it to both maximize reward and maintain an accurate (ideally unbiased)…

Machine Learning · Computer Science 2023-01-25 Peter Henderson , Ben Chugg , Brandon Anderson , Kristen Altenburger , Alex Turk , John Guyton , Jacob Goldin , Daniel E. Ho

In this paper, we analyze the continuous armed bandit problems for nonconvex cost functions under certain smoothness and sublevel set assumptions. We first derive an upper bound on the expected cumulative regret of a simple bin splitting…

Machine Learning · Computer Science 2021-03-31 Puning Zhao , Lifeng Lai

In this paper, we analyze the local convergence rate of optimistic mirror descent methods in stochastic variational inequalities, a class of optimization problems with important applications to learning theory and machine learning. Our…

Optimization and Control · Mathematics 2021-07-06 Waïss Azizian , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

This memoir presents a systematic study of the utility maximization problem of an investor in a constrained and unbounded financial market. Building upon the work of Hu et al. (2005) [Ann. Appl. Probab., 15, 1691--1712] in a bounded…

Probability · Mathematics 2024-10-16 Ying Hu , Gechun Liang , Shanjian Tang

We consider a bandit problem which involves sequential sampling from two populations (arms). Each arm produces a noisy reward realization which depends on an observable random covariate. The goal is to maximize cumulative expected reward.…

Statistics Theory · Mathematics 2010-03-09 Philippe Rigollet , Assaf Zeevi

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

Optimization and Control · Mathematics 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

Optimization and Control · Mathematics 2019-11-06 Haihao Lu , Robert M. Freund

We study a finite-horizon restless multi-armed bandit problem with multiple actions, dubbed R(MA)^2B. The state of each arm evolves according to a controlled Markov decision process (MDP), and the reward of pulling an arm depends on both…

Machine Learning · Computer Science 2022-03-25 Guojun Xiong , Jian Li , Rahul Singh

Intrinsic rewards play a central role in handling the exploration-exploitation trade-off when designing sequential decision-making algorithms, in both foundational theory and state-of-the-art deep reinforcement learning. The LinUCB…

Machine Learning · Computer Science 2022-04-13 Jordan T. Ash , Cyril Zhang , Surbhi Goel , Akshay Krishnamurthy , Sham Kakade

Many stochastic optimization algorithms work by estimating the gradient of the cost function on the fly by sampling datapoints uniformly at random from a training set. However, the estimator might have a large variance, which inadvertently…

Machine Learning · Computer Science 2017-08-10 Farnood Salehi , L. Elisa Celis , Patrick Thiran

We consider infinite-horizon discounted Markov decision problems with finite state and action spaces and study the convergence rates of the projected policy gradient method and a general class of policy mirror descent methods, all with…

Optimization and Control · Mathematics 2022-03-08 Lin Xiao

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

We consider the problem of \emph{influence maximization}, the problem of maximizing the number of people that become aware of a product by finding the `best' set of `seed' users to expose the product to. Most prior work on this topic…

Social and Information Networks · Computer Science 2016-04-28 Sharan Vaswani , Laks. V. S. Lakshmanan , Mark Schmidt