English
Related papers

Related papers: Information-theoretic minimax and submodular optim…

200 papers

Learning Markov decision processes (MDPs) in the presence of the adversary is a challenging problem in reinforcement learning (RL). In this paper, we study RL in episodic MDPs with adversarial reward and full information feedback, where the…

Machine Learning · Computer Science 2022-04-21 Jiafan He , Dongruo Zhou , Quanquan Gu

We present a novel method for mixed-integer optimization problems with multivariate and Lipschitz continuous nonlinearities. In particular, we do not assume that the nonlinear constraints are explicitly given but that we can only evaluate…

Optimization and Control · Mathematics 2023-03-22 Julia Grübel , Richard Krug , Martin Schmidt , Winnifried Wollner

We address the problem of finding an optimal policy in a Markov decision process under a restricted policy class defined by the convex hull of a set of base policies. This problem is of great interest in applications in which a number of…

Machine Learning · Computer Science 2018-02-28 Ershad Banijamali , Yasin Abbasi-Yadkori , Mohammad Ghavamzadeh , Nikos Vlassis

We study the problem of causal structure learning over a set of random variables when the experimenter is allowed to perform at most $M$ experiments in a non-adaptive manner. We consider the optimal learning strategy in terms of minimizing…

Machine Learning · Computer Science 2017-03-01 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash

In this paper we investigate the local risk-minimization approach for a semimartingale financial market where there are restrictions on the available information to agents who can observe at least the asset prices. We characterize the…

Probability · Mathematics 2014-11-20 Claudia Ceci , Katia Colaneri , Alessandra Cretarola

Stochastic gradient descent (SGD) is one of the most widely used algorithms for large scale optimization problems. While classical theoretical analysis of SGD for convex problems studies (suffix) \emph{averages} of iterates and obtains…

Optimization and Control · Mathematics 2019-05-30 Prateek Jain , Dheeraj Nagaraj , Praneeth Netrapalli

Nash equilibrium} (NE) can be stated as a formal theorem on a multilinear form, free of game theory terminology. On the other hand, inspired by this formalism, we state and prove a {\it multilinear minimax theorem}, a generalization of von…

Computer Science and Game Theory · Computer Science 2024-01-01 Bahman Kalantari

Latent Markov (LM) models represent an important tool of analysis of longitudinal data when response variables are affected by time-varying unobserved heterogeneity, which is accounted for by a hidden Markov chain. In order to avoid bias…

Statistics Theory · Mathematics 2013-06-10 Francesco Bartolucci , Alessio Farcomeni

The selection of optimal designs for generalized linear mixed models is complicated by the fact that the Fisher information matrix, on which most optimality criteria depend, is computationally expensive to evaluate. Our focus is on the…

Methodology · Statistics 2015-09-22 Timothy W. Waite , David C. Woods

Classically, a mainstream approach for solving a convex-concave min-max problem is to instead solve the variational inequality problem arising from its first-order optimality conditions. Is it possible to solve min-max problems faster by…

Optimization and Control · Mathematics 2025-11-06 Henry Shugart , Jason M. Altschuler

In this paper we consider non-smooth convex optimization problems with (possibly) infinite intersection of constraints. In contrast to the classical approach, where the constraints are usually represented as intersection of simple sets,…

Optimization and Control · Mathematics 2024-01-11 Angelia Nedich , Ion Necoara

An important problem in applied dynamical systems is to compute the external forcing that provokes the largest response of a desired observable quantity. For this, we investigate the perturbation theory of Markov matrices in connection with…

Dynamical Systems · Mathematics 2025-07-21 Manuel Santos Gutierrez , Niccolo Zagli , Giulia Carigi

Which ads should we display in sponsored search in order to maximize our revenue? How should we dynamically rank information sources to maximize the value of the ranking? These applications exhibit strong diminishing returns: Redundancy…

Machine Learning · Computer Science 2014-07-07 Daniel Golovin , Andreas Krause , Matthew Streeter

We propose an efficient algorithm for finding first-order Nash equilibria in min-max problems of the form $\min_{x \in X}\max_{y\in Y} F(x,y)$, where the objective function is smooth in both variables and concave with respect to $y$; the…

Optimization and Control · Mathematics 2021-05-04 Dmitrii M. Ostrovskii , Andrew Lowy , Meisam Razaviyayn

We consider sequential decision problems in which we adaptively choose one of finitely many alternatives and observe a stochastic reward. We offer a new perspective of interpreting Bayesian ranking and selection problems as adaptive…

Machine Learning · Computer Science 2016-06-16 Yingfei Wang , Warren Powell

This article provides a comprehensive exploration of submodular maximization problems, focusing on those subject to uniform and partition matroids. Crucial for a wide array of applications in fields ranging from computer science to systems…

Data Structures and Algorithms · Computer Science 2025-01-03 Solmaz S. Kia

We obtain a new lower bound on the information-based complexity of first-order minimization of smooth and convex functions. We show that the bound matches the worst-case performance of the recently introduced Optimized Gradient Method,…

Optimization and Control · Mathematics 2016-06-07 Yoel Drori

In this paper, we study the minimax rates and provide an implementable convex algorithm for Poisson inverse problems under weak sparsity and physical constraints. In particular we assume the model $y_i \sim \mbox{Poisson}(Ta_i^{\top}f^*)$…

Statistics Theory · Mathematics 2017-12-19 Yuan Li , Garvesh Raskutti

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

Optimization and Control · Mathematics 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

Minimax optimization problems have attracted significant attention in recent years due to their widespread application in numerous machine learning models. To solve the minimax problem, a wide variety of stochastic optimization methods have…

Machine Learning · Computer Science 2024-06-12 Hongchang Gao