English
Related papers

Related papers: Extension of Minimax for Algorithmic Lower Bounds

200 papers

Here we propose a general theoretical method for analyzing the risk bound in the presence of adversaries. Specifically, we try to fit the adversarial learning problem into the minimax framework. We first show that the original adversarial…

Machine Learning · Statistics 2019-01-25 Zhuozhuo Tu , Jingwei Zhang , Dacheng Tao

Machine learning models trained on uncurated datasets can often end up adversely affecting inputs belonging to underrepresented groups. To address this issue, we consider the problem of adaptively constructing training sets which allow us…

Machine Learning · Computer Science 2021-07-21 Shubhanshu Shekhar , Greg Fields , Mohammad Ghavamzadeh , Tara Javidi

We obtain limit theorems for extreme residuals in linear regression model in the case of minimax estimation of parameters.

Probability · Mathematics 2015-10-08 Aleksander Ivanov , Ivan Matsak , Sergiy Polotskiy

The running maximum-minimum (max-min) filter computes the maxima and minima over running windows of size w. This filter has numerous applications in signal processing and time series analysis. We present an easy-to-implement online…

Data Structures and Algorithms · Computer Science 2012-01-16 Daniel Lemire

Theory and algorithms are developed for detecting changes in the distribution of statistically periodic random processes. The statistical periodicity is modeled using independent and periodically identically distributed processes, a new…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Taposh Banerjee , Prudhvi Gurram , Gene Whipps

We consider the first, and most well studied, speed scaling problem in the algorithmic literature: where the scheduling quality of service measure is a deadline feasibility constraint, and where the power objective is to minimize the total…

Data Structures and Algorithms · Computer Science 2013-07-03 Ahmed Abousamra , David P. Bunde , Kirk Pruhs

Vector operators based on robust order statistics have proved successful in digital multichannel imaging applications, particularly color image filtering and enhancement, in dealing with impulsive noise while preserving edges and fine image…

Computer Vision and Pattern Recognition · Computer Science 2010-09-07 M. Emre Celebi , Hassan A. Kingravi , Rastislav Lukac , Fatih Celiker

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

Optimization and Control · Mathematics 2019-02-04 Robert Ravier , Vahid Tarokh

In this article, we develop an algorithm suitable for constrained optimization in $\mathbb{R}^n$. The results are developed through standard tools of n-dimensional real analysis and basic concepts of optimization. Indeed, the well known…

Optimization and Control · Mathematics 2019-02-26 Fabio Botelho

Optimal transport distances have become a classic tool to compare probability distributions and have found many applications in machine learning. Yet, despite recent algorithmic developments, their complexity prevents their direct use on…

Machine Learning · Statistics 2021-01-07 Kilian Fatras , Younes Zine , Szymon Majewski , Rémi Flamary , Rémi Gribonval , Nicolas Courty

We study the problem of designing minimax procedures in linear regression under the quantile risk. We start by considering the realizable setting with independent Gaussian noise, where for any given noise level and distribution of inputs,…

Statistics Theory · Mathematics 2024-06-19 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

Minimax optimization has found extensive applications in modern machine learning, in settings such as generative adversarial networks (GANs), adversarial training and multi-agent reinforcement learning. As most of these applications involve…

Machine Learning · Computer Science 2020-08-18 Chi Jin , Praneeth Netrapalli , Michael I. Jordan

Optimising queries in real-world situations under imperfect conditions is still a problem that has not been fully solved. We consider finding the optimal order in which to execute a given set of selection operators under partial ignorance…

Databases · Computer Science 2015-07-30 Khaled H. Alyoubi , Sven Helmer , Peter T. Wood

A popular line of recent research incorporates ML advice in the design of online algorithms to improve their performance in typical instances. These papers treat the ML algorithm as a black-box, and redesign online algorithms to take…

Machine Learning · Computer Science 2022-05-19 Keerti Anand , Rong Ge , Debmalya Panigrahi

We give novel algorithms for multi-task and lifelong linear bandits with shared representation. Specifically, we consider the setting where we play $M$ linear bandits with dimension $d$, each for $T$ rounds, and these $M$ bandit tasks share…

Machine Learning · Computer Science 2022-03-30 Jiaqi Yang , Qi Lei , Jason D. Lee , Simon S. Du

Online optimization problems arise in many resource allocation tasks, where the future demands for each resource and the associated utility functions change over time and are not known apriori, yet resources need to be allocated at every…

Optimization and Control · Mathematics 2015-02-06 Reza Eghbali , Jon Swenson , Maryam Fazel

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

The performance of decision policies and prediction models often deteriorates when applied to environments different from the ones seen during training. To ensure reliable operation, we analyze the stability of a system under distribution…

Machine Learning · Statistics 2026-02-13 Hongseok Namkoong , Yuanzhe Ma , Peter W. Glynn

The research area of algorithms with predictions has seen recent success showing how to incorporate machine learning into algorithm design to improve performance when the predictions are correct, while retaining worst-case guarantees when…

Machine Learning · Computer Science 2022-12-06 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Sergei Vassilvitskii

We study a variant of a recently introduced min-max optimization framework where the max-player is constrained to update its parameters in a greedy manner until it reaches a first-order stationary point. Our equilibrium definition for this…

Machine Learning · Computer Science 2022-07-04 Vijay Keswani , Oren Mangoubi , Sushant Sachdeva , Nisheeth K. Vishnoi
‹ Prev 1 8 9 10 Next ›