English
Related papers

Related papers: Dueling Optimization with a Monotone Adversary

200 papers

We revisit classic algorithmic search and optimization problems from the perspective of competition. Rather than a single optimizer minimizing expected cost, we consider a zero-sum game in which an optimization problem is presented to two…

Computer Science and Game Theory · Computer Science 2011-01-17 Nicole Immorlica , Adam Tauman Kalai , Brendan Lucier , Ankur Moitra , Andrew Postlewaite , Moshe Tennenholtz

This paper considers minimax optimization $\min_x \max_y f(x, y)$ in the challenging setting where $f$ can be both nonconvex in $x$ and nonconcave in $y$. Though such optimization problems arise in many machine learning paradigms including…

Machine Learning · Computer Science 2021-06-04 Tanner Fiez , Chi Jin , Praneeth Netrapalli , Lillian J. Ratliff

We address the problem of \emph{convex optimization with dueling feedback}, where the goal is to minimize a convex function given a weaker form of \emph{dueling} feedback. Each query consists of two points and the dueling feedback returns a…

Optimization and Control · Mathematics 2022-10-07 Aadirupa Saha , Tomer Koren , Yishay Mansour

This paper proposes an optimization algorithm based on how human fight and learn from each duelist. Since this algorithm is based on population, the proposed algorithm starts with an initial set of duelists. The duel is to determine the…

Neural and Evolutionary Computing · Computer Science 2015-12-03 Totok Ruki Biyanto , Henokh Yernias Fibrianto , Gunawan Nugroho , Erny Listijorini , Titik Budiati , Hairul Huda

We apply competitive analysis onto the problem of minimizing the number of queries to an oracle to completely reconstruct a given monotone Boolean function. Besides lower and upper bounds on the competitivity we determine optimal…

Data Structures and Algorithms · Computer Science 2014-02-03 Sascha Kurz

We consider a novel setting of zeroth order non-convex optimization, where in addition to querying the function value at a given point, we can also duel two points and get the point with the larger function value. We refer to this setting…

Machine Learning · Computer Science 2019-11-05 Yichong Xu , Aparna Joshi , Aarti Singh , Artur Dubrawski

This paper presents competitive algorithms for a novel class of online optimization problems with memory. We consider a setting where the learner seeks to minimize the sum of a hitting cost and a switching cost that depends on the previous…

Machine Learning · Computer Science 2021-01-11 Guanya Shi , Yiheng Lin , Soon-Jo Chung , Yisong Yue , Adam Wierman

The dueling bandit is a learning framework wherein the feedback information in the learning process is restricted to a noisy comparison between a pair of actions. In this research, we address a dueling bandit problem based on a cost…

Machine Learning · Statistics 2017-12-13 Wataru Kumagai

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

We consider Bayesian optimization in settings where observations can be adversarially biased, for example by an uncontrolled hidden confounder. Our first contribution is a reduction of the confounded setting to the dueling bandit model.…

Machine Learning · Statistics 2021-06-10 Johannes Kirschner , Andreas Krause

Online optimization covers problems such as online resource allocation, online bipartite matching, adwords (a central problem in e-commerce and advertising), and adwords with separable concave returns. We analyze the worst case competitive…

Data Structures and Algorithms · Computer Science 2016-11-03 Reza Eghbali , Maryam Fazel

Dueling optimization considers optimizing an objective with access to only a comparison oracle of the objective function. It finds important applications in emerging fields such as recommendation systems and robotics. Existing works on…

Optimization and Control · Mathematics 2026-03-03 Yuxuan Ren , Abhishek Roy , Shiqian Ma

We study the on-line minimum weighted bipartite matching problem in arbitrary metric spaces. Here, $n$ not necessary disjoint points of a metric space $M$ are given, and are to be matched on-line with $n$ points of $M$ revealed one by one.…

Data Structures and Algorithms · Computer Science 2007-06-06 Béla Csaba , András S. Pluhár

We address the challenge of designing optimal adversarial noise algorithms for settings where a learner has access to multiple classifiers. We demonstrate how this problem can be framed as finding strategies at equilibrium in a two-player,…

Machine Learning · Computer Science 2019-06-10 Juan C. Perdomo , Yaron Singer

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

Optimization and Control · Mathematics 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

We study the problem of zero-order optimization of a strongly convex function. The goal is to find the minimizer of the function by a sequential exploration of its values, under measurement noise. We study the impact of higher order…

Machine Learning · Computer Science 2022-11-28 Arya Akhavan , Massimiliano Pontil , Alexandre B. Tsybakov

We study competition in a general framework introduced by Immorlica et al. and answer their main open question. Immorlica et al. considered classic optimization problems in terms of competition and introduced a general class of games called…

Computer Science and Game Theory · Computer Science 2016-12-20 Sina Dehghani , MohammadTaghi Hajiaghayi , Hamid Mahini , Saeed Seddighin

We consider the problem of a learning agent who has to repeatedly play a general sum game against a strategic opponent who acts to maximize their own payoff by optimally responding against the learner's algorithm. The learning agent knows…

Computer Science and Game Theory · Computer Science 2025-02-21 Eshwar Ram Arunachaleswaran , Natalie Collina , Jon Schneider

The phenomenon of adversarial examples has been revealed in variant scenarios. Recent studies show that well-designed adversarial defense strategies can improve the robustness of deep learning models against adversarial examples. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jialiang Sun , Wen Yao , Tingsong Jiang , Xiaoqian Chen

Online algorithm is an important branch in algorithm design. Designing online algorithms with a bounded competitive ratio (in terms of worst-case performance) can be hard and usually relies on problem-specific assumptions. Inspired by…

Machine Learning · Computer Science 2021-11-22 Bingqian Du , Zhiyi Huang , Chuan Wu
‹ Prev 1 2 3 10 Next ›