中文
相关论文

相关论文: Competitive on-line learning with a convex loss fu…

200 篇论文

Inspired by the recent successes of Inverse Optimization (IO) across various application domains, we propose a novel offline Reinforcement Learning (ORL) algorithm for continuous state and action spaces, leveraging the convex loss function…

机器学习 · 计算机科学 2026-03-19 Ioannis Dimanidis , Tolga Ok , Peyman Mohajerin Esfahani

Machine learning is often used in competitive scenarios: Participants learn and fit static models, and those models compete in a shared platform. The common assumption is that in order to win a competition one has to have the best…

机器学习 · 计算机科学 2018-03-14 Amin Khajehnejad , Shima Hajimirza

Online learning represents an important family of machine learning algorithms, in which a learner attempts to resolve an online prediction (or any type of decision-making) task by learning a model/hypothesis from a sequence of data…

机器学习 · 计算机科学 2018-10-23 Steven C. H. Hoi , Doyen Sahoo , Jing Lu , Peilin Zhao

We study adversarial online nonparametric regression with general convex losses and propose a parameter-free learning algorithm that achieves minimax optimal rates. Our approach leverages chaining trees to compete against H{\"o}lder…

统计理论 · 数学 2025-04-14 Paul Liautaud , Pierre Gaillard , Olivier Wintenberger

The loss function is arguably among the most important hyperparameters for a neural network. Many loss functions have been designed to date, making a correct choice nontrivial. However, elaborate justifications regarding the choice of the…

机器学习 · 计算机科学 2022-10-31 Simon Dräger , Jannik Dunkelau

We design algorithms for online linear optimization that have optimal regret and at the same time do not need to know any upper or lower bounds on the norm of the loss vectors. We achieve adaptiveness to norms of loss vectors by scale…

机器学习 · 计算机科学 2015-07-03 Francesco Orabona , David Pal

We incorporate future information in the form of the estimated value of future gradients in online convex optimization. This is motivated by demand response in power systems, where forecasts about the current round, e.g., the weather or the…

最优化与控制 · 数学 2020-12-14 Antoine Lesage-Landry , Iman Shames , Joshua A. Taylor

Recent literature on online learning has focused on developing adaptive algorithms that take advantage of a regularity of the sequence of observations, yet retain worst-case performance guarantees. A complementary direction is to develop…

机器学习 · 计算机科学 2015-01-27 Ali Jadbabaie , Alexander Rakhlin , Shahin Shahrampour , Karthik Sridharan

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

机器学习 · 计算机科学 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

This paper is devoted to the online dominating set problem and its variants. We believe the paper represents the first systematic study of the effect of two limitations of online algorithms: making irrevocable decisions while not knowing…

数据结构与算法 · 计算机科学 2018-09-14 Joan Boyar , Stephan J. Eidenbenz , Lene M. Favrholdt , Michal Kotrbčík , Kim S. Larsen

Although hash function learning algorithms have achieved great success in recent years, most existing hash models are off-line, which are not suitable for processing sequential or online data. To address this problem, this work proposes an…

计算机视觉与模式识别 · 计算机科学 2017-04-10 Long-Kai Huang , Qiang Yang , Wei-Shi Zheng

This open problem asks whether there exists an online learning algorithm for binary classification that guarantees, for all target concepts, to make a sublinear number of mistakes, under only the assumption that the (possibly random)…

机器学习 · 计算机科学 2021-07-21 Steve Hanneke

We study the problem of online learning in competitive settings in the context of two-sided matching markets. In particular, one side of the market, the agents, must learn about their preferences over the other side, the firms, through…

人工智能 · 计算机科学 2022-06-07 Chinmay Maheshwari , Eric Mazumdar , Shankar Sastry

We consider a new and general online resource allocation problem, where the goal is to maximize a function of a positive semidefinite (PSD) matrix with a scalar budget constraint. The problem data arrives online, and the algorithm needs to…

最优化与控制 · 数学 2019-04-09 Reza Eghbali , James Saunderson , Maryam Fazel

We introduce a new protocol for prediction with expert advice in which each expert evaluates the learner's and his own performance using a loss function that may change over time and may be different from the loss functions used by the…

机器学习 · 计算机科学 2009-03-23 Alexey Chernov , Vladimir Vovk

An online decision-making problem is a learning problem in which a player repeatedly makes decisions in order to minimize the long-term loss. These problems that emerge in applications often have nonlinear combinatorial objective functions,…

机器学习 · 计算机科学 2024-04-29 Ken Yokoyama , Shinji Ito , Tatsuya Matsuoka , Kei Kimura , Makoto Yokoo

Ordinal regression is a classification task where classes have an order and prediction error increases the further the predicted class is from the true class. The standard approach for modeling ordinal data involves fitting parallel…

机器学习 · 计算机科学 2022-02-16 Fred Lu , Francis Ferraro , Edward Raff

The design of online algorithms has tended to focus on algorithms with worst-case guarantees, e.g., bounds on the competitive ratio. However, it is well-known that such algorithms are often overly pessimistic, performing sub-optimally on…

数据结构与算法 · 计算机科学 2020-12-11 Ali Zeynali , Bo Sun , Mohammad Hajiesmaili , Adam Wierman

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

机器学习 · 计算机科学 2023-02-22 Grégoire Mialon

Decision-making problems are commonly formulated as optimization problems, which are then solved to make optimal decisions. In this work, we consider the inverse problem where we use prior decision data to uncover the underlying…

最优化与控制 · 数学 2022-12-27 Rishabh Gupta , Qi Zhang