English
Related papers

Related papers: Online Regularization towards Always-Valid High-Di…

200 papers

Optimization modeling plays a critical role in the application of Operations Research (OR) tools to address real-world problems, yet they pose challenges and require extensive expertise from OR experts. With the advent of large language…

Computation and Language · Computer Science 2025-07-30 Chenyu Huang , Zhengyang Tang , Shixi Hu , Ruoqing Jiang , Xin Zheng , Dongdong Ge , Benyou Wang , Zizhuo Wang

Reward shaping is critical in reinforcement learning (RL), particularly for complex tasks where sparse rewards can hinder learning. However, choosing effective shaping rewards from a set of reward functions in a computationally efficient…

Machine Learning · Computer Science 2025-02-26 Chen Bo Calvin Zhang , Zhang-Wei Hong , Aldo Pacchiano , Pulkit Agrawal

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

Optimization and Control · Mathematics 2018-11-05 Cheng Tan , Wing Shing Wong

We consider a dynamic pricing problem in network revenue management where customer behavior is predicted by a choice model, i.e., the multinomial logit (MNL) model. The problem, even in the static setting (i.e., customer demand remains…

Optimization and Control · Mathematics 2025-01-06 Qian Shao , Tien Mai , Shih-Fen Cheng

This paper studies an online selection problem, where a seller seeks to sequentially sell multiple copies of an item to arriving buyers. We consider an adversarial setting, making no modeling assumptions about buyers' valuations for the…

Computer Science and Game Theory · Computer Science 2024-10-11 Bo Sun , Hossein Nekouyan Jazi , Xiaoqi Tan , Raouf Boutaba

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

Optimization and Control · Mathematics 2019-02-04 Robert Ravier , Vahid Tarokh

We study episodic reinforcement learning (RL) in non-stationary linear kernel Markov decision processes (MDPs). In this setting, both the reward function and the transition kernel are linear with respect to the given feature maps and are…

Machine Learning · Computer Science 2024-12-24 Han Zhong , Zhongren Chen , Zhuoran Yang , Zhaoran Wang , Csaba Szepesvári

We study the Online Traveling Salesperson Problem (OLTSP) with predictions. In OLTSP, a sequence of initially unknown requests arrive over time at points (locations) of a metric space. The goal is, starting from a particular point of the…

Data Structures and Algorithms · Computer Science 2023-05-04 Evripidis Bampis , Bruno Escoffier , Themis Gouleakis , Niklas Hahn , Kostas Lakis , Golnoosh Shahkarami , Michalis Xefteris

First-price auctions have recently gained significant traction in digital advertising markets, exemplified by Google's transition from second-price to first-price auctions. Unlike in second-price auctions, where bidding one's private…

Machine Learning · Computer Science 2025-10-07 Zihao Hu , Xiaoyu Fan , Yuan Yao , Jiheng Zhang , Zhengyuan Zhou

We analyze a new approach to Machine Learning coming from a modification of classical regularization networks by casting the process in the time dimension, leading to a sort of collapse of dimensionality in the problem of learning the model…

Machine Learning · Computer Science 2017-01-05 Marco Gori , Marco Maggini , Alessandro Rossi

Follow-the-Regularized-Leader (FTRL) algorithms are a popular class of learning algorithms for online linear optimization (OLO) that guarantee sub-linear regret, but the choice of regularizer can significantly impact dimension-dependent…

Machine Learning · Computer Science 2024-10-24 Khashayar Gatmiry , Jon Schneider , Stefanie Jegelka

We consider the general problem of online convex optimization with time-varying additive constraints in the presence of predictions for the next cost and constraint functions. A novel primal-dual algorithm is designed by combining a…

Machine Learning · Computer Science 2022-01-11 Daron Anderson , George Iosifidis , Douglas J. Leith

We consider the problem of offline reinforcement learning with model-based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism-oriented agent under the learned model. Current model-based…

Machine Learning · Computer Science 2021-09-16 Ruizhen Liu , Dazhi Zhong , Zhicong Chen

In this paper, we propose control-theoretic methods as tools for the design of online optimization algorithms that are able to address dynamic, noisy, and partially uncertain time-varying quadratic objective functions. Our approach…

Optimization and Control · Mathematics 2025-02-03 Umberto Casti , Sandro Zampieri

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

Machine Learning · Computer Science 2023-02-14 Arnold Salas

One of the fundamental challenges for offline reinforcement learning (RL) is ensuring robustness to data distribution. Whether the data originates from a near-optimal policy or not, we anticipate that an algorithm should demonstrate its…

Machine Learning · Computer Science 2023-10-18 Xiaohan Hu , Yi Ma , Chenjun Xiao , Yan Zheng , Jianye Hao

We consider the problem of online planning in a Markov Decision Process when given only access to a generative model, restricted to open-loop policies - i.e. sequences of actions - and under budget constraint. In this setting, the Open-Loop…

Machine Learning · Computer Science 2019-04-10 Edouard Leurent , Odalric-Ambrym Maillard

Iterative jailbreak methods that repeatedly rewrite and input prompts into large language models (LLMs) to induce harmful outputs -- using the model's previous responses to guide each new iteration -- have been found to be a highly…

Computation and Language · Computer Science 2025-10-21 Masahiro Kaneko , Zeerak Talat , Timothy Baldwin

Decision-making under uncertainty is a critical aspect of many practical autonomous systems due to incomplete information. Partially Observable Markov Decision Processes (POMDPs) offer a mathematically principled framework for formulating…

Artificial Intelligence · Computer Science 2025-10-28 Moran Barenboim , Vadim Indelman

Online learning algorithms are designed to perform in non-stationary environments, but generally there is no notion of a dynamic state to model constraints on current and future actions as a function of past actions. State-based models are…

Machine Learning · Computer Science 2015-09-01 Peng Guan , Maxim Raginsky , Rebecca Willett