English
Related papers

Related papers: On tracking varying bounds when forecasting bounde…

200 papers

This work investigates the challenge of ensuring safety guarantees in the presence of uncontrollable agents, whose behaviors are stochastic and depend on both their own and the system's states. We present a neural model predictive control…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shuqi Wang , Mingyang Feng , Yu Chen , Yue Gao , Xiang Yin

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

We study quasi-convex optimization problems, where only a subset of the constraints can be sampled, and yet one would like a probabilistic guarantee on the obtained solution with respect to the initial (unknown) optimization problem. Even…

Optimization and Control · Mathematics 2021-01-06 Guillaume O. Berger , Raphaël M. Jungers , Zheming Wang

We present online prediction methods for time series that let us explicitly handle nonstationary artifacts (e.g. trend and seasonality) present in most real time series. Specifically, we show that applying appropriate transformations to…

Machine Learning · Statistics 2018-08-28 Christopher Xie , Avleen Bijral , Juan Lavista Ferres

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

We present an algorithm for robust model predictive control with consideration of uncertainty and safety constraints. Our framework considers a nonlinear dynamical system subject to disturbances from an unknown but bounded uncertainty set.…

Optimization and Control · Mathematics 2021-04-23 Dongchan Lee , Konstantin Turitsyn , Jean-Jacques Slotine

In this work, we propose a control scheme for linear systems subject to pointwise in time state and input constraints that aims to minimize time-varying and a priori unknown cost functions. The proposed controller is based on online convex…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Marko Nonhoff , Johannes Köhler , Matthias A. Müller

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

We propose a novel framework for learning time-varying graphs from spatiotemporal measurements. Given an appropriate prior on the temporal behavior of signals, our proposed method can estimate time-varying graphs from a small number of…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Haruki Yokota , Koki Yamada , Yuichi Tanaka , Antonio Ortega

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

Machine Learning · Computer Science 2021-02-16 Nicolò Campolongo , Francesco Orabona

We propose a general framework for studying adaptive regret bounds in the online learning framework, including model selection bounds and data-dependent bounds. Given a data- or model-dependent bound we ask, "Does there exist some algorithm…

Machine Learning · Computer Science 2020-02-14 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

Deep learning optimization exhibits structure that is not captured by worst-case gradient bounds. Empirically, gradients along training trajectories are often temporally predictable and evolve within a low-dimensional subspace. In this work…

Machine Learning · Computer Science 2026-01-09 Anherutowa Calvo

When deploying autonomous systems in unknown and changing environments, it is critical that their motion planning and control algorithms are computationally efficient and can be reapplied online in real time, whilst providing theoretical…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Seth Siriya , Mo Chen , Ye Pu

Time series forecasting is ubiquitous in the modern world. Applications range from health care to astronomy, and include climate modelling, financial trading and monitoring of critical engineering equipment. To offer value over this range…

Machine Learning · Statistics 2018-10-26 Bernardo Pérez Orozco , Gabriele Abbati , Stephen Roberts

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

Optimization and Control · Mathematics 2019-02-04 Robert Ravier , Vahid Tarokh

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

This paper considers unconstrained convex optimization problems with time-varying objective functions. We propose algorithms with a discrete time-sampling scheme to find and track the solution trajectory based on prediction and correction…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Aryan Mokhtari , Alec Koppel , Geert Leus , Alejandro Ribeiro