中文
相关论文

相关论文: $\mathcal{L}_{1}$ Adaptive Optimizer for Online Ti…

200 篇论文

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents. For a time-varying graph, we propose a distributed online primal-dual algorithm with compressed communication…

最优化与控制 · 数学 2025-09-01 Kunpeng Zhang , Lei Xu , Xinlei Yi , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

An online decision-making problem is a learning problem in which a player repeatedly makes decisions in order to minimize the long-term loss. These problems that emerge in applications often have nonlinear combinatorial objective functions,…

机器学习 · 计算机科学 2024-04-29 Ken Yokoyama , Shinji Ito , Tatsuya Matsuoka , Kei Kimura , Makoto Yokoo

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

机器学习 · 计算机科学 2023-02-14 Arnold Salas

In this paper, a convex optimization-based method is proposed for numerically solving dynamic programs in continuous state and action spaces. The key idea is to approximate the output of the Bellman operator at a particular state by the…

最优化与控制 · 数学 2020-10-23 Insoon Yang

Stochastic optimization methods encounter new challenges in the realm of streaming, characterized by a continuous flow of large, high-dimensional data. While first-order methods, like stochastic gradient descent, are the natural choice,…

统计理论 · 数学 2024-02-02 Antoine Godichon-Baggioni , Nicklas Werge

This paper proposes a first-order total variation diminishing (TVD) treatment for coarsening and refining of local timestep size in response to dynamic local variations in wave speeds for nonlinear conservation laws. The algorithm is…

数值分析 · 数学 2020-03-23 Maximilian Bremer , John Bachan , Cy Chan , Clint Dawson

Online Convex Optimization plays a key role in large scale machine learning. Early approaches to this problem were conservative, in which the main focus was protection against the worst case scenario. But recently several algorithms have…

机器学习 · 计算机科学 2016-09-09 Parameswaran Kamalaruban

Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time…

最优化与控制 · 数学 2024-10-16 Jacob W. Knaup , Panagiotis Tsiotras

Total variation (TV) is a widely used function for regularizing imaging inverse problems that is particularly appropriate for images whose underlying structure is piecewise constant. TV regularized optimization problems are typically solved…

图像与视频处理 · 电气工程与系统科学 2025-08-26 Edward P. Chandler , Shirin Shoushtari , Brendt Wohlberg , Ulugbek S. Kamilov

This study proposes introducing convex optimization to find initial perturbations of atmospheric states to realize specified changes in subsequent weather. In the proposed method, we formulate and solve an inverse problem to find effective…

大气与海洋物理 · 物理学 2026-01-13 Toshiyuki Ohtsuka , Atsushi Okazaki , Masaki Ogura , Shunji Kotsuki

Given any increasing sequence of norms $\|\cdot\|_0,\dots,\|\cdot\|_{T-1}$, we provide an online convex optimization algorithm that outputs points $w_t$ in some domain $W$ in response to convex losses $\ell_t:W\to \mathbb{R}$ that…

机器学习 · 计算机科学 2020-02-11 Ashok Cutkosky

An optimization framework is presented for minimizing the energy functional developed around a generalized equation governing physical systems such as fluid dynamics, particle transport, phase transition, and other related systems. The…

流体动力学 · 物理学 2024-04-25 Varsha Gupta

We study the convergence rates of the classical Lagrangian-based methods and their variants for solving convex optimization problems with equality constraints. We present a generalized prediction-correction framework to establish $O(1/K^2)$…

最优化与控制 · 数学 2023-04-04 T. Zhang , Y. Xia , S. R. Li

We consider online learning in episodic loop-free Markov decision processes (MDPs), where the loss function can change arbitrarily between episodes, and the transition function is not known to the learner. We show…

机器学习 · 计算机科学 2019-05-21 Aviv Rosenberg , Yishay Mansour

In this paper we propose a general framework to characterize and solve the stochastic optimization problems with multiple objectives underlying many real world learning applications. We first propose a projection based algorithm which…

机器学习 · 计算机科学 2013-07-16 Mehrdad Mahdavi , Tianbao Yang , Rong Jin

Time-varying systems are a challenge in many scientific and engineering areas. Usually, estimation of time-varying parameters or signals must be performed online, which calls for the development of responsive online algorithms. In this…

最优化与控制 · 数学 2018-09-10 Sophie M. Fosson

Energy minimization has been an intensely studied core problem in computer vision. With growing image sizes (2D and 3D), it is now highly desirable to run energy minimization algorithms in parallel. But many existing algorithms, in…

计算机视觉与模式识别 · 计算机科学 2015-03-06 K. S. Sesh Kumar , Alvaro Barbero , Stefanie Jegelka , Suvrit Sra , Francis Bach

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

机器学习 · 计算机科学 2012-07-03 Huahua Wang , Arindam Banerjee

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

信息论 · 计算机科学 2020-12-15 Jonathan Lacotte , Mert Pilanci

The fast growth of communication technology within the concept of smart grids can provide data and control signals from/to all consumers in an online fashion. This could foster more participation for end-user customers. These types of…

系统与控制 · 电气工程与系统科学 2020-09-11 Arman Alahyari , David Pozo