English
Related papers

Related papers: An optimization-based reformulation of the classic…

200 papers

We investigate modified steepest descent methods coupled with a loping Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization…

Numerical Analysis · Mathematics 2008-08-03 A. De Cezaro , M. Haltmeier , A. Leitao , O. Scherzer

We present a unifying framework for adapting the update direction in gradient-based iterative optimization methods. As natural special cases we re-derive classical momentum and Nesterov's accelerated gradient method, lending a new intuitive…

Machine Learning · Statistics 2016-07-12 Aleksandar Botev , Guy Lever , David Barber

A hybrid dynamical system switches between dynamic regimes at time- or state-triggered events. We propose an offline algorithm that simultaneously estimates discrete and continuous components of a hybrid system's state. We formulate state…

Optimization and Control · Mathematics 2019-05-23 Jize Zhang , Andrew M. Pace , Samuel A. Burden , Aleksandr Aravkin

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

Motivated by robotic trajectory optimization problems we consider the Augmented Lagrangian approach to constrained optimization. We first propose an alternative augmentation of the Lagrangian to handle the inequality case (not based on…

Optimization and Control · Mathematics 2014-12-16 Marc Toussaint

To improve the predictive capacity of system models in the input-output sense, this paper presents a framework for model updating via learning of modeling uncertainties in locally (and thus also in globally) Lipschitz nonlinear systems.…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Farhad Ghanipoor , Carlos Murguia , Peyman Mohajerin Esfahani , Nathan van de Wouw

It is classical that, when the small deformation is assumed, the incremental analysis problem of an elastoplastic structure with a piecewise-linear yield condition and a linear strain hardening model can be formulated as a convex quadratic…

Optimization and Control · Mathematics 2017-08-22 Yoshihiro Kanno

The problem of state reconstruction is considered for uncertain linear time-invariant systems with overparameterization, arbitrary state-space matrices and unknown additive perturbation described by an exosystem. A novel adaptive observer…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Anton Glushchenko , Konstantin Lastochkin

In this paper we develop a new technique, called \textit{state redistribution}, that allows the use of explicit time stepping when approximating solutions to hyperbolic conservation laws on embedded boundary grids. State redistribution is a…

Numerical Analysis · Mathematics 2021-02-03 Marsha Berger , Andrew Giuliani

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Combinatorial optimization problems are ubiquitous in industrial applications. However, finding optimal or close-to-optimal solutions can often be extremely hard. Because some of these problems can be mapped to the ground-state search of…

Quantum Physics · Physics 2025-09-04 Junpeng Hou , Amin Barzegar , Helmut G. Katzgraber

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

This work introduces a non-intrusive model reduction approach for learning reduced models from partially observed state trajectories of high-dimensional dynamical systems. The proposed approach compensates for the loss of information due to…

Machine Learning · Computer Science 2021-03-29 Wayne Isaac Tan Uy , Benjamin Peherstorfer

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

The quantum simulation of classical fluids often involves the use of probabilistic algorithms that encode the result of the dynamics in the form of the amplitude of the selected quantum state. In most cases, however, the amplitude…

Quantum Physics · Physics 2025-07-04 Alessandro Andrea Zecchi , Claudio Sanavio , Simona Perotto , Sauro Succi

We use backward error analysis for differential equations to obtain modified or distorted equations describing the behaviour of the Newmark scheme applied to the transient structural dynamics equation. Based on the newly derived distorted…

Numerical Analysis · Mathematics 2024-11-12 Donát M. Takács , Tamás Fülöp

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach,…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Peihu Duan , Qishao Wang , Zhisheng Duan , Guanrong Chen

In this work, a nonlinear momentum method is introduced to enhance the convergence performance of momentum-based gradient optimization algorithms. Classical momentum methods, such as the Heavy Ball method, can be viewed as a dynamical…

Computational Physics · Physics 2026-02-09 Jianing Zhang , Rumei Liu