English
Related papers

Related papers: Sampling Strategies for Data-Driven Inference of I…

200 papers

This paper considers the problem of learning, from samples, the dependency structure of a system of linear stochastic differential equations, when some of the variables are latent. In particular, we observe the time evolution of some…

Machine Learning · Computer Science 2012-05-02 Ali Jalali , Sujay Sanghavi

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We consider the problem of on-line evaluation of critical characteristic parameters such as the L_2-gain (L2G), input feedforward passivity index (IFP) and output feedback passivity index (OFP) of non-linear systems using their input-output…

Systems and Control · Electrical Eng. & Systems 2022-04-04 Shirantha Welikala , Hai Lin , Panos J. Antsaklis

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

Gradient descent methods and especially their stochastic variants have become highly popular in the last decade due to their efficiency on big data optimization problems. In this thesis we present the development of data sampling strategies…

Optimization and Control · Mathematics 2018-04-03 Dominik Csiba

We analyze the convergence rate of various momentum-based optimization algorithms from a dynamical systems point of view. Our analysis exploits fundamental topological properties, such as the continuous dependence of iterates on their…

Optimization and Control · Mathematics 2021-04-13 Michael Muehlebach , Michael I. Jordan

We derive the system of differential equations for the gradient flow characterizing the training process of linear in-context learning in full generality. Next, we explore the geometric structure of the gradient flows in two instances,…

Dynamical Systems · Mathematics 2024-12-24 Songtao Lu , Yingdong Lu , Tomasz Nowicki

We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly…

Machine Learning · Statistics 2025-09-30 Reza Sadeghi Hafshejani , Mohamad Kazem Shirani Fradonbeh

This study presents a sampling-based method to guarantee robust stability of general control systems with uncertainty. The method allows the system dynamics and controllers to be represented by various data-driven models, such as Gaussian…

Optimization and Control · Mathematics 2025-04-11 Yuji Ito , Kenji Fujimoto

Control applications are increasingly sampled non-equidistantly in time, including in motion control, networked control, resource-aware control, and event-triggered control. Some of these applications use measurement devices that sample…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Rodrigo A. González , Koen Tiels , Tom Oomen

We propose a sampling-based trajectory optimization methodology for constrained problems. We extend recent works on stochastic search to deal with box control constraints,as well as nonlinear state constraints for discrete dynamical…

Optimization and Control · Mathematics 2019-11-13 George I. Boutselis , Ziyi Wang , Evangelos A. Theodorou

We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…

Optimization and Control · Mathematics 2020-03-12 Antonio Orvieto , Aurelien Lucchi

This paper investigates the data-driven predictive control problems for a class of continuous-time industrial processes with completely unknown dynamics. The proposed approach employs the data-driven technique to get the system matrices…

Optimization and Control · Mathematics 2020-12-08 Yuanqiang Zhou , Dewei Li , Yugeng Xi

Learning stabilizing controllers from data is an important task in engineering applications; however, collecting informative data is challenging because unstable systems often lead to rapidly growing or erratic trajectories. In this work,…

Optimization and Control · Mathematics 2026-02-11 Steffen W. R. Werner , Benjamin Peherstorfer

Systems that show different characteristics, such as finite-gain and passivity, depending on the nature of the inputs, are said to possess mixed input-output properties. In this paper, we provide a constructive method for characterizing…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Sebastiaan van den Eijnden , Thomas Chaffey

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

Machine Learning · Computer Science 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang

In this paper, we discuss various topological and metrical aspects of the set of stabilizing static feedback gains for multiple-input-multiple-output (MIMO) linear-time-invariant (LTI) systems, in both continuous and discrete-time.…

Systems and Control · Computer Science 2019-04-08 Jingjing Bu , Afshin Mesbahi , Mehran Mesbahi

Dynamical sampling refers to a class of problems in which space-time samples are taken from a signal evolving under an underlying dynamical system. The goal is to use these samples to recover relevant information about the system, such as…

Functional Analysis · Mathematics 2026-04-10 Akram Aldroubi , Carlos Cabrelli , Ilya Krishtal , Ursula Molter

Learning the continuous dynamics of a system from snapshots of its temporal marginals is a problem which appears throughout natural sciences and machine learning, including in quantum systems, single-cell biological data, and generative…

Machine Learning · Computer Science 2023-06-12 Kirill Neklyudov , Rob Brekelmans , Daniel Severo , Alireza Makhzani

A small-gain approach is proposed to analyze closed-loop stability of linear diffusion-reaction systems under finite-dimensional observer-based state feedback control. For this, the decomposition of the infinite-dimensional system into a…

Systems and Control · Electrical Eng. & Systems 2022-02-14 Lars Grüne , Thomas Meurer