English
Related papers

Related papers: Kolmogorov $n$-widths for linear dynamical systems

200 papers

We obtain exact lower bounds for Kolmogorov $n$-widths in spaces $C$ and $L$ of classes of convolutions with Neumann kernel $N_{q,\beta}(t)=\sum\limits_{k=1}^{\infty}\dfrac{q^k}{k}\cos\left(kt-\dfrac{\beta\pi}{2}\right)$, ${q\in(0,1)}$,…

Classical Analysis and ODEs · Mathematics 2013-12-24 V. V. Bodenchuk

In this work, we explore the application of multilinear algebra in reducing the order of multidimentional linear time-invariant (MLTI) systems. We use tensor Krylov subspace methods as key tools, which involve approximating the system…

Numerical Analysis · Mathematics 2023-05-19 M. A. Hamadi , K. Jbilou , A. Ratnani

Linear time-periodic (LTP) dynamical systems frequently appear in the modeling of phenomena related to fluid dynamics, electronic circuits, and structural mechanics via linearization centered around known periodic orbits of nonlinear…

Numerical Analysis · Mathematics 2017-06-13 Caleb C. Magruder , Serkan Gugercin , Christopher A. Beattie

It is shown that an LTI system is a relaxation system if and only if its Hankel operator is cyclic monotone. Cyclic monotonicity of the Hankel operator implies the existence of a storage function whose gradient is the Hankel operator. This…

Optimization and Control · Mathematics 2023-12-07 Thomas Chaffey , Henk J. van Waarde , Rodolphe Sepulchre

Direct estimates between linear or nonlinear Kolmogorov widths and entropy numbers are presented. These estimates are derived using the recently introduced Lipschitz widths. Applications for m-term approximation are obtained.

Functional Analysis · Mathematics 2022-03-02 Guergana Petrova , Przemyslaw Wojtaszczyk

Reduced basis methods for approximating the solutions of parameter-dependant partial differential equations (PDEs) are based on learning the structure of the set of solutions - seen as a manifold ${\mathcal S}$ in some functional space -…

Numerical Analysis · Mathematics 2024-07-08 Christophe Prud'Homme , Yvon Maday , Hassan Ballout

The Kolmogorov $N$-width $d_N(\mathcal{M})$ describes the rate of the worst-case error (w.r.t.\ a subset $\mathcal{M}\subset H$ of a normed space $H$) arising from a projection onto the best-possible linear subspace of $H$ of dimension…

Numerical Analysis · Mathematics 2019-04-11 Constantin Greif , Karsten Urban

Large-scale linear, time-invariant (LTI) dynamical systems are widely used to characterize complicated physical phenomena. We propose a two-stage algorithm to reduce the order of a large-scale LTI system given samples of its transfer…

Numerical Analysis · Mathematics 2023-04-11 Annan Yu , Alex Townsend

The manifold hypothesis suggests that the generalization performance of machine learning methods improves significantly when the intrinsic dimension of the input distribution's support is low. In the context of KRR, we investigate two…

Machine Learning · Computer Science 2026-01-23 Rustem Takhanov

We prove an inequality for the entropy numbers in terms of nonlinear Kolmogorov's widths. This inequality is in a spirit of known inequalities of this type and it is adjusted to the form convenient in applications for $m$-term…

Metric Geometry · Mathematics 2013-02-01 Vladimir Temlyakov

State-space models (SSMs) that utilize linear, time-invariant (LTI) systems are known for their effectiveness in learning long sequences. To achieve state-of-the-art performance, an SSM often needs a specifically designed initialization,…

Machine Learning · Computer Science 2024-10-03 Annan Yu , Michael W. Mahoney , N. Benjamin Erichson

We investigate parametrized variational problems where for each parameter the solution may originate from a different parameter-dependent function space. Our main motivation is the theory of Friedrichs' systems, a large abstract class of…

Numerical Analysis · Mathematics 2025-07-02 Christian Engwer , Mario Ohlberger , Lukas Renelt

We relate the problem of best low-rank approximation in the spectral norm for a matrix $A$ to Kolmogorov $n$-widths and corresponding optimal spaces. We characterize all the optimal spaces for the image of the Euclidean unit ball under $A$…

Numerical Analysis · Mathematics 2021-05-25 Michael S. Floater , Carla Manni , Espen Sande , Hendrik Speleers

In this paper, we focus on learning a linear time-invariant (LTI) model with low-dimensional latent variables but high-dimensional observations. We provide an algorithm that recovers the high-dimensional features, i.e. column space of the…

Systems and Control · Electrical Eng. & Systems 2024-06-27 Yuyang Zhang , Shahriar Talebi , Na Li

We consider the nonlinear Kolmogorov equation posed in a Hilbert space $H$, not necessarily of finite dimension. This model was recently studied by Cox et al. [24] in the framework of weak convergence rates of stochastic wave models. Here,…

Probability · Mathematics 2022-07-06 Javier Castro

Data-driven learning is rapidly evolving and places a new perspective on realizing state-space dynamical systems. However, dynamical systems derived from nonlinear ordinary differential equations (ODEs) suffer from limitations in…

Machine Learning · Computer Science 2025-07-29 Hansaka Aluvihare , Levi Lingsch , Xianqi Li , Sirani M. Perera

This paper presents a low-dimensional observer design for stable, single-input single-output, continuous-time linear time-invariant (LTI) systems. Leveraging the model reduction by moment matching technique, we approximate the system with a…

Systems and Control · Electrical Eng. & Systems 2025-08-04 M. F. Shakib , M. Khalil , R. Postoyan

Representation learning for high-dimensional, complex physical systems aims to identify a low-dimensional intrinsic latent space, which is crucial for reduced-order modeling and modal analysis. To overcome the well-known Kolmogorov barrier,…

Machine Learning · Computer Science 2025-11-07 Nithin Somasekharan , Shaowu Pan

Motivated by the successful use of greedy algorithms for Reduced Basis Methods, a greedy method is proposed that selects N input data in an asymptotically optimal way to solve well-posed operator equations using these N data. The operator…

Numerical Analysis · Mathematics 2019-03-28 Robert Schaback

This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model…

Systems and Control · Electrical Eng. & Systems 2021-11-25 Punit Tulpule , Umesh Vaidya