English
Related papers

Related papers: Regression-based projection for learning Mori-Zwan…

200 papers

Data-driven techniques have emerged as a promising alternative to traditional numerical methods for solving PDEs. For time-dependent PDEs, many approaches are Markovian -- the evolution of the trained system only depends on the current…

Machine Learning · Computer Science 2025-04-25 Ricardo Buitrago Ruiz , Tanya Marwah , Albert Gu , Andrej Risteski

We develop rigorous estimates and provably convergent approximations for the memory integral in the Mori-Zwanzig (MZ) formulation. The new theory is built upon rigorous mathematical foundations and is presented for both state-space and…

Numerical Analysis · Mathematics 2018-10-17 Yuanran Zhu , Jason M. Dominy , Daniele Venturi

Projection methods aim to reduce the dimensionality of the optimization instance, thereby improving the scalability of high-dimensional problems. Recently, Sakaue and Oki proposed a data-driven approach for linear programs (LPs), where the…

Optimization and Control · Mathematics 2025-11-18 Anh Tuan Nguyen , Viet Anh Nguyen

Time-dependent structural reliability analysis of nonlinear dynamical systems is non-trivial; subsequently, scope of most of the structural reliability analysis methods is limited to time-independent reliability analysis only. In this work,…

Machine Learning · Statistics 2024-09-21 Navaneeth N. , Souvik Chakraborty

Tensor regression has shown to be advantageous in learning tasks with multi-directional relatedness. Given massive multiway data, traditional methods are often too slow to operate on or suffer from memory bottleneck. In this paper, we…

Machine Learning · Computer Science 2016-07-12 Rose Yu , Yan Liu

Modal regression, a widely used regression protocol, has been extensively investigated in statistical and machine learning communities due to its robustness to outliers and heavy-tailed noises. Understanding modal regression's theoretical…

Machine Learning · Statistics 2022-03-15 Tielang Gong , Yuxin Dong , Hong Chen , Bo Dong , Wei Feng , Chen Li

We present and analyze an algorithm designed for addressing vector-valued regression problems involving possibly infinite-dimensional input and output spaces. The algorithm is a randomized adaptation of reduced rank regression, a technique…

Machine Learning · Computer Science 2024-01-01 Giacomo Turri , Vladimir Kostic , Pietro Novelli , Massimiliano Pontil

Machine learning models (mainly neural networks) are used more and more in real life. Users feed their data to the model for training. But these processes are often one-way. Once trained, the model remembers the data. Even when data is…

Machine Learning · Computer Science 2022-10-03 Zihao Cao , Jianzong Wang , Shijing Si , Zhangcheng Huang , Jing Xiao

Built upon the hypoelliptic analysis of the effective Mori-Zwanzig (EMZ) equation for observables of stochastic dynamical systems, we show that the obtained semigroup estimates for the EMZ equation can be used to drive prior estimates of…

Mathematical Physics · Physics 2021-06-21 Yuanran Zhu , Huan Lei

The Bellman equation and its continuous form, the Hamilton-Jacobi-Bellman equation, are ubiquitous in reinforcement learning and control theory. However, these equations become intractable for high-dimensional or nonlinear systems. This…

Artificial Intelligence · Computer Science 2026-05-04 Preston Rozwood , Edward Mehrez , Ludger Paehler , Wen Sun , Steven L. Brunton

Computing reduced-order models using non-intrusive methods is particularly attractive for systems that are simulated using black-box solvers. However, obtaining accurate data-driven models can be challenging, especially if the underlying…

Mathematical Physics · Physics 2024-01-03 Alberto Padovan , Blaine Vollmer , Daniel J. Bodony

We present an approach to construct approximate Koopman-type decompositions for dynamical systems depending on static or time-varying parameters. Our method simultaneously constructs an invariant subspace and a parametric family of…

Optimization and Control · Mathematics 2024-11-12 Yue Guo , Milan Korda , Ioannis G. Kevrekidis , Qianxiao Li

With the increasing penetration of renewable energy sources, growing demand variability, and evolving grid control strategies, accurate and efficient load modeling has become a critical yet challenging task. Traditional methods, such as…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Ding Lin , Han Guo , Jianhui Wang , Meng Yue , Tianqiao Zhao

We address the challenge of correlated predictors in high-dimensional GLMs, where regression coefficients range from sparse to dense, by proposing a data-driven random projection method. This is particularly relevant for applications where…

Methodology · Statistics 2025-12-30 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

This paper introduces a method for data-driven control based on the Koopman operator model predictive control. Unlike exiting approaches, the method does not require a dictionary and incorporates a nonlinear input transformation, thereby…

Optimization and Control · Mathematics 2023-09-22 Vít Cibulka , Milan Korda , Tomáš Haniš

Koopman operator theory, a powerful framework for discovering the underlying dynamics of nonlinear dynamical systems, was recently shown to be intimately connected with neural network training. In this work, we take the first steps in…

Neural and Evolutionary Computing · Computer Science 2021-10-08 Akshunna S. Dogra , William T Redman

Reconstruction of equations of motion from incomplete or noisy data and dimension reduction are two fundamental problems in the study of dynamical systems with many degrees of freedom. For the latter extensive efforts have been made but…

Statistical Mechanics · Physics 2011-02-08 Jianhua Xing , Kenneth S Kim

Representation learning enables us to automatically extract generic feature representations from a dataset to solve another machine learning task. Recently, extracted feature representations by a representation learning algorithm and a…

Machine Learning · Computer Science 2022-04-19 Kento Nozawa , Issei Sato

We present a comparative study of two methods for the reduction of the dimensionality of a system of ordinary differential equations that exhibits time-scale separation. Both methods lead to a reduced system of stochastic differential…

Numerical Analysis · Mathematics 2009-11-11 Panagiotis Stinis

The Koopman operator provides a powerful framework for data-driven analysis of dynamical systems. In the last few years, a wealth of numerical methods providing finite-dimensional approximations of the operator have been proposed (e.g.…

Dynamical Systems · Mathematics 2021-02-16 Marvyn Gulina , Alexandre Mauroy