English
Related papers

Related papers: Data-Driven Dynamic Factor Modeling via Manifold L…

200 papers

In this paper, we apply a recently developed nonparametric modeling approach, the "diffusion forecast", to predict the time-evolution of Fourier modes of turbulent dynamical systems. While the diffusion forecasting method assumes the…

Chaotic Dynamics · Physics 2016-03-23 Tyrus Berry , John Harlim

Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured records. For tabular data, however, generative modeling remains difficult: a dataset may contain…

Machine Learning · Computer Science 2026-05-25 Zhong Li , Qi Huang , Lincen Yang , Jiayang Shi , Zhao Yang , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen

Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral…

Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric…

Machine Learning · Statistics 2015-11-20 Moshe Salhov , Amit Bermanis , Guy Wolf , Amir Averbuch

Real-world data generation often involves certain geometries (e.g., graphs) that induce instance-level interdependence. This characteristic makes the generalization of learning models more difficult due to the intricate interdependent…

Machine Learning · Computer Science 2024-06-10 Qitian Wu , Fan Nie , Chenxiao Yang , Junchi Yan

System representations inspired by the infinite-dimensional Koopman operator (generator) are increasingly considered for predictive modeling. Due to the operator's linearity, a range of nonlinear systems admit linear predictor…

Machine Learning · Computer Science 2022-05-31 Petar Bevanda , Max Beier , Sebastian Kerz , Armin Lederer , Stefan Sosnowski , Sandra Hirche

This paper introduces a novel generative model for discrete distributions based on continuous normalizing flows on the submanifold of factorizing discrete measures. Integration of the flow gradually assigns categories and avoids issues of…

Machine Learning · Computer Science 2024-02-13 Bastian Boll , Daniel Gonzalez-Alvarado , Christoph Schnörr

Modern recording techniques enable neuroscientists to simultaneously study neural activity across large populations of neurons, with capturing predictor-dependent correlations being a fundamental challenge in neuroscience. Moreover, the…

Applications · Statistics 2025-02-04 Ganchao Wei

Data-driven reduced-order models of the dynamics of complex flows are important for tasks related to design, understanding, prediction, and control. Many flows obey symmetries, and the present work illustrates how these can be exploited to…

Machine Learning · Computer Science 2025-04-23 Carlos E. Pérez De Jesús , Alec J. Linot , Michael D. Graham

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

Machine Learning · Computer Science 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

This paper presents a data-learned linear Koopman embedding of nonlinear networked dynamics and uses it to enable real-time model predictive emergency voltage control in a power network. The approach involves a novel data-driven…

Systems and Control · Electrical Eng. & Systems 2023-10-06 Ramij R. Hossain , Rahmat Adesunkanmi , Ratnesh Kumar

We propose a novel conditional diffusion model for contextual portfolio optimization that learns the cross-sectional distribution of next-day stock returns conditioned on high-dimensional asset-specific factors. Our model leverages a…

Portfolio Management · Quantitative Finance 2026-04-17 Xuefeng Gao , Mengying He , Xuedong He

We study a data-dependent notion of diffusion-model generalization: when a model does not memorize the training set, where do its generated samples go relative to the geometry induced by the data? To answer this, we introduce a…

Machine Learning · Statistics 2026-05-14 Ye He , Yitong Qiu , Molei Tao

Quantum computation offers potential exponential speedups for simulating certain physical systems, but its application to nonlinear dynamics is inherently constrained by the requirement of unitary evolution. We propose the quantum Koopman…

Quantum Physics · Physics 2025-07-30 Baoyang Zhang , Zhen Lu , Yaomin Zhao , Yue Yang

Motivated by an application to empirical Bayes learning in high-dimensional regression, we study a class of Langevin diffusions in a system with random disorder, where the drift coefficient is driven by a parameter that continuously adapts…

Statistics Theory · Mathematics 2025-11-04 Zhou Fan , Justin Ko , Bruno Loureiro , Yue M. Lu , Yandi Shen

Beyond estimating parameters of interest from data, one of the key goals of statistical inference is to properly quantify uncertainty in these estimates. In Bayesian inference, this uncertainty is provided by the posterior distribution, the…

Machine Learning · Computer Science 2025-01-03 Daniela de Albuquerque , John Pearson

This paper considers an approximate dynamic matrix factor model that accounts for the time series nature of the data by explicitly modelling the time evolution of the factors. We study estimation of the model parameters based on the…

Methodology · Statistics 2026-01-08 Matteo Barigozzi , Luca Trapin

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

In this paper, we consider a surrogate modeling approach using a data-driven nonparametric likelihood function constructed on a manifold on which the data lie (or to which they are close). The proposed method represents the likelihood…

Data Analysis, Statistics and Probability · Physics 2019-06-04 Shixiao W. Jiang , John Harlim

Factor modeling is a powerful statistical technique that permits to capture the common dynamics in a large panel of data with a few latent variables, or factors, thus alleviating the curse of dimensionality. Despite its popularity and…

Econometrics · Economics 2021-03-03 Varlam Kutateladze