English
Related papers

Related papers: Beyond the Kolmogorov Barrier: A Learnable Weighte…

200 papers

In this work, we develop reduced order models (ROMs) to predict solutions to a multiscale kinetic transport equation with a diffusion limit under the parametric setting. When the underlying scattering effect is not sufficiently strong, the…

Numerical Analysis · Mathematics 2025-05-14 Tianyu Jin , Zhichao Peng , Yang Xiang

Model reduction of high-dimensional dynamical systems alleviates computational burdens faced in various tasks from design optimization to model predictive control. One popular model reduction approach is based on projecting the governing…

Dynamical Systems · Mathematics 2018-08-24 Francisco J. Gonzalez , Maciej Balajewicz

This work concerns control-oriented and structure-preserving learning of low-dimensional approximations of high-dimensional physical systems, with a focus on mechanical systems. We investigate the integration of neural autoencoders in model…

Machine Learning · Computer Science 2023-12-12 Marco Lepri , Davide Bacciu , Cosimo Della Santina

The Kolmogorov-Arnold Network (KAN) has recently gained attention as an alternative to traditional multi-layer perceptrons (MLPs), offering improved accuracy and interpretability by employing learnable activation functions on edges. In this…

Machine Learning · Computer Science 2025-01-03 Fangchen Yu , Ruilizhen Hu , Yidong Lin , Yuqi Ma , Zhenghao Huang , Wenye Li

With increasing penetration of distributed energy resources installed behind the meter, there is a growing need for adequate modelling of composite loads to enable accurate power system simulation analysis. Existing measurement based load…

Systems and Control · Electrical Eng. & Systems 2025-08-28 Sonam Dorji , Yongkang Sun , Yuchen Zhang , Ghavameddin Nourbakhsh , Yateendra Mishra , Yan Xu

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

The variational autoencoder (VAE) is a popular combination of deep latent variable model and accompanying variational learning technique. By using a neural inference network to approximate the model's posterior on latent variables, VAEs…

Machine Learning · Computer Science 2019-01-30 Junxian He , Daniel Spokoyny , Graham Neubig , Taylor Berg-Kirkpatrick

Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction…

Machine Learning · Statistics 2023-03-07 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis , Petros Koumoutsakos

Using an autoencoder for dimensionality reduction, this paper presents a novel projection-based reduced-order model for eigenvalue problems. Reduced-order modelling relies on finding suitable basis functions which define a low-dimensional…

Numerical Analysis · Mathematics 2022-12-06 Toby Phillips , Claire E. Heaney , Paul N. Smith , Christopher C. Pain

Generative models typically rely on either simple latent priors (e.g., Variational Autoencoders, VAEs), which are efficient but limited, or highly expressive iterative samplers (e.g., Diffusion and Energy-based Models), which are costly and…

Machine Learning · Computer Science 2026-05-12 Prithvi Raj

This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. Specifically, we integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable…

Machine Learning · Computer Science 2021-02-23 Siyuan Shen , Yang Yin , Tianjia Shao , He Wang , Chenfanfu Jiang , Lei Lan , Kun Zhou

The autoencoder is an unsupervised learning paradigm that aims to create a compact latent representation of data by minimizing the reconstruction loss. However, it tends to overlook the fact that most data (images) are embedded in a…

Machine Learning · Computer Science 2023-10-26 Alokendu Mazumder , Tirthajit Baruah , Bhartendu Kumar , Rishab Sharma , Vishwajeet Pattanaik , Punit Rathore

The combination of Monte Carlo methods and deep learning has recently led to efficient algorithms for solving partial differential equations (PDEs) in high dimensions. Related learning problems are often stated as variational formulations…

Machine Learning · Computer Science 2022-08-08 Lorenz Richter , Julius Berner

Enforcing complex (e.g., nonconvex) operational constraints is a critical challenge in real-world learning and control systems. However, existing methods struggle to efficiently enforce general classes of constraints. To address this, we…

Machine Learning · Computer Science 2026-04-07 Maria Chzhen , Priya L. Donti

A computational framework that leverages data from self-consistent field theory simulations with deep learning to accelerate the exploration of parameter space for block copolymers is presented. This is a substantial two-dimensional…

Materials Science · Physics 2023-07-04 Yao Xuan , Kris T. Delaney , Hector D. Ceniceros , Glenn H. Fredrickson

Physics-constrained data-driven computing is an emerging computational paradigm that allows simulation of complex materials directly based on material database and bypass the classical constitutive model construction. However, it remains…

Numerical Analysis · Mathematics 2022-09-12 Xiaolong He , Qizhi He , Jiun-Shyan Chen

Multivariate time series anomaly detection is a crucial problem in many industrial and research applications. Timely detection of anomalies allows, for instance, to prevent defects in manufacturing processes and failures in cyberphysical…

Machine Learning · Computer Science 2024-03-06 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

Kolmogorov-Arnold Networks (KANs) replace scalar weights with per-edge vectors of basis coefficients, thereby increasing expressivity and accuracy while also resulting in a multiplicative increase in parameters and memory. We propose…

Machine Learning · Computer Science 2026-02-10 Matthew Raffel , Adwaith Renjith , Lizhong Chen

Reduced-order models are powerful for analyzing and controlling high-dimensional dynamical systems. Yet constructing these models for complex hybrid systems such as legged robots remains challenging. Classical approaches rely on…

Robotics · Computer Science 2026-04-22 Blake Werner , Sergio A. Esteban , Massimiliano De Sa , Max H. Cohen , Aaron D. Ames

Recently developed reduced-order modeling techniques aim to approximate nonlinear dynamical systems on low-dimensional manifolds learned from data. This is an effective approach for modeling dynamics in a post-transient regime where the…

Dynamical Systems · Mathematics 2023-09-27 Samuel E. Otto , Gregory R. Macchio , Clarence W. Rowley