English
Related papers

Related papers: Surrogate Modeling with Low-Rank Function Represen…

200 papers

Microfluidics have shown great promise in multiple applications, especially in biomedical diagnostics and separations. While the flow properties of these microfluidic devices can be solved by numerical methods such as computational fluid…

Fluid Dynamics · Physics 2021-05-12 Quang Tuyen Le , Pao-Hsiung Chiu , Chin Chun Ooi

We study the high-dimensional asymptotics of empirical risk minimization (ERM) in over-parametrized two-layer neural networks with quadratic activations trained on synthetic data. We derive sharp asymptotics for both training and test…

Machine Learning · Statistics 2026-02-03 Vittorio Erba , Emanuele Troiani , Lenka Zdeborová , Florent Krzakala

When repeated evaluations for varying parameter configurations of a high-fidelity physical model are required, surrogate modeling techniques based on model order reduction are desired. In absence of the governing equations describing the…

Machine Learning · Computer Science 2023-06-13 Harshit Kapadia , Lihong Feng , Peter Benner

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

Neural operators have emerged as data-driven surrogates for solving partial differential equations (PDEs), and their success hinges on efficiently modeling the long-range, global coupling among spatial points induced by the underlying…

Machine Learning · Computer Science 2026-04-07 Zherui Yang , Haiyang Xin , Tao Du , Ligang Liu

Recent approaches based on transform-based tensor nuclear norm (TNN) have demonstrated notable effectiveness in hyperspectral image (HSI) inpainting by leveraging low-rank structures in latent representations. Recent developments…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yunshan Li , Wenwu Gong , Qianqian Wang , Chao Wang , Lili Yang

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Discrete tensor train decomposition is widely employed to mitigate the curse of dimensionality in solving high-dimensional PDEs through traditional methods. However, the direct application of the tensor train method typically requires…

Numerical Analysis · Mathematics 2025-10-16 Yani Feng , Michael K. Ng , Kejun Tang , Zhiwen Zhang

Compactly representing and efficently applying linear operators are fundamental ingredients in tensor network methods for simulating quantum many-body problems and solving high-dimensional problems in scientific computing. In this work, we…

Numerical Analysis · Mathematics 2024-05-17 Gianluca Ceruti , Daniel Kressner , Dominik Sulz

We propose a non-intrusive method to build surrogate models that approximate the solution of parameterized partial differential equations (PDEs), capable of taking into account the dependence of the solution on the shape of the…

Numerical Analysis · Mathematics 2024-09-20 Linying Zhang , Stefano Pagani , Jun Zhang , Francesco Regazzoni

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

Surrogate models have several uses in engineering design, including speeding up design optimization, noise reduction, test measurement interpolation, gradient estimation, portability, and protection of intellectual property. Traditionally,…

Computational Engineering, Finance, and Science · Computer Science 2021-09-08 Eamon Whalen , Caitlin Mueller

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

Hierarchical uncertainty quantification can reduce the computational cost of stochastic circuit simulation by employing spectral methods at different levels. This paper presents an efficient framework to simulate hierarchically some…

Computational Engineering, Finance, and Science · Computer Science 2016-11-17 Zheng Zhang , Xiu Yang , Ivan V. Oseledets , George Em Karniadakis , Luca Daniel

Reinforcement learning (RL) aims to estimate the action to take given a (time-varying) state, with the goal of maximizing a cumulative reward function. Predominantly, there are two families of algorithms to solve RL problems: value-based…

Machine Learning · Computer Science 2025-01-10 Sergio Rozada , Hoi-To Wai , Antonio G. Marques

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

Surrogates provide a cheap solution evaluation and offer significant leverage for optimizing computationally expensive problems. Usually, surrogates only approximate the original function. Recently, the perfect linear surrogates were…

Artificial Intelligence · Computer Science 2026-04-14 M. W. Przewozniczek , F. Chicano , R. Tinós , M. M. Komarnicki

Low-rank approximation is an effective model compression technique to not only reduce parameter storage requirements, but to also reduce computations. For convolutional neural networks (CNNs), however, well-known low-rank approximation…

Machine Learning · Computer Science 2019-05-27 Dongsoo Lee , Se Jung Kwon , Byeongwook Kim , Gu-Yeon Wei

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen