English
Related papers

Related papers: A non-intrusive data-based reformulation of a hybr…

200 papers

The massive scale of pretrained models has made efficient compression essential for practical deployment. Low-rank decomposition based on the singular value decomposition (SVD) provides a principled approach for model reduction, but its…

Machine Learning · Computer Science 2026-04-06 Farhad Pourkamali-Anaraki

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

In this paper, we propose a second order optimization method to learn models where both the dimensionality of the parameter space and the number of training samples is high. In our method, we construct on each iteration a Krylov subspace…

Machine Learning · Statistics 2011-11-21 Oriol Vinyals , Daniel Povey

Fully implicit Runge-Kutta (IRK) methods have many desirable properties as time integration schemes in terms of accuracy and stability, but high-order IRK methods are not commonly used in practice with numerical PDEs due to the difficulty…

Numerical Analysis · Mathematics 2021-10-07 Ben S. Southworth , Oliver Krzysik , Will Pazner , Hans De Sterck

Nearly all model-reduction techniques project the governing equations onto a linear subspace of the original state space. Such subspaces are typically computed using methods such as balanced truncation, rational interpolation, the…

Numerical Analysis · Computer Science 2019-06-07 Kookjin Lee , Kevin Carlberg

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

Machine Learning · Computer Science 2015-10-28 Masahiro Yukawa

We study the use of Krylov subspace recycling for the solution of a sequence of slowly-changing families of linear systems, where each family consists of shifted linear systems that differ in the coefficient matrix only by multiples of the…

Numerical Analysis · Mathematics 2014-10-01 Kirk M. Soodhalter , Daniel B. Szyld , Fei Xue

A data-driven framework is proposed for online estimation of quadrotor motor efficiency via residual minimization. The problem is formulated as a constrained nonlinear optimization that minimizes trajectory residuals between measured flight…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Sheng-Wen Cheng , Teng-Hu Cheng

In application of tomography imaging, limited-angle problem is a quite practical and important issue. In this paper, an iterative reprojection-reconstruction (IRR) algorithm using a modified Papoulis-Gerchberg (PG) iterative scheme is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuli Sun , Jinxu Tao , Conggui Liu

The data driven extrapolation requires the definition of a functional model depending on the available data and has the application scope of providing reliable predictions on the unknown dynamics. Since data might be scattered, we drive our…

Numerical Analysis · Mathematics 2020-12-24 Rosanna Campagna , Emma Perracchione

Many scientific and engineering challenges can be formulated as optimization problems which are constrained by partial differential equations (PDEs). These include inverse problems, control problems, and design problems. As a major…

Optimization and Control · Mathematics 2017-12-25 Lasse Hjuler Christiansen , John Bagterp Jørgensen

We estimate the wave speed in the acoustic wave equation from boundary measurements by constructing a reduced-order model (ROM) matching discrete time-domain data. The state-variable representation of the ROM can be equivalently viewed as a…

Numerical Analysis · Mathematics 2016-10-18 Vladimir Druskin , Alexander Mamonov , Andrew E. Thaler , Mikhail Zaslavsky

We consider algebraic iterative reconstruction methods with applications in image reconstruction. In particular, we are concerned with methods based on an unmatched projector/backprojector pair; i.e., the backprojector is not the exact…

Numerical Analysis · Mathematics 2019-02-14 Yiqiu Dong , Per Christian Hansen , Michiel E. Hochstenbach , Nicolai Andre Brogaard Riis

One of the limitations of recycled GCRO methods is the large amount of computation required to orthogonalize the basis vectors of the newly generated Krylov subspace for the approximate solution when combined with those of the recycle…

Numerical Analysis · Mathematics 2023-06-12 Stephen Thomas , Alison Baker , Stephane Gaudreault

We propose a technique for performing spectral (in time) analysis of spatially-resolved flowfield data, without needing any temporal resolution or information. This is achieved by combining projection-based reduced-order modeling with…

Fluid Dynamics · Physics 2023-07-31 Katherine J. Asztalos , Abdulrahman Almashjary , Scott T. M. Dawson

High-quality reconstructions of signals and images with sharp edges are needed in a wide range of applications. To overcome the large dimensionality of the parameter space and the complexity of the regularization functional,…

Numerical Analysis · Mathematics 2025-05-06 Jonathan Lindbloom , Mirjeta Pasha , Jan Glaubitz , Youssef Marzouk

We consider iterative (`turbo') algorithms for compressed sensing. First, a unified exposition of the different approaches available in the literature is given, thereby enlightening the general principles and main differences. In particular…

Information Theory · Computer Science 2017-05-22 Robert F. H. Fischer , Susanne Sparrer

In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. While recent advancements in machine learning have introduced flexible methods for IV estimation, they often encounter one or more of the following…

Machine Learning · Computer Science 2024-03-08 Zihao Li , Hui Lan , Vasilis Syrgkanis , Mengdi Wang , Masatoshi Uehara

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

In this work, we collect data from runs of Krylov subspace methods and pipelined Krylov algorithms in an effort to understand and model the impact of machine noise and other sources of variability on performance. We find large variability…

Mathematical Software · Computer Science 2021-03-24 Hannah Morgan , Patrick Sanan , Matthew G. Knepley , Richard Tran Mills