English
Related papers

Related papers: Recursive low-rank approximation and model reducti…

200 papers

We present weak approximations schemes of any order for the Heston model that are obtained by using the method developed by Alfonsi and Bally (2021). This method consists in combining approximation schemes calculated on different random…

Computational Finance · Quantitative Finance 2024-12-10 Aurélien Alfonsi , Edoardo Lombardo

Large-scale network systems describe a wide class of complex dynamical systems composed of many interacting subsystems. A large number of subsystems and their high-dimensional dynamics often result in highly complex topology and dynamics,…

Optimization and Control · Mathematics 2021-02-02 Xiaodong Cheng , Jacquelien M. A. Scherpen , Harry L. Trentelman

This paper introduces the concept of abstracted model reduction: a framework to improve the tractability of structure-preserving methods for the complexity reduction of interconnected system models. To effectively reduce high-order,…

Systems and Control · Electrical Eng. & Systems 2024-11-21 Luuk Poort , Lars A. L. Janssen , Bart Besselink , Rob H. B. Fey , Nathan van de Wouw

The aim of this note (as well as of the course itself) is to give a largely self-contained proof of two of the main results in the field of low-rank matrix recovery. This field aims for identification of low-rank matrices from only limited…

Functional Analysis · Mathematics 2016-09-27 Jan Vybiral

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

Dynamical low-rank approximation, as has been demonstrated recently, can be extremely efficient in solving kinetic equations. However, a major deficiency is that they do not preserve the structure of the underlying physical problem. For…

Numerical Analysis · Mathematics 2023-04-26 Lukas Einkemmer , Alexander Ostermann , Carmen Scalone

Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models (LLMs) due to their reduced computational and memory requirements. This paper investigates the effectiveness of these methods in…

Machine Learning · Computer Science 2024-05-30 Saswat Das , Marco Romanelli , Cuong Tran , Zarreen Reza , Bhavya Kailkhura , Ferdinando Fioretto

Low-rank matrix recovery problems arise naturally as mathematical formulations of various inverse problems, such as matrix completion, blind deconvolution, and phase retrieval. Over the last two decades, a number of works have rigorously…

Information Theory · Computer Science 2021-06-09 Tim Fuchs , David Gross , Peter Jung , Felix Krahmer , Richard Kueng , Dominik Stöger

The frequency-weighted model order reduction techniques are used to find a lower-order approximation of the high-order system that exhibits high-fidelity within the frequency region emphasized by the frequency weights. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Umair Zulfiqar , Victor Sreeram , Mian Ilyas Ahmad , Xin Du

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

An approach to derive low-complexity models describing thermal radiation for the sake of simulating the behavior of electric arcs in switchgear systems is presented. The idea is to approximate the (high dimensional) full-order equations,…

Optimization and Control · Mathematics 2015-12-09 Lorenzo Fagiano , Rudolf Gati

The influence-matrix formalism provides an alternative route to the classical simulation of quantum dynamics. Because influence matrices retain information only about the effective bath seen by local observables, they are expected to be…

Quantum Physics · Physics 2026-05-14 Cathy Li , Bruno Bertini , Katja Klobas , Tianci Zhou

In this note, we investigate how well we can reconstruct the best rank-$r$ approximation of a large matrix from a small number of its entries. We show that even if a data matrix is of full rank and cannot be approximated well by a low-rank…

Methodology · Statistics 2021-11-12 Shun Xu , Ming Yuan

In a previous paper [Adcock & Huybrechs, 2019] we described the numerical approximation of functions using redundant sets and frames. Redundancy in the function representation offers enormous flexibility compared to using a basis, but…

Numerical Analysis · Mathematics 2020-07-13 Ben Adcock , Daan Huybrechs

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

A reduced-order model algorithm, based on approximations of Lax pairs, is proposed to solve nonlinear evolution partial differential equations. Contrary to other reduced-order methods, like Proper Orthogonal Decomposition, the space where…

Numerical Analysis · Mathematics 2012-11-20 Jean-Frédéric Gerbeau , Damiano Lombardi

The reduction of dynamical systems has a rich history, with many important applications related to stability, control and verification. Reduction of nonlinear systems is typically performed in an exact manner - as is the case with…

Optimization and Control · Mathematics 2007-07-26 Paulo Tabuada , Aaron D. Ames , Agung Julius , George J. Pappas

In this paper, we propose a novel approach to the rank minimization problem, termed rank residual constraint (RRC) model. Different from existing low-rank based approaches, such as the well-known nuclear norm minimization (NNM) and the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Zhiyuan Zha , Xin Yuan , Bihan Wen , Jiantao Zhou , Jiachao Zhang , Ce Zhu

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi