English
Related papers

Related papers: A model reduction approach for inverse problems wi…

200 papers

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

In this paper, we present and analyze a new set of low-rank recovery algorithms for linear inverse problems within the class of hard thresholding methods. We provide strategies on how to set up these algorithms via basic ingredients for…

Numerical Analysis · Computer Science 2013-01-15 Anastasios Kyrillidis , Volkan Cevher

Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to…

Optimization and Control · Mathematics 2013-06-04 Stephen Becker , Volkan Cevher , Anastasios Kyrillidis

This paper presents a model order reduction (MOR) approach for high dimensional problems in the analysis of financial risk. To understand the financial risks and possible outcomes, we have to perform several thousand simulations of the…

Computational Finance · Quantitative Finance 2021-06-15 Andreas Binder , Onkar Jadhav , Volker Mehrmann

In this work we propose a new paradigm for designing efficient deep unrolling networks using operator sketching. The deep unrolling networks are currently the state-of-the-art solutions for imaging inverse problems. However, for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Junqi Tang , Subhadip Mukherjee , Carola-Bibiane Schönlieb

A complete solution for an inverse problem needs five main steps: choice of basis functions for discretization, determination of the order of the model, estimation of the hyperparameters, estimation of the solution, and finally,…

Data Analysis, Statistics and Probability · Physics 2009-11-07 A. Mohammad-Djafari

Solving the inverse problem is the key step in evaluating the capacity of a physical model to describe real phenomena. In medical image computing, it aligns with the classical theme of image-based model personalization. Traditionally, a…

A common optimization problem is the minimization of a symmetric positive definite quadratic form $< x,Tx >$ under linear constrains. The solution to this problem may be given using the Moore-Penrose inverse matrix. In this work we extend…

Functional Analysis · Mathematics 2010-03-31 Dimitrios Pappas

A common data analysis task is the reduced-rank regression problem: $$\min_{\textrm{rank-}k \ X} \|AX-B\|,$$ where $A \in \mathbb{R}^{n \times c}$ and $B \in \mathbb{R}^{n \times d}$ are given large matrices and $\|\cdot\|$ is some norm.…

Data Structures and Algorithms · Computer Science 2021-07-02 Praneeth Kacham , David P. Woodruff

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Self-organizing systems demonstrate how simple local rules can generate complex stochastic patterns. Many natural systems rely on such dynamics, making self-organization central to understanding natural complexity. A fundamental challenge…

Adaptation and Self-Organizing Systems · Physics 2026-01-12 Elias Najarro , Nicolas Bessone , Sebastian Risi

Reduced order modeling has gained considerable attention in recent decades owing to the advantages offered in reduced computational times and multiple solutions for parametric problems. The focus of this manuscript is the application of…

Numerical Analysis · Mathematics 2018-11-21 Gianluigi Rozza , Haris Malik , Nicola Demo , Marco Tezzele , Michele Girfoglio , Giovanni Stabile , Andrea Mola

In applications throughout science and engineering one is often faced with the challenge of solving an ill-posed inverse problem, where the number of available measurements is smaller than the dimension of the model to be estimated. However…

Optimization and Control · Mathematics 2012-10-30 Venkat Chandrasekaran , Benjamin Recht , Pablo A. Parrilo , Alan S. Willsky

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

In recent years, a certain type of problems have become of interest where one wants to query a trained classifier. Specifically, one wants to find the closest instance to a given input instance such that the classifier's predicted label is…

Machine Learning · Computer Science 2026-03-20 Miguel Á. Carreira-Perpiñán , Suryabhan Singh Hada

Tensor completion is an extension of matrix completion aimed at recovering a multiway data tensor by leveraging a given subset of its entries (observations) and the pattern of observation. The low-rank assumption is key in establishing a…

Numerical Analysis · Mathematics 2026-03-12 Shakir Showkat Sofi , Lieven De Lathauwer

Understanding the linear growth of disturbances due to external forcing is crucial for flow stability analysis, flow control, and uncertainty quantification. These applications typically require a large number of forward simulations of the…

Fluid Dynamics · Physics 2024-08-07 Alireza Amiri-Margavi , Hessam Babaee