English
Related papers

Related papers: Domain decomposition dynamical low-rank for multi-…

200 papers

Despite many modern applications of Deep Neural Networks (DNNs), the large number of parameters in the hidden layers makes them unattractive for deployment on devices with storage capacity constraints. In this paper we propose a Data-Driven…

Machine Learning · Computer Science 2021-07-14 Dimitris Papadimitriou , Swayambhoo Jain

The dynamical low-rank approximation of time-dependent matrices is a low-rank factorization updating technique. It leads to differential equations for factors of the matrices, which need to be solved numerically. We propose and analyze a…

Numerical Analysis · Mathematics 2013-01-09 Christian Lubich , Ivan Oseledets

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

The polynomial method from circuit complexity has been applied to several fundamental problems and obtains the state-of-the-art running times. As observed in [Alman and Williams, STOC 2017], almost all applications of the polynomial method…

Computational Complexity · Computer Science 2018-11-20 Lijie Chen , Ruosong Wang

In this paper we consider general rank minimization problems with rank appearing in either objective function or constraint. We first establish that a class of special rank minimization problems has closed-form solutions. Using this result,…

Optimization and Control · Mathematics 2012-05-30 Zhaosong Lu , Yong Zhang

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as…

Machine Learning · Statistics 2013-11-07 Stoyan Georgiev , Sayan Mukherjee

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

An efficient, accurate and reliable approximation of a matrix by one of lower rank is a fundamental task in numerical linear algebra and signal processing applications. In this paper, we introduce a new matrix decomposition approach termed…

Numerical Analysis · Computer Science 2018-08-15 Maboud F. Kaloorazi , Rodrigo C. de Lamare

Neural networks (NNs) have gained significant attention across various engineering disciplines, particularly in design optimization, where they are used to build surrogate models for high-dimensional regression problems. Despite their power…

Computational Engineering, Finance, and Science · Computer Science 2026-03-30 Timm Gödde , Eisso H. Atzema , Bojana Rosić

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

Inpainting-based compression methods are qualitatively promising alternatives to transform-based codecs, but they suffer from the high computational cost of the inpainting step. This prevents them from being applicable to time-critical…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Niklas Kämper , Joachim Weickert

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

The time-dependent fields obtained by solving partial differential equations in two and more dimensions quickly overwhelm the analytical capabilities of the human brain. A meaningful insight into the temporal behaviour can be obtained by…

Numerical Analysis · Mathematics 2024-04-04 Miha Rot , Martin Horvat , Gregor Kosec

Dynamic Low Rank (DLR) methods are a promising way to reduce the computational cost and memory footprint of the high-dimensional thermal radiative transfer (TRT) equations. The TRT equations are a system of nonlinear PDEs that model the…

Numerical Analysis · Mathematics 2026-01-27 Terry Haut , John Loffeld , Lukas Einkemmer , Pierson Guthrey , Stefan Brunner , William Schill

In this study, we address the challenge of low-rank model compression in the context of in-memory computing (IMC) architectures. Traditional pruning approaches, while effective in model size reduction, necessitate additional peripheral…

Hardware Architecture · Computer Science 2025-02-13 Kang Eun Jeon , Johnny Rhe , Jong Hwan Ko

In dynamic magnetic resonance (MR) imaging, low-rank plus sparse (L+S) decomposition, or robust principal component analysis (PCA), has achieved stunning performance. However, the selection of the parameters of L+S is empirical, and the…

Image and Video Processing · Electrical Eng. & Systems 2021-07-21 Wenqi Huang , Ziwen Ke , Zhuo-Xu Cui , Jing Cheng , Zhilang Qiu , Sen Jia , Leslie Ying , Yanjie Zhu , Dong Liang

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

The aim of this work is to present a model reduction technique in the framework of optimal control problems for partial differential equations. We combine two approaches used for reducing the computational cost of the mathematical numerical…

Numerical Analysis · Mathematics 2023-11-09 Ivan Prusak , Monica Nonino , Davide Torlo , Francesco Ballarin , Gianluigi Rozza

Low-rank structures play important role in recent advances of many problems in image science and data science. As a natural extension of low-rank structures for data with nonlinear structures, the concept of the low-dimensional manifold…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Rongjie Lai , Jia Li