中文
相关论文

相关论文: Dictionary-based Low-Rank Approximations and the M…

200 篇论文

Convolutional sparse representations are a form of sparse representation with a dictionary that has a structure that is equivalent to convolution with a set of linear filters. While effective algorithms have recently been developed for the…

机器学习 · 计算机科学 2018-09-06 Cristina Garcia-Cardona , Brendt Wohlberg

In this paper, we account for approaches of sparse recovery from large underdetermined linear models with perturbation present in both the measurements and the dictionary matrix. Existing methods have high computation and low efficiency.…

信息论 · 计算机科学 2012-05-02 Xuebing Han , Hao Zhang , Gang Li

Low-rank adaptation (LoRA) has been prominently employed for parameter-efficient fine-tuning of large language models (LLMs). However, the limited expressive capacity of LoRA, stemming from the low-rank constraint, has been recognized as a…

计算与语言 · 计算机科学 2025-03-18 Zhiwei He , Zhaopeng Tu , Xing Wang , Xingyu Chen , Zhijie Wang , Jiahao Xu , Tian Liang , Wenxiang Jiao , Zhuosheng Zhang , Rui Wang

Low rank approximation of a matrix (hereafter LRA) is a highly important area of Numerical Linear and Multilinear Algebra and Data Mining and Analysis. One can operate with an LRA at sublinear cost -- by using much fewer memory cells and…

数值分析 · 数学 2025-07-11 Soo Go , Qi Luan , Victor Y. Pan , John Svadlenka , Liang Zhao

In this paper, we present a predictor-corrector strategy for constructing rank-adaptive dynamical low-rank approximations (DLRAs) of matrix-valued ODE systems. The strategy is a compromise between (i) low-rank step-truncation approaches…

数值分析 · 数学 2022-09-09 Cory Hauck , Stefan Schnake

Deterministic models for radiation transport describe the density of radiation particles moving through a background material. In radiation therapy applications, the phase space of this density is composed of energy, spatial position and…

数值分析 · 数学 2021-11-16 Jonas Kusch , Pia Stammer

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt…

机器学习 · 统计学 2020-10-07 Dominik Kirchhoff , Sonja Kuhnt

We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information…

机器学习 · 计算机科学 2020-06-23 Jongseok Lee , Matthias Humt , Jianxiang Feng , Rudolph Triebel

The problem of joint direction-of-arrival estimation and distorted sensor detection has received a lot of attention in recent decades. Most state-of-the-art work formulated such a problem via low-rank and row-sparse decomposition, where the…

信号处理 · 电气工程与系统科学 2023-12-22 Huiping Huang , Tianjian Zhang , Feng Yin , Bin Liao , Henk Wymeersch

This work presents an approach for image reconstruction in clinical low-dose tomography that combines principles from sparse signal processing with ideas from deep learning. First, we describe sparse signal representation in terms of…

机器学习 · 统计学 2023-11-27 Jevgenija Rudzusika , Thomas Koehler , Ozan Öktem

In this paper we consider the problem of recovering a high dimensional data matrix from a set of incomplete and noisy linear measurements. We introduce a new model that can efficiently restrict the degrees of freedom of the problem and is…

信息论 · 计算机科学 2012-11-22 Mohammad Golbabaee , Pierre Vandergheynst

Interactions between search and recommendation have recently attracted significant attention, and several studies have shown that many potential applications involve with a joint problem of producing recommendations to users with respect to…

信息检索 · 计算机科学 2014-12-15 Lu Yu , Junming Huang , Chuang Liu , Zike Zhang

Sparsity-based approaches have been popular in many applications in image processing and imaging. Compressed sensing exploits the sparsity of images in a transform domain or dictionary to improve image recovery from undersampled…

机器学习 · 统计学 2019-06-14 Saiprasad Ravishankar , Brian E. Moore , Raj Rao Nadakuditi , Jeffrey A. Fessler

Matrix factorization (MF) can extract the low-rank features and integrate the information of the data manifold distribution from high-dimensional data, which can consider the nonlinear neighbourhood information. Thus, MF has drawn wide…

分布式、并行与集群计算 · 计算机科学 2021-11-24 Zixuan Li , Hao Li , Kenli Li , Fan Wu , Lydia Chen , Keqin Li

Dictionary learning is a branch of signal processing and machine learning that aims at finding a frame (called dictionary) in which some training data admits a sparse representation. The sparser the representation, the better the…

机器学习 · 计算机科学 2015-02-27 Luc Le Magoarou , Rémi Gribonval

Expressing a matrix as the sum of a low-rank matrix plus a sparse matrix is a flexible model capturing global and local features in data popularized as Robust PCA (Candes et al., 2011; Chandrasekaran et al., 2009). Compressed sensing,…

数值分析 · 数学 2022-04-28 Jared Tanner , Simon Vary

Low Rank Approximation (LRA) of a matrix is a hot research subject, fundamental for Matrix and Tensor Computations and Big Data Mining and Analysis. Computations with low rank matrices can be performed at sublinear cost -- by using much…

数值分析 · 数学 2025-08-11 Qi Luan , Victor Y. Pan , John Svadlenka , Liang Zhao

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. The popular method of low-rank adaptation (LoRA) offers a notable approach, hypothesizing that the…

计算与语言 · 计算机科学 2023-11-21 Ning Ding , Xingtai Lv , Qiaosen Wang , Yulin Chen , Bowen Zhou , Zhiyuan Liu , Maosong Sun

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

计算机视觉与模式识别 · 计算机科学 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

A new approach to the sparse Canonical Correlation Analysis (sCCA)is proposed with the aim of discovering interpretable associations in very high-dimensional multi-view, i.e.observations of multiple sets of variables on the same subjects,…

机器学习 · 统计学 2019-09-18 Omid S. Solari , James B. Brown , Peter J. Bickel