English
Related papers

Related papers: ALMA: a mathematics-driven approach for determinin…

200 papers

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

This paper presents a multilevel algorithm specifically designed for radio-interferometric imaging in astronomy. The proposed algorithm is used to solve the uSARA (unconstrained Sparsity Averaging Reweighting Analysis) formulation of this…

Optimization and Control · Mathematics 2024-03-21 Guillaume Lauga , Audrey Repetti , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves , Yves Wiaux

We propose a learnable variational model that learns the features and leverages complementary information from both image and measurement domains for image reconstruction. In particular, we introduce a learned alternating minimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chi Ding , Qingchao Zhang , Ge Wang , Xiaojing Ye , Yunmei Chen

This paper proposes scalable and fast algorithms for solving the Robust PCA problem, namely recovering a low-rank matrix with an unknown fraction of its entries being arbitrarily corrupted. This problem arises in many applications, such as…

Optimization and Control · Mathematics 2013-10-21 Zhouchen Lin , Minming Chen , Yi Ma

Magnetic resonance imaging (MRI) is an essential medical tool with inherently slow data acquisition process. Slow acquisition process requires patient to be long time exposed to scanning apparatus. In recent years significant efforts are…

Computer Vision and Pattern Recognition · Computer Science 2015-03-05 Jelena Badnjar

We introduce a new algorithm to solve a regularized spatial-spectral image estimation problem. Our approach is based on the linearized alternating directions method of multipliers (LADMM), which is a variation of the popular ADMM algorithm.…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yunsong Liu , Debdut Mandal , Congyu Liao , Kawin Setsompop , Justin P. Haldar

The CALMA (Computer Assisted Library for MAmmography) project is a five years plan developed in a physics research frame in collaboration between INFN (Istituto Nazionale di Fisica Nucleare) and many Italian hospitals. At present a large…

Medical Physics · Physics 2009-11-10 A. Lauria , R. Palmiero , G. Forni , P. Cerello , B. Golosio , F. Fauci , R. Magro , G. Raso , S. Tangaro , P. L. Indovina

Model merging offers a scalable alternative to multi-task learning but often yields suboptimal performance on classification tasks. We attribute this degradation to a geometric misalignment between the merged encoder and static…

Machine Learning · Computer Science 2026-02-03 Fanshuang Kong , Richong Zhang , Zhijie Nie , Hang Zhou , Ziqiao Wang , Qiang Sun , Chunming Hu

When aligning large language models (LLMs), their performance on various tasks (such as being helpful, harmless, and honest) depends heavily on the composition of their training data. However, selecting a data mixture that achieves strong…

Machine Learning · Computer Science 2025-06-03 Nicholas E. Corrado , Julian Katz-Samuels , Adithya Devraj , Hyokun Yun , Chao Zhang , Yi Xu , Yi Pan , Bing Yin , Trishul Chilimbi

Adapting large pre-trained language models to downstream tasks often entails fine-tuning millions of parameters or deploying costly dense weight updates, which hinders their use in resource-constrained environments. Low-rank Adaptation…

Machine Learning · Computer Science 2026-01-29 Longteng Zhang , Sen Wu , Shuai Hou , Zhengyu Qing , Zhuo Zheng , Danning Ke , Qihong Lin , Qiang Wang , Shaohuai Shi , Xiaowen Chu

Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques,…

Numerical Analysis · Mathematics 2024-11-28 Victor Y. Pan , Qi Luan , Soo Go

Reconstruction of images from noisy linear measurements is a core problem in image processing, for which convex optimization methods based on total variation (TV) minimization have been the long-standing state-of-the-art. We present an…

Information Theory · Computer Science 2016-08-31 Jean Barbier , Eric W. Tramel , Florent Krzakala

The parameter selection is crucial to regularization based image restoration methods. Generally speaking, a spatially fixed parameter for regularization item in the whole image does not perform well for both edge and smooth areas. A larger…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Tingting Zhang , Jie Chen , Caiying Wu , Zhifei He , Tieyong Zeng , Qiyu Jin

Motivated by single-particle cryo-electron microscopy, multi-reference alignment (MRA) models the task of recovering an unknown signal from multiple noisy observations corrupted by random rotations. The standard approach,…

Signal Processing · Electrical Eng. & Systems 2026-01-09 Shay Kreymer , Amnon Balanov , Tamir Bendory

LoRA has become one of the most widely used parameter-efficient fine-tuning methods due to its simplicity and effectiveness. However, numerous studies have shown that LoRA often introduces substantial parameter redundancy, which not only…

Computation and Language · Computer Science 2026-02-16 Daiye Miao , Yufang Liu , Jie Wang , Changzhi Sun , Yunke Zhang , Demei Yan , Shaokang Dong , Qi Zhang , Yuanbin Wu

This paper explores the use of the Learning Automata (LA) algorithm to compute threshold selection for image segmentation as it is a critical preprocessing step for image analysis, pattern recognition and computer vision. LA is a heuristic…

Computer Vision and Pattern Recognition · Computer Science 2014-05-30 Erik Cuevas , Daniel Zaldivar , Marco Perez

Augmented Lagrangian method (also called as method of multipliers) is an important and powerful optimization method for lots of smooth or nonsmooth variational problems in modern signal processing, imaging, optimal control and so on.…

Optimization and Control · Mathematics 2021-08-31 Hongpeng Sun

Spherical microphone arrays (SMAs) are widely used for sound field analysis, and sparse recovery (SR) techniques can significantly enhance their spatial resolution by modeling the sound field as a sparse superposition of dominant plane…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-05 Shunxi Xu , Craig T. Jin

Large pre-trained models, such as large language models (LLMs), present significant resource challenges for fine-tuning due to their extensive parameter sizes, especially for applications in mobile systems. To address this, Low-Rank…

Machine Learning · Computer Science 2024-07-18 Yuzhu Mao , Siqi Ping , Zihao Zhao , Yang Liu , Wenbo Ding

We propose two novel approaches to the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as simplex…

Information Theory · Computer Science 2015-06-17 Jeremy Vila , Philip Schniter