English
Related papers

Related papers: Two-Level Structural Sparsity Regularization for I…

200 papers

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

Point set registration involves identifying a smooth invertible transformation between corresponding points in two point sets, one of which may be smaller than the other and possibly corrupted by observation noise. This problem is…

Applications · Statistics 2018-12-27 Adam Spannaus , Vasileios Maroulas , David J. Keffer , Kody J. H. Law

Scientific image tampering is a problem that affects not only authors but also the general perception of the research community. Although previous researchers have developed methods to identify tampering in natural images, these methods may…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Ziyue Xiang , Daniel E. Acuna

Identifying damage of structural systems is typically characterized as an inverse problem which might be ill-conditioned due to aleatory and epistemic uncertainties induced by measurement noise and modeling error. Sparse representation can…

Applications · Statistics 2020-06-09 Zhao Chen , Hao Sun

We present a novel approach for extracting 3D atomic-level information from transmission electron microscopy (TEM) images affected by significant noise. The approach is based on formulating depth estimation as a semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matan Leibovich , Mai Tan , Ramon Manzorro , Adria Marcos-Morales , Sreyas Mohan , Peter A. Crozier , Carlos Fernandez-Granda

In tracking of time-varying low-rank models of time-varying matrices, we present a method robust to both uniformly-distributed measurement noise and arbitrarily-distributed ``sparse'' noise. In theory, we bound the tracking error. In…

Optimization and Control · Mathematics 2020-02-05 Albert Akhriev , Jakub Marecek , Andrea Simonetto

Greedy algorithms for minimizing L0-norm of sparse decomposition have profound application impact on many signal processing problems. In the sparse coding setup, given the observations $\mathrm{y}$ and the redundant dictionary…

Numerical Analysis · Computer Science 2015-02-13 Yuanyi Xue , Yao Wang

The orthogonal matching pursuit (OMP) is an algorithm to solve sparse approximation problems. Sufficient conditions for exact recovery are known with and without noise. In this paper we investigate the applicability of the OMP for the…

Numerical Analysis · Mathematics 2010-10-26 Loic Denis , Dirk A. Lorenz , Dennis Trede

We consider the problem of sparse atomic optimization, where the notion of "sparsity" is generalized to meaning some linear combination of few atoms. The definition of atomic set is very broad; popular examples include the standard basis,…

Optimization and Control · Mathematics 2019-12-30 Thomas Zhang

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

Fine-tuning pre-trained models has been ubiquitously proven to be effective in a wide range of NLP tasks. However, fine-tuning the whole model is parameter inefficient as it always yields an entirely new model for each task. Currently, many…

Computation and Language · Computer Science 2022-11-29 Zihao Fu , Haoran Yang , Anthony Man-Cho So , Wai Lam , Lidong Bing , Nigel Collier

Analyzing atomically resolved images is a time-consuming process requiring solid experience and substantial human intervention. In addition, the acquired images contain a large amount of information such as crystal structure, presence and…

In this work, a new two-stage identification method based on dynamic programming and sparsity inducing is proposed for switched linear systems. Our method achieves sparsity inducing in the identification of switched linear systems by the…

Systems and Control · Electrical Eng. & Systems 2024-07-15 Zheng Wenju , Ye Hao

We propose a new algorithm for recovery of sparse signals from their compressively sensed samples. The proposed algorithm benefits from the strategy of gradual movement to estimate the positions of non-zero samples of sparse signal. We…

Information Theory · Computer Science 2012-04-04 Seyed Hossein Hosseini , Mahrokh G. Shayesteh

Latent variable models are a fundamental modeling tool in machine learning applications, but they present significant computational and analytical challenges. The popular EM algorithm and its variants, is a much used algorithmic tool; yet…

Machine Learning · Computer Science 2015-12-08 Xinyang Yi , Constantine Caramanis

This paper investigates the problem of recovering missing samples using methods based on sparse representation adapted especially for image signals. Instead of $l_2$-norm or Mean Square Error (MSE), a new perceptual quality measure is used…

Machine Learning · Computer Science 2017-10-18 Amirhossein Javaheri , Hadi Zayyani , Farokh Marvasti

We study the implicit regularization of gradient descent towards structured sparsity via a novel neural reparameterization, which we call a diagonally grouped linear neural network. We show the following intriguing property of our…

Machine Learning · Statistics 2023-01-31 Jiangyuan Li , Thanh V. Nguyen , Chinmay Hegde , Raymond K. W. Wong

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The…

Methodology · Statistics 2025-01-10 Vahe Avagyan

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

The information content of atomic resolution scanning transmission electron microscopy (STEM) images can often be reduced to a handful of parameters describing each atomic column, chief amongst which is the column position. Neural networks…

Materials Science · Physics 2023-02-22 Jingrui Wei , Ben Blaiszik , Aristana Scourtas , Dane Morgan , Paul M. Voyles