English
Related papers

Related papers: Blockwise SVD with error in the operator and appli…

200 papers

In this paper we consider estimating the system parameters and designing stable observer for unknown noisy linear time-invariant (LTI) systems. We propose a Support Vector Regression (SVR) based estimator to provide adjustable asymmetric…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Xuda Ding , Han Wang , Jianping He , Cailian Chen , Xinping Guan

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

Offline Signature Verification (OSV) is a fundamental biometric task across various forensic, commercial and legal applications. The underlying task at hand is to carefully model fine-grained features of the signatures to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Soumitri Chattopadhyay , Siladittya Manna , Saumik Bhattacharya , Umapada Pal

Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameters within the matrix with equal importance, which is a simple…

Computation and Language · Computer Science 2022-12-19 Ting Hua , Yen-Chang Hsu , Felicity Wang , Qian Lou , Yilin Shen , Hongxia Jin

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

Numerical Analysis · Mathematics 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier

Convolution and transposed convolution are fundamental operators widely used in neural networks. However, transposed convolution (a.k.a. deconvolution) does not serve as a true inverse of convolution due to inherent differences in their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Xuhong Huang , Shiqi Liu , Kai Zhang , Ying Tai , Jian Yang , Hui Zeng , Lei Zhang

Convexity properties of error rates of a class of decoders, including the ML/min-distance one as a special case, are studied for arbitrary constellations, bit mapping and coding. Earlier results obtained for the AWGN channel are extended to…

Information Theory · Computer Science 2016-11-15 Sergey Loyka , Victoria Kostina , Francois Gagnon

Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Since inverse problems typically suffer from instability with respect to data perturbations, a variety of regularization…

Numerical Analysis · Mathematics 2024-02-27 Andrea Ebner , Markus Haltmeier

We study the question of extracting a sequence of functions $\{\boldsymbol{f}_i, \boldsymbol{g}_i\}_{i=1}^s$ from observing only the sum of their convolutions, i.e., from $\boldsymbol{y} = \sum_{i=1}^s \boldsymbol{f}_i\ast…

Information Theory · Computer Science 2017-11-29 Shuyang Ling , Thomas Strohmer

Blind deconvolution has made significant progress in the past decade. Most successful algorithms are classified either as Variational or Maximum a-Posteriori ($MAP$). In spite of the superior theoretical justification of variational…

Computer Vision and Pattern Recognition · Computer Science 2014-06-17 Dilip Krishnan , Joan Bruna , Rob Fergus

This paper considers the linear inverse problem where we wish to estimate a structured signal $x$ from its corrupted observations. When the problem is ill-posed, it is natural to make use of a convex function $f(\cdot)$ that exploits the…

Information Theory · Computer Science 2013-12-06 Samet Oymak , Christos Thrampoulidis , Babak Hassibi

In this paper, we examine the convergence of mirror descent in a class of stochastic optimization problems that are not necessarily convex (or even quasi-convex), and which we call variationally coherent. Since the standard technique of…

Optimization and Control · Mathematics 2018-07-17 Zhengyuan Zhou , Panayotis Mertikopoulos , Nicholas Bambos , Stephen Boyd , Peter Glynn

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

Machine Learning · Computer Science 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

Kitaev's toric code is one of the most prominent models for fault-tolerant quantum computation, currently regarded as the leading solution for connectivity constrained quantum technologies. Significant effort has been recently devoted to…

Quantum Physics · Physics 2026-03-26 Julien du Crest , Mehdi Mhalla , Valentin Savin

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are batch methods designed mainly based on the convex optimization, say, the…

Machine Learning · Statistics 2018-02-01 Ke Ma , Jinshan Zeng , Jiechao Xiong , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

Statistical dependencies among wavelet coefficients are commonly represented by graphical models such as hidden Markov trees(HMTs). However, in linear inverse problems such as deconvolution, tomography, and compressed sensing, the presence…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 Nikhil S Rao , Robert D. Nowak , Stephen J. Wright , Nick G. Kingsbury

A block decomposition method is proposed for minimizing a (possibly non-convex) continuously differentiable function subject to one linear equality constraint and simple bounds on the variables. The proposed method iteratively selects a…

Optimization and Control · Mathematics 2019-03-06 Andrea Cristofari

Inverse problems are fundamental in fields like medical imaging, geophysics, and computerized tomography, aiming to recover unknown quantities from observed data. However, these problems often lack stability due to noise and…

Numerical Analysis · Mathematics 2024-06-26 Andrea Ebner , Matthias Schwab , Markus Haltmeier

Low-rank regularization-based deep unrolling networks have achieved remarkable success in various inverse imaging problems (IIPs). However, the singular value decomposition (SVD) is non-differentiable when duplicated singular values occur,…

Numerical Analysis · Mathematics 2024-11-22 Yinghao Zhang , Yue Hu

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setting. Defining Bregman…

Optimization and Control · Mathematics 2022-10-12 Pierre-Cyril Aubin-Frankowski , Anna Korba , Flavien Léger