English
Related papers

Related papers: Robust Least Squares Problems with Binary Uncertai…

200 papers

The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are…

Machine Learning · Statistics 2015-08-24 Reinhard Heckel , Helmut Bölcskei

We introduce the implicitly constrained least squares (ICLS) classifier, a novel semi-supervised version of the least squares classifier. This classifier minimizes the squared loss on the labeled data among the set of parameters implied by…

Machine Learning · Statistics 2017-01-31 Jesse H. Krijthe , Marco Loog

Neural networks are predominantly trained using gradient-based methods, yet in many applications their final predictions remain far from the accuracy attainable within the model's expressive capacity. We introduce Linearized Subspace…

Machine Learning · Computer Science 2026-01-21 Wenbo Cao , Weiwei Zhang

Robust regression techniques rely on least-squares optimization, which works well for Gaussian noise but fails in the presence of asymmetric structured noise. We propose a hybrid neural-symbolic architecture where a transformer encoder…

Machine Learning · Computer Science 2025-08-06 Roman Gutierrez , Tony Kai Tang , Isabel Gutierrez

This paper presents a novel algorithm integrating global and robust optimization methods to solve continuous non-convex quadratic problems under convex uncertainty sets. The proposed Robust spatial branch-and-bound (RsBB) algorithm combines…

Optimization and Control · Mathematics 2025-11-18 Asimina Marousi , Vassilis M. Charitopoulos

This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much…

Computer Vision and Pattern Recognition · Computer Science 2014-04-29 Can-Yi Lu , Hai Min , Zhong-Qiu Zhao , Lin Zhu , De-Shuang Huang , Shuicheng Yan

A new algorithm for 3D localization in multiplatform radar networks, comprising one transmitter and multiple receivers, is proposed. To take advantage of the monostatic sensor radiation pattern features, ad-hoc constraints are imposed in…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Augusto Aubry , Paolo Braca , Antonio De Maio , Angela Marino

Motivated by renal imaging studies that combine renogram curves with pharmacokinetic and demographic covariates, we propose Hybrid partial least squares (Hybrid PLS) for simultaneous supervised dimension reduction and regression in the…

Methodology · Statistics 2026-01-26 Jongmin Mun , Jeong Hoon Jang

Consider the problem of minimizing the sum of a smooth convex function and a separable nonsmooth convex function subject to linear coupling constraints. Problems of this form arise in many contemporary applications including signal…

Optimization and Control · Mathematics 2014-01-29 Mingyi Hong , Tsung-Hui Chang , Xiangfeng Wang , Meisam Razaviyayn , Shiqian Ma , Zhi-Quan Luo

Nonnegative (linear) least square problems are a fundamental class of problems that is well-studied in statistical learning and for which solvers have been implemented in many of the standard programming languages used within the machine…

Optimization and Control · Mathematics 2022-03-09 Jelena Diakonikolas , Chenghui Li , Swati Padmanabhan , Chaobing Song

We study the total least squares (TLS) problem that generalizes least squares regression by allowing measurement errors in both dependent and independent variables. TLS is widely used in applied fields including computer vision, system…

Machine Learning · Statistics 2014-07-01 Dmitry Malioutov , Nikolai Slavov

The autocovariance least squares (ALS) method is a computationally efficient approach for estimating noise covariances in Kalman filters without requiring specific noise models. However, conventional ALS and its variants rely on the classic…

Optimization and Control · Mathematics 2026-03-10 Jiahong Li , Fang Deng

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Designing learning algorithms that are resistant to perturbations of the underlying data distribution is a problem of wide practical and theoretical importance. We present a general approach to this problem focusing on unsupervised…

Machine Learning · Computer Science 2021-02-22 Andreas Maurer , Daniela A. Parletta , Andrea Paudice , Massimiliano Pontil

Least squares kernel based methods have been widely used in regression problems due to the simple implementation and good generalization performance. Among them, least squares support vector regression (LS-SVR) and extreme learning machine…

Machine Learning · Computer Science 2020-06-03 Hongwei Dong , Liming Yang

We present GURLS, a least squares, modular, easy-to-extend software library for efficient supervised learning. GURLS is targeted to machine learning practitioners, as well as non-specialists. It offers a number state-of-the-art training…

Machine Learning · Computer Science 2013-03-06 Andrea Tacchetti , Pavan K Mallapragada , Matteo Santoro , Lorenzo Rosasco

Secure ultra-reliable low-latency communication (URLLC) has been recently investigated with the fundamental limits of finite block length (FBL) regime in mind. Analysis has revealed that when eavesdroppers outnumber BS antennas or enjoy a…

Signal Processing · Electrical Eng. & Systems 2021-11-30 Mohammad Naseri Tehrani , Shahrokh Farahmand

Iteratively Re-weighted Least Squares (IRLS) is a method for solving minimization problems involving non-quadratic cost functions, perhaps non-convex and non-smooth, which however can be described as the infimum over a family of quadratic…

Numerical Analysis · Mathematics 2016-02-24 Massimo Fornasier , Steffen Peter , Holger Rauhut , Stephan Worm

We propose a deep learning approach to the obstacle problem inspired by the first-order system least-squares (FOSLS) framework. This method reformulates the problem as a convex minimization task; by simultaneously approximating the…

Numerical Analysis · Mathematics 2025-08-28 Gabriel Acosta , Eugenia Belén , Francisco M. Bersetche , Juan Pablo Borthagaray

We present a novel screening methodology to safely discard irrelevant nodes within a generic branch-and-bound (BnB) algorithm solving the l0-penalized least-squares problem. Our contribution is a set of two simple tests to detect sets of…

Signal Processing · Electrical Eng. & Systems 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira