English
Related papers

Related papers: Covariance-free Partial Least Squares: An Incremen…

200 papers

Class incremental learning aims to enable models to learn from sequential, non-stationary data streams across different tasks without catastrophic forgetting. In class incremental semantic segmentation (CISS), the semantic content of image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiao Yu , Yan Fang , Yao Zhao , Yunchao Wei

For solving a wide class of nonconvex and nonsmooth problems, we propose a proximal linearized iteratively reweighted least squares (PL-IRLS) algorithm. We first approximate the original problem by smoothing methods, and second write the…

Optimization and Control · Mathematics 2016-11-02 Hui Zhang , Tao Sun , Lizhi Cheng

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

The partial least squares (PLS) is a popular modeling technique commonly used in social sciences. The traditional PLS algorithm deals with variables measured on interval scales while data are often collected on ordinal scales: a…

Methodology · Statistics 2012-12-21 Gabriele Cantaluppi

Modern manufacturing value chains require intelligent orchestration of processes across company borders in order to maximize profits while fostering social and environmental sustainability. However, the implementation of integrated,…

Machine Learning · Statistics 2024-01-29 Du Nguyen Duy , Ramin Nikzad-Langerodi

Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhengwen Li , Xiabi Liu

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

We propose a novel method to model nonlinear regression problems by adapting the principle of penalization to Partial Least Squares (PLS). Starting with a generalized additive model, we expand the additive component of each variable in…

Statistics Theory · Mathematics 2010-08-13 Nicole Kraemer , Anne-Laure Boulesteix , Gerhard Tutz

Partial Least Squares (PLS) regression emerged as an alternative to ordinary least squares for addressing multicollinearity in a wide range of scientific applications. As multidimensional tensor data is becoming more widespread, tensor…

Methodology · Statistics 2024-10-11 Kwangmoon Park , Sündüz Keleş

Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chao Chen , Yu-Shen Liu , Zhizhong Han

$\textit{Implicit neural representations}$ (INRs) aim to learn a $\textit{continuous function}$ (i.e., a neural network) to represent an image, where the input and output of the function are pixel coordinates and RGB/Gray values,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Liu , Feng Liu , Haishuai Wang , Ning Ma , Jiajun Bu , Bo Han

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

Face restoration is an inherently ill-posed problem, where additional prior constraints are typically considered crucial for mitigating such pathology. However, real-world image prior are often hard to simulate with precise mathematical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Lingbo Yang , Pan Wang , Zhanning Gao , Shanshe Wang , Peiran Ren , Siwei Ma , Wen Gao

Partial least squares (PLS) regression combines dimensionality reduction and prediction using a latent variable model. Since partial least squares regression (PLS-R) does not require matrix inversion or diagonalization, it can be applied to…

Methodology · Statistics 2014-08-05 Tzu-Yu Liu , Laura Trinchera , Arthur Tenenhaus , Dennis Wei , Alfred O. Hero

Image clustering is a particularly challenging computer vision task, which aims to generate annotations without human supervision. Recent advances focus on the use of self-supervised learning strategies in image clustering, by first…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

In this paper, we propose deep partial least squares for the estimation of high-dimensional nonlinear instrumental variable regression. As a precursor to a flexible deep neural network architecture, our methodology uses partial least…

Methodology · Statistics 2023-06-06 Maria Nareklishvili , Nicholas Polson , Vadim Sokolov

We present a non-conforming least squares method for approximating solutions of second order elliptic problems with discontinuous coefficients. The method is based on a general Saddle Point Least Squares (SPLS) method introduced in previous…

Numerical Analysis · Mathematics 2019-04-01 Constantin Bacuta , Jacob Jacavage

High-dimensional compositional data are commonplace in the modern omics sciences amongst others. Analysis of compositional data requires a proper choice of orthonormal coordinate representation as their relative nature is not compatible…

Semantic instance segmentation remains a challenging task. In this work we propose to tackle the problem with a discriminative loss function, operating at the pixel level, that encourages a convolutional network to produce a representation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Bert De Brabandere , Davy Neven , Luc Van Gool