English
Related papers

Related papers: Hybrid Partial Least Squares Regression with Multi…

200 papers

The rapid development of autonomous driving and mobile mapping calls for off-the-shelf LiDAR SLAM solutions that are adaptive to LiDARs of different specifications on various complex scenarios. To this end, we propose MULLS, an efficient,…

Robotics · Computer Science 2021-04-28 Yue Pan , Pengchuan Xiao , Yujie He , Zhenlei Shao , Zesong Li

We implement extensions of the partial least squares generalized linear regression (PLSGLR) due to Bastien et al. (2005) through its combination with logistic regression and linear discriminant analysis, to get a partial least squares…

Computation · Statistics 2019-06-20 Adolphus Wagala , Graciela Gonzalez-Farıas , Rogelio Ramos , Oscar Dalmau

In applications, a substantial number of problems can be formulated as non-linear least squares problems over smooth varieties. Unlike the usual least squares problem over a Euclidean space, the non-linear least squares problem over a…

Optimization and Control · Mathematics 2025-03-11 Shenglong Hu , Ke Ye

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

Separable nonlinear least squares (SNLS)problem is a special class of nonlinear least squares (NLS)problems, whose objective function is a mixture of linear and nonlinear functions. It has many applications in many different areas,…

Computational Geometry · Computer Science 2016-11-17 Wajeb Gharibi , Omar Saeed Al-Mushayt

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

A full parametric and linear specification may be insufficient to capture complicated patterns in studies exploring complex features, such as those investigating age-related changes in brain functional abilities. Alternatively, a partially…

Methodology · Statistics 2024-02-07 Jia Liang , Shuo Chen , Peter Kochunov , L Elliot Hong , Chixiang Chen

This paper considers the hyperparameter optimization problem of mathematical techniques that arise in the numerical solution of differential and integral equations. The well-known approaches grid and random search, in a parallel algorithm…

Numerical Analysis · Mathematics 2023-04-28 Alireza Afzal Aghaei , Kourosh Parand

This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional…

Machine Learning · Computer Science 2020-08-26 Zhiqiang Cai , Jingshuang Chen , Min Liu , Xinyu Liu

Although much progress has been made in classification with high-dimensional features \citep{Fan_Fan:2008, JGuo:2010, CaiSun:2014, PRXu:2014}, classification with ultrahigh-dimensional features, wherein the features much outnumber the…

Machine Learning · Statistics 2016-11-14 Yanming Li , Hyokyoung Hong , Jian Kang , Kevin He , Ji Zhu , Yi Li

We propose a multi-dimensional persistent sheaf Laplacian (MPSL) framework on simplicial complexes for image analysis. The proposed method is motivated by the strong sensitivity of commonly used dimensionality reduction techniques, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xiang Xiang Wang , Guo-Wei Wei

We develop a new method for multivariate scalar on multidimensional distribution regression. Traditional approaches typically analyze isolated univariate scalar outcomes or consider unidimensional distributional representations as…

Methodology · Statistics 2023-10-17 Rahul Ghosal , Marcos Matabuena

This paper develops a novel spatial quantile function-on-scalar regression model, which studies the conditional spatial distribution of a high-dimensional functional response given scalar predictors. With the strength of both quantile…

Methodology · Statistics 2020-12-22 Zhengwu Zhang , Xiao Wang , Linglong Kong , Hongtu Zhu

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

The hybrid LSMR algorithm is proposed for large-scale general-form regularization. It is based on a Krylov subspace projection method where the matrix $A$ is first projected onto a subspace, typically a Krylov subspace, which is implemented…

Numerical Analysis · Mathematics 2024-09-17 Yanfei Yang

Multiscale Models are known to be successful in uncovering and analyzing the structures in data at different resolutions. In the current work we propose a feature driven Reproducing Kernel Hilbert space (RKHS), for which the associated…

Machine Learning · Computer Science 2022-08-24 Prashant Shekhar , Abani Patra

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residuals with large…

Optimization and Control · Mathematics 2026-04-15 Xiang Meng , Andrés Gómez , Rahul Mazumder

Several causal parameters in short panel data models are functionals of a nested nonparametric instrumental variable regression (nested NPIV). Recent examples include mediated, time varying, and long term treatment effects identified using…

Machine Learning · Statistics 2025-06-02 Isaac Meza , Rahul Singh

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

The selection of best variables is a challenging problem in supervised and unsupervised learning, especially in high dimensional contexts where the number of variables is usually much larger than the number of observations. In this paper,…

Methodology · Statistics 2024-04-01 Benoit Liquet , Sarat Moka , Samuel Muller