English
Related papers

Related papers: Weighted shape-constrained estimation for the auto…

200 papers

The paper introduces the weighted convolution, a novel approach to the convolution for signals defined on regular grids (e.g., 2D images) through the application of an optimal density function to scale the contribution of neighbouring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Simone Cammarasana , Giuseppe Patanè

Shape-constrained inference has wide applicability in bioassay, medicine, economics, risk assessment, and many other fields. Although there has been a large amount of work on monotone-constrained univariate curve estimation, multivariate…

Methodology · Statistics 2019-11-19 Lizhen Lin , Brian St. Thomas , Walter W. Piegorsch , James Scott , Carlos Carvalho

We propose a focused weighted-average least squares (FWALS) estimator that addresses the computational burden of focused model averaging. By semi-orthogonalizing auxiliary regressors, the weighting problem is reduced from $2^{k_2}$…

Econometrics · Economics 2026-03-04 Shou-Yung Yin

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2020-02-27 Meixia Lin , Defeng Sun , Kim-Chuan Toh

We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight…

Methodology · Statistics 2025-08-05 Pierluigi Amodio , Luigi Brugnano , Felice Iavernaro

We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares…

Methodology · Statistics 2023-10-24 Somabha Mukherjee , Rohit K. Patra , Andrew L. Johnson , Hiroshi Morita

We study kernel least-squares estimation under a norm constraint. This form of regularisation is known as Ivanov regularisation and it provides better control of the norm of the estimator than the well-established Tikhonov regularisation.…

Statistics Theory · Mathematics 2019-06-17 Stephen Page , Steffen Grünewälder

In this paper we examine a novel way of imposing shape constraints on a local polynomial kernel estimator. The proposed approach is referred to as Shape Constrained Kernel-weighted Least Squares (SCKLS). We prove uniform consistency of the…

Applications · Statistics 2018-01-19 Daisuke Yagi , Yining Chen , Andrew L. Johnson , Timo Kuosmanen

A novel regression method is introduced and studied. The procedure weights squared residuals based on their magnitude. Unlike the classic least squares which treats every squared residual equally important, the new procedure exponentially…

Methodology · Statistics 2023-12-11 Yijun Zuo , Hanwen Zuo

We propose a new class of spatio-temporal models with unknown and banded autoregressive coefficient matrices. The setting represents a sparse structure for high-dimensional spatial panel dynamic models when panel members represent economic…

Methodology · Statistics 2018-04-19 Zhaoxing Gao , Yingying Ma , Hansheng Wang , Qiwei Yao

Weighted $\ell_1$-minimization has been studied as a technique for the reconstruction of a sparse signal from compressively sampled measurements when prior information about the signal, in the form of a support estimate, is available. In…

Information Theory · Computer Science 2016-12-09 Deanna Needell , Rayan Saab , Tina Woolf

In the gravitational-wave analysis of pulsar-timing-array datasets, parameter estimation is usually performed using Markov Chain Monte Carlo methods to explore posterior probability densities. We introduce an alternative procedure that…

General Relativity and Quantum Cosmology · Physics 2024-05-16 Michele Vallisneri , Marco Crisostomi , Aaron D. Johnson , Patrick M. Meyers

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

Probability · Mathematics 2016-07-05 Gilles Pagès , Fabien Panloup

Pre-trained vision foundation models (VFMs) provide strong semantic representations, yet their patch-level features are inherently coarse, limiting their effectiveness on tasks requiring fine-grained localization, dense prediction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wentong Li , Zhiyuan Qi , Zichen Zhao , Kai Zhang , Lei Zhang

A weighted regression procedure is proposed for regression type problems where the innovations are heavy-tailed. This method approximates the least absolute regression method in large samples, and the main advantage will be if the sample is…

Computation · Statistics 2018-11-06 J. Martin van Zyl

This paper provides a least squares formulation for the training of a 2-layer convolutional neural network using quadratic activation functions, a 2-norm loss function, and no regularization term. Using this method, an analytic expression…

Machine Learning · Computer Science 2024-11-18 Zachary Yetman Van Egmond , Luis Rodrigues

We consider a high-probability non-asymptotic confidence estimation in the $\ell^2$-regularized non-linear least-squares setting with fixed design. In particular, we study confidence estimation for local minimizers of the regularized…

Machine Learning · Computer Science 2025-06-12 Ilja Kuzborskij , Yasin Abbasi Yadkori

Compressed Sensing refers to extracting a low-dimensional structured signal of interest from its incomplete random linear observations. A line of recent work has studied that, with the extra prior information about the signal, one can…

Information Theory · Computer Science 2017-04-19 Sajad Daei , Farzan Haddadi

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani