English
Related papers

Related papers: Nonlinear least-squares spline fitting with variab…

200 papers

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

In this paper we derive and test a probability-based weighting that can balance residuals of different types in spline fitting. In contrast to previous formulations, the proposed spline error weighting scheme also incorporates a prediction…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Hannes Ovrén , Per-Erik Forssén

We propose a novel, good-quality, and less demanding method for detecting knots on the surface of wooden logs using multimodal data fusion. Knots are a primary factor affecting the quality of sawn timber, making their detection fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Bořek Reich , Matej Kunda , Fedor Zolotarev , Tuomas Eerola , Pavel Zemčík , Tomi Kauppi

This article proposes a Bayesian approach to estimating the spectral density of a stationary time series using a prior based on a mixture of P-spline distributions. Our proposal is motivated by the B-spline Dirichlet process prior of…

Methodology · Statistics 2021-01-28 Patricio Maturana-Russel , Renate Meyer

We apply nonparametric Bayesian methods to study the problem of estimating the intensity function of an inhomogeneous Poisson process. We exhibit a prior on intensities which both leads to a computationally feasible method and enjoys…

Statistics Theory · Mathematics 2013-11-28 Eduard Belitser , Paulo Serra , Harry van Zanten

This paper explores the use of artificial neural networks for the stable and data-driven selection of the frequency parameter in hyperbolic polynomial penalized splines (HP-splines). This parameter defines the underlying spline space and is…

Numerical Analysis · Mathematics 2026-04-24 Vittoria Bruni , Paola Erminia Calabrese , Rosanna Campagna , Domenico Vitulano

Quantile regression has received increased attention in the statistics community in recent years. This article adapts an auxiliary variable method, commonly used in Bayesian variable selection for mean regression models, to the fitting of…

Methodology · Statistics 2012-02-28 J. -L. Dortet-Bernadet , Y. Fan

Markov-switching models are powerful tools that allow capturing complex patterns from time series data driven by latent states. Recent work has highlighted the benefits of estimating components of these models nonparametrically, enhancing…

Methodology · Statistics 2024-11-19 Jan-Ole Koslik

The R package cpr provides tools for selection of parsimonious B-spline regression models via algorithms coined `control polygon reduction' (CPR) and `control net reduction' (CNR). B-Splines are commonly used in regression models to smooth…

Computation · Statistics 2017-05-16 Peter E. DeWitt , Samantha MaWhinney , Nichole E. Carlson

The weighted nonlinear least-squares problem for low-rank signal estimation is considered. The problem of constructing a numerical solution that is stable and fast for long time series is addressed. A modified weighted Gauss-Newton method,…

Numerical Analysis · Mathematics 2022-07-08 Nikita Zvonarev , Nina Golyandina

Presented is a new algorithm for estimating the frequency of a single-tone noisy signal using linear least squares (LLS). Frequency estimation is a nonlinear problem, and typically, methods such as Nonlinear Least Squares (NLS) (batch) or a…

Signal Processing · Electrical Eng. & Systems 2019-04-17 Solomon Davis , Izhak Bucher

In this paper, we study spline trajectory generation via the solution of two optimisation problems: (i) a quadratic program (QP) with linear equality constraints and (ii) a nonlinear and nonconvex optimisation program. We propose an…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Declan Burke , Airlie Chapman , Iman Shames

This paper proposes a computational framework for the design optimization of stable structures under large deformations by incorporating nonlinear buckling constraints. A novel strategy for suppressing spurious buckling modes related to…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Guodong Zhang , Kapil Khandelwal , Tong Guo

This report studies local asymptotics of P-splines with $p$th degree B-splines and a $m$th order difference penalty. Earlier work with $p$ and $m$ restricted is extended to the general case. Asymptotically, penalized splines are kernel…

Statistics Theory · Mathematics 2012-06-12 Luo Xiao , Yingxing Li , Tatiyana V. Apanasovich , David Ruppert

Regression splines are largely used to investigate and predict data behavior, attracting the interest of mathematicians for their beautiful numerical properties, and of statisticians for their versatility with respect to the applications.…

Methodology · Statistics 2025-01-09 Rosanna Campagna , Serena Crisci , Gabriele Santin , Gerardo Toraldo , Marco Viola

One of the purposes in this paper is to provide a better understanding of the alternance property which occurs in Chebyshev polynomial approximation and piecewise polynomial approximation problems. In the first part of this paper, we…

Numerical Analysis · Mathematics 2018-01-23 Jean-Pierre Crouzeix , Nadezda Sukhorukova , Julien Ugon

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

Machine Learning · Computer Science 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

Least squares form one of the most prominent classes of optimization problems, with numerous applications in scientific computing and data fitting. When such formulations aim at modeling complex systems, the optimization process must…

Optimization and Control · Mathematics 2021-05-31 E. Bergou , Y. Diouane , V. Kungurtsev , C. W. Royer

We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that…

Optimization and Control · Mathematics 2015-05-12 Mert Pilanci , Martin J. Wainwright