English
Related papers

Related papers: WeSpeR: Computing non-linear shrinkage formulas fo…

200 papers

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

A key assumption in the theory of nonlinear adaptive control is that the uncertainty of the system can be expressed in the linear span of a set of known basis functions. While this assumption leads to efficient algorithms, it limits…

Optimization and Control · Mathematics 2022-08-26 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

Linear optimization problems are investigated whose parameters are uncertain. We apply coherent distortion risk measures to capture the possible violation of a restriction. Each risk constraint induces an uncertainty set of coefficients,…

Methodology · Statistics 2017-12-18 Karl Mosler , Pavel Bazovkin

A novel numerical method for the estimation of large time-varying parameter (TVP) models is proposed. The updating and smoothing estimates of the TVP model are derived within the context of generalised linear least squares and through…

Methodology · Statistics 2018-01-23 Stella Hadjiantoni , Erricos J. Kontoghiorghes

We propose the introduction of nonlinear operation into the feature generation process in convolutional neural networks. This nonlinearity can be implemented in various ways. First we discuss the use of nonlinearities in the process of data…

Machine Learning · Computer Science 2019-05-30 Gavneet Singh Chadha , Andreas Schwung

This paper presents a practical and simple fully nonparametric multivariate smoothing procedure that adapts to the underlying smoothness of the true regression function. Our estimator is easily computed by successive application of existing…

Methodology · Statistics 2011-06-08 P. A. Cornillon , N. Hengartner , E. Matzner-Løber

We present a new method for performing nonlinear approximation with redundant dictionaries. The method constructs an $m-$term approximation of the signal by thresholding with respect to a weighted version of its canonical expansion…

Functional Analysis · Mathematics 2017-11-07 Emil Solsbæk Ottosen , Morten Nielsen

Classification and probability estimation are fundamental tasks with broad applications across modern machine learning and data science, spanning fields such as biology, medicine, engineering, and computer science. Recent development of…

Methodology · Statistics 2026-03-25 Liyun Zeng , Hao Helen Zhang

Opacities of molecules in exoplanet atmospheres rely on increasingly detailed line-lists for these molecules. The line lists available today contain for many species up to several billions of lines. Computation of the spectral line profile…

Earth and Planetary Astrophysics · Physics 2017-11-08 Michiel Min

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

The likelihood function for cosmological parameters, given by e.g. weak lensing shear measurements, depends on contributions to the covariance induced by the nonlinear evolution of the cosmic web. As nonlinear clustering to date has only…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-26 Robert Reischke , Alina Kiessling , Björn Malte Schäfer

To tackle massive data, subsampling is a practical approach to select the more informative data points. However, when responses are expensive to measure, developing efficient subsampling schemes is challenging, and an optimal sampling…

Computation · Statistics 2022-10-11 Jing Wang , HaiYing Wang , Shifeng Xiong

In this paper, we propose the application of shrinkage strategies to estimate coefficients in the Bell regression models when prior information about the coefficients is available. The Bell regression models are well-suited for modeling…

Statistics Theory · Mathematics 2024-01-03 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Computer algebra algorithms are developed for evaluating the coefficients in Airy-type asymptotic expansions that are obtained from integrals with a large parameter. The coefficients are defined from recursive schemes obtained from…

Classical Analysis and ODEs · Mathematics 2013-10-04 Raimundas Vidunas , Nico M. Temme

Flexible estimation of the mean outcome under a treatment regimen (i.e., value function) is the key step toward personalized medicine. We define our target parameter as a conditional value function given a set of baseline covariates which…

Statistics Theory · Mathematics 2023-09-29 Ashkan Ertefaie , Luke Duttweiler , Brent A. Johnson , Mark J. van der Laan

Estimating the expected value of an observable appearing in a non-equilibrium stochastic process usually involves sampling. If the observable's variance is high, many samples are required. In contrast, we show that performing the same task…

Statistical Mechanics · Physics 2015-04-07 T. H. Johnson , T. J. Elliott , S. R. Clark , D. Jaksch

To effectively exploit large-scale structure surveys, we depend on accurate and reliable predictions of non-linear cosmological structure formation. Tools for efficient and comprehensive computational modelling are therefore essential to…

Cosmology and Nongalactic Astrophysics · Physics 2020-10-07 Benjamin Bose , Matteo Cataneo , Tilman Tröster , Qianli Xia , Catherine Heymans , Lucas Lombriser

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

A weighted regression procedure is proposed for regression type problems where the innovations are heavy-tailed. This method approximates the least absolute regression method in large samples, and the main advantage will be if the sample is…

Computation · Statistics 2018-11-06 J. Martin van Zyl

Many high-dimensional data sets suffer from hidden confounding which affects both the predictors and the response of interest. In such situations, standard regression methods or algorithms lead to biased estimates. This paper substantially…

Methodology · Statistics 2024-12-17 Cyrill Scheidegger , Zijian Guo , Peter Bühlmann