English
Related papers

Related papers: Scalable Estimation for Structured Additive Distri…

200 papers

In artificial neural networks trained with gradient descent, the weights used for processing stimuli are also used during backward passes to calculate gradients. For the real brain to approximate gradients, gradient information would have…

Neurons and Cognition · Quantitative Biology 2020-02-04 Jordan Guerguiev , Konrad P. Kording , Blake A. Richards

The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capable of estimating their own uncertainty. In the context of regression, instead of estimating…

Machine Learning · Computer Science 2026-05-14 Quentin Duchemin , Guillaume Obozinski

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

The economic and banking importance of the small and medium enterprise (SME) sector is well recognized in contemporary society. Business credit loans are very important for the operation of SMEs, and the revenue is a key indicator of credit…

Machine Learning · Computer Science 2020-05-05 Zebang Zhang , Kui Zhao , Kai Huang , Quanhui Jia , Yanming Fang , Quan Yu

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

Designing scalable estimation algorithms is a core challenge in modern statistics. Here we introduce a framework to address this challenge based on parallel approximants, which yields estimators with provable properties that operate on the…

Methodology · Statistics 2023-08-04 Aritra Chakravorty , William S. Cleveland , Patrick J. Wolfe

Feature attribution methods, or saliency maps, are one of the most popular approaches for explaining the decisions of complex machine learning models such as deep neural networks. In this study, we propose a stochastic optimization approach…

Machine Learning · Statistics 2018-07-17 Kouichi Ikeno , Satoshi Hara

Increasingly larger data sets of processes in space and time ask for statistical models and methods that can cope with such data. We show that the solution of a stochastic advection-diffusion partial differential equation provides a…

Methodology · Statistics 2016-02-18 Fabio Sigrist , Hans R. Künsch , Werner A. Stahel

We propose a novel spike and slab prior specification with scaled beta prime marginals for the importance parameters of regression coefficients to allow for general effect selection within the class of structured additive distributional…

Methodology · Statistics 2020-06-30 Nadja Klein , Manuel Carlan , Thomas Kneib , Stefan Lang , Helga Wagner

There is an increasing convergence between biologically plausible computational models of inference and learning with local update rules and the global gradient-based optimization of neural network models employed in machine learning. One…

Machine Learning · Computer Science 2021-11-16 Andre Ofner , Raihan Kabir Ratul , Suhita Ghosh , Sebastian Stober

Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent…

Statistics Theory · Mathematics 2023-06-23 Charlotte Baey , Maud Delattre , Estelle Kuhn , Jean-Benoist Leger , Sarah Lemler

In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that…

Machine Learning · Computer Science 2024-01-10 Sankalp Gilda , Neel Bhandari , Wendy Mak , Andrea Panizza

The stochastic gradient descent (SGD) algorithm is widely used for parameter estimation, especially for huge data sets and online learning. While this recursive algorithm is popular for computation and memory efficiency, quantifying…

Machine Learning · Statistics 2021-06-23 Wanrong Zhu , Xi Chen , Wei Biao Wu

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

Developing efficient solutions for inference problems in intelligent sensor networks is crucial for the next generation of location, tracking, and mapping services. This paper develops a scalable distributed probabilistic inference…

Machine Learning · Computer Science 2023-10-24 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

In semivarying coefficient models for longitudinal/clustered data, usually of primary interest is usually the parametric component which involves unknown constant coefficients. First, we study semiparametric efficiency bound for estimation…

Methodology · Statistics 2015-09-15 Ming-Yen Cheng , Toshio Honda , Jialiang Li

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

We consider the task of learning Ising models when the signs of different random variables are flipped independently with possibly unequal, unknown probabilities. In this paper, we focus on the problem of robust estimation of…

Machine Learning · Statistics 2020-06-11 Ashish Katiyar , Vatsal Shah , Constantine Caramanis

In regression modelling approach, the main step is to fit the regression line as close as possible to the target variable. In this process most algorithms try to fit all of the data in a single line and hence fitting all parts of target…

Machine Learning · Statistics 2018-05-07 Kumarjit Pathak , Jitin Kapila , Aasheesh Barvey , Nikit Gawande