English
Related papers

Related papers: Convergence rate for predictive recursion estimati…

200 papers

Distributional regression aims at estimating the conditional distribution of a targetvariable given explanatory co-variates. It is a crucial tool for forecasting whena precise uncertainty quantification is required. A popular methodology…

Statistics Theory · Mathematics 2024-11-22 Clément Dombry , Ahmed Zaoui

Nonparametric regression with random design is considered. Estimates are defined by minimzing a penalized empirical $L_2$ risk over a suitably chosen class of neural networks with one hidden layer via gradient descent. Here, the gradient…

Statistics Theory · Mathematics 2019-12-10 Alina Braun , Michael Kohler , Harro Walk

In panel data subject to nonignorable attrition, auxiliary (refreshment) sampling may restore full identification under weak assumptions on the attrition process. Despite their generality, these identification strategies have seen limited…

Econometrics · Economics 2025-12-16 Grigory Franguridi , Jinyong Hahn , Pierre Hoonhout , Arie Kapteyn , Geert Ridder

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

Optimization and Control · Mathematics 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Proper scoring rules evaluate the quality of probabilistic predictions, playing an essential role in the pursuit of accurate and well-calibrated models. Every proper score decomposes into two fundamental components -- proper calibration…

Machine Learning · Computer Science 2023-12-15 Teodora Popordanoska , Sebastian G. Gruber , Aleksei Tiulpin , Florian Buettner , Matthew B. Blaschko

The paper is concerned with stochastic approximation procedures having three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function. We…

Statistics Theory · Mathematics 2016-11-14 Teo Sharia , Lei Zhong

As the popularity of hierarchical point forecast reconciliation methods increases, there is a growing interest in probabilistic forecast reconciliation. Many studies have utilized machine learning or deep learning techniques to implement…

Artificial Intelligence · Computer Science 2023-11-22 Guanyu Zhang , Feng Li , Yanfei Kang

Recent results in nonparametric regression show that for deep learning, i.e., for neural network estimates with many hidden layers, we are able to achieve good rates of convergence even in case of high-dimensional predictor variables,…

Statistics Theory · Mathematics 2019-12-12 Alina Braun , Michael Kohler , Adam Krzyzak

Methods for forecasting time series adhering to linear constraints have seen notable development in recent years, especially with the advent of forecast reconciliation. This paper extends forecast reconciliation to the open question of…

Methodology · Statistics 2025-10-27 Daniele Girolimetto , Anastasios Panagiotelis , Tommaso Di Fonzo , Han Li

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

Reinforcement Learning with Verifiable Rewards (RLVR) improves final-answer accuracy on reasoning tasks, but it does not reliably improve reasoning quality. Because outcome rewards only assess final answers, they also reward spurious…

Machine Learning · Computer Science 2026-05-19 Chenlu Ye , Zhou Yu , Ziji Zhang , Hao Chen , Narayanan Sadagopan , Jing Huang , Tong Zhang , Anurag Beniwal

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

We consider the problem of estimating a mixture of power series distributions with infinite support, to which belong very well-known models such as Poisson, Geometric, Logarithmic or Negative Binomial probability mass functions. We consider…

Statistics Theory · Mathematics 2025-08-04 Fadoua Balabdaoui , Harald Besdziek , Yong Wang

Predicting not only the target but also an accurate measure of uncertainty is important for many machine learning applications and in particular safety-critical ones. In this work we study the calibration of uncertainty prediction for…

Machine Learning · Computer Science 2020-02-04 Dan Levi , Liran Gispan , Niv Giladi , Ethan Fetaya

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

In this paper a first attempt at deriving an improved performance measure for language models, the probability ratio measure (PRM) is described. In a proof of concept experiment, it is shown that PRM correlates better with recognition…

cmp-lg · Computer Science 2007-05-23 Joerg P. Ueberla

Deep learning models are notoriously vulnerable to imperceptible perturbations. Most existing research centers on adversarial robustness (AR), which evaluates models under worst-case scenarios by examining the existence of deterministic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yi Zhang , Zheng Wang , Zhen Chen , Wenjie Ruan , Qing Guo , Siddartha Khastgir , Carsten Maple , Xingyu Zhao

The theoretical advances on the properties of scoring rules over the past decades have broadened the use of scoring rules in probabilistic forecasting. In meteorological forecasting, statistical postprocessing techniques are essential to…

Statistics Theory · Mathematics 2022-12-13 Romain Pic , Clément Dombry , Philippe Naveau , Maxime Taillardat

Finite-precision floating point arithmetic unavoidably introduces rounding errors which are traditionally bounded using a worst-case analysis. However, worst-case analysis might be overly conservative because worst-case errors can be…

Numerical Analysis · Mathematics 2019-12-11 Fredrik Dahlqvist , Rocco Salvia , George A Constantinides