English
Related papers

Related papers: Consistent estimation of distribution functions un…

200 papers

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

We examine deviations from Boltzmann-Gibbs statistics for partially equilibrated systems of finite size. We find that such systems are characterized by the Levy distribution whose non-extensivity parameter is related to the number of…

Nuclear Theory · Physics 2007-05-23 Athanasios N. Petridis

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

A continuous approximation framework for non-linear stochastic as well as deterministic discrete maps is developed. For the stochastic map with uncorelated Gaussian noise, by successively applying the It\^o lemma, we obtain a Langevin type…

Statistical Mechanics · Physics 2017-10-25 David A. Kessler , Stanislav Burov

This article introduces a non parametric warping model for functional data. When the outcome of an experiment is a sample of curves, data can be seen as realizations of a stochastic process, which takes into account the small variations…

Statistics Theory · Mathematics 2008-12-18 Jean-François Dupuy , Jean-Michel Loubes , Elie Maza

The empirical Bayes estimators in mixed models are useful for small area estimation in the sense of increasing precision of prediction for small area means, and one wants to know the prediction errors of the empirical Bayes estimators based…

Methodology · Statistics 2016-04-07 Shonosuke Sugasawa , Tatsuya Kubokawa

For a bivariate random vector (X,Y), symmetry conditions are presented that yield stochastic orderings among |X|, |Y|, |max(X,Y)|, and | min(X, Y)|. Partial extensions of these results for multivariate random vectors (X1,...,Xn) are also…

Statistics Theory · Mathematics 2012-06-22 Yindeng Jiang , Michael D. Perlman

We consider component-wise equivariant estimation of order restricted location/scale parameters of a general bivariate distribution under quite general conditions on underlying distributions and the loss function. This paper unifies various…

Statistics Theory · Mathematics 2022-07-05 Naresh Garg , Neeraj Misra

We consider the problem of nonparametric estimation of a convex regression function $\phi_0$. We study the risk of the least squares estimator (LSE) under the natural squared error loss. We show that the risk is always bounded from above by…

Statistics Theory · Mathematics 2014-12-10 Adityanand Guntuboyina , Bodhisattva Sen

Let X_1,...., X_n be a collection of iid discrete random variables, and Y_1,..., Y_m a set of noisy observations of such variables. Assume each observation Y_a to be a random function of some a random subset of the X_i's, and consider the…

Information Theory · Computer Science 2007-09-04 Andrea Montanari

We prove that certain natural random variables associated with the local eigenvalue statistics for generalized lattice Anderson models constructed with finite-rank perturbations are compound Poisson distributed. This distribution is…

Mathematical Physics · Physics 2015-09-30 Peter D. Hislop , M. Krishna

A recent line of ground-breaking results for permutation-based SGD has corroborated a widely observed phenomenon: random permutations offer faster convergence than with-replacement sampling. However, is random optimal? We show that this…

Machine Learning · Computer Science 2021-11-29 Shashank Rajput , Kangwook Lee , Dimitris Papailiopoulos

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

We prove that any random variable $X$ whose moment generating function is point-wise upper bounded by that of $ G \sim \mathcal{N}(0,1) $ must be dominated by $ G/\mathbb{E}[|G|] $ in convex order, meaning $ \mathbb{E}[f(X)] \le…

Probability · Mathematics 2026-04-30 Yihan Zhang

We consider the problem of estimating an arbitrary smooth functional of $k \geq 1 $ distribution functions (d.f.s.) in terms of random samples from them. The natural estimate replaces the d.f.s by their empirical d.f.s. Its bias is…

Statistics Theory · Mathematics 2010-08-03 C. S. Withers , S. Nadarajah

This article addresses structure-preserving smooth approximation of semiconcave functions. semiconcave functions are of particular interest because they naturally arise in a variety of variational problems, including {optimal feedback…

Optimization and Control · Mathematics 2026-02-10 Karl Kunisch , Donato Vásquez-Varas

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed…

Statistics Theory · Mathematics 2015-03-13 Jan Johannes , Maik Schwarz

Most of the stochastic orders for comparing random variables, considered in the literature, are afflicted with two main drawbacks: (i) lack of connex property and (ii) lack of consideration of any dependence structure between the random…

Methodology · Statistics 2021-03-03 Sugata Ghosh , Asok K. Nanda

This paper proves, in very general settings, that convex risk minimization is a procedure to select a unique conditional probability model determined by the classification problem. Unlike most previous work, we give results that are general…

Machine Learning · Computer Science 2015-06-16 Matus Telgarsky , Miroslav Dudík , Robert Schapire

In this paper, we discuss the ambiguous chance constrained based portfolio optimization problems, in which the perturbations associated with the input parameters are stochastic in nature, but their distributions are not known precisely. We…

Optimization and Control · Mathematics 2023-11-09 Pulak Swain , Akshay Kumar Ojha