English
Related papers

Related papers: Non-Bernoulli Perturbation Distributions for Small…

200 papers

We study nonparametric regression with covariates $X$ and outcome $Y$ under random unbiased perturbations (RUPs) of the conditional distribution $Y|X$, where the marginal distribution of covariates, $P^X$, remains fixed but the conditional…

Statistics Theory · Mathematics 2025-11-27 Anna Lyubarskaja , Dominik Rothenhäusler

Constructing flexible probability models that respect constraints on key functionals -- such as the mean -- is a fundamental problem in nonparametric statistics. Existing approaches lack systematic tools for enforcing such constraints while…

Methodology · Statistics 2025-12-03 Alejandro Jara , Carlos Sing-Long

Non-uniform sampling arises when an experimenter does not have full control over the sampling characteristics of the process under investigation. Moreover, it is introduced intentionally in algorithms such as Bayesian optimization and…

Machine Learning · Statistics 2020-07-03 Stijn de Waele

Sign-Perturbed Sum (SPS) is a powerful finite-sample system identification algorithm which can construct confidence regions for the true data generating system with exact coverage probabilities, for any finite sample size. SPS was developed…

Machine Learning · Statistics 2024-01-30 Szabolcs Szentpéteri , Balázs Csanád Csáji

In this paper we improve some existing results concerning the approximation of the distribution of extremes of a 1-dependent and stationary sequence of random variables. We enlarge the range of applicability and improve the approximation…

Probability · Mathematics 2012-11-26 Alexandru Amarioarei

We prove a non-asymptotic concentration inequality for the spectral norm of sparse inhomogeneous random tensors with Bernoulli entries. For an order-$k$ inhomogeneous random tensor $T$ with sparsity $p_{\max}\geq \frac{c\log n}{n }$, we…

Probability · Mathematics 2021-05-05 Zhixin Zhou , Yizhe Zhu

General purpose optimization routines such as nlminb, optim (R) or nlmixed (SAS) are frequently used to estimate model parameters in nonstandard distributions. This paper presents Particle Swarm Optimization (PSO), as an alternative to many…

Machine Learning · Statistics 2024-05-22 Sisi Shao , Junhyung Park , Weng Kee Wong

In the matter of selection of sample time points for the estimation of the power spectral density of a continuous time stationary stochastic process, irregular sampling schemes such as Poisson sampling are often preferred over regular…

Statistics Theory · Mathematics 2010-07-19 Radhendushka Srivastava , Debasis Sengupta

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

In this paper, we discuss the potential for improvement of the simple random access scheme by utilizing local information such as the received signal-to-interference-plus-noise-ratio (SINR). We propose a spatially adaptive random access…

Information Theory · Computer Science 2015-05-05 Dong Min Kim , Seong-Lyun Kim

In this paper, we propose a computer-oriented method of construction of optimal group sequential hypothesis tests with variable group sizes. In particular, for independent and identically distributed observations we obtain the form of…

Methodology · Statistics 2023-03-30 Andrey Novikov

We explore training Binary Neural Networks (BNNs) as a discrete variable inference problem over a factor graph. We study the behaviour of this conversion in an under-parameterized BNN setting and propose stochastic versions of Belief…

Machine Learning · Computer Science 2022-04-06 Amir Khoshaman , Giuseppe Castiglione , Christopher Srinivasa

We study distributed stochastic nonconvex optimization in multi-agent networks. We introduce a novel algorithmic framework for the distributed minimization of the sum of the expected value of a smooth (possibly nonconvex) function (the…

Signal Processing · Electrical Eng. & Systems 2020-05-13 Paolo Di Lorenzo , Simone Scardapane

We introduce a novel approach based on stochastic optimization to find the optimal sampling distribution for the data-driven stability analysis of switched linear systems. Our goal is to address limitations of existing approaches, in…

Optimization and Control · Mathematics 2025-09-01 Alexis Vuille , Guillaume O. Berger , Raphaël M. Jungers

In this paper we study gradient estimation for a network of nonlinear stochastic units known as the Little model. Many machine learning systems can be described as networks of homogeneous units, and the Little model is of a particularly…

Optimization and Control · Mathematics 2019-05-07 Thomas Flynn , Felisa Vázquez-Abad

We consider the detection of multivariate spatial clusters in the Bernoulli model with $N$ locations, where the design distribution has weakly dependent marginals. The locations are scanned with a rectangular window with sides parallel to…

Statistics Theory · Mathematics 2010-02-26 Guenther Walther

We present new sampling methods in finite population that allow to control the joint inclusion probabilities of units and especially the spreading of sampled units in the population. They are based on the use of renewal chains and…

Methodology · Statistics 2017-04-12 Yves Tillé , Lionel Qualité , Matthieu Wilhelm

Principal Subspace Analysis (PSA) -- and its sibling, Principal Component Analysis (PCA) -- is one of the most popular approaches for dimensionality reduction in signal processing and machine learning. But centralized PSA/PCA solutions are…

Machine Learning · Computer Science 2021-11-25 Arpita Gang , Bingqing Xiang , Waheed U. Bajwa

Due to the massive number of devices in the M2M communication era, new challenges have been brought to the existing random-access (RA) mechanism, such as severe preamble collisions and resource block (RB) wastes. To address these problems,…

Information Theory · Computer Science 2019-10-09 Zhaoji Zhang , Ying Li , Lei Liu , Huimei Han

In this paper, a stochastic approximation (SA) based distributed algorithm is proposed to solve the resource allocation (RA) with uncertainties. In this problem, a group of agents cooperatively optimize a separable optimization problem with…

Optimization and Control · Mathematics 2016-11-01 Peng Yi , Jinlong Lei , Yiguang Hong