English
Related papers

Related papers: Generalized Stochastic Approximation of the Log-Li…

200 papers

We consider the problem of conformal prediction under covariate shift. Given labeled data from a source domain and unlabeled data from a covariate shifted target domain, we seek to construct prediction sets with valid marginal coverage in…

Machine Learning · Statistics 2025-07-02 Sunay Joshi , Shayan Kiyani , George Pappas , Edgar Dobriban , Hamed Hassani

Stochastic approximation (SA) is a method for finding the root of an operator perturbed by noise. There is a rich literature establishing the asymptotic normality of rescaled SA iterates under fairly mild conditions. However, these…

Machine Learning · Statistics 2026-02-17 Shaan Ul Haque , Zedong Wang , Zixuan Zhang , Siva Theja Maguluri

Over the past decade, the low-degree heuristic has been used to estimate the algorithmic thresholds for a wide range of average-case planted vs null distinguishing problems. Such results rely on the hypothesis that if the low-degree moments…

Computational Complexity · Computer Science 2026-01-12 Jun-Ting Hsieh , Daniel M. Kane , Pravesh K. Kothari , Jerry Li , Sidhanth Mohanty , Stefan Tiegel

A method is introduced for approximate marginal likelihood inference via adaptive Gaussian quadrature in mixed models with a single grouping factor. The core technical contribution is an algorithm for computing the exact gradient of the…

Methodology · Statistics 2024-11-13 Alex Stringer

We consider a distributed detection problem within a wireless sensor network (WSN), where a substantial number of sensors cooperate to detect the existence of sparse stochastic signals. To achieve a trade-off between detection performance…

Signal Processing · Electrical Eng. & Systems 2024-11-07 Linlin Mao , Shefeng Yan , Zeping Sui , Hongbin Li

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

We consider the change-point detection problem of deciding, based on noisy measurements, whether an unknown signal over a given graph is constant or is instead piecewise constant over two connected induced subgraphs of relatively low cut…

Statistics Theory · Mathematics 2012-06-06 James Sharpnack , Alessandro Rinaldo , Aarti Singh

Since the work of Page in the 1950s, the problem of detecting an abrupt change in the distribution of stochastic processes has received a great deal of attention. In particular, a deep connection has been established between Lorden's…

Probability · Mathematics 2017-06-23 José E. Figueroa-López , Sveinn Ólafsson

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

Methodology · Statistics 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Smoothness of the subdiagonals of the Cholesky factor of large covariance matrices is closely related to the degrees of nonstationarity of autoregressive models for time series and longitudinal data. Heuristically, one expects for a nearly…

Machine Learning · Statistics 2020-07-23 Aramayis Dallakyan , Mohsen Pourahmadi

An asymptotically optimal blind calibration scheme of uniform linear arrays for narrowband Gaussian signals is proposed. Rather than taking the direct Maximum Likelihood (ML) approach for joint estimation of all the unknown model…

Signal Processing · Electrical Eng. & Systems 2020-09-01 Amir Weiss , Arie Yeredor

The paper provides a thorough investigation of Direct loss minimization (DLM), which optimizes the posterior to minimize predictive loss, in sparse Gaussian processes. For the conjugate case, we consider DLM for log-loss and DLM for square…

Machine Learning · Computer Science 2020-10-29 Yadi Wei , Rishit Sheth , Roni Khardon

A new bivariate partial sum process for locally stationary time series is introduced and its weak convergence to a Brownian sheet is established. This construction enables the development of a novel self-normalized CUSUM test statistic for…

Statistics Theory · Mathematics 2026-04-15 Florian Heinrichs

We consider causal, low-latency, sequential lossy compression, with mean squared-error (MSE) as the distortion loss, and a perception loss function (PLF) to enhance the realism of reconstructions. As the main contribution, we propose and…

Machine Learning · Computer Science 2025-02-18 Sadaf Salehkalaibar , Buu Phan , Likun Cai , Joao Atz Dick , Wei Yu , Jun Chen , Ashish Khisti

Stochastic approximation algorithms are iterative procedures which are used to approximate a target value in an environment where the target is unknown and direct observations are corrupted by noise. These algorithms are useful, for…

Logic in Computer Science · Computer Science 2022-08-10 Koundinya Vajjha , Barry Trager , Avraham Shinnar , Vasily Pestun

One of the most popular methodologies for estimating the average treatment effect at the threshold in a regression discontinuity design is local linear regression (LLR), which places larger weight on units closer to the threshold. We…

Methodology · Statistics 2019-02-01 Zach Branson , Maxime Rischard , Luke Bornn , Luke Miratrix

While the real world is inherently stochastic, Large Language Models (LLMs) are predominantly evaluated on single-round inference against fixed ground truths. In this work, we shift the lens to distribution alignment: assessing whether…

Computation and Language · Computer Science 2026-04-08 Yanbei Jiang , Amr Keleg , Ryandito Diandaru , Jey Han Lau , Lea Frermann , Biaoyan Fang , Fajri Koto

We develop a new robust stopping criterion in Partial Least Squares Regressions (PLSR) components construction characterised by a high level of stability. This new criterion is defined as a universal one since it is suitable both for PLSR…

Methodology · Statistics 2021-08-17 Jérémy Magnanensi , Frédéric Bertrand , Myriam Maumy-Bertrand , Nicolas Meyer

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell