English
Related papers

Related papers: Conformal Frequency Estimation with Sketched Data

200 papers

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algorithms over larger…

Machine Learning · Computer Science 2025-04-01 Menghua Wu , Yujia Bao , Regina Barzilay , Tommi Jaakkola

Time evolving surfaces can be modeled as two-dimensional Functional time series, exploiting the tools of Functional data analysis. Leveraging this approach, a forecasting framework for such complex data is developed. The main focus revolves…

Methodology · Statistics 2023-07-19 Niccolò Ajroldi , Jacopo Diquigiovanni , Matteo Fontana , Simone Vantini

We propose a novel approach to program synthesis, focusing on synthesizing database queries. At a high level, our proposed algorithm takes as input a sketch with soft constraints encoding user intent, and then iteratively interacts with the…

Programming Languages · Computer Science 2021-10-12 Osbert Bastani , Xin Zhang , Armando Solar-Lezama

We present a modular, extensible likelihood framework for spectroscopic inference based on synthetic model spectra. The subtraction of an imperfect model from a continuously sampled spectrum introduces covariance between adjacent datapoints…

Solar and Stellar Astrophysics · Physics 2015-10-21 Ian Czekala , Sean M. Andrews , Kaisey S. Mandel , David W. Hogg , Gregory M. Green

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

Conformal prediction, which makes no distributional assumptions about the data, has emerged as a powerful and reliable approach to uncertainty quantification in practical applications. The nonconformity measure used in conformal prediction…

Machine Learning · Computer Science 2024-10-15 Yuko Kato , David M. J. Tax , Marco Loog

Stochastic variational inference algorithms are derived for fitting various heteroskedastic time series models. We examine Gaussian, t, and skew-t response GARCH models and fit these using Gaussian variational approximating densities. We…

Computation · Statistics 2023-08-30 Hanwen Xuan , Luca Maestrini , Feng Chen , Clara Grazian

The focus of this paper is on the quantification of sampling variation in frequentist probabilistic forecasts. We propose a method of constructing confidence sets that respects the functional nature of the forecast distribution, and use…

Methodology · Statistics 2017-08-09 David Harris , Gael M. Martin , Indeewara Perera , D. S. Poskitt

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

Frequency estimation data structures such as the count-min sketch (CMS) have found numerous applications in databases, networking, computational biology and other domains. Many applications that use the count-min sketch process massive and…

Data Structures and Algorithms · Computer Science 2018-05-01 Mayank Goswami , Dzejla Medjedovic , Emina Mekic , Prashant Pandey

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na

Least squares regression is a ubiquitous tool for building emulators (a.k.a. surrogate models) of problems across science and engineering for purposes such as design space exploration and uncertainty quantification. When the regression data…

Numerical Analysis · Mathematics 2024-07-08 Nuojin Cheng , Osman Asif Malik , Yiming Xu , Stephen Becker , Alireza Doostan , Akil Narayan

As sketch research has collectively matured over time, its adaptation for at-mass commercialisation emerges on the immediate horizon. Despite an already mature research endeavour for photos, there is no research on the efficient inference…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Aneeshan Sain , Subhajit Maity , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

Conformal prediction is a popular method to construct prediction intervals with marginal coverage guarantees from black-box machine learning models. In applications with potentially high-impact events, such as flooding or financial crises,…

Methodology · Statistics 2026-04-02 Olivier C. Pasche , Henry Lam , Sebastian Engelke

In demographic literature, forecast uncertainty is often quantified with a statistical model. This model-based approach may potentially suffer from drawbacks, namely model misspecification, selection effect, and lack of finite-sample…

Applications · Statistics 2026-05-29 Han Lin Shang

Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high dimensional linear regression with random design. We first establish the convergence rates of the minimax expected…

Statistics Theory · Mathematics 2015-11-30 T. Tony Cai , Zijian Guo

Large-scale distributed training of neural networks is often limited by network bandwidth, wherein the communication time overwhelms the local computation time. Motivated by the success of sketching methods in sub-linear/streaming…

Machine Learning · Computer Science 2020-01-24 Nikita Ivkin , Daniel Rothchild , Enayat Ullah , Vladimir Braverman , Ion Stoica , Raman Arora

Conformal regression provides prediction intervals with global coverage guarantees, but often fails to capture local error distributions, leading to non-homogeneous coverage. We address this with a new adaptive method based on rescaling…

Machine Learning · Computer Science 2023-06-01 Nicolas Deutschmann , Mattia Rigotti , Maria Rodriguez Martinez