English
Related papers

Related papers: L2 Boosting on generalized Hoeffding decomposition…

200 papers

We present a robust generalization of the synthetic control method for comparative case studies. Like the classical method, we present an algorithm to estimate the unobservable counterfactual of a treatment unit. A distinguishing feature of…

Econometrics · Economics 2017-11-21 Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

Given a statistical model, we propose a novel estimation method that yields randomised estimators for the unknown distribution of an observed random variable. We establish non-asymptotic bounds for the performance of these estimators and…

Statistics Theory · Mathematics 2026-05-06 Yannick Baraud

Many single-target regression problems require estimates of uncertainty along with the point predictions. Probabilistic regression algorithms are well-suited for these tasks. However, the options are much more limited when the prediction…

Machine Learning · Statistics 2021-06-08 Michael O'Malley , Adam M. Sykulski , Rick Lumpkin , Alejandro Schuler

For a sensor network, a tractable spatially-dependent node deployment model is presented with the property that the density is inversely proportional to the sink distance. A stochastic model is formulated to examine message advancements…

Probability · Mathematics 2015-03-13 H. Paul Keeler

Word embeddings are a fundamental tool in natural language processing. Currently, word embedding methods are evaluated on the basis of empirical performance on benchmark data sets, and there is a lack of rigorous understanding of their…

Methodology · Statistics 2023-01-18 Neil Dey , Matthew Singer , Jonathan P. Williams , Srijan Sengupta

Question answering models struggle to generalize to novel compositions of training patterns, such to longer sequences or more complex test structures. Current end-to-end models learn a flat input embedding which can lose input syntax…

Computation and Language · Computer Science 2021-11-08 Yu Gai , Paras Jain , Wendi Zhang , Joseph E. Gonzalez , Dawn Song , Ion Stoica

We introduce an estimation method for the scaled skewness coefficient of the sample mean of short and long memory linear processes. This method can be extended to estimate higher moments such as curtosis coefficient of the sample mean. Also…

Statistics Theory · Mathematics 2020-05-25 Masoud M Nasari , Mohamedou Ould-Haye

This paper deals with the problem of estimating the state of a linear time-invariant system in the presence of sporadically available measurements and external perturbations. An observer with a continuous intersample injection term is…

Systems and Control · Computer Science 2020-11-06 Francesco Ferrante , Frédéric Gouaisbaut , Ricardo G. Sanfelice , Sophie Tarbouriech

Cosine similarity between two words, computed using their contextualised token embeddings obtained from masked language models (MLMs) such as BERT has shown to underestimate the actual similarity between those words (Zhou et al., 2022).…

Computation and Language · Computer Science 2023-05-19 Saeth Wannasuphoprasit , Yi Zhou , Danushka Bollegala

We formalize notions of robustness for composite estimators via the notion of a breakdown point. A composite estimator successively applies two (or more) estimators: on data decomposed into disjoint parts, it applies the first estimator on…

Machine Learning · Computer Science 2016-09-06 Pingfan Tang , Jeff M. Phillips

The paper develops new methods of non-parametric estimation a compound Poisson distribution. Such a problem arise, in particular, in the inference of a Levy process recorded at equidistant time intervals. Our key estimator is based on…

Statistics Theory · Mathematics 2015-10-19 Alexey Lindo , Sergei Zuyev , Serik Sagitov

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

A new approach to $L_2$-consistent estimation of a general density functional using $k$-nearest neighbor distances is proposed, where the functional under consideration is in the form of the expectation of some function $f$ of the densities…

Statistics Theory · Mathematics 2022-03-14 J. Jon Ryu , Shouvik Ganguly , Young-Han Kim , Yung-Kyun Noh , Daniel D. Lee

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

This manuscript bridges nonparametric smoothness-based and shape-restricted estimation, which may appear as two disjoint paradigms in the field. The proposed approach is motivated by a conceptually simple observation: every Lipschitz…

Methodology · Statistics 2026-05-22 Kenta Takatsu , Tianyu Zhang , Arun Kumar Kuchibhotla

Randomized controlled trials (RCT's) allow researchers to estimate causal effects in an experimental sample with minimal identifying assumptions. However, to generalize or transport a causal effect from an RCT to a target population,…

Methodology · Statistics 2022-02-08 Melody Huang

In this paper, we study the problem of principal component analysis with generative modeling assumptions, adopting a general model for the observed matrix that encompasses notable special cases, including spiked matrix recovery and phase…

Machine Learning · Statistics 2022-09-08 Zhaoqiang Liu , Jiulong Liu , Subhroshekhar Ghosh , Jun Han , Jonathan Scarlett

Score-based diffusion models have achieved remarkable empirical success in generating high-quality samples from target data distributions. Among them, the Denoising Diffusion Probabilistic Model (DDPM) is one of the most widely used…

Machine Learning · Statistics 2025-12-16 Yuchen Jiao , Yuchen Zhou , Gen Li

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

Various studies that address the compressed sensing problem with Multiple Measurement Vectors (MMVs) have been recently carried. These studies assume the vectors of the different channels to be jointly sparse. In this paper, we relax this…

Machine Learning · Computer Science 2016-11-14 Hamid Palangi , Rabab Ward , Li Deng