English
Related papers

Related papers: Noise-Contrastive Estimation for Multivariate Poin…

200 papers

We focus on estimating the integrated covariance of log-price processes in the presence of market microstructure noise. We construct an efficient unbiased estimator for the quadratic covariation of two It\^{o} processes in the case where…

Statistics Theory · Mathematics 2008-12-19 Markus Bibinger

The last decade has seen max-stable processes emerge as a common tool for the statistical modeling of spatial extremes. However, their application is complicated due to the unavailability of the multivariate density function, and so…

Methodology · Statistics 2009-02-23 Simone A. Padoan , Mathieu Ribatet , Scott A. Sisson

Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical…

Statistics Theory · Mathematics 2008-05-27 Jiahua Chen , Xianming Tan

Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jichang Li , Guanbin Li , Feng Liu , Yizhou Yu

In model-free deep reinforcement learning (RL) algorithms, using noisy value estimates to supervise policy evaluation and optimization is detrimental to the sample efficiency. As this noise is heteroscedastic, its effects can be mitigated…

Machine Learning · Computer Science 2022-05-04 Vincent Mai , Kaustubh Mani , Liam Paull

Many tasks in explainable machine learning, such as data valuation and feature attribution, perform expensive computation for each data point and are intractable for large datasets. These methods require efficient approximations, and…

Machine Learning · Computer Science 2024-10-31 Ian Covert , Chanwoo Kim , Su-In Lee , James Zou , Tatsunori Hashimoto

The negative binomial distribution has been widely used as a more flexible model than the Poisson distribution for count data. However, when the true data-generating process is Poisson, it is often challenging to distinguish it from a…

Statistics Theory · Mathematics 2026-04-07 Yingying Yang , Niloufar Dousti Mousavi , Zhou Yu , Jie Yang

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

Improvement guarantees for semi-supervised classifiers can currently only be given under restrictive conditions on the data. We propose a general way to perform semi-supervised parameter estimation for likelihood-based classifiers for…

Machine Learning · Statistics 2015-05-12 Marco Loog

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

We consider functional data which are measured on a discrete set of observation points. Often such data are measured with additional noise. We explore in this paper the factor structure underlying this type of data. We show that the latent…

Methodology · Statistics 2021-11-23 Siegfried Hörmann , Fatima Jammoul

One of the key factors of enabling machine learning models to comprehend and solve real-world tasks is to leverage multimodal data. Unfortunately, annotation of multimodal data is challenging and expensive. Recently, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Elad Amrani , Rami Ben-Ari , Daniel Rotman , Alex Bronstein

We develop a framework for composite likelihood estimation of parametric continuous-time stationary Gaussian processes. We derive the asymptotic theory of the associated maximum composite likelihood estimator. We implement our approach on a…

Econometrics · Economics 2026-01-21 Mikkel Bennedsen , Kim Christensen , Peter Christensen

Large crossed data sets, described by generalized linear mixed models, have become increasingly common and provide challenges for statistical analysis. At very large sizes it becomes desirable to have the computational costs of estimation,…

Methodology · Statistics 2017-06-15 Katelyn Gao , Art B. Owen

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

Maximum likelihood estimation of energy-based models is a challenging problem due to the intractability of the log-likelihood gradient. In this work, we propose learning both the energy function and an amortized approximate sampling…

Machine Learning · Computer Science 2019-05-29 Rithesh Kumar , Sherjil Ozair , Anirudh Goyal , Aaron Courville , Yoshua Bengio

Context: Logging tasks track the system's functioning by keeping records of evidence that have been analyzed by monitoring and observability activities. For these activities to be effective, it is necessary to consider the quality of the…

Software Engineering · Computer Science 2021-06-08 Eduardo Mendes , Fabio Petrillo

This paper studies a training method to jointly estimate an energy-based model and a flow-based model, in which the two models are iteratively updated based on a shared adversarial value function. This joint training method has the…

Machine Learning · Statistics 2020-04-02 Ruiqi Gao , Erik Nijkamp , Diederik P. Kingma , Zhen Xu , Andrew M. Dai , Ying Nian Wu

Word alignment is an important natural language processing task that indicates the correspondence between natural languages. Recently, unsupervised learning of log-linear models for word alignment has received considerable attention as it…

Computation and Language · Computer Science 2014-10-13 Yang Liu , Maosong Sun