English
Related papers

Related papers: Bregman divergence as general framework to estimat…

200 papers

Deep Bregman divergence measures divergence of data points using neural networks which is beyond Euclidean distance and capable of capturing divergence over distributions. In this paper, we propose deep Bregman divergences for contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Mina Rezaei , Farzin Soleymani , Bernd Bischl , Shekoofeh Azizi

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

We investigate adaptive mixture methods that linearly combine outputs of $m$ constituent filters running in parallel to model a desired signal. We use "Bregman divergences" and obtain certain multiplicative updates to train the linear…

Machine Learning · Computer Science 2016-11-18 Mehmet A. Donmez , Huseyin A. Inan , Suleyman S. Kozat

We discuss unbiased estimation equations in a class of objective function using a monotonically increasing function $f$ and Bregman divergence. The choice of the function $f$ gives desirable properties such as robustness against outliers.…

Machine Learning · Computer Science 2021-08-26 Masahiro Kobayashi , Kazuho Watanabe

Minimization of suitable statistical distances~(between the data and model densities) has proved to be a very useful technique in the field of robust inference. Apart from the class of $\phi$-divergences of \cite{a} and \cite{b}, the…

Statistics Theory · Mathematics 2021-01-25 Sancharee Basak , Ayanendranath Basu

Statistical tasks such as density estimation and approximate Bayesian inference often involve densities with unknown normalising constants. Score-based methods, including score matching, are popular techniques as they are free of…

Machine Learning · Statistics 2021-12-22 Li K. Wenliang , Heishiro Kanagawa

This paper discusses regularized estimators in the multivariate statistical model as tools naturally arising within a Bayesian framework. First, a link is established between Bayesian estimation and inference under parameter rounding…

Methodology · Statistics 2025-09-15 Jan Kalina

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

Machine Learning · Computer Science 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

Several statistical models are given in the form of unnormalized densities, and calculation of the normalization constant is intractable. We propose estimation methods for such unnormalized models with missing data. The key concept is to…

Machine Learning · Statistics 2020-06-11 Masatoshi Uehara , Takeru Matsuda , Jae Kwang Kim

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu

Boosting has garnered significant interest across both machine learning and statistical communities. Traditional boosting algorithms, designed for fully observed random samples, often struggle with real-world problems, particularly with…

Machine Learning · Statistics 2026-02-19 Yuan Bian , Grace Y. Yi , Wenqing He

Existing popular unsupervised embedding learning methods focus on enhancing the instance-level local discrimination of the given unlabeled images by exploring various negative data. However, the existed sample outliers which exhibit large…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Jiahuan Zhou , Yansong Tang , Bing Su , Ying Wu

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

Methodology · Statistics 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Anomaly detection plays a crucial role in various real-world applications, including healthcare and finance systems. Owing to the limited number of anomaly labels in these complex systems, unsupervised anomaly detection methods have…

Machine Learning · Computer Science 2023-10-10 Zongyuan Huang , Baohua Zhang , Guoqiang Hu , Longyuan Li , Yanyan Xu , Yaohui Jin

Bregman divergences are a class of distance-like comparison functions which play fundamental roles in optimization, statistics, and information theory. One important property of Bregman divergences is that they cause two useful formulations…

Information Theory · Computer Science 2025-01-07 Philip S. Chodrow

Unsupervised rank aggregation on score-based permutations, which is widely used in many applications, has not been deeply explored yet. This work studies the use of submodular optimization for rank aggregation on score-based permutations in…

Machine Learning · Computer Science 2017-09-08 Jun Qi , Xu Liu , Javier Tejedor , Shunsuke Kamijo

Many statistical models are given in the form of non-normalized densities with an intractable normalization constant. Since maximum likelihood estimation is computationally intensive for these models, several estimation methods have been…

Statistics Theory · Mathematics 2021-09-01 Takeru Matsuda , Masatoshi Uehara , Aapo Hyvarinen