English
Related papers

Related papers: On Coarse Graining of Information and Its Applicat…

200 papers

Deep convolutional neural networks have shown high efficiency in computer visions and other applications. However, with the increase in the depth of the networks, the computational complexity is growing exponentially. In this paper, we…

Machine Learning · Computer Science 2021-01-08 Ali Mirzaeian , Sai Manoj , Ashkan Vakil , Houman Homayoun , Avesta Sasan

We propose a method to approximate the distribution of robot configurations satisfying multiple objectives. Our approach uses variational inference, a popular method in Bayesian computation, which has several advantages over sampling-based…

Robotics · Computer Science 2019-11-25 Emmanuel Pignat , Teguh Lembono , Sylvain Calinon

In this work, we study generalized entropies and information geometry in a group-theoretical framework. We explore the conditions that ensure the existence of some natural properties and at the same time of a group-theoretical structure for…

Mathematical Physics · Physics 2021-08-03 Miguel A. Rodríguez , Álvaro Romaniega , Piergiulio Tempesta

In this paper, we present a novel method for co-clustering, an unsupervised learning approach that aims at discovering homogeneous groups of data instances and features by grouping them simultaneously. The proposed method uses the entropy…

Machine Learning · Statistics 2017-05-22 Charlotte Laclau , Ievgen Redko , Basarab Matei , Younès Bennani , Vincent Brault

Mixture models extend the toolbox of clustering methods available to the data analyst. They allow for an explicit definition of the cluster shapes and structure within a probabilistic framework and exploit estimation and inference…

Methodology · Statistics 2025-09-15 Bettina Grün

A new class of general exponential ranking models is introduced which we label angle-based models for ranking data. A consensus score vector is assumed, which assigns scores to a set of items, where the scores reflect a consensus view of…

Methodology · Statistics 2017-12-27 Hang Xu , Mayer Alvo , Philip L. H. Yu

This paper is concerned with an important issue in finite mixture modelling, the selection of the number of mixing components. We propose a new penalized likelihood method for model selection of finite multivariate Gaussian mixture models.…

Methodology · Statistics 2013-01-17 Tao Huang , Heng Peng , Kun Zhang

We introduce a supervised dimensionality reduction methodology for categorical (and discretized mixed-type) data based on a density-matrix construction induced by class-conditional frequencies. Given a labeled dataset encoded in a one-hot…

Machine Learning · Statistics 2026-03-03 Raquel Bosch-Romeu , Antonio Falcó , osé-Antonio Rodríguez-Gallego

This article extends the literature on copulas with discrete or continuous marginals to the case where some of the marginals are a mixture of discrete and continuous components. We do so by carefully defining the likelihood as the density…

Methodology · Statistics 2017-09-05 David Gunawan , Mohamad A. Khaled , Robert Kohn

We propose a Bayesian approach for model-based clustering of multivariate categorical data where variables are allowed to be associated within clusters and the number of clusters is unknown. The approach uses a two-layer mixture of finite…

Methodology · Statistics 2024-07-09 Gertraud Malsiner-Walli , Bettina Grün , Sylvia Frühwirth-Schnatter

A method for aggregation of expert estimates in small groups is proposed. The method is based on combinatorial approach to decomposition of pair-wise comparison matrices and to processing of expert data. It also uses the basic principles of…

Optimization and Control · Mathematics 2019-11-14 Vitaliy Tsyganok , Sergii Kadenko , Oleh Andriichuk , Pavlo Roik

We develop a general method for estimating a finite mixture of non-normalized models. Here, a non-normalized model is defined to be a parametric distribution with an intractable normalization constant. Existing methods for estimating…

Machine Learning · Statistics 2021-09-01 Takeru Matsuda , Aapo Hyvarinen

Identifying the relevant coarse-grained degrees of freedom in a complex physical system is a key stage in developing powerful effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this…

Statistical Mechanics · Physics 2024-11-27 Doruk Efe Gökmen , Zohar Ringel , Sebastian D. Huber , Maciej Koch-Janusz

In this work, we propose an original method for aggregating multiple clustering coming from different sources of information. Each partition is encoded by a co-membership matrix between observations. Our approach uses a mixture of…

Machine Learning · Computer Science 2024-01-10 Kylliann De Santiago , Marie Szafranski , Christophe Ambroise

Research on cluster analysis for categorical data continues to develop, with new clustering algorithms being proposed. However, in this context, the determination of the number of clusters is rarely addressed. In this paper, we propose a…

Methodology · Statistics 2014-09-29 Cláudia Silvestre , Margarida G. M. S. Cardoso , Mário A. T. Figueiredo

Semantic part localization can facilitate fine-grained categorization by explicitly isolating subtle appearance differences associated with specific object parts. Methods for pose-normalized representations have been proposed, but generally…

Computer Vision and Pattern Recognition · Computer Science 2014-07-16 Ning Zhang , Jeff Donahue , Ross Girshick , Trevor Darrell

Classifications organize entities into categories that identify similarities within a category and discern dissimilarities among categories, and they powerfully classify information in support of analysis. We propose a new classification…

Optimization and Control · Mathematics 2022-09-05 Casey Garner , Allen Holder

Big data often has emergent structure that exists at multiple levels of abstraction, which are useful for characterizing complex interactions and dynamics of the observations. Here, we consider multiple levels of abstraction via a…

Multiscale molecular modeling is widely applied in scientific research of molecular properties over large time and length scales. Two specific challenges are commonly present in multiscale modeling, provided that information between the…

Computational Physics · Physics 2024-07-23 Jun Zhang , Xiaohan Lin , Weinan E , Yi Qin Gao

In this article, we propose a covariance based method for combining partial data sets in the genotype to phenotype spectrum. In particular, an expectation-maximization algorithm that can be used to combine partially overlapping…

Applications · Statistics 2020-01-13 Deniz Akdemir , Julio Isidro Sanchez