English
Related papers

Related papers: Statistical Estimation and Clustering of Group-inv…

200 papers

Mixture models are among the most popular tools for clustering. However, when the dimension and the number of clusters is large, the estimation of the clusters become challenging, as well as their interpretation. Restriction on the…

Applications · Statistics 2021-05-11 Léna Carel , Pierre Alquier

In this paper, we formulate the problem of inferring a Finite Mixture Model from discrete data as an optimal transport problem with entropic regularization of parameter $\lambda\geq 0$. Our method unifies hard and soft clustering, the…

Machine Learning · Computer Science 2024-03-11 Jean-Frédéric Diebold , Nicolas Papadakis , Arnaud Dessein , Charles-Alban Deledalle

Group zero-attracting LMS and its reweighted form have been proposed for addressing system identification problems with structural group sparsity in the parameters to estimate. Both algorithms however suffer from a trade-off between…

Signal Processing · Electrical Eng. & Systems 2018-04-02 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen

An efficient simulation framework is proposed to model collective emission in disordered ensembles of quantum emitters. Using a cumulant expansion approach, the computational complexity scales polynomially as opposed to exponentially with…

Optics · Physics 2025-12-17 Qingyi Zhou , Wenxin Wu , Maryam Zahedian , Zongfu Yu , Jennifer T. Choy

We propose a novel exponentially-modified Gaussian (EMG) mixture residual model. The EMG mixture is well suited to model residuals that are contaminated by a distribution with positive support. This is in contrast to commonly used robust…

Machine Learning · Statistics 2019-02-18 Sebastian Ament , John Gregoire , Carla Gomes

Clustering algorithms are a cornerstone of machine learning applications. Recently, a quantum algorithm for clustering based on the k-means algorithm has been proposed by Kerenidis, Landman, Luongo and Prakash. Based on their work, we…

Quantum Physics · Physics 2020-01-23 Hideyuki Miyahara , Kazuyuki Aihara , Wolfgang Lechner

Model-based clustering approaches concern the paradigm of exploratory data analysis relying on the finite mixture model to automatically find a latent structure governing observed data. They are one of the most popular and successful…

Methodology · Statistics 2014-04-29 Faicel Chamroukhi

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

The spectral clustering algorithm is often used as a binary clustering method for unclassified data by applying the principal component analysis. To study theoretical properties of the algorithm, the assumption of conditional…

Statistics Theory · Mathematics 2025-05-27 Kohei Kawamoto , Yuichi Goto , Koji Tsukuda

Distributed parameter identification for large-scale multi-agent networks encounters challenges due to nonlinear dynamics and partial observations. Simultaneously, ensuring the stability is crucial for the robust identification of dynamic…

Dynamical Systems · Mathematics 2024-01-09 Chunhui Li , Chengpu Yu

In this paper, we consider the task of clustering a set of individual time series while modeling each cluster, that is, model-based time series clustering. The task requires a parametric model with sufficient flexibility to describe the…

Machine Learning · Computer Science 2023-02-23 Ryohei Umatani , Takashi Imai , Kaoru Kawamoto , Shutaro Kunimasa

We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides…

Machine Learning · Computer Science 2020-10-09 Shengxi Li , Zeyang Yu , Min Xiang , Danilo Mandic

We address the new problem of estimating a piece-wise constant signal with the purpose of detecting its change points and the levels of clusters. Our approach is to model it as a nonparametric penalized least square model selection on a…

Machine Learning · Statistics 2019-12-04 Othmane Mazhar , Cristian R. Rojas , Carlo Fischione , Mohammad R. Hesamzadeh

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

We consider the problem of determining the weights of a quantum ensemble. That is to say, given a quantum system that is in a set of possible known states according to an unknown probability law, we give strategies to estimate the…

Quantum Physics · Physics 2010-02-01 J. I. de Vicente , J. Calsamiglia , R. Munoz-Tapia , E. Bagan

We extend the linear mixed-effects state model to accommodate the correlated individuals and investigate its parameter and state estimation based on disturbance smoothing in this paper. For parameter estimation, EM and score based…

Methodology · Statistics 2014-09-03 Jie Zhou , Aiping Tang

We describe and analyze a broad class of mixture models for real-valued multivariate data in which the probability density of observations within each component of the model is represented as an arbitrary combination of basis functions.…

Methodology · Statistics 2025-02-28 M. E. J. Newman

Mixtures of multivariate normal inverse Gaussian (MNIG) distributions can be used to cluster data that exhibit features such as skewness and heavy tails. However, for cluster analysis, using a traditional finite mixture model framework,…

Methodology · Statistics 2020-05-13 Yuan Fang , Dimitris Karlis , Sanjeena Subedi

Extreme-mass-ratio inspiral (EMRI) signals pose significant challenges in gravitational wave (GW) astronomy owing to their low-frequency nature and highly complex waveforms, which occupy a high-dimensional parameter space with numerous…

(abridged) We develop an algorithm for estimating parameters of a distribution sampled with contamination, employing a statistical technique known as ``expectation maximization'' (EM). Given models for both member and contaminant…