English
Related papers

Related papers: A Unifying Probabilistic Perspective for Spectral …

200 papers

We analyze the problem of maximum likelihood estimation for Gaussian distributions that are multivariate totally positive of order two (MTP2). By exploiting connections to phylogenetics and single-linkage clustering, we give a simple proof…

Methodology · Statistics 2018-05-29 Steffen Lauritzen , Caroline Uhler , Piotr Zwiernik

We present an image representation method which is derived from analyzing Gaussian probability density function (\emph{pdf}) space using Lie group theory. In our proposed method, images are modeled by Gaussian mixture models (GMMs) which…

Computer Vision and Pattern Recognition · Computer Science 2017-05-11 Liyu Gong , Meng Chen , Chunlong Hu

Spectral dimensionality reduction algorithms are widely used in numerous domains, including for recognition, segmentation, tracking and visualization. However, despite their popularity, these algorithms suffer from a major limitation known…

Machine Learning · Computer Science 2018-01-03 Yochai Blau , Tomer Michaeli

Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of…

Machine Learning · Statistics 2018-10-18 Rui Zhuang , Johannes Lederer

The multivariate normal density is a monotonic function of the distance to the mean, and its ellipsoidal shape is due to the underlying Euclidean metric. We suggest to replace this metric with a locally adaptive, smoothly changing…

Machine Learning · Statistics 2016-09-26 Georgios Arvanitidis , Lars Kai Hansen , Søren Hauberg

Iterative methods for fitting a Gaussian Random Field (GRF) model via maximum likelihood (ML) estimation requires solving a nonconvex optimization problem. The problem is aggravated for anisotropic GRFs where the number of covariance…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique Del Castillo

This paper establishes the minimum entropy principle (MEP) for the relativistic Euler equations with a broad class of equations of state (EOSs) and addresses the challenge of preserving the local version of the discovered MEP in high-order…

Numerical Analysis · Mathematics 2025-03-18 Shumo Cui , Kailiang Wu , Linfeng Xu

Incorporating feature selection into a classification or regression method often carries a number of advantages. In this paper we formalize feature selection specifically from a discriminative perspective of improving…

Machine Learning · Computer Science 2013-01-18 Tony S. Jebara , Tommi S. Jaakkola

We develop the method of Maximum Entropy (ME) as a technique to generate approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2007-07-24 Chih-Yuan Tseng , Ariel Caticha

Recent advances on adaptive steganography show that the performance of image steganographic communication can be improved by incorporating the non-additive models that capture the dependences among adjacent pixels. In this paper, a Gaussian…

Multimedia · Computer Science 2019-08-06 Wenkang Su , Jiangqun Ni , Yuanfeng Pan , Xianglei Hu , Yun-Qing Shi

The vast majority of Dimensionality Reduction (DR) techniques rely on second-order statistics to define their optimization objective. Even though this provides adequate results in most cases, it comes with several shortcomings. The methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Nikolaos Passalis , Anastasios Tefas

Lagrangian particle tracking is essential for characterizing turbulent flows, but inferring particle acceleration from inherently noisy position data remains a significant challenge. Fluid particles in turbulence experience extreme,…

Data Analysis, Statistics and Probability · Physics 2026-02-27 Griffin M Kearney , Kasey M Laurent , Makan Fardad

We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable…

Machine Learning · Statistics 2012-06-08 Hannes Nickisch , Matthias Seeger

Dimension reduction, widely used in science, maps high-dimensional data into low-dimensional space. We investigate a basic mathematical model underlying the techniques of stochastic neighborhood embedding (SNE) and its popular variant…

Machine Learning · Statistics 2025-03-26 Ben Weinkove

Standard Adjacency Spectral Embedding (ASE) relies on a global low-rank assumption often incompatible with the sparse, transitive structure of real-world networks, causing local geometric features to be 'smeared'. To address this, we…

Machine Learning · Statistics 2026-03-13 Hannah Sansford , Nick Whiteley , Patrick Rubin-Delanchy

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

This paper is devoted to the performance analysis of the detectors proposed in the companion paper where a comprehensive design framework is presented for the adaptive detection of subspace signals. The framework addresses four variations…

Signal Processing · Electrical Eng. & Systems 2022-11-23 Pia Addabbo , Danilo Orlando , Giuseppe Ricci , Louis L. Scharf

Methods for inference and simulation of linearly constrained Gaussian Markov Random Fields (GMRF) are computationally prohibitive when the number of constraints is large. In some cases, such as for intrinsic GMRFs, they may even be…

Methodology · Statistics 2021-06-04 David Bolin , Jonas Wallin

3D Gaussian Splatting (3DGS) has emerged as a leading technique for novel view synthesis, demonstrating exceptional rendering efficiency. \replaced[]{Well-reconstructed surfaces can be characterized by low configurational entropy, where…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Hong Kuang , Jianchen Liu

Spatial prediction is commonly achieved under the assumption of a Gaussian random field (GRF) by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets,…

Methodology · Statistics 2021-07-20 Karl T. Pazdernik , Ranjan Maitra