English
Related papers

Related papers: Maximum Entropy Kernels for System Identification

200 papers

Kernel Estimation provides an unbinned and non-parametric estimate of the probability density function from which a set of data is drawn. In the first section, after a brief discussion on parametric and non-parametric methods, the theory of…

High Energy Physics - Experiment · Physics 2009-10-31 Kyle S. Cranmer

3D action recognition was shown to benefit from a covariance representation of the input data (joint 3D positions). A kernel machine feed with such feature is an effective paradigm for 3D action recognition, yielding state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

Coarse-grained (CG) models facilitate an efficient exploration of complex systems by reducing the unnecessary degrees of freedom of the fine-grained (FG) system while recapitulating major structural correlations. Unlike structural…

Chemical Physics · Physics 2023-01-18 Jaehyeok Jin , Kenneth S. Schweizer , Gregory A. Voth

Maximum-Entropy Distributions offer an attractive family of probability densities suitable for moment closure problems. Yet finding the Lagrange multipliers which parametrize these distributions, turns out to be a computational bottleneck…

Machine Learning · Statistics 2023-08-14 Mohsen Sadr , Manuel Torrilhon , M. Hossein Gorji

Kernels representing limiting cases of neural network architectures have recently gained popularity. However, the application and performance of these new kernels compared to existing options, such as the Matern kernel, is not well studied.…

Machine Learning · Statistics 2024-10-14 Amanda Muyskens , Benjamin W. Priest , Imene R. Goumiri , Michael D. Schneider

This work addresses two main issues of the standard Kernel Entropy Component Analysis (KECA) algorithm: the optimization of the kernel decomposition and the optimization of the Gaussian kernel parameter. KECA roughly reduces to a sorting of…

Correlation matrices are a major type of multivariate data. To examine properties of a given correlation matrix, a common practice is to compare the same quantity between the original correlation matrix and reference correlation matrices,…

Physics and Society · Physics 2018-07-25 Naoki Masuda , Sadamori Kojaku , Yukie Sano

Identifying symmetries in quantum dynamics, such as identity or time-reversal invariance, is a crucial challenge with profound implications for quantum technologies. We introduce a unified framework combining group representation theory and…

Quantum Physics · Physics 2025-02-04 Masahito Hayashi , Yu-Ao Chen , Chenghong Zhu , Xin Wang

In the past years statistical physics has been successfully applied for complex networks modelling. In particular, it has been shown that the maximum entropy principle can be exploited in order to construct graph ensembles for real-world…

As a novel similarity measure that is defined as the expectation of a kernel function between two random variables, correntropy has been successfully applied in robust machine learning and signal processing to combat large outliers. The…

Machine Learning · Computer Science 2021-09-07 Badong Chen , Yuqing Xie , Xin Wang , Zejian yuan , Pengju Ren , Jing Qin

In this paper we propose a new identification scheme for Hammerstein systems, which are dynamic systems consisting of a static nonlinearity and a linear time-invariant dynamic system in cascade. We assume that the nonlinear function can be…

Systems and Control · Computer Science 2016-05-20 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or…

Machine Learning · Computer Science 2025-12-03 Senrong Xu , Tianyu Wang , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

A nonparametric family of conditional distributions is introduced, which generalizes conditional exponential families using functional parameters in a suitable RKHS. An algorithm is provided for learning the generalized natural parameter,…

Machine Learning · Statistics 2018-04-10 Michael Arbel , Arthur Gretton

The information detection of complex systems from data is currently undergoing a revolution, driven by the emergence of big data and machine learning methodology. Discovering governing equations and quantifying dynamical properties of…

Dynamical Systems · Mathematics 2021-12-10 Min Dai , Jinqiao Duan , Jianyu Hu , Xiangjun Wang

Designing categorical kernels is a major challenge for Gaussian process regression with continuous and categorical inputs. Despite previous studies, it is difficult to identify a preferred method, either because the evaluation metrics, the…

Machine Learning · Statistics 2025-10-03 Raphaël Carpintero Perez , Sébastien Da Veiga , Josselin Garnier

This paper studies the optimality of kernel methods in high-dimensional data clustering. Recent works have studied the large sample performance of kernel clustering in the high-dimensional regime, where Euclidean distance becomes less…

Machine Learning · Statistics 2019-12-03 Leena Chennuru Vankadara , Debarghya Ghoshdastidar

We study non-linear data-dimension reduction. We are motivated by the classical linear framework of Principal Component Analysis. In nonlinear case, we introduce instead a new kernel-Principal Component Analysis, manifold and feature space…

Functional Analysis · Mathematics 2022-09-09 Palle E. T. Jorgensen , Sooran Kang , Myung-Sin Song , Feng Tian

The characterization of network and biophysical properties from neural spiking activity is an important goal in neuroscience. A framework that provides unbiased inference on causal synaptic interaction and single neural properties has been…

Neurons and Cognition · Quantitative Biology 2024-05-27 Kevin S. Chen , Ying-Jen Yang

Noisy intermediate-scale quantum processors have produced a quantum computation revolution in recent times. However, to make further advances new strategies to overcome the error rate growth are needed. One possible way out is dividing…

Quantum Physics · Physics 2025-01-20 J. Montes , F. Borondo , Gabriel G. Carlo