English
Related papers

Related papers: Unified model selection approach based on minimum …

200 papers

Canonical correlation analysis (CCA) is a widely used technique for estimating associations between two sets of multi-dimensional variables. Recent advancements in CCA methods have expanded their application to decipher the interactions of…

Machine Learning · Statistics 2025-02-05 Hongju Park , Shuyang Bai , Zhenyao Ye , Hwiyoung Lee , Tianzhou Ma , Shuo Chen

Existing granular-ball generation methods are still mainly driven by handcrafted quality measures and heuristic splitting or stopping criteria, which may weaken the transparency of local generation decisions in clustering. To address this…

Machine Learning · Computer Science 2026-05-14 Zeqiang Xian , Caihui Liu , Yong Zhang , Wenjing Qiu , Duoqian Miao , Witold Pedrycz

Stochastic Gradient Descent (SGD) is the main approach to optimizing neural networks. Several generalization properties of deep networks, such as convergence to a flatter minima, are believed to arise from SGD. This article explores the…

Machine Learning · Computer Science 2024-12-05 Aditya Shah , Aditya Challa , Sravan Danda , Archana Mathur , Snehanshu Saha

The Minimum Description Length (MDL) principle states that the optimal model for a given data set is that which compresses it best. Due to practial limitations the model can be restricted to a class such as linear regression models, which…

Machine Learning · Statistics 2015-03-13 Florin Popescu , Daniel Renz

Multi-model inference covers a wide range of modern statistical applications such as variable selection, model confidence set, model averaging and variable importance. The performance of multi-model inference depends on the availability of…

Statistics Theory · Mathematics 2019-06-07 Ching-Wei Cheng , Guang Cheng

There is a recent trend to leverage the power of graph neural networks (GNNs) for brain-network based psychiatric diagnosis, which,in turn, also motivates an urgent need for psychiatrists to fully understand the decision behavior of the…

Machine Learning · Statistics 2024-01-30 Kaizhong Zheng , Shujian Yu , Badong Chen

We consider model selection in generalized linear models (GLM) for high-dimensional data and propose a wide class of model selection criteria based on penalized maximum likelihood with a complexity penalty on the model size. We derive a…

Statistics Theory · Mathematics 2016-03-31 Felix Abramovich , Vadim Grinshtein

This work studies the theoretical rules of feature selection in linear discriminant analysis (LDA), and a new feature selection method is proposed for sparse linear discriminant analysis. An $l_1$ minimization method is used to select the…

Methodology · Statistics 2013-04-23 Cheng Wang , Longbing Cao , Baiqi Miao

This paper indicates causality as the tool that unifies the analysis of both activations and connectivity of brain areas, obtained with fMRI data. Causality analysis is commonly applied to study connectivity, so this work focuses on…

Methodology · Statistics 2011-02-25 Nevio Dubbini

Multivariate time series anomaly detection has numerous real-world applications and is being extensively studied. Modeling pairwise correlations between variables is crucial. Existing methods employ learnable graph structures and graph…

Machine Learning · Computer Science 2025-01-24 Zehao Liu , Mengzhou Gao , Pengfei Jiao

An approach is proposed for inferring Granger causality between jointly stationary, Gaussian signals from quantized data. First, a necessary and sufficient rank criterion for the equality of two conditional Gaussian distributions is proved.…

Systems and Control · Electrical Eng. & Systems 2022-02-07 Salman Ahmadi , Girish N. Nair , Erik Weyer

Characterising cause-effect relationships in complex systems is fundamental to understanding their underlying mechanisms. Granger causality (GC) remains a widely used computational tool for identifying causal relationships in time series…

Machine Learning · Statistics 2026-05-26 S. A. Adedayo

Neural processes in the brain operate at a range of temporal scales. Granger causality, the most widely-used neuroscientific tool for inference of directed functional connectivity from neurophsyiological data, is traditionally deployed in…

Applications · Statistics 2019-07-17 Lionel Barnett , Anil K. Seth

In the signal processing and statistics literature, the minimum description length (MDL) principle is a popular tool for choosing model complexity. Successful examples include signal denoising and variable selection in linear regression,…

Signal Processing · Electrical Eng. & Systems 2022-01-28 Zhenyu Wei , Raymond K. W. Wong , Thomas C. M. Lee

In recent years, there has been a growing interest in combining learnable modules with numerical optimization to solve low-level vision tasks. However, most existing approaches focus on designing specialized schemes to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Risheng Liu , Zhu Liu , Pan Mu , Xin Fan , Zhongxuan Luo

Model selection based on classical information criteria, such as BIC, is generally computationally demanding, but its properties are well studied. On the other hand, model selection based on parameter shrinkage by $\ell_1$-type penalties is…

Machine Learning · Statistics 2013-07-10 Kun Zhang , Heng Peng , Laiwan Chan , Aapo Hyvarinen

Granger causality and variants of this concept allow the study of complex dynamical systems as networks constructed from multivariate time series. In this work, a large number of Granger causality measures used to form causality networks…

Computation · Statistics 2020-01-08 Elsa Siggiridou , Christos Koutlis , Alkiviadis Tsimpiris , Dimitris Kugiumtzis

Combined inference for heterogeneous high-dimensional data is critical in modern biology, where clinical and various kinds of molecular data may be available from a single study. Classical genetic association studies regress a single…

Applications · Statistics 2017-03-22 Hélène Ruffieux , Anthony C. Davison , Jörg Hager , Irina Irincheeva

The effort to understand network systems in increasing detail has resulted in a diversity of methods designed to extract their large-scale structure from data. Unfortunately, many of these methods yield diverging descriptions of the same…

Data Analysis, Statistics and Probability · Physics 2015-03-27 Tiago P. Peixoto

Granger causal inference is a contentious but widespread method used in fields ranging from economics to neuroscience. The original definition addresses the notion of causality in time series by establishing functional dependence…

Methodology · Statistics 2023-09-19 Noah D. Gade , Jordan Rodu