English
Related papers

Related papers: Introducing Block-Toeplitz Covariance Matrices to …

200 papers

Source enumeration typically relies on subspace-based techniques that require accurate separation of signal and noise subspaces. However, prior works do not address coherent sources in small uniform linear arrays, where ambiguities arise in…

Signal Processing · Electrical Eng. & Systems 2025-07-24 Dibakar Sil , Sunder Ram Krishnan , Kumar Vijay Mishra

We revisit Deep Linear Discriminant Analysis (Deep LDA) from a likelihood-based perspective. While classical LDA is a simple Gaussian model with linear decision boundaries, attaching an LDA head to a neural encoder raises the question of…

Machine Learning · Statistics 2026-02-23 Maxat Tezekbayev , Arman Bolatov , Zhenisbek Assylbekov

The emergence of large-margin softmax cross-entropy losses in training deep speaker embedding neural networks has triggered a gradual shift from parametric back-ends to a simpler cosine similarity measure for speaker verification. Popular…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-12 Qiongqiong Wang , Kong Aik Lee , Tianchi Liu

In recent years, deep learning (DL) has contributed significantly to the improvement of motor-imagery brain-machine interfaces (MI-BMIs) based on electroencephalography(EEG). While achieving high classification accuracy, DL models have also…

Signal Processing · Electrical Eng. & Systems 2020-06-03 Thorir Mar Ingolfsson , Michael Hersche , Xiaying Wang , Nobuaki Kobayashi , Lukas Cavigelli , Luca Benini

Linear discriminant analysis (LDA) is a typical method for classification problems with large dimensions and small samples. There are various types of LDA methods that are based on the different types of estimators for the covariance…

Methodology · Statistics 2023-03-07 Jaehoan Kim , Hoyoung Park , Junyong Park

This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking…

Applications · Statistics 2016-06-29 Ying Sun , Prabhu Babu , Daniel P. Palomar

This paper tackles the problem of Lipschitz regularization of Convolutional Neural Networks. Lipschitz regularity is now established as a key property of modern deep learning with implications in training stability, generalization,…

Machine Learning · Computer Science 2020-11-10 Alexandre Araujo , Benjamin Negrevergne , Yann Chevaleyre , Jamal Atif

In the internet era there has been an explosion in the amount of digital text information available, leading to difficulties of scale for traditional inference algorithms for topic models. Recent advances in stochastic variational inference…

Machine Learning · Computer Science 2013-05-14 James Foulds , Levi Boyles , Christopher Dubois , Padhraic Smyth , Max Welling

Quadratic discriminant analysis (QDA) is a widely used classification technique that generalizes the linear discriminant analysis (LDA) classifier to the case of distinct covariance matrices among classes. For the QDA classifier to yield…

Machine Learning · Computer Science 2020-06-26 Houssem Sifaou , Abla Kammoun , Mohamed-Slim Alouini

The attention mechanism has gained significant recognition in the field of computer vision due to its ability to effectively enhance the performance of deep neural networks. However, existing methods often struggle to effectively utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Wei Xu , Yi Wan

We develop a framework for analyzing multivariate time series using topological data analysis (TDA) methods. The proposed methodology involves converting the multivariate time series to point cloud data, calculating Wasserstein distances…

Algebraic Topology · Mathematics 2020-12-29 Chengyuan Wu , Carol Anne Hargreaves

In time series analysis, when fitting an autoregressive model, one must solve a Toeplitz ordinary least squares problem numerous times to find an appropriate model, which can severely affect computational times with large data sets. Two…

Machine Learning · Statistics 2021-12-28 Ali Eshragh , Oliver Di Pietro , Michael A. Saunders

Equalizer parameter optimization is critical for signal integrity in high-speed memory systems operating at multi-gigabit data rates. However, existing methods suffer from computationally expensive eye diagram evaluation, optimization of…

Machine Learning · Computer Science 2026-05-07 Muhammad Usama , Dong Eui Chang

The problem of estimating the covariance matrix $\Sigma$ of a $p$-variate distribution based on its $n$ observations arises in many data analysis contexts. While for $n>p$, the classical sample covariance matrix $\hat{\Sigma}_n$ is a good…

Information Theory · Computer Science 2017-09-28 Maryia Kabanava , Holger Rauhut

The use of quadratic discriminant analysis (QDA) or its regularized version (R-QDA) for classification is often not recommended, due to its well-acknowledged high sensitivity to the estimation noise of the covariance matrix. This becomes…

Machine Learning · Statistics 2020-09-15 Amine Bejaoui , Khalil Elkhalil , Abla Kammoun , Mohamed Slim Alouni , Tarek Al-Naffouri

Background: Topological data analysis (TDA) has exploded as a tool for analyzing and making sense of high dimensional datasets across a variety of fields. Mapper is a tool from TDA that captures low-dimensional structure from…

General Topology · Mathematics 2025-12-04 Brittany Story , Zhibin Zhou , Ramesh Srinivasan , Scott Kerick , David Boothe , Piotr J. Franaszczuk

This paper addresses the problem of estimating the Hermitian Toeplitz covariance matrix under practical hardware constraints of sparse observations and coarse quantization. Within the triangular-dithered quantization framework, we propose…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hongwei Xu , Weichao Zheng , Zai Yang

Linear and Quadratic Discriminant analysis (LDA/QDA) are common tools for classification problems. For these methods we assume observations are normally distributed within group. We estimate a mean and covariance matrix for each group and…

Machine Learning · Statistics 2011-12-08 Noah Simon , Rob Tibshirani

Electroencephalography (EEG)-based wearable brain-computer interfaces (BCIs) face challenges due to low signal-to-noise ratio (SNR) and non-stationary neural activity. We introduce in this manuscript a mathematically rigorous framework that…

Neurons and Cognition · Quantitative Biology 2025-09-24 Eva Guttmann-Flury , Shan Zhao , Jian Zhao , Mohamad Sawan

Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive…