English
Related papers

Related papers: Covariance Regularization for Probabilistic Linear…

200 papers

Spoken language recognition (SLR) refers to the automatic process used to determine the language present in a speech sample. SLR is an important task in its own right, for example, as a tool to analyze or categorize large amounts of…

Computation and Language · Computer Science 2022-08-15 Luciana Ferrer , Diego Castan , Mitchell McLaren , Aaron Lawson

This work studies the theoretical rules of feature selection in linear discriminant analysis (LDA), and a new feature selection method is proposed for sparse linear discriminant analysis. An $l_1$ minimization method is used to select the…

Methodology · Statistics 2013-04-23 Cheng Wang , Longbing Cao , Baiqi Miao

Functional linear discriminant analysis offers a simple yet efficient method for classification, with the possibility of achieving a perfect classification. Several methods are proposed in the literature that mostly address the…

Methodology · Statistics 2020-12-14 Juhyun Park , Jeongyoun Ahn , Yongho Jeon

Sparse arrays enable resolving more direction of arrivals (DoAs) than antenna elements using non-uniform arrays. This is typically achieved by reconstructing the covariance of a virtual large uniform linear array (ULA), which is then…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Yoav Amiel , Dor H. Shmuel , Nir Shlezinger , Wasim Huleihel

In this paper, we propose a structured Robust Adaptive Dic-tionary Pair Learning (RA-DPL) framework for the discrim-inative sparse representation learning. To achieve powerful representation ability of the available samples, the setting of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yulin Sun , Zhao Zhang , Weiming Jiang , Zheng Zhang , Li Zhang , Shuicheng Yan , Meng Wang

Regularized discriminant analysis (RDA), proposed by Friedman (1989), is a widely popular classifier that lacks interpretability and is impractical for high-dimensional data sets. Here, we present an interpretable and computationally…

Machine Learning · Statistics 2017-02-07 John A. Ramey , Caleb K. Stein , Phil D. Young , Dean M. Young

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

We present a novel approach to the formulation and the resolution of sparse Linear Discriminant Analysis (LDA). Our proposal, is based on penalized Optimal Scoring. It has an exact equivalence with penalized LDA, contrary to the multi-class…

Machine Learning · Computer Science 2012-07-03 Luis Francisco Sanchez Merchante , Yves Grandvalet , Gerrad Govaert

In this paper, we propose a novel algorithm for speaker diarization using metric learning for graph based clustering. The graph clustering algorithms use an adjacency matrix consisting of similarity scores. These scores are computed between…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Prachi Singh , Sriram Ganapathy

This paper proposes a tool for dimension reduction where the dimension of the original space is reduced: a Principal Loading Analysis (PLA). PLA is a tool to reduce dimensions by discarding variables. The intuition is that variables are…

Statistics Theory · Mathematics 2021-03-05 Jan O. Bauer , Bernhard Drabant

Traditional speech separation and speaker diarization approaches rely on prior knowledge of target speakers or a predetermined number of participants in audio signals. To address these limitations, recent advances focus on developing…

Various regularized linear discriminant analysis (LDA) methods have been proposed to address the problems of the classic methods in high-dimensional settings. Asymptotic optimality has been established for some of these methods in high…

Methodology · Statistics 2015-08-06 Ruiyan Luo , Xin Qi

We present an extension of sparse PCA, or sparse dictionary learning, where the sparsity patterns of all dictionary elements are structured and constrained to belong to a prespecified set of shapes. This \emph{structured sparse PCA} is…

Machine Learning · Statistics 2009-09-09 Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Sparse regularization such as $\ell_1$ regularization is a quite powerful and widely used strategy for high dimensional learning problems. The effectiveness of sparse regularization has been supported practically and theoretically by…

Machine Learning · Statistics 2018-02-23 Masaaki Takada , Taiji Suzuki , Hironori Fujisawa

A good supervised embedding for a specific machine learning task is only sensitive to changes in the label of interest and is invariant to other confounding factors. We leverage the concept of repeatability from measurement theory to…

Sound · Computer Science 2023-10-27 Jianwei Zhang , Suren Jayasuriya , Visar Berisha

Recent advances show that two-dimensional linear discriminant analysis (2DLDA) is a successful matrix based dimensionality reduction method. However, 2DLDA may encounter the singularity issue theoretically and the sensitivity to outliers.…

Machine Learning · Computer Science 2018-10-26 Chun-Na Li , Yuan-Hai Shao , Wei-Jie Chen , Zhen Wang , Nai-Yang Deng

The cross-domain performance of automatic speech recognition (ASR) could be severely hampered due to the mismatch between training and testing distributions. Since the target domain usually lacks labeled data, and domain shifts exist at…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-01 Han Zhu , Gaofeng Cheng , Jindong Wang , Wenxin Hou , Pengyuan Zhang , Yonghong Yan

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

In some speaker recognition scenarios we find conversations recorded simultaneously over multiple channels. That is the case of the interviews in the NIST SRE dataset. To take advantage of that, we propose a modification of the PLDA model…

Machine Learning · Statistics 2015-11-24 Jesús Villalba

Post-training compression of large language models (LLMs) often relies on low-rank weight approximations that represent each column of the weight matrix in a shared low-dimensional subspace. This strategy is computationally efficient but…

Computation and Language · Computer Science 2026-05-05 Denis Makhov , Dmitriy Shopkhoev , Magauiya Zhussip , Ammar Ali , Stamatios Lefkimmiatis