English
Related papers

Related papers: Quantifying Dimensional Independence in Speech: An…

200 papers

Disentangled Representation Learning aims to improve the explainability of deep learning methods by training a data encoder that identifies semantically meaningful latent variables in the data generation process. Nevertheless, there is no…

Machine Learning · Computer Science 2024-10-08 Ruoyu Wang , Lina Yao

Speech is a multiplexed signal displaying levels of complexity, organizational principles and perceptual units of analysis at distinct timescales. This critical acoustic signal for human communication is thus characterized at distinct…

Neurons and Cognition · Quantitative Biology 2024-07-10 Jérémy Giroud , Benjamin Morillon

Speech and language technologies offer valuable opportunities for supporting mental health assessment through objective and interpretable cues. We present a systematic feature-based analysis framework leveraging perceptually grounded…

Artificial Intelligence · Computer Science 2026-05-28 Vassilis Lyberatos , Edmund G. Dervakos , Eleni Adamidi , Athanasios Voulodimos , Giorgos Stamou

Self-supervised speech models learn representations that capture both content and speaker information. Yet this entanglement creates problems: content tasks suffer from speaker bias, and privacy concerns arise when speaker identity leaks…

Sound · Computer Science 2026-04-02 Xiaoxu Zhu , Junhua Li , Aaron J. Li , Guangchao Yao , Xiaojie Yu

To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We evaluate these models…

Computation and Language · Computer Science 2021-06-08 Lan Zhang , Victor Prokhorov , Ehsan Shareghi

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

Machine Learning · Computer Science 2020-03-05 Cory Stephenson , Jenelle Feather , Suchismita Padhy , Oguz Elibol , Hanlin Tang , Josh McDermott , SueYeon Chung

Besides its linguistic content, our speech is rich in biometric information that can be inferred by classifiers. Learning privacy-preserving representations for speech signals enables downstream tasks without sharing unnecessary, private…

Sound · Computer Science 2021-06-18 Dimitrios Stoidis , Andrea Cavallaro

Speech embeddings often retain sensitive attributes such as speaker identity, accent, or demographic information, posing risks in biased model training and privacy leakage. We propose WavShape, an information-theoretic speech representation…

Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is…

Machine Learning · Computer Science 2026-02-25 Antonio Almudévar , Alfonso Ortega

The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral…

Artificial Intelligence · Computer Science 2026-04-10 Chenchen Kuai , Jiwan Jiang , Zihao Zhu , Hao Wang , Keshu Wu , Zihao Li , Yunlong Zhang , Chenxi Liu , Zhengzhong Tu , Zhiwen Fan , Yang Zhou

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…

Multimodal Sentiment Analysis (MSA) leverages heterogeneous modalities, such as language, vision, and audio, to enhance the understanding of human sentiment. While existing models often focus on extracting shared information across…

Machine Learning · Computer Science 2025-04-10 Pan Wang , Qiang Zhou , Yawen Wu , Tianlong Chen , Jingtong Hu

A central goal of interpretability is to recover representations of causally relevant concepts from the activations of neural networks. The quality of these concept representations is typically evaluated in isolation, and under implicit…

Machine Learning · Computer Science 2025-12-18 Aaron Mueller , Andrew Lee , Shruti Joshi , Ekdeep Singh Lubana , Dhanya Sridhar , Patrik Reizinger

There has been an increasing research interest in cross-age speaker verification~(CASV). However, existing speaker verification systems perform poorly in CASV due to the great individual differences in voice caused by aging. In this paper,…

Sound · Computer Science 2024-09-25 Fengrun Zhang , Wangjin Zhou , Yiming Liu , Wang Geng , Yahui Shan , Chen Zhang

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Dialogue disentanglement aims to detach the chronologically ordered utterances into several independent sessions. Conversation utterances are essentially organized and described by the underlying discourse, and thus dialogue disentanglement…

Computation and Language · Computer Science 2023-06-13 Bobo Li , Hao Fei , Fei Li , Shengqiong Wu , Lizi Liao , Yinwei Wei , Tat-Seng Chua , Donghong Ji

Recent Audio Multimodal Large Language Models (Audio MLLMs) demonstrate impressive performance on speech benchmarks, yet it remains unclear whether these models genuinely process acoustic signals or rely on text-based semantic inference. To…

Artificial Intelligence · Computer Science 2026-03-23 Jiaqi Xiong , Yunjia Qi , Qi Cao , Yu Zheng , Yutong Zhang , Ziteng Wang , Ruofan Liao , Weisheng Xu , Sichen Liu

Mutual information (MI) is a general measure of statistical dependence with widespread application across the sciences. However, estimating MI between multi-dimensional variables is challenging because the number of samples necessary to…

Quantitative Methods · Quantitative Biology 2025-03-06 Gokul Gowri , Xiao-Kang Lun , Allon M. Klein , Peng Yin

Generative psychological analysis of in-the-wild conversations faces two fundamental challenges: (1) existing Vision-Language Models (VLMs) fail to resolve Articulatory-Affective Ambiguity, where visual patterns of speech mimic emotional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yigui Feng , Qinglin Wang , Haotian Mo , Yang Liu , Ke Liu , Gencheng Liu , Xinhai Chen , Siqi Shen , Songzhu Mei , Jie Liu

Estimating Mutual Information (MI), a key measure of dependence of random quantities without specific modelling assumptions, is a challenging problem in high dimensions. We propose a novel mutual information estimator based on parametrizing…

Machine Learning · Statistics 2025-10-24 Haoran Ni , Martin Lotz