English
Related papers

Related papers: Retrieval-based Disentangled Representation Learni…

200 papers

Multimodal representations that enable cross-modal retrieval are widely used. However, these often lack interpretability making it difficult to explain the retrieved results. Solutions such as learning sparse disentangled representations…

Information Retrieval · Computer Science 2025-06-25 Prachi J , Sumit Bhatia , Srikanta Bedathur

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

Most existing audio-text retrieval (ATR) approaches typically rely on a single-level interaction to associate audio and text, limiting their ability to align different modalities and leading to suboptimal matches. In this work, we present a…

Sound · Computer Science 2025-05-06 Yifei Xin , Zhihong Zhu , Xuxin Cheng , Xusheng Yang , Yuexian Zou

Dense retrieval (DR) has the potential to resolve the query understanding challenge in conversational search by matching in the learned embedding space. However, this adaptation is challenging due to DR models' extra needs for supervision…

Information Retrieval · Computer Science 2021-05-20 Shi Yu , Zhenghao Liu , Chenyan Xiong , Tao Feng , Zhiyuan Liu

Multi-view multi-label learning frequently suffers from simultaneous feature absence and incomplete annotations, due to challenges in data acquisition and cost-intensive supervision. To tackle the complex yet highly practical problem while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Quanjiang Li , Zhiming Liu , Tianxiang Xu , Tingjin Luo , Chenping Hou

Recommendation algorithms forecast user preferences by correlating user and item representations derived from historical interaction patterns. In pursuit of enhanced performance, many methods focus on learning robust and independent…

Information Retrieval · Computer Science 2024-08-01 Zhenyang Li , Fan Liu , Yinwei Wei , Zhiyong Cheng , Liqiang Nie , Mohan Kankanhalli

Retrieval-augmented models have proven to be effective in natural language processing tasks, yet there remains a lack of research on their optimization using variational inference. We introduce the Variational Open-Domain (VOD) framework…

Computation and Language · Computer Science 2023-06-01 Valentin Liévin , Andreas Geert Motzfeldt , Ida Riis Jensen , Ole Winther

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

We present an approach for unsupervised learning of speech representation disentangling contents and styles. Our model consists of: (1) a local encoder that captures per-frame information; (2) a global encoder that captures per-utterance…

Computation and Language · Computer Science 2021-06-22 Andros Tjandra , Ruoming Pang , Yu Zhang , Shigeki Karita

Multimodal sensory data resembles the form of information perceived by humans for learning, and are easy to obtain in large quantities. Compared to unimodal data, synchronization of concepts between modalities in such data provides…

Machine Learning · Statistics 2018-05-30 Wei-Ning Hsu , James Glass

Learning Interpretable representation in medical applications is becoming essential for adopting data-driven models into clinical practice. It has been recently shown that learning a disentangled feature representation is important for a…

Machine Learning · Computer Science 2019-04-19 Mhd Hasan Sarhan , Abouzar Eslami , Nassir Navab , Shadi Albarqouni

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-19 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

Machine Learning · Computer Science 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

Reinforcement Learning (RL) algorithms can learn robotic control tasks from visual observations, but they often require a large amount of data, especially when the visual scene is complex and unstructured. In this paper, we explore how the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ameya Pore , Riccardo Muradore , Diego Dall'Alba

Speaker verification, as a biometric authentication mechanism, has been widely used due to the pervasiveness of voice control on smart devices. However, the task of "in-the-wild" speaker verification is still challenging, considering the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jianwei Tai , Xiaoqi Jia , Qingjia Huang , Weijuan Zhang , Haichao Du , Shengzhi Zhang

Disentangled representation learning in speech processing has lagged behind other domains, largely due to the lack of datasets with annotated generative factors for robust evaluation. To address this, we propose SynSpeech, a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yusuf Brima , Ulf Krumnack , Simone Pika , Gunther Heidemann

Information retrieval has transitioned from standalone systems into essential components across broader applications, with indexing efficiency, cost-effectiveness, and freshness becoming increasingly critical yet often overlooked. In this…

Computation and Language · Computer Science 2025-03-07 Jiawei Zhou , Li Dong , Furu Wei , Lei Chen