English
Related papers

Related papers: Learning weakly supervised multimodal phoneme embe…

200 papers

We present a multimodal framework to learn general audio representations from videos. Existing contrastive audio representation learning methods mainly focus on using the audio modality alone during training. In this work, we show that…

Sound · Computer Science 2021-04-29 Luyu Wang , Pauline Luc , Adria Recasens , Jean-Baptiste Alayrac , Aaron van den Oord

Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding. According to their respective characteristics, the scheme of independently designed architecture has been…

Sound · Computer Science 2022-07-08 Junwen Xiong , Yu Zhou , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha

Multimodal embeddings aim to enrich the semantic information in neural representations of language compared to text-only models. While different embeddings exhibit different applicability and performance on downstream tasks, little is known…

Computation and Language · Computer Science 2023-06-06 Aleksey Tikhonov , Lisa Bylinina , Denis Paperno

Face-voice association is widely studied in multimodal learning and is approached representing faces and voices with embeddings that are close for a same person and well separated from those of others. Previous work achieved this with loss…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Marta Moscati , Oleksandr Kats , Mubashir Noman , Muhammad Zaigham Zaheer , Yufang Hou , Markus Schedl , Shah Nawaz

We explore self-supervised models that can be potentially deployed on mobile devices to learn general purpose audio representations. Specifically, we propose methods that exploit the temporal context in the spectrogram domain. One method…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-29 Marco Tagliasacchi , Beat Gfeller , Félix de Chaumont Quitry , Dominik Roblek

Deep learning has been successfully applied to human activity recognition. However, training deep neural networks requires explicitly labeled data which is difficult to acquire. In this paper, we present a model with multiple siamese…

Human-Computer Interaction · Computer Science 2023-07-19 Taoran Sheng , Manfred Huber

We propose in this work a multi-view learning approach for audio and music classification. Considering four typical low-level representations (i.e. different views) commonly used for audio and music recognition tasks, the proposed…

Sound · Computer Science 2021-03-04 Huy Phan , Huy Le Nguyen , Oliver Y. Chén , Lam Pham , Philipp Koch , Ian McLoughlin , Alfred Mertins

Conditional sound separation in multi-source audio mixtures without having access to single source sound data during training is a long standing challenge. Existing mix-and-separate based methods suffer from significant performance drop…

Sound · Computer Science 2024-04-03 Tanvir Mahmud , Saeed Amizadeh , Kazuhito Koishida , Diana Marculescu

This work examines the content and usefulness of disentangled phone and speaker representations from two separately trained VQ-VAE systems: one trained on multilingual data and another trained on monolingual data. We explore the multi- and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-29 Jennifer Williams , Jason Fong , Erica Cooper , Junichi Yamagishi

We study multi-task learning for two orthogonal speech technology tasks: speech and speaker recognition. We use wav2vec2 as a base architecture with two task-specific output heads. We experiment with different architectural decisions to mix…

Sound · Computer Science 2023-05-29 Nik Vaessen , David A. van Leeuwen

Human communication is multi-modal; e.g., face-to-face interaction involves auditory signals (speech) and visual signals (face movements and hand gestures). Hence, it is essential to exploit multiple modalities when designing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Marah Halawa , Florian Blume , Pia Bideau , Martin Maier , Rasha Abdel Rahman , Olaf Hellwich

In this paper, we study how to use masked signal modeling in vision and language (V+L) representation learning. Instead of developing masked language modeling (MLM) and masked image modeling (MIM) independently, we propose to build joint…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Gukyeong Kwon , Zhaowei Cai , Avinash Ravichandran , Erhan Bas , Rahul Bhotika , Stefano Soatto

There are two sub-tasks implied in the weakly-supervised SED: audio tagging and event boundary detection. Current methods which combine multi-task learning with SED requires annotations both for these two sub-tasks. Since there are only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-25 Yuxin Huang , Xiangdong Wang , Liwei Lin , Hong Liu , Yueliang Qian

Lip-reading aims to recognize speech content from videos via visual analysis of speakers' lip movements. This is a challenging task due to the existence of homophemes-words which involve identical or highly similar lip movements, as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Chenhao Wang

Semi-supervised learning via learning from limited quantities of labeled data has been investigated as an alternative to supervised counterparts. Maximizing knowledge gains from copious unlabeled data benefit semi-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ayaan Haque , Abdullah-Al-Zubaer Imran , Adam Wang , Demetri Terzopoulos

Weakly Labelled learning has garnered lot of attention in recent years due to its potential to scale Sound Event Detection (SED) and is formulated as Multiple Instance Learning (MIL) problem. This paper proposes a Multi-Task Learning (MTL)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Soham Deshmukh , Bhiksha Raj , Rita Singh

Approaches to improving multilingual language understanding often struggle with significant performance gaps between high-resource and low-resource languages. While there are efforts to align the languages in a single latent space to…

Computation and Language · Computer Science 2024-11-18 Haeji Jung , Changdae Oh , Jooeon Kang , Jimin Sohn , Kyungwoo Song , Jinkyu Kim , David R. Mortensen

Recent work in vision-and-language pretraining has investigated supervised signals from object detection data to learn better, fine-grained multimodal representations. In this work, we take a step further and explore how we can tap into…

Computation and Language · Computer Science 2023-10-20 Emanuele Bugliarello , Aida Nematzadeh , Lisa Anne Hendricks

Target speech separation refers to extracting a target speaker's voice from an overlapped audio of simultaneous talkers. Previously the use of visual modality for target speech separation has demonstrated great potentials. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Rongzhi Gu , Shi-Xiong Zhang , Yong Xu , Lianwu Chen , Yuexian Zou , Dong Yu

The rapidly evolving field of robotics necessitates methods that can facilitate the fusion of multiple modalities. Specifically, when it comes to interacting with tangible objects, effectively combining visual and tactile sensory data is…

Robotics · Computer Science 2024-01-23 Vedant Dave , Fotios Lygerakis , Elmar Rueckert