English
Related papers

Related papers: Contrastive Audio-Language Learning for Music

200 papers

Challenges in managing linguistic diversity and integrating various musical modalities are faced by current music information retrieval systems. These limitations reduce their effectiveness in a global, multimodal music environment. To…

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung

Content creators often use music to enhance their videos, from soundtracks in movies to background music in video blogs and social media content. However, identifying the best music for a video can be a difficult and time-consuming task. To…

Multimedia · Computer Science 2024-12-24 Shanti Stewart , Gouthaman KV , Lie Lu , Andrea Fanelli

Cross-modal correlation provides an inherent supervision for video unsupervised representation learning. Existing methods focus on distinguishing different video clips by visual and audio representations. We human visual perception could…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shaobo Min , Qi Dai , Hongtao Xie , Chuang Gan , Yongdong Zhang , Jingdong Wang

Music recommender systems frequently utilize network-based models to capture relationships between music pieces, artists, and users. Although these relationships provide valuable insights for predictions, new music pieces or artists often…

Sound · Computer Science 2024-09-16 Florian Grötschla , Luca Strässle , Luca A. Lanzendörfer , Roger Wattenhofer

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Audio representations for music information retrieval are typically learned via supervised learning in a task-specific fashion. Although effective at producing state-of-the-art results, this scheme lacks flexibility with respect to the…

Sound · Computer Science 2022-02-18 Ilaria Manco , Emmanouil Benetos , Elio Quinton , Gyorgy Fazekas

Recent advances have been witnessed in audio-language joint learning, such as CLAP, that shows much success in multi-modal understanding tasks. These models usually aggregate uni-modal local representations, namely frame or word features,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-16 Yiming Li , Zhifang Guo , Xiangdong Wang , Hong Liu

As deep learning models evolve, new applications and challenges are rapidly emerging. Tasks that once relied on a single modality, such as text, images, or audio, are now enriched by seamless interactions between multimodal data. These…

Multi-modal Contrastive Representation learning aims to encode different modalities into a semantically aligned shared space. This paradigm shows remarkable generalization ability on numerous downstream tasks across various modalities.…

Machine Learning · Computer Science 2023-10-20 Zehan Wang , Yang Zhao , Xize Cheng , Haifeng Huang , Jiageng Liu , Li Tang , Linjun Li , Yongqi Wang , Aoxiong Yin , Ziang Zhang , Zhou Zhao

Accurate classification of articulatory-phonological features plays a vital role in understanding human speech production and developing robust speech technologies, particularly in clinical contexts where targeted phonemic analysis and…

Deep learning has successfully shown excellent performance in learning joint representations between different data modalities. Unfortunately, little research focuses on cross-modal correlation learning where temporal structures of…

Multimedia · Computer Science 2019-08-13 Donghuo Zeng , Yi Yu , Keizo Oyama

Multimodal learning has driven innovation across various industries, particularly in the field of music. By enabling more intuitive interaction experiences and enhancing immersion, it not only lowers the entry barriers to the music but also…

Multimedia · Computer Science 2026-02-24 Sifei Li , Mining Tan , Feier Shen , Minyan Luo , Zijiao Yin , Fan Tang , Weiming Dong , Changsheng Xu

Audio-text retrieval enables semantic alignment between audio content and natural language queries, supporting applications in multimedia search, accessibility, and surveillance. However, current state-of-the-art approaches struggle with…

Computation and Language · Computer Science 2026-04-28 Meizhu Liu , Matthew Rowe , Amit Agarwal , Michael Avendi , Yassi Abbasi , Hitesh Laxmichand Patel , Paul Li , Kyu J. Han , Tao Sheng , Sujith Ravi , Dan Roth

Mean Opinion Score (MOS) prediction for text to music systems requires evaluating both overall musical quality and text prompt alignment. This paper introduces WhisQ, a multimodal architecture that addresses this dual-assessment challenge…

Sound · Computer Science 2025-06-09 Jakaria Islam Emon , Kazi Tamanna Alam , Md. Abu Salek

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building a skyscraper, where…

Computation and Language · Computer Science 2024-08-15 Ronghao Lin , Haifeng Hu

Current emotion-based contrastive language-audio pretraining (CLAP) methods typically learn by na\"ively aligning audio samples with corresponding text prompts. Consequently, this approach fails to capture the ordinal nature of emotions,…

Machine Learning · Computer Science 2025-05-30 Shreeram Suresh Chandra , Lucas Goncalves , Junchen Lu , Carlos Busso , Berrak Sisman

We present COCOLA (Coherence-Oriented Contrastive Learning for Audio), a contrastive learning method for musical audio representations that captures the harmonic and rhythmic coherence between samples. Our method operates at the level of…

Humans do not acquire perceptual abilities in the way we train machines. While machine learning algorithms typically operate on large collections of randomly-chosen, explicitly-labeled examples, human acquisition relies more heavily on…

Multimodal models that jointly process audio and language hold great promise in audio understanding and are increasingly being adopted in the music domain. By allowing users to query via text and obtain information about a given audio…

Sound · Computer Science 2024-08-05 Benno Weck , Ilaria Manco , Emmanouil Benetos , Elio Quinton , George Fazekas , Dmitry Bogdanov