English
Related papers

Related papers: COCOLA: Coherence-Oriented Contrastive Learning of…

200 papers

Music performances are representative scenarios for audio-visual modeling. Unlike common scenarios with sparse audio, music performances continuously involve dense audio signals throughout. While existing multimodal learning methods on the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xingjian Diao , Chunhui Zhang , Tingxuan Wu , Ming Cheng , Zhongyu Ouyang , Weiyi Wu , Jiang Gui

This paper investigates negative sampling for contrastive learning in the context of audio-text retrieval. The strategy for negative sampling refers to selecting negatives (either audio clips or textual descriptions) from a pool of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-20 Huang Xie , Okko Räsänen , Tuomas Virtanen

The identification of structural differences between a music performance and the score is a challenging yet integral step of audio-to-score alignment, an important subtask of music information retrieval. We present a novel method to detect…

Sound · Computer Science 2021-02-16 Ruchit Agrawal , Daniel Wolff , Simon Dixon

Multiple modalities for certain information provide a variety of perspectives on that information, which can improve the understanding of the information. Thus, it may be crucial to generate data of different modality from the existing data…

Sound · Computer Science 2022-07-26 HaeChun Chung , JooYong Shim , Jong-Kook Kim

Most of existing audio fingerprinting systems have limitations to be used for high-specific audio retrieval at scale. In this work, we generate a low-dimensional representation from a short unit segment of audio, and couple this fingerprint…

Sound · Computer Science 2021-02-11 Sungkyun Chang , Donmoon Lee , Jeongsoo Park , Hyungui Lim , Kyogu Lee , Karam Ko , Yoonchang Han

In this work, we present CoCal, an interpretable and consistent object parsing framework based on dictionary-based mask transformer. Designed around Contrastive Components and Logical Constraints, CoCal rethinks existing cluster-based mask…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tiezheng Zhang , Qihang Yu , Alan Yuille , Ju He

Recent advances have been witnessed in audio-language joint learning, such as CLAP, that shows much success in multi-modal understanding tasks. These models usually aggregate uni-modal local representations, namely frame or word features,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-16 Yiming Li , Zhifang Guo , Xiangdong Wang , Hong Liu

Flamenco is a music tradition from Southern Spain which attracts a growing community of enthusiasts around the world. Its unique melodic and rhythmic elements, the typically spontaneous and improvised interpretation and its diversity…

Sound · Computer Science 2015-10-15 Nadine Kroher , José-Miguel Díaz-Báñez , Joaquin Mora , Emilia Gómez

Contrastive learning has emerged as a powerful technique in audio-visual representation learning, leveraging the natural co-occurrence of audio and visual modalities in webscale video datasets. However, conventional contrastive audio-visual…

Sound · Computer Science 2025-03-18 Ioannis Tsiamas , Santiago Pascual , Chunghsin Yeh , Joan Serrà

We propose Cooperative Component Analysis (CoCA), a new method for unsupervised multi-view analysis: it identifies the component that simultaneously captures significant within-view variance and exhibits strong cross-view correlation. The…

Methodology · Statistics 2024-07-25 Daisy Yi Ding , Alden Green , Min Woo Sun , Robert Tibshirani

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

Machine Learning · Computer Science 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Humans perceive the world through multisensory integration, blending the information of different modalities to adapt their behavior. Contrastive learning offers an appealing solution for multimodal self-supervised learning. Indeed, by…

Machine Learning · Computer Science 2025-03-06 Benoit Dufumier , Javiera Castillo-Navarro , Devis Tuia , Jean-Philippe Thiran

Human-humanoid collaboration shows significant promise for applications in healthcare, domestic assistance, and manufacturing. While compliant robot-human collaboration has been extensively developed for robotic arms, enabling compliant…

Robotics · Computer Science 2025-10-17 Yushi Du , Yixuan Li , Baoxiong Jia , Yutang Lin , Pei Zhou , Wei Liang , Yanchao Yang , Siyuan Huang

Standard fine-tuning of pre-trained audio models couples representation learning with classifier training, which can obscure the true quality of the learned representations. In this work, we advocate for a disentangled two-stage framework…

Sound · Computer Science 2025-09-23 Yang Wang , Qibin Liang , Chenghao Xiao , Yizhi Li , Noura Al Moubayed , Chenghua Lin

To help address the occlusion problem in panoptic segmentation and image understanding, this paper proposes a new large-scale dataset named COCO-OLAC (COCO Occlusion Labels for All Computer Vision Tasks), which is derived from the COCO…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Wenbo Wei , Jun Wang , Abhir Bhalerao

Contrastive learning is a powerful way of learning multimodal representations across various domains such as image-caption retrieval and audio-visual representation learning. In this work, we investigate if these findings generalize to the…

Information Retrieval · Computer Science 2023-09-04 Karel Veldkamp , Mariya Hendriksen , Zoltán Szlávik , Alexander Keijser

Stance detection seeks to identify the viewpoints of individuals either in favor or against a given target or a controversial topic. Current advanced neural models for stance detection typically employ fully parametric softmax classifiers.…

Machine Learning · Computer Science 2024-06-21 Yinghan Cheng , Qi Zhang , Chongyang Shi , Liang Xiao , Shufeng Hao , Liang Hu

Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong…

Machine Learning · Computer Science 2024-05-30 Yichen Wen , Zhiquan Tan , Kaipeng Zheng , Chuanlong Xie , Weiran Huang

Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate complex structures from simpler elements. In this paper, we…

Machine Learning · Computer Science 2024-08-20 Giovanni Bindi , Philippe Esling

We introduce a multi-modal diffusion model tailored for the bi-directional conditional generation of video and audio. We propose a joint contrastive training loss to improve the synchronization between visual and auditory occurrences. We…

Machine Learning · Computer Science 2024-10-10 Ruihan Yang , Hannes Gamper , Sebastian Braun