English
Related papers

Related papers: COCOLA: Coherence-Oriented Contrastive Learning of…

200 papers

Deep learning has successfully shown excellent performance in learning joint representations between different data modalities. Unfortunately, little research focuses on cross-modal correlation learning where temporal structures of…

Multimedia · Computer Science 2019-08-13 Donghuo Zeng , Yi Yu , Keizo Oyama

Open-vocabulary audio language models (ALMs), like Contrastive Language Audio Pretraining (CLAP), represent a promising new paradigm for audio-text retrieval using natural language queries. In this paper, for the first time, we perform…

The foundation models based on pre-training technology have significantly advanced artificial intelligence from theoretical to practical applications. These models have facilitated the feasibility of computer-aided diagnosis for widespread…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xiaofei Chen , Yuting He , Cheng Xue , Rongjun Ge , Shuo Li , Guanyu Yang

The accumulation of time-series data and the absence of labels make time-series Anomaly Detection (AD) a self-supervised deep learning task. Single-normality-assumption-based methods, which reveal only a certain aspect of the whole…

Machine Learning · Computer Science 2023-04-18 Rui Wang , Chongwei Liu , Xudong Mou , Kai Gao , Xiaohui Guo , Pin Liu , Tianyu Wo , Xudong Liu

The development of models for learning music similarity and feature extraction from audio media files is an increasingly important task for the entertainment industry. This work proposes a novel music classification model based on metric…

Sound · Computer Science 2019-09-19 Angelo C. Mendes da Silva , Mauricio A. Nunes , Raul Fonseca Neto

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong

Audio-Visual Segmentation (AVS) aims to identify, at the pixel level, the object in a visual scene that produces a given sound. Current AVS methods rely on costly fine-grained annotations of mask-audio pairs, making them impractical for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Swapnil Bhosale , Haosen Yang , Diptesh Kanojia , Jiangkang Deng , Xiatian Zhu

This research presents a robust approach to classifying COVID-19 cough sounds using cutting-edge machine-learning techniques. Leveraging deep neural decision trees and deep neural decision forests, our methodology demonstrates consistent…

Sound · Computer Science 2025-01-03 Rofiqul Islam , Nihad Karim Chowdhury , Muhammad Ashad Kabir

Contrastive learning is emerging as a powerful technique for extracting knowledge from unlabeled data. This technique requires a balanced mixture of two ingredients: positive (similar) and negative (dissimilar) samples. This is typically…

Computation and Language · Computer Science 2022-03-17 Rui Cao , Yihao Wang , Yuxin Liang , Ling Gao , Jie Zheng , Jie Ren , Zheng Wang

Recent progress in text-to-music generation has enabled models to synthesize high-quality musical segments, full compositions, and even respond to fine-grained control signals, e.g. chord progressions. State-of-the-art (SOTA) systems differ…

Sound · Computer Science 2025-09-05 Or Tal , Felix Kreuk , Yossi Adi

We propose an end-to-end music mixing style transfer system that converts the mixing style of an input multitrack to that of a reference song. This is achieved with an encoder pre-trained with a contrastive objective to extract only audio…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-12 Junghyun Koo , Marco A. Martínez-Ramírez , Wei-Hsiang Liao , Stefan Uhlich , Kyogu Lee , Yuki Mitsufuji

We present SoundLoCD, a novel text-to-sound generation framework, which incorporates a LoRA-based conditional discrete contrastive latent diffusion model. Unlike recent large-scale sound generation models, our model can be efficiently…

Sound · Computer Science 2024-05-27 Xinlei Niu , Jing Zhang , Christian Walder , Charles Patrick Martin

Widefield microscopy is widely used for non-invasive imaging of biological structures at subcellular resolution. When applied to complex specimen, its image quality is degraded by sample-induced optical aberration. Adaptive optics can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Iksung Kang , Qinrong Zhang , Stella X. Yu , Na Ji

Efficient audio quality assessment is vital for streamlining audio codec development. Objective assessment tools have been developed over time to algorithmically predict quality ratings from subjective assessments, the gold standard for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Pablo M. Delgado , Jürgen Herre

As an important component of multimedia analysis tasks, audio classification aims to discriminate between different audio signal types and has received intensive attention due to its wide applications. Generally speaking, the raw signal can…

Multimedia · Computer Science 2020-02-25 Liang Gao , Kele Xu , Huaimin Wang , Yuxing Peng

In this paper, we propose a joint generative and contrastive representation learning method (GeCo) for anomalous sound detection (ASD). GeCo exploits a Predictive AutoEncoder (PAE) equipped with self-attention as a generative model to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Xiao-Min Zeng , Yan Song , Zhu Zhuo , Yu Zhou , Yu-Hong Li , Hui Xue , Li-Rong Dai , Ian McLoughlin

Generating factual-consistent summaries is a challenging task for abstractive summarization. Previous works mainly encode factual information or perform post-correct/rank after decoding. In this paper, we provide a factual-consistent…

Computation and Language · Computer Science 2022-01-11 Wei Liu , Huanqin Wu , Wenjing Mu , Zhen Li , Tao Chen , Dan Nie

Despite recent progress in video and language representation learning, the weak or sparse correspondence between the two modalities remains a bottleneck in the area. Most video-language models are trained via pair-level loss to predict…

Machine Learning · Computer Science 2022-10-12 Zixu Wang , Yujie Zhong , Yishu Miao , Lin Ma , Lucia Specia

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

Computation and Language · Computer Science 2024-05-13 Bowen Xing , Ivor W. Tsang

Codistillation has been proposed as a mechanism to share knowledge among concurrently trained models by encouraging them to represent the same function through an auxiliary loss. This contrasts with the more commonly used fully-synchronous…

Machine Learning · Computer Science 2021-07-27 Shagun Sodhani , Olivier Delalleau , Mahmoud Assran , Koustuv Sinha , Nicolas Ballas , Michael Rabbat