English
Related papers

Related papers: Unsupervised Generative Adversarial Alignment Repr…

200 papers

Deep learning has boosted the performance of many music information retrieval (MIR) systems in recent years. Yet, the complex hierarchical arrangement of music makes end-to-end learning hard for some MIR tasks - a very deep and flexible…

Sound · Computer Science 2018-12-11 Anders Elowsson

Despite the innovations in deep learning and generative AI, creating long term structure as well as the layers of repeated structure common in musical works remains an open challenge in music generation. We propose an attention layer that…

Sound · Computer Science 2024-06-27 Sophia Hager , Kathleen Hablutzel , Katherine M. Kinnaird

Agents that can follow language instructions are expected to be useful in a variety of situations such as navigation. However, training neural network-based agents requires numerous paired trajectories and languages. This paper proposes…

Machine Learning · Computer Science 2023-01-03 Kei Akuzawa , Yusuke Iwasawa , Yutaka Matsuo

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

The state of the art in music source separation employs neural networks trained in a supervised fashion on multi-track databases to estimate the sources from a given mixture. With only few datasets available, often extensive data…

Machine Learning · Computer Science 2018-04-09 Daniel Stoller , Sebastian Ewert , Simon Dixon

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Deep learning has been extensively used in medical imaging applications, assuming that the test and training datasets belong to the same probability distribution. However, a common challenge arises when working with medical images generated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Mohd Usama , Belal Ahmad , Christer Gronlund , Faleh Menawer R Althiyabi

Multimodal contrastive models have achieved strong performance in text-audio retrieval and zero-shot settings, but improving joint embedding spaces remains an active research area. Less attention has been given to making these systems…

Sound · Computer Science 2025-06-25 Julien Guinot , Elio Quinton , György Fazekas

Adversarial learning methods are a promising approach to training robust deep networks, and can generate complex samples across diverse domains. They also can improve recognition despite the presence of domain shift or dataset bias: several…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Eric Tzeng , Judy Hoffman , Kate Saenko , Trevor Darrell

We present an approach to unsupervised audio representation learning. Based on a triplet neural network architecture, we harnesses semantically related cross-modal information to estimate audio track-relatedness. By applying Latent Semantic…

Multimedia · Computer Science 2020-03-30 Alexander Schindler , Sergiu Gordea , Peter Knees

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

Improving the aesthetic quality of images is challenging and eager for the public. To address this problem, most existing algorithms are based on supervised learning methods to learn an automatic photo enhancer for paired data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Zhangkai Ni , Wenhan Yang , Shiqi Wang , Lin Ma , Sam Kwong

Text-guided image generation has witnessed unprecedented progress due to the development of diffusion models. Beyond text and image, sound is a vital element within the sphere of human perception, offering vivid representations and…

Graphics · Computer Science 2023-06-21 Yue Yang , Kaipeng Zhang , Yuying Ge , Wenqi Shao , Zeyue Xue , Yu Qiao , Ping Luo

Deep Neural Networks have recently demonstrated promising performance in binary change detection (CD) problems in remote sensing (RS), requiring a large amount of labeled multitemporal training samples. Since collecting such data is…

Image and Video Processing · Electrical Eng. & Systems 2020-07-08 Jose Luis Holgado Alvarez , Mahdyar Ravanbakhsh , Begüm Demir

Generative adversarial network (GAN) is formulated as a two-player game between a generator (G) and a discriminator (D), where D is asked to differentiate whether an image comes from real data or is produced by G. Under such a formulation,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Qingyan Bai , Ceyuan Yang , Yinghao Xu , Xihui Liu , Yujiu Yang , Yujun Shen

Deep generative models have emerged as a promising approach in the medical image domain to address data scarcity. However, their use for sequential data like respiratory sounds is less explored. In this work, we propose a straightforward…

Sound · Computer Science 2023-11-14 June-Woo Kim , Chihyeon Yoon , Miika Toikkanen , Sangmin Bae , Ho-Young Jung

Adversarial attacks have always been a serious threat for any data-driven model. In this paper, we explore subspaces of adversarial examples in unitary vector domain, and we propose a novel detector for defending our models trained for…

Machine Learning · Computer Science 2019-10-29 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance, consent, and training transparency. These models are typically trained on large-scale…

Machine Learning · Computer Science 2026-05-29 Yi Chen Liu , Jiawei Yu , Kexin Cao , Syed Irfan Ali Meerza , Trishika Movva , Jian Liu

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned…

Machine Learning · Computer Science 2022-11-28 Yixin Liu , Yizhen Zheng , Daokun Zhang , Vincent CS Lee , Shirui Pan

This paper proposes a novel unsupervised autoregressive neural model for learning generic speech representations. In contrast to other speech representation learning methods that aim to remove noise or speaker variabilities, ours is…

Computation and Language · Computer Science 2019-06-20 Yu-An Chung , Wei-Ning Hsu , Hao Tang , James Glass