English
Related papers

Related papers: FIGARO: Generating Symbolic Music with Fine-Graine…

200 papers

Over the past several years, deep learning for sequence modeling has grown in popularity. To achieve this goal, LSTM network structures have proven to be very useful for making predictions for the next output in a series. For instance, a…

Sound · Computer Science 2022-03-24 Michael Conner , Lucas Gral , Kevin Adams , David Hunger , Reagan Strelow , Alexander Neuwirth

Analysing music in the field of machine learning is a very difficult problem with numerous constraints to consider. The nature of audio data, with its very high dimensionality and widely varying scales of structure, is one of the primary…

Sound · Computer Science 2022-05-17 Tracy Qian , Jackson Kaunismaa , Tony Chung

In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Dimitri von Rütte , Elisabetta Fedele , Jonathan Thomm , Lukas Wolf

Populations of neurons display an extraordinary diversity in the behaviors they affect and display. Machine learning techniques have recently emerged that allow us to create networks of model neurons that display behaviours of similar…

Neurons and Cognition · Quantitative Biology 2018-02-07 Wilten Nicola , Claudia Clopath

Natural language generators for task-oriented dialogue must effectively realize system dialogue actions and their associated semantics. In many applications, it is also desirable for generators to control the style of an utterance. To date,…

Computation and Language · Computer Science 2018-05-23 Shereen Oraby , Lena Reed , Shubhangi Tandon , T. S. Sharath , Stephanie Lukin , Marilyn Walker

Autoregressive models based on Transformers have become the prevailing approach for generating music compositions that exhibit comprehensive musical structure. These models are typically trained by minimizing the negative log-likelihood…

Sound · Computer Science 2023-10-11 Ziyi Jiang , Ruoxue Wu , Zhenghan Chen , Xiaoxuan Liang

AI music generation has advanced rapidly, with models like diffusion and autoregressive algorithms enabling high-fidelity outputs. These tools can alter styles, mix instruments, or isolate them. Since sound can be visualized as…

This paper proposes a hierarchical generative model with a multi-grained latent variable to synthesize expressive speech. In recent years, fine-grained latent variables are introduced into the text-to-speech synthesis that enable the fine…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-28 Yukiya Hono , Kazuna Tsuboi , Kei Sawada , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

With rapid development of neural networks, deep-learning has been extended to various natural language generation fields, such as machine translation, dialogue generation and even literature creation. In this paper, we propose a theme-aware…

Computation and Language · Computer Science 2019-06-06 Jie Wang , Xinyan Zhao

We introduce Noise2Music, where a series of diffusion models is trained to generate high-quality 30-second music clips from text prompts. Two types of diffusion models, a generator model, which generates an intermediate representation…

In addressing the challenge of interpretability and generalizability of artificial music intelligence, this paper introduces a novel symbolic representation that amalgamates both explicit and implicit musical information across diverse…

Sound · Computer Science 2024-01-08 Yikai Qian , Tianle Wang , Xinyi Tong , Xin Jin , Duo Xu , Bo Zheng , Tiezheng Ge , Feng Yu , Song-Chun Zhu

We propose a novel symbolic music representation and Generative Adversarial Network (GAN) framework specially designed for symbolic multitrack music generation. The main theme of symbolic music generation primarily encompasses the…

Sound · Computer Science 2024-09-04 Jinlong Zhu , Keigo Sakurai , Ren Togo , Takahiro Ogawa , Miki Haseyama

Lyrics generation presents unique challenges, particularly in achieving precise syllable control while adhering to song form structures such as verses and choruses. Conventional line-by-line approaches often lead to unnatural phrasing,…

Computation and Language · Computer Science 2025-06-24 Yunkee Chae , Eunsik Shin , Suntae Hwang , Seungryeol Paik , Kyogu Lee

A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a deep reinforcement learning architecture that predicts and generates polyphonic…

Sound · Computer Science 2018-12-05 Nikhil Kotecha

Generative methods for graphs need to be sufficiently flexible to model complex dependencies between sets of nodes. At the same time, the generated graphs need to satisfy domain-dependent feasibility conditions, that is, they should not…

Machine Learning · Computer Science 2025-01-22 Stefan Mautner , Rolf Backofen , Fabrizio Costa

We propose a novel approach for generating unrestricted adversarial examples by manipulating fine-grained aspects of image generation. Unlike existing unrestricted attacks that typically hand-craft geometric transformations, we learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Omid Poursaeed , Tianxing Jiang , Yordanos Goshu , Harry Yang , Serge Belongie , Ser-Nam Lim

This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Hugo Touvron , Alexandre Sablayrolles , Matthijs Douze , Matthieu Cord , Hervé Jégou

Recent works have sought to enhance the controllability and precision of text-driven motion generation. Some approaches leverage large language models (LLMs) to produce more detailed texts, while others incorporate global 3D coordinate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Keming Shen , Bizhu Wu , Junliang Chen , Xiaoqin Wang , Linlin Shen

Songs, as a central form of musical art, exemplify the richness of human intelligence and creativity. While recent advances in generative modeling have enabled notable progress in long-form song generation, current systems for full-length…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Huakang Chen , Yuepeng Jiang , Guobin Ma , Chunbo Hao , Shuai Wang , Jixun Yao , Ziqian Ning , Meng Meng , Jian Luan , Lei Xie

While many diffusion models perform well when controlling particular aspects such as style, character, and interaction, they struggle with fine-grained control due to dataset limitations and intricate model architecture design. This paper…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Conghan Yue , Zhengwei Peng , Shiyan Du , Zhi Ji , Chuangjian Cai , Le Wan , Dongyu Zhang