中文
相关论文

相关论文: FIGARO: Generating Symbolic Music with Fine-Graine…

200 篇论文

Over the past several years, deep learning for sequence modeling has grown in popularity. To achieve this goal, LSTM network structures have proven to be very useful for making predictions for the next output in a series. For instance, a…

声音 · 计算机科学 2022-03-24 Michael Conner , Lucas Gral , Kevin Adams , David Hunger , Reagan Strelow , Alexander Neuwirth

Analysing music in the field of machine learning is a very difficult problem with numerous constraints to consider. The nature of audio data, with its very high dimensionality and widely varying scales of structure, is one of the primary…

声音 · 计算机科学 2022-05-17 Tracy Qian , Jackson Kaunismaa , Tony Chung

In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Dimitri von Rütte , Elisabetta Fedele , Jonathan Thomm , Lukas Wolf

Populations of neurons display an extraordinary diversity in the behaviors they affect and display. Machine learning techniques have recently emerged that allow us to create networks of model neurons that display behaviours of similar…

神经元与认知 · 定量生物学 2018-02-07 Wilten Nicola , Claudia Clopath

Natural language generators for task-oriented dialogue must effectively realize system dialogue actions and their associated semantics. In many applications, it is also desirable for generators to control the style of an utterance. To date,…

计算与语言 · 计算机科学 2018-05-23 Shereen Oraby , Lena Reed , Shubhangi Tandon , T. S. Sharath , Stephanie Lukin , Marilyn Walker

Autoregressive models based on Transformers have become the prevailing approach for generating music compositions that exhibit comprehensive musical structure. These models are typically trained by minimizing the negative log-likelihood…

声音 · 计算机科学 2023-10-11 Ziyi Jiang , Ruoxue Wu , Zhenghan Chen , Xiaoxuan Liang

AI music generation has advanced rapidly, with models like diffusion and autoregressive algorithms enabling high-fidelity outputs. These tools can alter styles, mix instruments, or isolate them. Since sound can be visualized as…

This paper proposes a hierarchical generative model with a multi-grained latent variable to synthesize expressive speech. In recent years, fine-grained latent variables are introduced into the text-to-speech synthesis that enable the fine…

音频与语音处理 · 电气工程与系统科学 2021-12-28 Yukiya Hono , Kazuna Tsuboi , Kei Sawada , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

With rapid development of neural networks, deep-learning has been extended to various natural language generation fields, such as machine translation, dialogue generation and even literature creation. In this paper, we propose a theme-aware…

计算与语言 · 计算机科学 2019-06-06 Jie Wang , Xinyan Zhao

We introduce Noise2Music, where a series of diffusion models is trained to generate high-quality 30-second music clips from text prompts. Two types of diffusion models, a generator model, which generates an intermediate representation…

In addressing the challenge of interpretability and generalizability of artificial music intelligence, this paper introduces a novel symbolic representation that amalgamates both explicit and implicit musical information across diverse…

声音 · 计算机科学 2024-01-08 Yikai Qian , Tianle Wang , Xinyi Tong , Xin Jin , Duo Xu , Bo Zheng , Tiezheng Ge , Feng Yu , Song-Chun Zhu

We propose a novel symbolic music representation and Generative Adversarial Network (GAN) framework specially designed for symbolic multitrack music generation. The main theme of symbolic music generation primarily encompasses the…

声音 · 计算机科学 2024-09-04 Jinlong Zhu , Keigo Sakurai , Ren Togo , Takahiro Ogawa , Miki Haseyama

Lyrics generation presents unique challenges, particularly in achieving precise syllable control while adhering to song form structures such as verses and choruses. Conventional line-by-line approaches often lead to unnatural phrasing,…

计算与语言 · 计算机科学 2025-06-24 Yunkee Chae , Eunsik Shin , Suntae Hwang , Seungryeol Paik , Kyogu Lee

A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a deep reinforcement learning architecture that predicts and generates polyphonic…

声音 · 计算机科学 2018-12-05 Nikhil Kotecha

Generative methods for graphs need to be sufficiently flexible to model complex dependencies between sets of nodes. At the same time, the generated graphs need to satisfy domain-dependent feasibility conditions, that is, they should not…

机器学习 · 计算机科学 2025-01-22 Stefan Mautner , Rolf Backofen , Fabrizio Costa

We propose a novel approach for generating unrestricted adversarial examples by manipulating fine-grained aspects of image generation. Unlike existing unrestricted attacks that typically hand-craft geometric transformations, we learn…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Omid Poursaeed , Tianxing Jiang , Yordanos Goshu , Harry Yang , Serge Belongie , Ser-Nam Lim

This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned…

计算机视觉与模式识别 · 计算机科学 2020-11-30 Hugo Touvron , Alexandre Sablayrolles , Matthijs Douze , Matthieu Cord , Hervé Jégou

Recent works have sought to enhance the controllability and precision of text-driven motion generation. Some approaches leverage large language models (LLMs) to produce more detailed texts, while others incorporate global 3D coordinate…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Keming Shen , Bizhu Wu , Junliang Chen , Xiaoqin Wang , Linlin Shen

Songs, as a central form of musical art, exemplify the richness of human intelligence and creativity. While recent advances in generative modeling have enabled notable progress in long-form song generation, current systems for full-length…

音频与语音处理 · 电气工程与系统科学 2025-07-25 Huakang Chen , Yuepeng Jiang , Guobin Ma , Chunbo Hao , Shuai Wang , Jixun Yao , Ziqian Ning , Meng Meng , Jian Luan , Lei Xie

While many diffusion models perform well when controlling particular aspects such as style, character, and interaction, they struggle with fine-grained control due to dataset limitations and intricate model architecture design. This paper…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Conghan Yue , Zhengwei Peng , Shiyan Du , Zhi Ji , Chuangjian Cai , Le Wan , Dongyu Zhang