English
Related papers

Related papers: Integrating Text-to-Music Models with Language Mod…

200 papers

Music generation introduces challenging complexities to large language models. Symbolic structures of music often include vertical harmonization as well as horizontal counterpoint, urging various adaptations and enhancements for large-scale…

Sound · Computer Science 2024-07-30 Seungyeon Rhyu , Kichang Yang , Sungjun Cho , Jaehyeon Kim , Kyogu Lee , Moontae Lee

In this paper, we consider a novel research problem: music-to-text synaesthesia. Different from the classical music tagging problem that classifies a music recording into pre-defined categories, music-to-text synaesthesia aims to generate…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-09 Zhihuan Kuang , Shi Zong , Jianbing Zhang , Jiajun Chen , Hongfu Liu

Audio-based music structure analysis (MSA) is an essential task in Music Information Retrieval that remains challenging due to the complexity and variability of musical form. Recent advances highlight the potential of fine-tuning…

Sound · Computer Science 2025-07-21 Yixiao Zhang , Haonan Chen , Ju-Chiang Wang , Jitong Chen

We propose the Multi-Track Music Machine (MMM), a generative system based on the Transformer architecture that is capable of generating multi-track music. In contrast to previous work, which represents musical material as a single…

Sound · Computer Science 2020-08-24 Jeff Ens , Philippe Pasquier

Recent advances in Large Language Models (LLMs) have led to significant breakthroughs in video understanding. However, existing models still struggle with long video processing due to the context length constraint of LLMs and the vast…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haoran Hao , Jiaming Han , Yiyuan Zhang , Xiangyu Yue

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

In recent years, machine learning, and in particular generative adversarial neural networks (GANs) and attention-based neural networks (transformers), have been successfully used to compose and generate music, both melodies and polyphonic…

The paper presents a method of the music generation based on LSTM (Long Short-Term Memory), contrasts the effects of different network structures on the music generation and introduces other methods used by some researchers.

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Xin Xu

Breakthroughs in text-to-music generation models are transforming the creative landscape, equipping musicians with innovative tools for composition and experimentation like never before. However, controlling the generation process to…

Sound · Computer Science 2025-06-19 Teysir Baoueb , Xiaoyu Bie , Xi Wang , Gaël Richard

Music generation has attracted growing interest with the advancement of deep generative models. However, generating music conditioned on textual descriptions, known as text-to-music, remains challenging due to the complexity of musical…

Sound · Computer Science 2025-05-08 Peike Li , Boyu Chen , Yao Yao , Yikai Wang , Allen Wang , Alex Wang

Modeling long texts has been an essential technique in the field of natural language processing (NLP). With the ever-growing number of long documents, it is important to develop effective modeling methods that can process and analyze such…

Computation and Language · Computer Science 2025-06-11 Zican Dong , Tianyi Tang , Junyi Li , Wayne Xin Zhao

Generating music is an interesting and challenging problem in the field of machine learning. Mimicking human creativity has been popular in recent years, especially in the field of computer vision and image processing. With the advent of…

Sound · Computer Science 2020-11-03 Ashish Ranjan , Varun Nagesh Jolly Behera , Motahar Reza

Large language models (LLMs) are very performant connectionist systems, but do they exhibit more compositionality? More importantly, is that part of why they perform so well? We present empirical analyses across four LLM families (12…

Computation and Language · Computer Science 2025-05-21 Ruchira Dhar , Anders Søgaard

Symbolic Music Generation relies on the contextual representation capabilities of the generative model, where the most prevalent approach is the Transformer-based model. The learning of musical context is also related to the structural…

Sound · Computer Science 2022-07-12 Guowei Wu , Shipei Liu , Xiaoya Fan

We present an approach for recommending a music track for a given video, and vice versa, based on both their temporal alignment and their correspondence at an artistic level. We propose a self-supervised approach that learns this…

Multimedia · Computer Science 2022-06-16 Didac Suris , Carl Vondrick , Bryan Russell , Justin Salamon

In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting. Motivated by recent advances in the computer vision domain, we are the first to explore the combination of pre-trained text-to-audio…

We consider the generative modeling of speech over multiple minutes, a requirement for long-form multimedia generation and audio-native voice assistants. However, textless spoken language models struggle to generate plausible speech past…

Computation and Language · Computer Science 2025-07-11 Se Jin Park , Julian Salazar , Aren Jansen , Keisuke Kinoshita , Yong Man Ro , RJ Skerry-Ryan

We apply deep learning methods, specifically long short-term memory (LSTM) networks, to music transcription modelling and composition. We build and train LSTM networks using approximately 23,000 music transcriptions expressed with a…

Sound · Computer Science 2016-05-02 Bob L. Sturm , João Felipe Santos , Oded Ben-Tal , Iryna Korshunova

This paper presents an overview and the technical framework of the ICME 2026 Grand Challenge on Academic Text-to-Music Generation (ATTM). Despite the rapid progress in text-to-music generation (TTM) systems, the field is currently dominated…

Sound · Computer Science 2026-05-22 Fang-Chih Hsieh , Wei-Jaw Lee , Chun-Ping Wang , Hung-yi Lee , Hao-Wen Dong , Yi-Hsuan Yang

This paper explores a simple extension of diffusion-based rectified flow Transformers for text-to-music generation, termed as FluxMusic. Generally, along with design in advanced Flux\footnote{https://github.com/black-forest-labs/flux}…

Sound · Computer Science 2024-12-23 Zhengcong Fei , Mingyuan Fan , Changqian Yu , Junshi Huang
‹ Prev 1 3 4 5 6 7 10 Next ›