English
Related papers

Related papers: Academic Text-to-Music Grand Challenge: Datasets, …

200 papers

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

This is the summary paper for the AudioMOS Challenge 2025, the very first challenge for automatic subjective quality prediction for synthetic audio. The challenge consists of three tracks. The first track aims to assess text-to-music…

Music has a unique and complex structure which is challenging for both expert humans and existing AI systems to understand, and presents unique challenges relative to other forms of audio. We present LLark, an instruction-tuned multimodal…

Sound · Computer Science 2024-06-04 Josh Gardner , Simon Durand , Daniel Stoller , Rachel M. Bittner

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

Computation and Language · Computer Science 2024-10-18 Sahar Iravani , Tim . O . F Conrad

Automatic Music Transcription (AMT), inferring musical notes from raw audio, is a challenging task at the core of music understanding. Unlike Automatic Speech Recognition (ASR), which typically focuses on the words of a single speaker, AMT…

Sound · Computer Science 2022-03-16 Josh Gardner , Ian Simon , Ethan Manilow , Curtis Hawthorne , Jesse Engel

This study evaluates the baseline capabilities of Large Language Models (LLMs) like ChatGPT, Claude, and Gemini to learn concepts in music theory through in-context learning and chain-of-thought prompting. Using carefully designed prompts…

Sound · Computer Science 2025-04-01 Liam Pond , Ichiro Fujinaga

Despite the central role that melody plays in music perception, it remains an open challenge in music information retrieval to reliably detect the notes of the melody present in an arbitrary music recording. A key challenge in melody…

Sound · Computer Science 2022-12-06 Chris Donahue , John Thickstun , Percy Liang

Music classification, a cornerstone of music information retrieval, supports a wide array of applications. To address the lack of comprehensive datasets and effective methods for sub-genre classification in mainstage dance music, we…

Sound · Computer Science 2025-08-05 Hongzhi Shu , Xinglin Li , Hongyu Jiang , Minghao Fu , Xinyu Li

The rapid advancement of large language models (LLMs) is fundamentally reshaping software engineering (SE), driving a paradigm shift in both academic research and industrial practice. While top-tier SE venues continue to show sustained or…

Software Engineering · Computer Science 2025-12-18 Hang Yu , Yuzhou Lai , Li Zhang , Xiaoli Lian , Fang Liu , Yanrui Dong , Ting Zhang , Zhi Jin , David Lo

Despite the impressive advances in text-to-image models, they often struggle to effectively compose complex scenes with multiple objects, displaying various attributes and relationships. To address this challenge, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kaiyi Huang , Chengqi Duan , Kaiyue Sun , Enze Xie , Zhenguo Li , Xihui Liu

Text-to-video (T2V) generative models have advanced significantly, yet their ability to compose different objects, attributes, actions, and motions into a video remains unexplored. Previous text-to-video benchmarks also neglect this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Kaiyue Sun , Kaiyi Huang , Xian Liu , Yue Wu , Zihan Xu , Zhenguo Li , Xihui Liu

Music datasets play a crucial role in advancing research in machine learning for music. However, existing music datasets suffer from limited size, accessibility, and lack of audio resources. To address these shortcomings, we present…

Sound · Computer Science 2023-10-06 Luca A. Lanzendörfer , Florian Grötschla , Emil Funke , Roger Wattenhofer

Existing Large Language Model (LLM) based autoregressive (AR) text-to-speech (TTS) systems, while achieving state-of-the-art quality, still face critical challenges. The foundation of this LLM-based paradigm is the discretization of the…

Evaluating audio generation systems, including text-to-music (TTM), text-to-speech (TTS), and text-to-audio (TTA), remains challenging due to the subjective and multi-dimensional nature of human perception. Existing methods treat mean…

Sound · Computer Science 2025-08-13 Chien-Chun Wang , Kuan-Tang Huang , Cheng-Yeh Yang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

Recent text generation research has increasingly focused on open-ended domains such as story and poetry generation. Because models built for such tasks are difficult to evaluate automatically, most researchers in the space justify their…

Computation and Language · Computer Science 2021-09-15 Marzena Karpinska , Nader Akoury , Mohit Iyyer

This paper introduces a new large-scale music dataset, MusicNet, to serve as a source of supervision and evaluation of machine learning methods for music research. MusicNet consists of hundreds of freely-licensed classical music recordings…

Machine Learning · Statistics 2017-04-07 John Thickstun , Zaid Harchaoui , Sham Kakade

Automatic Music Transcription (AMT) converts audio recordings into symbolic musical representations. Training deep neural networks (DNNs) for AMT typically requires strongly aligned training pairs with precise frame-level annotations. Since…

Sound · Computer Science 2025-11-19 Jonathan Yaffe , Ben Maman , Meinard Müller , Amit H. Bermano

This study introduces a text-conditioned approach to generating drumbeats with Latent Diffusion Models (LDMs). It uses informative conditioning text extracted from training data filenames. By pretraining a text and drumbeat encoder through…

Sound · Computer Science 2024-08-07 Pushkar Jajoria , James McDermott

Recent advances in audio-text large language models (LLMs) have opened new possibilities for music understanding and generation. However, existing benchmarks are limited in scope, often relying on simplified tasks or multi-choice…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Yinghao Ma , Siyou Li , Juntao Yu , Emmanouil Benetos , Akira Maezawa
‹ Prev 1 3 4 5 6 7 10 Next ›