English
Related papers

Related papers: AccoMontage: Accompaniment Arrangement via Phrase …

200 papers

Composition is a cornerstone of visual aesthetics, influencing the appeal of an image. While its principles operate independently of specific content, in practice, composition is often coupled with semantics. As a result, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Kai Zou , Zhiwei Zhao , Bin Liu , Nenghai Yu

Generative systems of musical accompaniments are rapidly growing, yet there are no standardized metrics to evaluate how well generations align with the conditional audio prompt. We introduce a distribution-based measure called…

Sound · Computer Science 2025-04-09 Maarten Grachten , Javier Nistal

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

Machine-learning techniques have been recently used with spectacular results to generate artefacts such as music or text. However, these techniques are still unable to capture and generate artefacts that are convincingly structured. In this…

Artificial Intelligence · Computer Science 2017-03-03 Pierre Roy , Alexandre Papadopoulos , François Pachet

Diffusion models have shown promising results in cross-modal generation tasks involving audio and music, such as text-to-sound and text-to-music generation. These text-controlled music generation models typically focus on generating music…

Sound · Computer Science 2024-10-24 Tornike Karchkhadze , Mohammad Rasool Izadi , Ke Chen , Gerard Assayag , Shlomo Dubnov

Singing is one of the most cherished forms of human entertainment. However, creating a beautiful song requires an accompaniment that complements the vocals and aligns well with the song instruments and genre. With advancements in deep…

Sound · Computer Science 2024-11-14 Quoc-Huy Trinh , Minh-Van Nguyen , Trong-Hieu Nguyen Mau , Khoa Tran , Thanh Do

This paper proposes a novel Transformer-based model for music score infilling, to generate a music passage that fills in the gap between given past and future contexts. While existing infilling approaches can generate a passage that…

Sound · Computer Science 2022-10-07 Chih-Pin Tan , Alvin W. Y. Su , Yi-Hsuan Yang

Generating rare compositional concepts in text-to-image synthesis remains a challenge for diffusion models, particularly for attributes that are uncommon in the training data. While recent approaches, such as R2F, address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Kwanyoung Lee , Hyunwoo Oh , SeungJu Cha , Sungho Koh , Dong-Jin Kim

Melody harmonization, which involves generating a chord progression that complements a user-provided melody, continues to pose a significant challenge. A chord progression must not only be in harmony with the melody, but also interdependent…

Sound · Computer Science 2023-12-05 Shangda Wu , Yue Yang , Zhaowen Wang , Xiaobing Li , Maosong Sun

We introduce ACE-Step, a novel open-source foundation model for music generation that overcomes key limitations of existing approaches and achieves state-of-the-art performance through a holistic architectural design. Current methods face…

Sound · Computer Science 2025-06-03 Junmin Gong , Sean Zhao , Sen Wang , Shengyuan Xu , Joe Guo

Songwriting is often driven by multimodal inspirations, such as imagery, narratives, or existing music, yet songwriters remain unsupported by current music AI systems in incorporating these multimodal inputs into their creative processes.…

Human-Computer Interaction · Computer Science 2025-02-17 Yewon Kim , Sung-Ju Lee , Chris Donahue

Generating long sequences with structural coherence remains a fundamental challenge for autoregressive models across sequential generation tasks. In symbolic music generation, this challenge is particularly pronounced, as existing methods…

Sound · Computer Science 2026-04-08 Boyu Cao , Lekai Qian , Dehan Li , Haoyu Gu , Mingda Xu , Qi Liu

Popular music is often composed of an accompaniment and a lead component, the latter typically consisting of vocals. Filtering such mixtures to extract one or both components has many applications, such as automatic karaoke and remixing.…

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang

Cover song generation stands out as a popular way of music making in the music-creative community. In this study, we introduce Piano Cover Generation (PiCoGen), a two-stage approach for automatic cover song generation that transcribes the…

Sound · Computer Science 2024-07-31 Chih-Pin Tan , Shuen-Huei Guan , Yi-Hsuan Yang

Music has the power to evoke intense emotional experiences and regulate the mood of an individual. With the advent of online streaming services, research in music recommendation services has seen tremendous progress. Modern methods…

Multimedia · Computer Science 2021-10-05 Kunal Vaswani , Yudhik Agrawal , Vinoo Alluri

We report an approach to obtaining complex networks with diverse topology, here called syntonets, taking into account the consonances and dissonances between notes as defined by scale temperaments. Though the fundamental frequency is…

Sound · Computer Science 2020-12-09 Luciano da Fontoura Costa , Henrique Ferraz de Arruda

Recently, some single-step systems without onset detection have shown their effectiveness in automatic musical tempo estimation. Following the success of these systems, in this paper we propose a Multi-scale Grouped Attention Network to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-06 Xiaoheng Sun , Qiqi He , Yongwei Gao , Wei Li

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

As language models (LMs) become more capable, it is increasingly important to align them with human preferences. However, the dominant paradigm for training Preference Models (PMs) for that purpose suffers from fundamental limitations, such…

Computation and Language · Computer Science 2024-03-18 Dongyoung Go , Tomasz Korbak , Germán Kruszewski , Jos Rozen , Marc Dymetman