English
Related papers

Related papers: Beat-Aligned Spectrogram-to-Sequence Generation of…

200 papers

Automatic music generation with artificial intelligence typically requires a large amount of data which is hard to obtain for many less common genres and musical instruments. To tackle this issue, we present ongoing work and preliminary…

Sound · Computer Science 2023-01-04 Li Zhang , Chris Callison-Burch

Structure aware graph generation aims to generate graphs that satisfy given topological properties. It has applications in domains such as drug discovery, social network modeling, and knowledge graph construction. Unlike existing methods…

Artificial Intelligence · Computer Science 2026-05-05 Nidhi Vakil , Hadi Amiri

The intersection between poetry and music provides an interesting case for computational creativity, yet remains relatively unexplored. This paper explores the integration of poetry and music through the lens of beat patterns, investigating…

Computation and Language · Computer Science 2025-02-06 Mohamad Elzohbi , Richard Zhao

Rhythm is a fundamental aspect of human behaviour, present from infancy and deeply embedded in cultural practices. Rhythm anticipation is a spontaneous cognitive process that typically occurs before the onset of actual beats. While most…

Neurons and Cognition · Quantitative Biology 2025-03-18 Zhongju Yuan , Geraint Wiggins , Dick Botteldooren

We consider the task of data-to-text generation, which aims to create textual output from non-linguistic input. We focus on generating long-form text, i.e., documents with multiple paragraphs, and propose a neural model enhanced with a…

Computation and Language · Computer Science 2022-03-01 Ratish Puduppully , Yao Fu , Mirella Lapata

We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) conditioned asynchronously on realizations of a second, correlated process (the control process). We…

Sound · Computer Science 2024-07-29 John Thickstun , David Hall , Chris Donahue , Percy Liang

Game designs often center on the game mechanics---rules governing the logical evolution of the game. We seek to develop an intelligent system that generates computer games. As first steps towards this goal we present a composable and…

Artificial Intelligence · Computer Science 2019-08-06 Alexander Zook , Mark O. Riedl

Tokenizing music to fit the general framework of language models is a compelling challenge, especially considering the diverse symbolic structures in which music can be represented (e.g., sequences, grids, and graphs). To date, most…

Sound · Computer Science 2026-05-29 Lekai Qian , Haoyu Gu , Jingwei Zhao , Ziyu Wang

Music is inherently made up of complex structures, and representing them as graphs helps to capture multiple levels of relationships. While music generation has been explored using various deep generation techniques, research on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Wen Qing Lim , Jinhua Liang , Huan Zhang

Time-series forecasting is crucial for numerous real-world applications including weather prediction and financial market modeling. While temporal-domain methods remain prevalent, frequency-domain approaches can effectively capture…

Machine Learning · Computer Science 2025-08-05 Zhixuan Li , Naipeng Chen , Seonghwa Choi , Sanghoon Lee , Weisi Lin

Designing pacing for video games presents a unique set of challenges. Due to their interactivity, non-linearity, and narrative nature, many aspects must be coordinated and considered simultaneously. In addition, games are often developed in…

Human-Computer Interaction · Computer Science 2024-08-28 Julian Geheeb , Daniel Dyrda , Sebastian Geheeb

Conditional music generation offers significant advantages in terms of user convenience and control, presenting great potential in AI-generated content research. However, building conditional generative systems for multitrack popular songs…

Sound · Computer Science 2025-10-27 Jing Luo , Xinyu Yang , Dorien Herremans

Pre-training on graph neural networks (GNNs) aims to learn transferable knowledge for downstream tasks with unlabeled data, and it has recently become an active research area. The success of graph pre-training models is often attributed to…

Machine Learning · Computer Science 2023-11-22 Jiarong Xu , Renhong Huang , Xin Jiang , Yuxuan Cao , Carl Yang , Chunping Wang , Yang Yang

This paper presents an architecture for generating music for video games based on the Transformer deep learning model. Our motivation is to be able to customize the generation according to the taste of the player, who can select a corpus of…

Rap generation, which aims to produce lyrics and corresponding singing beats, needs to model both rhymes and rhythms. Previous works for rap generation focused on rhyming lyrics but ignored rhythmic beats, which are important for rap…

Sound · Computer Science 2021-07-06 Lanqing Xue , Kaitao Song , Duocai Wu , Xu Tan , Nevin L. Zhang , Tao Qin , Wei-Qiang Zhang , Tie-Yan Liu

Deep learning algorithms are increasingly developed for learning to compose music in the form of MIDI files. However, whether such algorithms work well for composing guitar tabs, which are quite different from MIDIs, remain relatively…

Sound · Computer Science 2020-08-05 Yu-Hua Chen , Yu-Hsiang Huang , Wen-Yi Hsiao , Yi-Hsuan Yang

Self-supervised pre-training models have been used successfully in several machine learning domains. However, only a tiny amount of work is related to music. In our work, we treat a spectrogram of music as a series of patches and design a…

Sound · Computer Science 2022-10-31 Leyi Zhao , Yi Li

We present a (semi)-algorithm to compute winning strategies for parametric timed games. Previous algorithms only synthesized constraints on the clock parameters for which the game is winning. A new definition of (winning) strategies is…

Formal Languages and Automata Theory · Computer Science 2025-06-19 Mikael Bisgaard Dahlsen-Jensen , Baptiste Fievet , Laure Petrucci , Jaco van de Pol

Recently, multi-instrument music generation has become a hot topic. Different from single-instrument generation, multi-instrument generation needs to consider inter-track harmony besides intra-track coherence. This is usually achieved by…

Sound · Computer Science 2023-05-29 Xipin Wei , Junhui Chen , Zirui Zheng , Li Guo , Lantian Li , Dong Wang

Advancements in generative models have sparked significant interest in generating images while adhering to specific structural guidelines. Scene graph to image generation is one such task of generating images which are consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rameshwar Mishra , A V Subramanyam