English
Related papers

Related papers: JAMMIN-GPT: Text-based Improvisation using LLMs in…

200 papers

Electronic music artists and sound designers have unique workflow practices that necessitate specialized approaches for developing music information retrieval and creativity support tools. Furthermore, electronic music instruments, such as…

Sound · Computer Science 2022-10-28 Olga Vechtomova , Gaurav Sahu

AI-empowered music processing is a diverse field that encompasses dozens of tasks, ranging from generation tasks (e.g., timbre synthesis) to comprehension tasks (e.g., music classification). For developers and amateurs, it is very difficult…

Computation and Language · Computer Science 2023-10-26 Dingyao Yu , Kaitao Song , Peiling Lu , Tianyu He , Xu Tan , Wei Ye , Shikun Zhang , Jiang Bian

We introduce Generative Lecture, a concept that makes existing lecture videos interactive through generative AI and AI clone instructors. By leveraging interactive avatars powered by HeyGen, ElevenLabs, and GPT-5, we embed an AI instructor…

Human-Computer Interaction · Computer Science 2025-12-30 Hye-Young Jo , Ada Yi Zhao , Xiaoan Liu , Ryo Suzuki

Encoding legislative text in a formal representation is an important prerequisite to different tasks in the field of AI & Law. For example, rule-based expert systems focused on legislation can support laypeople in understanding how…

Computation and Language · Computer Science 2023-11-10 Samyar Janatian , Hannes Westermann , Jinzhe Tan , Jaromir Savelka , Karim Benyekhlef

We explore the automatic generation of interactive, scenario-based lessons designed to train novice human tutors who teach middle school mathematics online. Employing prompt engineering through a Retrieval-Augmented Generation approach with…

Recent advances in generative artificial intelligence (AI) have created models capable of high-quality musical content generation. However, little consideration is given to how to use these models for real-time or cooperative jamming…

Human-Computer Interaction · Computer Science 2025-03-03 Alexander Scarlatos , Yusong Wu , Ian Simon , Adam Roberts , Tim Cooijmans , Natasha Jaques , Cassie Tarakajian , Cheng-Zhi Anna Huang

Automatic generation of graphical layouts is crucial for many real-world applications, including designing posters, flyers, advertisements, and graphical user interfaces. Given the incredible ability of Large language models (LLMs) in both…

Computation and Language · Computer Science 2024-10-18 Jian Chen , Ruiyi Zhang , Yufan Zhou , Jennifer Healey , Jiuxiang Gu , Zhiqiang Xu , Changyou Chen

To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task,…

Computation and Language · Computer Science 2024-07-15 Jinglong Gao , Xiao Ding , Yiming Cui , Jianbai Zhao , Hepeng Wang , Ting Liu , Bing Qin

Music-to-dance generation aims to synthesize human dance motion conditioned on musical input. Despite recent progress, significant challenges remain due to the semantic gap between music and dance motion, as music offers only abstract cues,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Qing Wang , Xiaohang Yang , Yilan Dong , Naveen Raj Govindaraj , Gregory Slabaugh , Shanxin Yuan

While the recent developments in large language models (LLMs) have successfully enabled generative recommenders with natural language interactions, their recommendation behavior is limited, leaving other simpler yet crucial components such…

Information Retrieval · Computer Science 2025-10-09 Seungheon Doh , Keunwoo Choi , Juhan Nam

Mobile applications have become an essential part of our daily lives, making ensuring their quality an important activity. Graphical User Interface (GUI) testing is a quality assurance method that has frequently been used for mobile apps.…

Software Engineering · Computer Science 2025-09-11 Chenhui Cui , Tao Li , Junjie Wang , Chunyang Chen , Dave Towey , Rubing Huang

The field of music generation using Large Language Models (LLMs) is evolving rapidly, yet existing music notation systems, such as MIDI, ABC Notation, and MusicXML, remain too complex for effective fine-tuning of LLMs. These formats are…

This paper explores the idea of utilising Long Short-Term Memory neural networks (LSTMNN) for the generation of musical sequences in ABC notation. The proposed approach takes ABC notations from the Nottingham dataset and encodes it to be…

Sound · Computer Science 2021-06-10 Vaishali Ingale , Anush Mohan , Divit Adlakha , Krishan Kumar , Mohit Gupta

Programming assistants powered by large language models (LLMs) have become widely available, with conversational assistants like ChatGPT particularly accessible to novice programmers. However, varied tool capabilities and inconsistent…

Human-Computer Interaction · Computer Science 2026-03-02 Gabrielle O'Brien , Antonio Pedro Santos Alves , Sebastian Baltes , Grischa Liebel , Mircea Lungu , Marcos Kalinowski

Text generation in image-based platforms, particularly for music-related content, requires precise control over text styles and the incorporation of emotional expression. However, existing approaches often need help to control the…

Computation and Language · Computer Science 2023-10-16 Yuelyu Ji , Yuheng Song , Wei Wang , Ruoyi Xu , Zhongqian Xie , Huiyun Liu

Large language models (LLMs) effectively generate fluent text when the target output follows natural language patterns. However, structured prediction tasks confine the output format to a limited ontology, causing even very large models to…

Computation and Language · Computer Science 2023-10-19 Derek Chen , Celine Lee , Yunan Lu , Domenic Rosati , Zhou Yu

This paper introduces Aptly, a platform designed to democratize mobile app development, particularly for young learners. Aptly integrates a Large Language Model (LLM) with App Inventor, enabling users to create apps using their natural…

Human-Computer Interaction · Computer Science 2025-06-17 Evan W. Patton , David Y. J. Kim , Ashley Granquist , Robin Liu , Arianna Scott , Jennet Zamanova , Harold Abelson

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

In this paper, we introduce Story2MIDI, a sequence-to-sequence Transformer-based model for generating emotion-aligned music from a given piece of text. To develop this model, we construct the Story2MIDI dataset by merging existing datasets…

Although the automatic identification of the optimal fingering for the performance of melodies on fretted string instruments has already been addressed (at least partially) in the literature, the specific case regarding lead electric guitar…

Artificial Intelligence · Computer Science 2024-07-15 Pierluigi Bontempi , Daniele Manerba , Alexandre D'Hooge , Sergio Canazza