English
Related papers

Related papers: Data-Driven Visual Reflection on Music Instrument …

200 papers

The imitation of percussive instruments via the human voice is a natural way for us to communicate rhythmic ideas and, for this reason, it attracts the interest of music makers. Specifically, the automatic mapping of these vocal imitations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Alejandro Delgado , SKoT McDonald , Ning Xu , Mark Sandler

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applications. This paper reviews this field, categorizing music…

Sound · Computer Science 2026-03-09 Shuyu Li , Shulei Ji , Zihao Wang , Songruoyao Wu , Jiaxing Yu , Kejun Zhang

Mood recognition is an important problem in music informatics and has key applications in music discovery and recommendation. These applications have become even more relevant with the rise of music streaming. Our work investigates the…

Sound · Computer Science 2021-10-12 Rajnish Kumar , Manjeet Dahiya

We present an authentic learning task designed for computing students, centred on the creation of data-art visualisations from chosen datasets for a public exhibition. This exhibition was showcased in the cinema foyer for two weeks in June,…

Human-Computer Interaction · Computer Science 2024-08-15 Jonathan C. Roberts

In this demo we show a novel approach to score following. Instead of relying on some symbolic representation, we are using a multi-modal convolutional neural network to match the incoming audio stream directly to sheet music images. This…

Sound · Computer Science 2016-12-16 Matthias Dorfer , Andreas Arzt , Sebastian Böck , Amaury Durand , Gerhard Widmer

Older adults living with multiple chronic conditions (MCC) can considerably benefit from collecting and reflecting on their health data. Many older adults collect their health data using various approaches, such as digital tools or…

Human-Computer Interaction · Computer Science 2026-04-22 Shri Harini Ramesh , Foroozan Daneshzand , Matteo Sotelo , Mahsa Sinaei , Fateme Rajabiyazdi

Visualization plays a relevant role for discovering patterns in big sets of data. In fact, the most common way to help a human with a pattern interpretation is through a graphic. In 2D/3D virtual environments for procedural training the…

Human-Computer Interaction · Computer Science 2025-12-24 Diego Riofrío-Luzcando , Jaime RamÍrez , Cristian Moral , Angélica de Antonio , Marta Berrocal-Lobo

Within a Music Information Retrieval perspective, the goal of the study presented here is to investigate the impact on sound features of the musician's affective intention, namely when trying to intentionally convey emotional contents via…

Information Retrieval · Computer Science 2016-05-19 Alberto Introini , Giorgio Presti , Giuseppe Boccignone

Existing methods for expressive music performance rendering rely on supervised learning over small labeled datasets, which limits scaling of both data volume and model size, despite the availability of vast unlabeled music, as in vision and…

Sound · Computer Science 2025-12-03 Hong-Jie You , Jie-Jing Shao , Xiao-Wen Yang , Lin-Han Jia , Lan-Zhe Guo , Yu-Feng Li

Emerging technologies in the domain of extended reality offer rich, new possibilities for the study and practice of joint music performance. Apart from the technological challenges, bringing music players together in extended reality raises…

Human-Computer Interaction · Computer Science 2023-08-31 Bavo Van Kerrebroeck , Kristel Crombé , Stéphanie Wilain , Marc Leman , Pieter-Jan Maes

Time series is a collection of data instances that are ordered according to a time stamp. Stock prices, temperature, etc are examples of time series data in real life. Time series data are used for forecasting sales, predicting trends.…

Human-Computer Interaction · Computer Science 2024-04-25 Sathya Krishnan Suresh , Shunmugapriya P

In this paper, we introduce our research challenges for creating new musical instruments using everyday-life media with intimate interfaces, such as the self-body, clothes, water and stuffed toys. Various sensor technologies including image…

Human-Computer Interaction · Computer Science 2020-10-06 Kenji Mase , Tomoko Yonezawa

Here we present guidelines that highlight the impact of haptic feedback upon the experiences of computer musicians using Digital Musical Instruments (DMIs). In this context, haptic feedback offers a tangible, bi-directional exchange between…

Human-Computer Interaction · Computer Science 2020-10-06 Gareth W. Young , Katie Crowley

With the improvement of living standards, user requirements of modern products are becoming increasingly more diversified and personalized. Traditional product design methods can no longer satisfy the market needs due to their strong…

Human-Computer Interaction · Computer Science 2021-09-24 Huafeng Quan , Shaobo Li , Changchang Zeng , Hongjing Wei , Jianjun Hu

Public-facing data visualizations can play a vital role in making complex information clear and engaging, thereby encouraging informed public discourse and participation. However, existing work offers limited insight into how practitioners…

Human-Computer Interaction · Computer Science 2026-05-29 Regina Schuster , Kathleen Gregory , Torsten Möller , Laura Koesten

Technology can facilitate self-learning for academic and leisure activities such as music learning. In general, learning to play an unknown musical song at sight on the electric piano or any other instrument can be quite a chore. In a…

Human-Computer Interaction · Computer Science 2020-04-29 Martin Haug , Paavo Camps , Tobias Umland , Jan-Niklas Voigt-Antons

A long-standing vision in computer science has been to evolve computing devices into proactive assistants that enhance our productivity, health and wellness, and many other facets of our lives. User digitization is crucial in achieving this…

Human-Computer Interaction · Computer Science 2024-03-04 Karan Ahuja

Generative models guided by text prompts are increasingly becoming more popular. However, no text-to-MIDI models currently exist due to the lack of a captioned MIDI dataset. This work aims to enable research that combines LLMs with symbolic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Jan Melechovsky , Abhinaba Roy , Dorien Herremans

User experience in data visualization is typically assessed through post-viewing self-reports, but these overlook the dynamic cognitive processes during interaction. This study explores the use of mind wandering -- a phenomenon where…

Human-Computer Interaction · Computer Science 2024-08-08 Anjana Arunkumar , Lace Padilla , Chris Bryan

Data-driven methods play an increasingly important role in discovering geometric, structural, and semantic relationships between 3D shapes in collections, and applying this analysis to support intelligent modeling, editing, and…

Graphics · Computer Science 2015-02-25 Kai Xu , Vladimir G. Kim , Qixing Huang , Evangelos Kalogerakis