English
Related papers

Related papers: A Preliminary Model for the Design of Music Visual…

200 papers

We present and discuss the results of a qualitative analysis of visualization images to derive an image-based typology of visualizations. For each image, we seek to identify its main focus or the essential stimuli. As a result, we derived…

Human-Computer Interaction · Computer Science 2025-01-08 Jian Chen , Petra Isenberg , Robert S. Laramee , Tobias Isenberg , Michael Sedlmair , Torsten Moeller , Rui Li

We contribute a first design space on visualizations in motion and the design of a pilot study we plan to run in the fall. Visualizations can be useful in contexts where either the observation is in motion or the whole visualization is…

Human-Computer Interaction · Computer Science 2024-09-12 Lijie Yao , Anastasia Bezerianos , Petra Isenberg

We propose a design space for data melodification, where standard visualization idioms and fundamental data characteristics map to rhetorical devices of music for a more affective experience of data. Traditional data sonification transforms…

Human-Computer Interaction · Computer Science 2025-10-02 Ke Er Amy Zhang , David Grellscheid , Laura Garrison

Visuals can enhance our experience of music, owing to the way they can amplify the emotions and messages conveyed within it. However, creating music visualization is a complex, time-consuming, and resource-intensive process. We introduce…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Tao Long , Nathan Raw , Lydia Chilton

Visualizing the insights of the invisible music is able to bring listeners an enjoyable and immersive listening experience, and therefore has attracted much attention in the field of information visualization. Over the past decades, various…

Human-Computer Interaction · Computer Science 2023-08-29 Chuer Chen , Nan Cao , Jiani Hou , Yi Guo , Yulei Zhang , Yang Shi

In this paper, we introduce Foley Music, a system that can synthesize plausible music for a silent video clip about people playing musical instruments. We first identify two key intermediate representations for a successful video to music…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Chuang Gan , Deng Huang , Peihao Chen , Joshua B. Tenenbaum , Antonio Torralba

For the tasks of automatic music emotion recognition, genre recognition, music recommendation it is helpful to be able to extract mode from any section of a musical piece as a perceived amount of major or minor mode (majorness) inside that…

Sound · Computer Science 2018-06-28 Anna Aljanaki , Gerhard Widmer

Annotations are a critical component of visualizations, helping viewers interpret the visual representation and highlighting critical data insights. Despite their significant role, we lack an understanding of how annotations can be…

Human-Computer Interaction · Computer Science 2024-08-09 Rhys Sorenson-Graff , S. Sandra Bae , Jordan Wirfs-Brock

Since the 60s, musicology has been increasingly impacted by computational tools in various ways, from systematic analysis approaches to modeling of creativity. This article presents a comprehensive assessment of the current state of…

Digital Libraries · Computer Science 2025-07-22 Jorge Junior Morgado Vega , Sachin Sharma , Federico Simonetta

We introduce a design study process model for medical visualization based on the analysis of existing medical visualization and visual analysis works, and our own interdisciplinary research experience. With a literature review of related…

Human-Computer Interaction · Computer Science 2025-12-25 Mengjie Fan , Liang Zhou

Information Visualization techniques are built on a context with many factors related to both vision and cognition, making it difficult to draw a clear picture of how data visually turns into comprehension. In the intent of promoting a…

Graphics · Computer Science 2016-05-16 Jose Rodrigues-Jr , Luciana Zaina , Maria Oliveira , Bruno Brandoli , Agma Traina

In this paper, we describe a research agenda for deriving design principles directly from data. We argue that it is time to go beyond manually curated and applied visualization design guidelines. We propose learning models of visualization…

Human-Computer Interaction · Computer Science 2018-08-17 Bahador Saket , Dominik Moritz , Halden Lin , Victor Dibia , Cagatay Demiralp , Jeffrey Heer

Music Information Retrieval (MIR) has seen a recent surge in deep learning-based approaches, which often involve encoding symbolic music (i.e., music represented in terms of discrete note events) in an image-like or language like fashion.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-12 Huan Zhang , Emmanouil Karystinaios , Simon Dixon , Gerhard Widmer , Carlos Eduardo Cancino-Chacón

A representation technique that allows encoding music in a way that contains musical meaning would improve the results of any model trained for computer music tasks like generation of melodies and harmonies of better quality. The field of…

Computation and Language · Computer Science 2020-05-20 Sebastian Garcia-Valencia

Similar to colorization in computer vision, instrument separation is to assign instrument labels (e.g. piano, guitar...) to notes from unlabeled mixtures which contain only performance information. To address the problem, we adopt diffusion…

Sound · Computer Science 2022-09-08 Sangjun Han , Hyeongrae Ihm , DaeHan Ahn , Woohyung Lim

Advancements in the digital technologies have enabled researchers to develop a variety of Computational Music applications. Such applications are required to capture, process, and generate data related to music. Therefore, it is important…

Sound · Computer Science 2021-04-27 SeyyedPooya HekmatiAthar , Mohd Anwar

This paper presents an analytical taxonomy that can suitably describe, rather than simply classify, techniques for data presentation. Unlike previous works, we do not consider particular aspects of visualization techniques, but their…

Music semantics is embodied, in the sense that meaning is biologically mediated by and grounded in the human body and brain. This embodied cognition perspective also explains why music structures modulate kinetic and somatosensory…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Francisco Afonso Raposo , David Martins de Matos , Ricardo Ribeiro

Music Emotion Recognition involves the automatic identification of emotional elements within music tracks, and it has garnered significant attention due to its broad applicability in the field of Music Information Retrieval. It can also be…

Sound · Computer Science 2023-08-29 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

This work was developed aiming to employ Statistical techniques to the field of Music Emotion Recognition, a well-recognized area within the Signal Processing world, but hardly explored from the statistical point of view. Here, we opened…

Machine Learning · Statistics 2021-07-13 Nathalie Deziderio , Hugo Tremonte de Carvalho