English
Related papers

Related papers: Stringesthesia: Dynamically Shifting Musical Agenc…

200 papers

Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive form of Brain-Computer Interface (BCI). It is used for the imaging of brain hemodynamics and has gained popularity due to the certain pros it poses over other similar…

Machine Learning · Computer Science 2021-01-19 Talha Siddique , Md Shaad Mahmud

This paper provides an analysis of a mixed-media experimental musical work that explores the integration of human musical interaction with a newly developed interface for the violin, manipulated by an improvising violinist, interactive…

Human-Computer Interaction · Computer Science 2024-07-25 Anna Savery , Richard Savery

Music is an expressive form of communication often used to convey emotion in scenarios where "words are not enough". Part of this information lies in the musical composition where well-defined language exists. However, a significant amount…

Sound · Computer Science 2017-08-14 Iman Malik , Carl Henrik Ek

Surgical simulation offers a promising addition to conventional surgical training. However, available simulation tools lack photorealism and rely on hardcoded behaviour. Denoising Diffusion Models are a promising alternative for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Ssharvien Kumar Sivakumar , Çağhan Köksal , Elsa Böhm , Felix Wagner , Adrian Gericke , Ghazal Ghazaei , Anirban Mukhopadhyay

Drawing inspiration from the notion of cognitive incongruence associated with Stroop's famous experiment, from musical principles, and from the observation that music consumption on an individual basis is becoming increasingly ubiquitous,…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-19 Ishwarya Ananthabhotla , Joseph A. Paradiso

Functional near-infrared spectroscopy (fNIRS) is a non-invasive technique for monitoring brain activity. To better understand the brain, researchers often use deep learning to address the classification challenges of fNIRS data. Our study…

Signal Processing · Electrical Eng. & Systems 2024-11-25 Zhihao Cao

Our study delves into the "Embodied Musicking Dataset," exploring the intertwined relationships and correlations between physiological and psychological dimensions during improvisational music performances. The primary objective is to…

Sound · Computer Science 2024-01-24 Yawen Zhang

The system presented here shows the feasibility of modeling the knowledge involved in a complex musical activity by integrating sub-symbolic and symbolic processes. This research focuses on the question of whether there is any advantage in…

Artificial Intelligence · Computer Science 2007-05-23 Claudia V. Goldman , Dan Gang , Jeffrey S. Rosenschein , Daniel Lehmann

Vibration signals have been increasingly utilized in various engineering fields for analysis and monitoring purposes, including structural health monitoring, fault diagnosis and damage detection, where vibration signals can provide valuable…

Signal Processing · Electrical Eng. & Systems 2023-07-25 Youzhi Liang , Wen Liang , Jianguo Jia

We present a real-time visualization system for Transcranial Magnetic Stimulation (TMS), a non-invasive neuromodulation technique for treating various brain disorders and mental health diseases. Our solution targets the current challenges…

Signal Processing · Electrical Eng. & Systems 2024-03-14 Loraine Franke , Tae Young Park , Jie Luo , Yogesh Rathi , Steve Pieper , Lipeng Ning , Daniel Haehn

Livestreaming has rapidly become a popular online pastime, with real-time interaction between streamer and viewer being a key motivating feature. However, viewers have traditionally had limited opportunity to directly influence the streamed…

Human-Computer Interaction · Computer Science 2025-04-15 Michael Yin , Robert Xiao

Abstract This project presents a system of neural networks to translate between images and melodies. Autoencoders compress the information in samples to abstract representation. A translation network learns a set of correspondences between…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Karl Wienand , Wolfgang M. Heckl

We here present work a generalized low-level technical framework aimed to provide musical biofeedback in post-stroke balance and gait rehabilitation, built by an iterative user-centered process. The framework comprises wireless wearable…

Human-Computer Interaction · Computer Science 2020-12-02 Prithvi Kantan , Erika G. Spaich , Sofia Dahl

Effective connectivity analysis provides an understanding of the functional organization of the brain by studying how activated regions influence one other. We propose a nonparametric Bayesian approach to model effective connectivity…

Applications · Statistics 2011-07-22 Sourabh Bhattacharya , Ranjan Maitra

People feel emotions when listening to music. However, emotions are not tangible objects that can be exploited in the music composition process as they are difficult to capture and quantify in algorithms. We present a novel musical…

Artificial Intelligence · Computer Science 2018-10-09 Eunjeong Stella Koh , Shahrokh Yadegari

Neuroimaging data allows researchers to model the relationship between multivariate patterns of brain activity and outcomes related to mental states and behaviors. However, the existence of outlying participants can potentially undermine…

Methodology · Statistics 2026-03-17 Dongliang Zhang , Masoud Asgharian , Martin A. Lindquist

Participatory art allows for the spectator to be a participant or a viewer able to engage actively with interactive art. Real-time technologies offer new ways to create participative artworks. We hereby investigate how to engage…

Graphics · Computer Science 2023-06-23 Jean-François Jégo , Margherita Bergamo Meneghini

Gesture-driven music generation is an emerging human-computer interaction paradigm for touch-free and expressive musical interaction. However, many existing approaches treat the task as isolated gesture classification or map gestures to…

Multimedia · Computer Science 2026-04-29 Rathinaraja Jeyaraj , Barathi Subramanian , Kapilya Gangadharan , Anand Paul

We present a new system for real-time visualisation of music performance, focused for the moment on a fugue played by a string quartet. The basic principle is to offer a visual guide to better understand music using strategies that should…

Sound · Computer Science 2020-06-19 Olivier Lartillot , Carlos Cancino-Chacón , Charles Brazier

Objective: The next generation prosthetic hand that moves and feels like a real hand requires a robust neural interconnection between the human minds and machines. Methods: Here we present a neuroprosthetic system to demonstrate that…