English
Related papers

Related papers: Machine Learning for a Music Glove Instrument

200 papers

Traditional surveillance systems rely on human attention, limiting their effectiveness. This study employs convolutional neural networks and transfer learning to develop a real-time computer vision system for automatic handgun detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Youssef Elmir

Automatic music transcription (AMT) is one of the most challenging tasks in the music information retrieval domain. It is the process of converting an audio recording of music into a symbolic representation containing information about the…

Sound · Computer Science 2023-05-02 Michał Leś , Michał Woźniak

Professional athletes increasingly use automated analysis of meta- and signal data to improve their training and game performance. As in other related human-to-human research fields, signal data, in particular, contain important…

Sound · Computer Science 2022-02-21 Lukas Stappen , Manuel Milling , Valentin Munst , Korakot Hoffmann , Bjorn W. Schuller

Audio-driven bimanual piano motion generation requires precise modeling of complex musical structures and dynamic cross-hand coordination. However, existing methods often rely on acoustic-only representations lacking symbolic priors, employ…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Xuan Wang , Kai Ruan , Jiayi Han , Kaiyue Zhou , Gaoang Wang

We introduce a real-time, human-in-the-loop gesture control framework that can dynamically adapt audio and music based on human movement by analyzing live video input. By creating a responsive connection between visual and auditory stimuli,…

Human-Computer Interaction · Computer Science 2025-04-29 Mahya Khazaei , Ali Bahrani , George Tzanetakis

Guitar tablatures enrich the structure of traditional music notation by assigning each note to a string and fret of a guitar in a particular tuning, indicating precisely where to play the note on the instrument. The problem of generating…

Sound · Computer Science 2024-08-12 Drew Edwards , Xavier Riley , Pedro Sarmento , Simon Dixon

Any data annotation for subjective tasks shows potential variations between individuals. This is particularly true for annotations of emotional responses to musical stimuli. While older approaches to music emotion recognition systems…

Sound · Computer Science 2025-01-22 Karn N. Watcharasupat , Yiwei Ding , T. Aleksandra Ma , Pavan Seshadri , Alexander Lerch

The recent success of raw audio waveform synthesis models like WaveNet motivates a new approach for music synthesis, in which the entire process --- creating audio samples from a score and instrument information --- is modeled using…

Sound · Computer Science 2018-11-02 Jong Wook Kim , Rachel Bittner , Aparna Kumar , Juan Pablo Bello

The use of wearable robots has been widely adopted in rehabilitation training for patients with hand motor impairments. However, the uniqueness of patients' muscle loss is often overlooked. Leveraging reinforcement learning and a…

Robotics · Computer Science 2025-05-15 Shirui Lyu , Vittorio Caggiano , Matteo Leonetti , Dario Farina , Letizia Gionfrida

This paper explores the development of a control and sensor strategy for an industrial wearable wrist exoskeleton by classifying and predicting workers' actions. The study evaluates the correlation between exerted force and effort…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Roberto F. Pitzalis , Nicholas Cartocci , Christian Di Natali , Darwin G. Caldwell , Giovanni Berselli , Jesús Ortiz

Emotions are fundamental to the creation and perception of music performances. However, achieving human-like expression and emotion through machine learning models for performance rendering remains a challenging task. In this work, we…

Sound · Computer Science 2025-11-06 Ilya Borovik , Dmitrii Gavrilev , Vladimir Viro

We are concerned with a novel sensor-based gesture input/instruction technology which enables human beings to interact with computers conveniently. The human being wears an emitter on the finger or holds a digital pen that generates a time…

Classical Physics · Physics 2017-05-23 Yukun Guo , Jingzhi Li , Hongyu Liu , Xianchao Wang

Electromyography (EMG) data has been extensively adopted as an intuitive interface for instructing human-robot collaboration. A major challenge of the real-time detection of human grasp intent is the identification of dynamic EMG from hand…

Robotics · Computer Science 2024-02-29 Mo Han , Mehrshad Zandigohar , Sezen Yagmur Gunay , Gunar Schirner , Deniz Erdogmus

State-of-the-art robotic hand prosthetics generate finger and wrist movement through pattern recognition (PR) algorithms using features of forearm electromyogram (EMG) signals, but re- quires extensive training and is prone to poor…

Applications · Statistics 2018-05-09 Md Nazmul Islam , Jonathan Stallings , Ana-Maria Staicu , Dustin Crouch , Lizhi Pan , He Huang

The task of learning the piano has been a centuries-old challenge for novices, experts and technologists. Several innovations have been introduced to support proper posture, movement, and motivation, while sight-reading and improvisation…

Human-Computer Interaction · Computer Science 2022-11-14 Jordan Aiko Deja

The automated recognition of music genres from audio information is a challenging problem, as genre labels are subjective and noisy. Artist labels are less subjective and less noisy, while certain artists may relate more strongly to certain…

Machine Learning · Computer Science 2019-01-15 Jaehun Kim , Minz Won , Xavier Serra , Cynthia C. S. Liem

Sensor gloves are popular input devices for a large variety of applications including health monitoring, control of music instruments, learning sign language, dexterous computer interfaces, and tele-operating robot hands. Many commercial…

This study aims to enhance the quality of music generation using Transformers by incorporating meta-information. While Transformer-based approaches are effective at capturing long-term dependencies in musical compositions, the music they…

Sound · Computer Science 2026-05-21 Shinnosuke Taksuka , Hideo Mukai

Handovers frequently occur in our social environments, making it imperative for a collaborative robotic system to master the skill of handover. In this work, we aim to investigate the relationship between the grip force variation for a…

Robotics · Computer Science 2023-03-29 Parag Khanna , Mårten Björkman , Christian Smith

With the increasing demand for human-computer interaction (HCI), flexible wearable gloves have emerged as a promising solution in virtual reality, medical rehabilitation, and industrial automation. However, the current technology still has…

Robotics · Computer Science 2025-07-04 Huazhi Dong , Chunpeng Wang , Mingyuan Jiang , Francesco Giorgio-Serchi , Yunjie Yang