English
Related papers

Related papers: Piano Fingering with Reinforcement Learning

200 papers

In this work we present a new approach for the task of predicting fingerings for piano music. While prior neural approaches have often treated this as a sequence tagging problem with independent predictions, we put forward a checklist…

Machine Learning · Computer Science 2022-09-14 Nikita Srivatsan , Taylor Berg-Kirkpatrick

The virtuoso plays the piano with passion, poetry and extraordinary technical ability. As Liszt said (a virtuoso)must call up scent and blossom, and breathe the breath of life. The strongest robots that can play a piano are based on a…

Robotics · Computer Science 2022-08-08 Huazhe Xu , Yuping Luo , Shaoxiong Wang , Trevor Darrell , Roberto Calandra

Piano fingering -- knowing which finger to use to play each note in a musical piece, is a hard and important skill to master when learning to play the piano. While some sheet music is available with expert-annotated fingering information,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Amit Moryossef , Yanai Elazar , Yoav Goldberg

We present a data-driven approach for physics-based, muscle-driven dexterous control that enables musculoskeletal hands to perform precise piano playing for novel pieces of music outside the reference dataset. Our approach combines…

Graphics · Computer Science 2026-04-28 Pei Xu , Yufei Ye , Shuchun Sun , Yu Ding , Elizabeth Schumann , C. Karen Liu

Replicating human-like dexterity in robot hands represents one of the largest open problems in robotics. Reinforcement learning is a promising approach that has achieved impressive progress in the last few years; however, the class of…

A music glove instrument equipped with force sensitive, flex and IMU sensors is trained on an electric piano to learn note sequences based on a time series of sensor inputs. Once trained, the glove is used on any surface to generate the…

Human-Computer Interaction · Computer Science 2020-01-28 Joseph Bakarji

Piano playing requires agile, precise, and coordinated hand control that stretches the limits of dexterity. Hand motion models with the sophistication to accurately recreate piano playing have a wide range of applications in character…

Graphics · Computer Science 2024-10-10 Ruocheng Wang , Pei Xu , Haochen Shi , Elizabeth Schumann , C. Karen Liu

It has been a long-standing research goal to endow robot hands with human-level dexterity. Bi-manual robot piano playing constitutes a task that combines challenges from dynamic tasks, such as generating fast while precise motions, with…

A typical part of learning to play the piano is the progression through a series of practice units that focus on individual dimensions of the skill, such as hand coordination, correct posture, or correct timing. Ideally, a focus on a…

Human-Computer Interaction · Computer Science 2021-06-25 Alexandra Moringen , Sören Rüttgers , Luisa Zintgraf , Jason Friedman , Helge Ritter

Endowing robot hands with human-level dexterity has been a long-standing goal in robotics. Bimanual robotic piano playing represents a particularly challenging task: it is high-dimensional, contact-rich, and requires fast, precise control.…

In piano playing, different ways of touch lead to different tones. The effects of changing forces on keys are presented by changing interaction between hammer and string. The thesis focuses on several important variables in hammer-string…

General Physics · Physics 2010-11-23 Lai-Mei Nie

The task of learning the piano has been a centuries-old challenge for novices, experts and technologists. Several innovations have been introduced to support proper posture, movement, and motivation, while sight-reading and improvisation…

Human-Computer Interaction · Computer Science 2022-11-14 Jordan Aiko Deja

For around 300 years, humans have been learning to play the modern piano either with a teacher or on their own. In recent years teaching and learning have been enhanced using augmented technologies that support novices. Other technologies…

Human-Computer Interaction · Computer Science 2022-04-15 Jordan Aiko Deja , Sven Mayer , Klen Čopič Pucihar , Matjaž Kljun

Humans have been developing and playing musical instruments for millennia. With technological advancements, instruments were becoming ever more sophisticated. In recent decades computer-supported innovations have also been introduced in…

Human-Computer Interaction · Computer Science 2022-11-04 Jordan Aiko Deja , Sven Mayer , Klen Čopič Pucihar , Matjaž Kljun

Recently, artificial intelligence techniques for education have been received increasing attentions, while it still remains an open problem to design the effective music instrument instructing systems. Although key presses can be directly…

Sound · Computer Science 2025-02-26 Qijun Gan , Song Wang , Shengtao Wu , Jianke Zhu

Towards the grand challenge of achieving human-level manipulation in robots, playing piano is a compelling testbed that requires strategic, precise, and flowing movements. Over the years, several works demonstrated hand-designed controllers…

Robotics · Computer Science 2026-04-14 Yves-Simon Zeulner , Simon Crämer , Sandeep Selvaraj , Roberto Calandra

Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natural dynamics but struggle with positional accuracy. Piano…

Artificial Intelligence · Computer Science 2026-04-14 Joonhyung Bae , Kirak Kim , Hyeyoon Cho , Sein Lee , Yoon-Seok Choi , Hyeon Hur , Gyubin Lee , Akira Maezawa , Satoshi Obata , Jonghwa Park , Jaebum Park , Juhan Nam

The existing piano fingering labeling statistical models usually consider the constraints among the fingers and the correlation between fingering and notes, and rarely include the relationship among the notes directly. The limited learned…

Sound · Computer Science 2021-08-23 Haoyue Zhao , Xin Guan , Qiang Li

Algorithms for automatic piano transcription have improved dramatically in recent years due to new datasets and modeling techniques. Recent developments have focused primarily on adapting new neural network architectures, such as the…

Sound · Computer Science 2024-02-05 Drew Edwards , Simon Dixon , Emmanouil Benetos , Akira Maezawa , Yuta Kusaka

A typical process of learning to play a piece on a piano consists of a progression through a series of practice units that focus on individual dimensions of the skill, the so-called practice modes. Practice modes in learning to play music…

Machine Learning · Computer Science 2024-06-10 Alexandra Moringen , Elad Vromen , Helge Ritter , Jason Friedman
‹ Prev 1 2 3 10 Next ›