English
Related papers

Related papers: Towards Reliable Real-time Opera Tracking: Combini…

200 papers

Real-time music alignment, also known as score following, is a fundamental MIR task with a long history and is essential for many interactive applications. Despite its importance, there has not been a unified open framework for comparing…

Sound · Computer Science 2025-10-14 Jiyun Park , Carlos Cancino-Chacón , Suhit Chiruthapudi , Juhan Nam

In this paper, we design a system in order to perform the real-time beat tracking for an audio signal. We use Onset Strength Signal (OSS) to detect the onsets and estimate the tempos. Then, we form Cumulative Beat Strength Signal (CBSS) by…

Sound · Computer Science 2017-10-31 Ali Mottaghi , Kayhan Behdin , Ashkan Esmaeili , Mohammadreza Heydari , Farokh Marvasti

We introduce ITTO, a challenging new benchmark suite for evaluating and diagnosing the capabilities and limitations of point tracking methods. Our videos are sourced from existing datasets and egocentric real-world recordings, with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Ilona Demler , Saumya Chauhan , Georgia Gkioxari

Music can be represented in multiple forms, such as in the audio form as a recording of a performance, in the symbolic form as a computer readable score, or in the image form as a scan of the sheet music. Music synchronisation provides a…

Sound · Computer Science 2022-06-02 Ruchit Agrawal

Modern keyboards allow a musician to play multiple instruments at the same time by assigning zones -- fixed pitch ranges of the keyboard -- to different instruments. In this paper, we aim to further extend this idea and examine the…

Sound · Computer Science 2021-10-22 Hao-Wen Dong , Chris Donahue , Taylor Berg-Kirkpatrick , Julian McAuley

With the proliferation of video platforms on the internet, recording musical performances by mobile devices has become commonplace. However, these recordings often suffer from degradation such as noise and reverberation, which negatively…

Sound · Computer Science 2023-08-25 Yunkee Chae , Junghyun Koo , Sungho Lee , Kyogu Lee

Large music content libraries often comprise multiple versions of a piece of music. To establish a link between different versions, automatic music alignment methods map each position in one version to a corresponding position in another…

Sound · Computer Science 2016-10-11 Siying Wang , Sebastian Ewert , Simon Dixon

Expressive singing voice correction is an appealing but challenging problem. A robust time-warping algorithm which synchronizes two singing recordings can provide a promising solution. We thereby propose to address the problem by canonical…

Audio and Speech Processing · Electrical Eng. & Systems 2017-11-27 Yin-Jyun Luo , Ming-Tso Chen , Tai-Shih Chi , Li Su

We propose a method for the problem of real time chord accompaniment of improvised music. Our implementation can learn an underlying structure of the musical performance and predict next chord. The system uses Hidden Markov Model to find…

Human-Computer Interaction · Computer Science 2012-06-28 Panagiotis Tigas

This paper resumes the results of a research conducted in a music production situation Therefore, it is more a final lab report, a prospective methodology then a scientific experience. The methodology we are presenting was developed as an…

Sound · Computer Science 2015-11-24 Mikhail Malt , Marta Gentilucci

Dynamic time warping (DTW) is a well-known algorithm for time series elastic dissimilarity measure. Its ability to deal with non-linear time distortions makes it helpful in variety of data mining tasks. Such a task is also anomaly detection…

Machine Learning · Computer Science 2023-10-05 Matej Kloska , Gabriela Grmanova , Viera Rozinajova

Writing concurrent programs is highly error-prone due to the nondeterminism in interprocess communication. The most reliable indicators of errors in concurrency are data races, which are accesses to a shared resource that can be executed…

Programming Languages · Computer Science 2019-11-06 Andreas Pavlogiannis

Prior approaches to lead instrument detection primarily analyze mixture audio, limited to coarse classifications and lacking generalization ability. This paper presents a novel approach to lead instrument detection in multitrack music audio…

Sound · Computer Science 2025-03-06 Longshen Ou , Yu Takahashi , Ye Wang

The ability to localize and track acoustic events is a fundamental prerequisite for equipping machines with the ability to be aware of and engage with humans in their surrounding environment. However, in realistic scenarios, audio signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-22 Christine Evers , Heinrich Loellmann , Heinrich Mellmann , Alexander Schmidt , Hendrik Barfuss , Patrick Naylor , Walter Kellermann

This paper addresses learning end-to-end models for time series data that include a temporal alignment step via dynamic time warping (DTW). Existing approaches to differentiable DTW either differentiate through a fixed warping path or apply…

Machine Learning · Computer Science 2023-03-21 Ming Xu , Sourav Garg , Michael Milford , Stephen Gould

Soft dynamic time warping (SDTW) is a differentiable loss function that allows for training neural networks from weakly aligned data. Typically, SDTW is used to iteratively compute and refine soft alignments that compensate for temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-11 Johannes Zeitler , Simon Deniffel , Michael Krause , Meinard Müller

Many tasks in music information retrieval (MIR) involve weakly aligned data, where exact temporal correspondences are unknown. The connectionist temporal classification (CTC) loss is a standard technique to learn feature representations…

Sound · Computer Science 2023-04-12 Michael Krause , Christof Weiß , Meinard Müller

This work considers the problem of detecting signals from multiple sequentially observed data streams, where only one stream can be observed at every time instant. The goal is to detect signals as quickly as possible while controlling the…

Methodology · Statistics 2026-04-07 Yiming Xing , Georgios Fellouris

Runtime verification has gained popularity as a lightweight approach for increasing assurance in systems under scrutiny. Performing runtime checks enables dynamic monitoring and alerts for unexpected behavior, thereby improving reliability…

Software Engineering · Computer Science 2026-03-19 Vladyslav Mikytiv , Bernardo Toninho , Carla Ferreira

Automatic musical accompaniment is where a human musician is accompanied by a computer musician. The computer musician is able to produce musical accompaniment that relates musically to the human performance. The accompaniment should follow…

Sound · Computer Science 2018-03-28 Anyi Rao , Francis Lau