中文
相关论文

相关论文: Fretting-Transformer: Encoder-Decoder Model for MI…

200 篇论文

Automated audio captioning aims to use natural language to describe the content of audio data. This paper presents an audio captioning system with an encoder-decoder architecture, where the decoder predicts words based on audio features…

音频与语音处理 · 电气工程与系统科学 2021-08-06 Xinhao Mei , Qiushi Huang , Xubo Liu , Gengyun Chen , Jingqian Wu , Yusong Wu , Jinzheng Zhao , Shengchen Li , Tom Ko , H Lilian Tang , Xi Shao , Mark D. Plumbley , Wenwu Wang

This paper describes a streaming audio-to-MIDI piano transcription approach that aims to sequentially translate a music signal into a sequence of note onset and offset events. The sequence-to-sequence nature of this task may call for the…

声音 · 计算机科学 2025-03-04 Weixing Wei , Jiahao Zhao , Yulun Wu , Kazuyoshi Yoshii

We employ imitation learning to train a neural transition-based string transducer for morphological tasks such as inflection generation and lemmatization. Previous approaches to training this type of model either rely on an external…

计算与语言 · 计算机科学 2018-09-03 Peter Makarov , Simon Clematide

With the development of diffusion models, text-guided image style transfer has demonstrated high-quality controllable synthesis results. However, the utilization of text for diverse music style transfer poses significant challenges,…

声音 · 计算机科学 2024-02-22 Sifei Li , Yuxin Zhang , Fan Tang , Chongyang Ma , Weiming dong , Changsheng Xu

We propose Beat Transformer, a novel Transformer encoder architecture for joint beat and downbeat tracking. Different from previous models that track beats solely based on the spectrogram of an audio mixture, our model deals with demixed…

声音 · 计算机科学 2022-09-16 Jingwei Zhao , Gus Xia , Ye Wang

There have been numerous attempts to represent raw data as numerical vectors that effectively capture semantic and contextual information. However, in the field of symbolic music, previous works have attempted to validate their music…

声音 · 计算机科学 2023-06-08 Sangjun Han , Hyeongrae Ihm , Woohyung Lim

Due to its effectiveness and performance, the Transformer translation model has attracted wide attention, most recently in terms of probing-based approaches. Previous work focuses on using or probing source linguistic features in the…

计算与语言 · 计算机科学 2021-04-21 Hongfei Xu , Josef van Genabith , Qiuhui Liu , Deyi Xiong

Pre-trained encoder-decoder transformer architectures have become increasingly popular recently with the advent of T5 models. T5 has also become more favorable over other architectures like BERT due to the amount of data that it is…

计算与语言 · 计算机科学 2022-10-25 Frederick Liu , Terry Huang , Shihang Lyu , Siamak Shakeri , Hongkun Yu , Jing Li

This paper explores a variety of models for frame-based music transcription, with an emphasis on the methods needed to reach state-of-the-art on human recordings. The translation-invariant network discussed in this paper, which combines a…

机器学习 · 统计学 2017-11-15 John Thickstun , Zaid Harchaoui , Dean Foster , Sham M. Kakade

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

声音 · 计算机科学 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard

Text-to-music (TTM) generation, which converts textual descriptions into audio, opens up innovative avenues for multimedia creation. Achieving high quality and diversity in this process demands extensive, high-quality data, which are often…

声音 · 计算机科学 2025-06-18 Chang Li , Ruoyu Wang , Lijuan Liu , Jun Du , Yixuan Sun , Zilu Guo , Zhenrong Zhang , Yuan Jiang , Jianqing Gao , Feng Ma

Transformer-based NLP models are powerful but have high computational costs that limit deployment. Finetuned encoder-decoder models are popular in specialized domains and can outperform larger more generalized decoder-only models, such as…

计算与语言 · 计算机科学 2024-11-19 Bo-Ru Lu , Nikita Haduong , Chien-Yu Lin , Hao Cheng , Noah A. Smith , Mari Ostendorf

To apply neural sequence models such as the Transformers to music generation tasks, one has to represent a piece of music by a sequence of tokens drawn from a finite set of pre-defined vocabulary. Such a vocabulary usually involves tokens…

声音 · 计算机科学 2021-01-08 Wen-Yi Hsiao , Jen-Yu Liu , Yin-Cheng Yeh , Yi-Hsuan Yang

Transformer-based language models often achieve strong results on mathematical reasoning benchmarks while remaining fragile on basic numerical understanding and arithmetic operations. A central limitation is that numbers are processed as…

计算与语言 · 计算机科学 2026-01-15 Andreea Dutulescu , Stefan Ruseti , Mihai Dascalu

Music Information Retrieval (MIR) research is increasingly leveraging representation learning to obtain more compact, powerful music audio representations for various downstream MIR tasks. However, current representation evaluation methods…

声音 · 计算机科学 2023-12-13 Christos Plachouras , Pablo Alonso-Jiménez , Dmitry Bogdanov

Music emotion recognition is a key task in symbolic music understanding (SMER). Recent approaches have shown promising results by fine-tuning large-scale pre-trained models (e.g., MIDIBERT, a benchmark in symbolic music understanding) to…

声音 · 计算机科学 2025-12-23 Haiying Xia , Zhongyi Huang , Yumei Tan , Shuxiang Song

Automatic piano transcription models are typically evaluated using simple frame- or note-wise information retrieval (IR) metrics. Such benchmark metrics do not provide insights into the transcription quality of specific musical aspects such…

声音 · 计算机科学 2024-10-10 Patricia Hu , Lukáš Samuel Marták , Carlos Cancino-Chacón , Gerhard Widmer

Recent work in the field of symbolic music generation has shown value in using a tokenization based on the GuitarPro format, a symbolic representation supporting guitar expressive attributes, as an input and output representation. We extend…

声音 · 计算机科学 2023-07-12 Jackson Loth , Pedro Sarmento , CJ Carr , Zack Zukowski , Mathieu Barthet

Automatic note-level transcription is considered one of the most challenging tasks in music information retrieval. The specific case of flamenco singing transcription poses a particular challenge due to its complex melodic progressions,…

声音 · 计算机科学 2016-11-17 Nadine Kroher , Emilia Gómez

Pitch and meter are two fundamental music features for symbolic music generation tasks, where researchers usually choose different encoding methods depending on specific goals. However, the advantages and drawbacks of different encoding…

声音 · 计算机科学 2023-02-01 Yuqiang Li , Shengchen Li , George Fazekas