中文
相关论文

相关论文: Utilizing Domain Knowledge in End-to-End Audio Pro…

200 篇论文

A novel end-to-end binaural sound localisation approach is proposed which estimates the azimuth of a sound source directly from the waveform. Instead of employing hand-crafted features commonly employed for binaural sound localisation, such…

声音 · 计算机科学 2019-04-04 Paolo Vecchiotti , Ning Ma , Stefano Squartini , Guy J. Brown

Deep Learning methods employ multiple processing layers to learn hierarchial representations of data. They have already been deployed in a humongous number of applications and have produced state-of-the-art results. Recently with the growth…

计算与语言 · 计算机科学 2018-08-15 Sarvesh Patil

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

音频与语音处理 · 电气工程与系统科学 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

The introduction of large-scale audio datasets, such as AudioSet, paved the way for Transformers to conquer the audio domain and replace CNNs as the state-of-the-art neural network architecture for many tasks. Audio Spectrogram Transformers…

声音 · 计算机科学 2023-10-25 Florian Schmid , Khaled Koutini , Gerhard Widmer

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

计算与语言 · 计算机科学 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

Convolutional neural network (CNN) architectures have originated and revolutionized machine learning for images. In order to take advantage of CNNs in predictive modeling with audio data, standard FFT-based signal processing methods are…

声音 · 计算机科学 2025-02-20 Pavol Harar , Roswitha Bammer , Anna Breger , Monika Dörfler , Zdenek Smekal

Audio Spectrogram Transformer models rule the field of Audio Tagging, outrunning previously dominating Convolutional Neural Networks (CNNs). Their superiority is based on the ability to scale up and exploit large-scale datasets such as…

声音 · 计算机科学 2023-06-26 Florian Schmid , Khaled Koutini , Gerhard Widmer

Deep neural networks can learn complex and abstract representations, that are progressively obtained by combining simpler ones. A recent trend in speech and speaker recognition consists in discovering these representations starting from raw…

音频与语音处理 · 电气工程与系统科学 2019-02-26 Mirco Ravanelli , Yoshua Bengio

Music, speech, and acoustic scene sound are often handled separately in the audio domain because of their different signal characteristics. However, as the image domain grows rapidly by versatile image classification models, it is necessary…

声音 · 计算机科学 2017-12-05 Jongpil Lee , Taejun Kim , Jiyoung Park , Juhan Nam

We describe in this report our audio scene recognition system submitted to the DCASE 2016 challenge. Firstly, given the label set of the scenes, a label tree is automatically constructed. This category taxonomy is then used in the feature…

神经与进化计算 · 计算机科学 2016-08-16 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

State-of-the-art speech recognition systems rely on fixed, hand-crafted features such as mel-filterbanks to preprocess the waveform before the training pipeline. In this paper, we study end-to-end systems trained directly from the raw…

计算与语言 · 计算机科学 2018-06-22 Neil Zeghidour , Nicolas Usunier , Gabriel Synnaeve , Ronan Collobert , Emmanuel Dupoux

A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained…

信号处理 · 电气工程与系统科学 2022-06-16 Alessandro Gallo , Manh Duong Phung

We investigate sequence machine learning techniques on raw radio signal time-series data. By applying deep recurrent neural networks we learn to discriminate between several application layer traffic types on top of a constant envelope…

机器学习 · 计算机科学 2016-10-04 Timothy J. O'Shea , Seth Hitefield , Johnathan Corgan

Environmental sound classification (ESC) is a challenging problem due to the complexity of sounds. The ESC performance is heavily dependent on the effectiveness of representative features extracted from the environmental sounds. However,…

声音 · 计算机科学 2019-07-05 Zhichao Zhang , Shugong Xu , Tianhao Qiao , Shunqing Zhang , Shan Cao

In many real-life tasks of application of supervised learning approaches, all the training data are not available at the same time. The examples are lifelong image classification or recognition of environmental objects during interaction of…

机器学习 · 计算机科学 2020-06-15 Miltiadis Poursanidis , Jenny Benois-Pineau , Akka Zemmari , Boris Mansenca , Aymar de Rugy

Speech emotion recognition (SER) classifies human emotions in speech with a computer model. Recently, performance in SER has steadily increased as deep learning techniques have adapted. However, unlike many domains that use speech data,…

声音 · 计算机科学 2024-09-09 Byunggun Kim , Younghun Kwon

Recent advances in deep learning show that end-to-end speech to text translation model is a promising approach to direct the speech translation field. In this work, we provide an overview of different end-to-end architectures, as well as…

计算与语言 · 计算机科学 2019-11-21 Parnia Bahar , Tobias Bieschke , Hermann Ney

Deep audio classification, traditionally cast as training a deep neural network on top of mel-filterbanks in a supervised fashion, has recently benefited from two independent lines of work. The first one explores "learnable frontends",…

声音 · 计算机科学 2022-03-30 Sarthak Yadav , Neil Zeghidour

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

信号处理 · 电气工程与系统科学 2022-11-24 Zongyan Yao , Xilin Liu

Environmental sound classification (ESC) is an important and challenging problem. In contrast to speech, sound events have noise-like nature and may be produced by a wide variety of sources. In this paper, we propose to use a novel deep…

声音 · 计算机科学 2018-08-28 Zhichao Zhang , Shugong Xu , Shan Cao , Shunqing Zhang