中文
相关论文

相关论文: Multi-Source Transformer Architectures for Audiovi…

200 篇论文

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a Transformer-based architecture. We particularly focus on the scene context provided by the visual information, to ground the ASR. We extract…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Georgios Paraskevopoulos , Srinivas Parthasarathy , Aparna Khare , Shiva Sundaram

In this paper we present a Deep Neural Network architecture for the task of acoustic scene classification which harnesses information from increasing temporal resolutions of Mel-Spectrogram segments. This architecture is composed of…

声音 · 计算机科学 2018-11-13 Alexander Schindler , Thomas Lidy , Andreas Rauber

In this report, we presents low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed frameworks can be separated into four main steps: Front-end spectrogram extraction, online data augmentation, back-end…

声音 · 计算机科学 2022-06-14 Lam Pham , Dat Ngo , Anahid Jalali , Alexander Schindler

This work is an improved system that we submitted to task 1 of DCASE2023 challenge. We propose a method of low-complexity acoustic scene classification by a parallel attention-convolution network which consists of four modules, including…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Yanxiong Li , Jiaxin Tan , Guoqing Chen , Jialong Li , Yongjie Si , Qianhua He

This paper studies deep network architectures to address the problem of video classification. A multi-stream framework is proposed to fully utilize the rich multimodal information in videos. Specifically, we first train three Convolutional…

计算机视觉与模式识别 · 计算机科学 2015-11-12 Zuxuan Wu , Yu-Gang Jiang , Xi Wang , Hao Ye , Xiangyang Xue , Jun Wang

Deep neural networks (DNNs) have recently achieved great success in a multitude of classification tasks. Ensembles of DNNs have been shown to improve the performance. In this paper, we explore the recent state-of-the-art DNNs used for image…

声音 · 计算机科学 2017-10-04 Venkatesh Duppada , Sushant Hiray

Acoustic scene classification is an automatic listening problem that aims to assign an audio recording to a pre-defined scene based on its audio data. Over the years (and in past editions of the DCASE) this problem has often been solved…

This paper describes an acoustic scene classification method which achieved the 4th ranking result in the IEEE AASP challenge of Detection and Classification of Acoustic Scenes and Events 2016. In order to accomplish the ensuing task,…

声音 · 计算机科学 2018-07-16 Sangwook Park , Seongkyu Mun , Younglo Lee , David K. Han , Hanseok Ko

In this paper, we present a deep neural network (DNN)-based acoustic scene classification framework. Two hierarchical learning methods are proposed to improve the DNN baseline performance by incorporating the hierarchical taxonomy…

声音 · 计算机科学 2016-08-16 Yong Xu , Qiang Huang , Wenwu Wang , Mark D. Plumbley

In this paper we present our work on Task 1 Acoustic Scene Classi- fication and Task 3 Sound Event Detection in Real Life Recordings. Among our experiments we have low-level and high-level features, classifier optimization and other…

Recently, convolutional neural networks (CNN) have achieved the state-of-the-art performance in acoustic scene classification (ASC) task. The audio data is often transformed into two-dimensional spectrogram representations, which are then…

声音 · 计算机科学 2020-07-09 Helin Wang , Yuexian Zou , Dading Chong

In this work, we propose an approach that features deep feature embedding learning and hierarchical classification with triplet loss function for Acoustic Scene Classification (ASC). In the one hand, a deep convolutional neural network is…

音频与语音处理 · 电气工程与系统科学 2020-02-13 Lam Pham , Ian McLoughlin , Huy Phan , Ramaswamy Palaniappan , Alfred Mertins

In this work for Capsule Vision Challenge 2024, we addressed the challenge of multiclass anomaly classification in video capsule Endoscopy (VCE)[1] with a variety of deep learning models, ranging from custom CNNs to advanced transformer…

图像与视频处理 · 电气工程与系统科学 2024-12-04 Dev Rishi Verma , Vibhor Saxena , Dhruv Sharma , Arpan Gupta

Large-scale pretraining of visual representations has led to state-of-the-art performance on a range of benchmark computer vision tasks, yet the benefits of these techniques at extreme scale in complex production systems has been relatively…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Josh Beal , Hao-Yu Wu , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

We present a work on low-complexity acoustic scene classification (ASC) with multiple devices, namely the subtask A of Task 1 of the DCASE2021 challenge. This subtask focuses on classifying audio samples of multiple devices with a…

音频与语音处理 · 电气工程与系统科学 2023-06-06 Yanxiong Li , Wenchang Cao , Wei Xie , Qisheng Huang , Wenfeng Pang , Qianhua He

In this paper, we presents a low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed framework can be separated into three main steps: Front-end spectrogram extraction, back-end classification, and late…

声音 · 计算机科学 2021-06-17 Lam Pham , Hieu Tang , Anahid Jalali , Alexander Schindler , Ross King

We describe in this report our audio scene recognition system submitted to the DCASE 2016 challenge. Firstly, given the label set of the scenes, a label tree is automatically constructed. This category taxonomy is then used in the feature…

神经与进化计算 · 计算机科学 2016-08-16 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

In this technical report, we present a joint effort of four groups, namely GT, USTC, Tencent, and UKE, to tackle Task 1 - Acoustic Scene Classification (ASC) in the DCASE 2020 Challenge. Task 1 comprises two different sub-tasks: (i) Task 1a…

Several methods have been proposed for classifying long textual documents using Transformers. However, there is a lack of consensus on a benchmark to enable a fair comparison among different approaches. In this paper, we provide a…

计算与语言 · 计算机科学 2022-03-23 Hyunji Hayley Park , Yogarshi Vyas , Kashif Shah

The Detection and Classification of Acoustic Scenes and Events (DCASE) consists of five audio classification and sound event detection tasks: 1) Acoustic scene classification, 2) General-purpose audio tagging of Freesound, 3) Bird audio…

声音 · 计算机科学 2019-12-10 Qiuqiang Kong , Turab Iqbal , Yong Xu , Wenwu Wang , Mark D. Plumbley