English
Related papers

Related papers: Multi-Source Transformer Architectures for Audiovi…

200 papers

Indoor scene recognition is a growing field with great potential for behaviour understanding, robot localization, and elderly monitoring, among others. In this study, we approach the task of scene recognition from a novel standpoint, using…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Andreea Glavan , Estefania Talavera

Deep convolutional neural networks have been widely used in scene classification of remotely sensed images. In this work, we propose a robust learning method for the task that is secure against partially incorrect categorization of images.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Jinyang Wang , Tao Wang , Min Gan , George Hadjichristofi

This thesis focuses on dealing with the task of acoustic scene classification (ASC), and then applied the techniques developed for ASC to a real-life application of detecting respiratory disease. To deal with ASC challenges, this thesis…

Sound · Computer Science 2021-07-21 Lam Pham

Environmental sound analysis is currently getting more and more attentions. In the domain, acoustic scene classification and acoustic event classification are two closely related tasks. In this letter, a two-stage method is proposed for the…

Sound · Computer Science 2021-03-31 Weiping Zheng , Dacan Jiang , Gansen Zhao

In this paper, we consider multi-sensor classification when there is a large number of unlabeled samples. The problem is formulated under the multi-view learning framework and a Consensus-based Multi-View Maximum Entropy Discrimination…

Information Theory · Computer Science 2016-11-17 Tianpei Xie , Nasser M. Nasrabadi , Alfred O. Hero

Various attention mechanisms are being widely applied to acoustic scene classification. However, we empirically found that the attention mechanism can excessively discard potentially valuable information, despite improving performance. We…

Machine Learning · Computer Science 2021-12-24 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Ha-Jin Yu

We present an iVector based Acoustic Scene Classification (ASC) system suited for real life settings where active foreground speech can be present. In the proposed system, each recording is represented by a fixed-length iVector that models…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Siyuan Song , Brecht Desplanques , Celest De Moor , Kris Demuynck , Nilesh Madhu

We present in this paper an efficient approach for acoustic scene classification by exploring the structure of class labels. Given a set of class labels, a category taxonomy is automatically learned by collectively optimizing a clustering…

Multimedia · Computer Science 2016-07-27 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

In this work, we compare the performance of three selected techniques in open set acoustic scenes classification (ASC). We test thresholding of the softmax output of a deep network classifier, which is the most popular technique nowadays…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Zuzanna Kwiatkowska , Beniamin Kalinowski , Michał Kośmider , Krzysztof Rykaczewski

Enhancing images in low-light scenes is a challenging but widely concerned task in the computer vision. The mainstream learning-based methods mainly acquire the enhanced model by learning the data distribution from the specific scenes,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Long Ma , Dian Jin , Nan An , Jinyuan Liu , Xin Fan , Risheng Liu

In a recent acoustic scene classification (ASC) research field, training and test device channel mismatch have become an issue for the real world implementation. To address the issue, this paper proposes a channel domain conversion using…

Sound · Computer Science 2018-12-06 Seongkyu Mun , Suwon Shon

Scene classification has established itself as a challenging research problem. Compared to images of individual objects, scene images could be much more semantically complex and abstract. Their difference mainly lies in the level of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ji Zhang , Jean-Paul Ainam , Li-hui Zhao , Wenai Song , Xin Wang

Spectrograms have been widely used in Convolutional Neural Networks based schemes for acoustic scene classification, such as the STFT spectrogram and the MFCC spectrogram, etc. They have different time-frequency characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Weiping Zheng , Zhenyao Mo , Xiaotao Xing , Gansen Zhao

Customer reviews play a crucial role in assessing customer satisfaction, gathering feedback, and driving improvements for businesses. Analyzing these reviews provides valuable insights into customer sentiments, including compliments,…

Computation and Language · Computer Science 2023-08-23 Anusuya Krishnan

Scene classification, aiming at classifying a scene image to one of the predefined scene categories by comprehending the entire image, is a longstanding, fundamental and challenging problem in computer vision. The rise of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Delu Zeng , Minyu Liao , Mohammad Tavakolian , Yulan Guo , Bolei Zhou , Dewen Hu , Matti Pietikäinen , Li Liu

With the rise of deep learning algorithms nowadays, scene image representation methods have achieved a significant performance boost in classification. However, the performance is still limited because the scene images are mostly complex…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Chiranjibi Sitaula , Tej Bahadur Shahi , Faezeh Marzbanrad , Jagannath Aryal

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Automated audio captioning aims to use natural language to describe the content of audio data. This paper presents an audio captioning system with an encoder-decoder architecture, where the decoder predicts words based on audio features…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-06 Xinhao Mei , Qiushi Huang , Xubo Liu , Gengyun Chen , Jingqian Wu , Yusong Wu , Jinzheng Zhao , Shengchen Li , Tom Ko , H Lilian Tang , Xi Shao , Mark D. Plumbley , Wenwu Wang

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

Learning visual feature representations for video analysis is a daunting task that requires a large amount of training samples and a proper generalization framework. Many of the current state of the art methods for video captioning and…

Machine Learning · Computer Science 2018-09-20 Oliver Nina , Washington Garcia , Scott Clouse , Alper Yilmaz