English
Related papers

Related papers: An Audio-Visual Dataset and Deep Learning Framewor…

200 papers

This paper introduces the acoustic scene classification task of DCASE 2018 Challenge and the TUT Urban Acoustic Scenes 2018 dataset provided for the task, and evaluates the performance of a baseline system in the task. As in previous years…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-12 Annamaria Mesaros , Toni Heittola , Tuomas Virtanen

In this paper, we present a deep learning based multimodal system for classifying daily life videos. To train the system, we propose a two-phase training strategy. In the first training phase (Phase I), we extract the audio and visual…

Sound · Computer Science 2023-05-03 Lam Pham , Trang Le , Cam Le , Dat Ngo , Weissenfeld Axel , Alexander Schindler

Neural networks trained on datasets such as ImageNet have led to major advances in visual object classification. One obstacle that prevents networks from reasoning more deeply about complex scenes and situations, and from integrating visual…

Deepfakes are increasingly realistic and easy to produce, raising concerns about the reliability of human judgments in misinformation settings. We study audiovisual deepfake detection by measuring how consistently crowd workers distinguish…

Information Retrieval · Computer Science 2026-05-07 Michael Soprano , Andrea Cioci , Stefano Mizzaro

The rapid advances in audio analysis underscore its vast potential for humancomputer interaction, environmental monitoring, and public safety; yet, existing audioonly datasets often lack spatial context. To address this gap, we present two…

Sound · Computer Science 2025-12-10 Shuaihang Yuan , Congcong Wen , Muhammad Shafique , Anthony Tzes , Yi Fang

We are interested in developing an automated system for detection of organized movements in human crowds. Computer vision algorithms can extract information from videos of crowded scenes and automatically detect and track groups of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alexandre Matov

In this paper, we present a comprehensive analysis of Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording from its acoustic signature. In particular, we firstly propose an inception-based and low…

Sound · Computer Science 2022-10-18 Lam Pham , Dusan Salovic , Anahid Jalali , Alexander Schindler , Khoa Tran , Canh Vu , Phu X. Nguyen

Multiple-object tracking and behavior analysis have been the essential parts of surveillance video analysis for public security and urban management. With billions of surveillance video captured all over the world, multiple-object tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Guojun Yin , Bin Liu , Huihui Zhu , Tao Gong , Nenghai Yu

In this paper, we propose an accurate and real-time anomaly detection and localization in crowded scenes, and two descriptors for representing anomalous behavior in video are proposed. We consider a video as being a set of cubic patches.…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Mohammad Sabokrou , Mahmood Fathy , Mojtaba Hosseini

Acoustic scene classification (ASC) and sound event detection (SED) are fundamental tasks in environmental sound analysis, and many methods based on deep learning have been proposed. Considering that information on acoustic scenes and sound…

Sound · Computer Science 2022-04-06 Keisuke Imoto , Yuka Komatsu , Shunsuke Tsubaki , Tatsuya Komatsu

Acoustic scene classification (ASC) is a problem related to the field of machine listening whose objective is to classify/tag an audio clip in a predefined label describing a scene location (e. g. park, airport, etc.). Many state-of-the-art…

Sound · Computer Science 2020-06-29 Javier Naranjo-Alcazar , Sergi Perez-Castanos , Pedro Zuccarello , Maximo Cobos

We present an iVector based Acoustic Scene Classification (ASC) system suited for real life settings where active foreground speech can be present. In the proposed system, each recording is represented by a fixed-length iVector that models…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Siyuan Song , Brecht Desplanques , Celest De Moor , Kris Demuynck , Nilesh Madhu

Estimating scene flow in RGB-D videos is attracting much interest of the computer vision researchers, due to its potential applications in robotics. The state-of-the-art techniques for scene flow estimation, typically rely on the knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Ravi Kumar Thakur , Snehasis Mukherjee

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) training a student…

Sound · Computer Science 2023-05-17 Lam Pham , Dat Ngo , Cam Le , Anahid Jalali , Alexander Schindler

Previous works on scene classification are mainly based on audio or visual signals, while humans perceive the environmental scenes through multiple senses. Recent studies on audio-visual scene classification separately fine-tune the…

Sound · Computer Science 2022-08-04 Yuanbo Hou , Bo Kang , Dick Botteldooren

State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. They typically use the same filters over the whole image or over large image patches. Only then do they estimate local scale to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Weizhe Liu , Mathieu Salzmann , Pascal Fua

Scene labeling is a challenging classification problem where each input image requires a pixel-level prediction map. Recently, deep-learning-based methods have shown their effectiveness on solving this problem. However, we argue that the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-12 Zhe Wang , Hongsheng Li , Wanli Ouyang , Xiaogang Wang

In this work we present the modular Crowd Simulation Evaluation through Composition framework (CSEC) which provides a quantitative comparison between different pedestrian and crowd simulation approaches. Evaluation is made based on the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Rob Dupre , Vasileios Argyriou

Acoustic scene classification (ASC) has been approached in the last years using deep learning techniques such as convolutional neural networks or recurrent neural networks. Many state-of-the-art solutions are based on image classification…

In the past, Acoustic Scene Classification systems have been based on hand crafting audio features that are input to a classifier. Nowadays, the common trend is to adopt data driven techniques, e.g., deep learning, where audio…

Sound · Computer Science 2018-06-29 Eduardo Fonseca , Rong Gong , Xavier Serra