English
Related papers

Related papers: Deep Space Separable Distillation for Lightweight …

200 papers

Acoustic scene classification is an automatic listening problem that aims to assign an audio recording to a pre-defined scene based on its audio data. Over the years (and in past editions of the DCASE) this problem has often been solved…

Acoustic scene recordings are often collected from a diverse range of cities. Most existing acoustic scene classification (ASC) approaches focus on identifying common acoustic scene patterns across cities to enhance generalization. However,…

Sound · Computer Science 2025-06-16 Yiqiang Cai , Yizhou Tan , Shengchen Li , Xi Shao , Mark D. Plumbley

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Recent advances have been made in applying convolutional neural networks to achieve more precise prediction results for medical image segmentation problems. However, the success of existing methods has highly relied on huge computational…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Dian Qin , Jiajun Bu , Zhe Liu , Xin Shen , Sheng Zhou , Jingjun Gu , Zhijua Wang , Lei Wu , Huifen Dai

Sound event detection (SED) and Acoustic scene classification (ASC) are two widely researched audio tasks that constitute an important part of research on acoustic scene analysis. Considering shared information between sound events and…

Sound · Computer Science 2022-09-14 Daniel Aleksander Krause , Annamaria Mesaros

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

The real-time processing of time series signals is a critical issue for many real-life applications. The idea of real-time processing is especially important in audio domain as the human perception of sound is sensitive to any kind of…

Machine Learning · Computer Science 2023-02-10 Grzegorz Stefański , Krzysztof Arendt , Paweł Daniluk , Bartłomiej Jasik , Artur Szumaczuk

We propose a novel deep layer cascade (LC) method to improve the accuracy and speed of semantic segmentation. Unlike the conventional model cascade (MC) that is composed of multiple independent models, LC treats a single deep model as a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Xiaoxiao Li , Ziwei Liu , Ping Luo , Chen Change Loy , Xiaoou Tang

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in building well-performing low-complexity Acoustic Scene…

Sound · Computer Science 2025-03-17 Tobias Morocutti , Florian Schmid , Khaled Koutini , Gerhard Widmer

Transformer-based Super-Resolution (SR) methods have demonstrated superior performance compared to convolutional neural network (CNN)-based SR approaches due to their capability to capture long-range dependencies. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Karam Park , Jae Woong Soh , Nam Ik Cho

Acoustic scene classification (ASC) predominantly relies on supervised approaches. However, acquiring labeled data for training ASC models is often costly and time-consuming. Recently, self-supervised learning (SSL) has emerged as a…

Sound · Computer Science 2024-08-28 Yiqiang Cai , Shengchen Li , Xi Shao

In the acoustic scene classification (ASC) task, an acoustic scene consists of diverse sounds and is inferred by identifying combinations of distinct attributes among them. This study aims to extract and cluster these attributes effectively…

Sound · Computer Science 2022-07-01 Won-Gook Choi , Joon-Hyuk Chang , Jae-Mo Yang , Han-Gil Moon

The emerging task of fine-grained image classification in low-data regimes assumes the presence of low inter-class variance and large intra-class variation along with a highly limited amount of training samples per class. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Dmitry Demidov , Abduragim Shtanchaev , Mihail Mihaylov , Mohammad Almansoori

In this work, we compare the performance of three selected techniques in open set acoustic scenes classification (ASC). We test thresholding of the softmax output of a deep network classifier, which is the most popular technique nowadays…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Zuzanna Kwiatkowska , Beniamin Kalinowski , Michał Kośmider , Krzysztof Rykaczewski

This paper demonstrates a novel approach to improve face-recognition pose-invariance using semantic-segmentation features. The proposed Seg-Distilled-ID network jointly learns identification and semantic-segmentation tasks, where the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Ali Hassani , Zaid El Shair , Rafi Ud Duala Refat , Hafiz Malik

Semantic scene completion, also known as semantic occupancy prediction, can provide dense geometric and semantic information for autonomous vehicles, which attracts the increasing attention of both academia and industry. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Song Wang , Jiawei Yu , Wentong Li , Wenyu Liu , Xiaolu Liu , Junbo Chen , Jianke Zhu

Recent efforts have been made on acoustic scene classification in the audio signal processing community. In contrast, few studies have been conducted on acoustic scene clustering, which is a newly emerging problem. Acoustic scene clustering…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Yanxiong Li , Mingle Liu , Wucheng Wang , Yuhan Zhang , Qianhua He

Recent studies focus on developing efficient systems for acoustic scene classification (ASC) using convolutional neural networks (CNNs), which typically consist of consecutive kernels. This paper highlights the benefits of using separate…

Sound · Computer Science 2024-05-30 Yiqiang Cai , Peihong Zhang , Shengchen Li

Knowledge distillation has been widely used to compress existing deep learning models while preserving the performance on a wide range of applications. In the specific context of Automatic Speech Recognition (ASR), distillation from…

Machine Learning · Computer Science 2021-07-06 Yan Gao , Titouan Parcollet , Nicholas Lane

Deploying large and complex deep neural networks on resource-constrained edge devices poses significant challenges due to their computational demands and the complexities of non-convex optimization. Traditional compression methods such as…

Machine Learning · Computer Science 2024-10-10 Prateek Varshney , Mert Pilanci