English
Related papers

Related papers: Joint Feature and Output Distillation for Low-comp…

200 papers

It is a practical research topic how to deal with multi-device audio inputs by a single acoustic scene classification system with efficient design. In this work, we propose Residual Normalization, a novel feature normalization method that…

Sound · Computer Science 2021-11-15 Byeonggeun Kim , Seunghan Yang , Jangho Kim , Simyung Chang

Cued Speech (CS) is a visual communication system for the deaf or hearing impaired people. It combines lip movements with hand cues to obtain a complete phonetic repertoire. Current deep learning based methods on automatic CS recognition…

Multimedia · Computer Science 2021-06-28 Jianrong Wang , Ziyue Tang , Xuewei Li , Mei Yu , Qiang Fang , Li Liu

In this technical report, we present a joint effort of four groups, namely GT, USTC, Tencent, and UKE, to tackle Task 1 - Acoustic Scene Classification (ASC) in the DCASE 2020 Challenge. Task 1 comprises two different sub-tasks: (i) Task 1a…

This paper presents the Low-Complexity Acoustic Scene Classification with Device Information Task of the DCASE 2025 Challenge, along with its baseline system. Continuing the focus on low-complexity models, data efficiency, and device…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-08 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Gerhard Widmer

Acoustic scene classification (ASC) is one of the most popular problems in the field of machine listening. The objective of this problem is to classify an audio clip into one of the predefined scenes using only the audio data. This problem…

This study proposes a knowledge distillation algorithm based on large language models and feature alignment, aiming to effectively transfer the knowledge of large pre-trained models into lightweight student models, thereby reducing…

Computation and Language · Computer Science 2024-12-30 Shuo Wang , Chihang Wang , Jia Gao , Zhen Qi , Hongye Zheng , Xiaoxuan Liao

Acoustic scene recordings are often collected from a diverse range of cities. Most existing acoustic scene classification (ASC) approaches focus on identifying common acoustic scene patterns across cities to enhance generalization. However,…

Sound · Computer Science 2025-06-16 Yiqiang Cai , Yizhou Tan , Shengchen Li , Xi Shao , Mark D. Plumbley

This article describes the Data-Efficient Low-Complexity Acoustic Scene Classification Task in the DCASE 2024 Challenge and the corresponding baseline system. The task setup is a continuation of previous editions (2022 and 2023), which…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-19 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Khaled Koutini , Gerhard Widmer

This paper presents the details of Task 1A Acoustic Scene Classification in the DCASE 2021 Challenge. The task targeted development of low-complexity solutions with good generalization properties. The provided baseline system is based on a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Irene Martín-Morató , Toni Heittola , Annamaria Mesaros , Tuomas Virtanen

In this paper, we propose a simple yet effective contrastive knowledge distillation framework that achieves sample-wise logit alignment while preserving semantic consistency. Conventional knowledge distillation approaches exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Wencheng Zhu , Xin Zhou , Pengfei Zhu , Yu Wang , Qinghua Hu

Recently, audio-visual scene classification (AVSC) has attracted increasing attention from multidisciplinary communities. Previous studies tended to adopt a pipeline training strategy, which uses well-trained visual and acoustic encoders to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Chengxin Chen , Meng Wang , Pengyuan Zhang

To improve device robustness, a highly desirable key feature of a competitive data-driven acoustic scene classification (ASC) system, a novel two-stage system based on fully convolutional neural networks (CNNs) is proposed. Our two-stage…

This paper presents a low-complexity framework for acoustic scene classification (ASC). Most of the frameworks designed for ASC use convolutional neural networks (CNNs) due to their learning ability and improved performance compared to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Arshdeep Singh , Mark D. Plumbley

Knowledge distillation has emerged as a powerful technique for model compression, enabling the transfer of knowledge from large teacher networks to compact student models. However, traditional knowledge distillation methods treat all…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aakash Gore , Anoushka Dey , Aryan Mishra

Acoustic scene classification identifies an input segment into one of the pre-defined classes using spectral information. The spectral information of acoustic scenes may not be mutually exclusive due to common acoustic properties across…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-18 Hee-Soo Heo , Jee-weon Jung , Hye-jin Shim , Ha-Jin Yu

In this paper, we propose a method for incremental learning of two distinct tasks over time: acoustic scene classification (ASC) and audio tagging (AT). We use a simple convolutional neural network (CNN) model as an incremental learner to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-25 Manjunath Mulimani , Annamaria Mesaros

Acoustic scene classification (ASC) suffers from device-induced domain shift, especially when labels are limited. Prior work focuses on curriculum-based training schedules that structure data presentation by ordering or reweighting training…

Sound · Computer Science 2026-02-02 Peihong Zhang , Yuxuan Liu , Rui Sang , Zhixin Li , Yiqiang Cai , Yizhou Tan , Shengchen Li

In the acoustic scene classification (ASC) task, an acoustic scene consists of diverse sounds and is inferred by identifying combinations of distinct attributes among them. This study aims to extract and cluster these attributes effectively…

Sound · Computer Science 2022-07-01 Won-Gook Choi , Joon-Hyuk Chang , Jae-Mo Yang , Han-Gil Moon

Resource-constrained perception systems such as edge computing and vision-for-robotics require vision models to be both accurate and lightweight in computation and memory usage. While knowledge distillation is a proven strategy to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shengcao Cao , Mengtian Li , James Hays , Deva Ramanan , Yi-Xiong Wang , Liang-Yan Gui

This paper addresses the challenges of high computational cost and slow inference in deploying large language models. It proposes a distillation strategy guided by multiple teacher models. The method constructs several teacher models and…

Computation and Language · Computer Science 2025-07-22 Xiandong Meng , Yan Wu , Yexin Tian , Xin Hu , Tianze Kang , Junliang Du