English
Related papers

Related papers: Compression of Acoustic Event Detection Models wit…

200 papers

In this paper we consider the problem of recovering a low-rank Tucker approximation to a massive tensor based solely on structured random compressive measurements. Crucially, the proposed random measurement ensembles are both designed to be…

Information Theory · Computer Science 2023-08-29 Cullen Haselby , Mark A. Iwen , Deanna Needell , Elizaveta Rebrova , William Swartworth

Model compression by way of parameter pruning, quantization, or distillation has recently gained popularity as an approach for reducing the computational requirements of modern deep neural network models for NLP. Inspired by prior works…

Computation and Language · Computer Science 2023-10-10 Clara Na , Sanket Vaibhav Mehta , Emma Strubell

Deep convolutional neural networks contain tens of millions of parameters, making them impossible to work efficiently on embedded devices. We propose iterative approach of applying low-rank approximation to compress deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Maksym Kholiavchenko

We propose a method for specializing deep detectors and trackers to restricted settings. Our approach is designed with the following goals in mind: (a) Improving accuracy in restricted domains; (b) preventing overfitting to new domains and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Dotan Kaufman , Koby Bibas , Eran Borenstein , Michael Chertok , Tal Hassner

Robust strategies for Alzheimer's disease (AD) detection are important, given the high prevalence of AD. In this paper, we study the performance and generalizability of three approaches for AD detection from speech on the recent ADReSSo…

Computation and Language · Computer Science 2022-09-16 Aparna Balagopalan , Jekaterina Novikova

Sound event detection is a challenging task, especially for scenes with multiple simultaneous events. While event classification methods tend to be fairly accurate, event localization presents additional challenges, especially when large…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-12 Sandeep Kothinti , Keisuke Imoto , Debmalya Chakrabarty , Gregory Sell , Shinji Watanabe , Mounya Elhilali

Many methods of sound event detection (SED) based on machine learning regard a segmented time frame as one data sample to model training. However, the sound durations of sound events vary greatly depending on the sound event class, e.g.,…

Model compression is essential for serving large deep neural nets on devices with limited resources or applications that require real-time responses. As a case study, a state-of-the-art neural language model usually consists of one or more…

Computation and Language · Computer Science 2018-06-20 Patrick H. Chen , Si Si , Yang Li , Ciprian Chelba , Cho-jui Hsieh

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

Machine Learning · Computer Science 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

This paper proposes a network architecture mainly designed for audio tagging, which can also be used for weakly supervised acoustic event detection (AED). The proposed network consists of a modified DenseNet as the feature extractor, and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Chieh-Chi Kao , Bowen Shi , Ming Sun , Chao Wang

Training machine learning models on mobile devices has the potential of improving both privacy and accuracy of the models. However, one of the major obstacles to achieving this goal is the memory limitation of mobile devices. Reducing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-27 Mary Gooneratne , Khe Chai Sim , Petr Zadrazil , Andreas Kabel , Françoise Beaufays , Giovanni Motta

As learned image compression (LIC) methods become increasingly computationally demanding, enhancing their training efficiency is crucial. This paper takes a step forward in accelerating the training of LIC methods by modeling the neural…

Image and Video Processing · Electrical Eng. & Systems 2025-05-26 Yichi Zhang , Zhihao Duan , Yuning Huang , Fengqing Zhu

With several advantages over conventional RGB cameras, event cameras have provided new opportunities for tackling visual tasks under challenging scenarios with fast motion, high dynamic range, and/or power constraint. Yet unlike image/video…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Srutarshi Banerjee , Zihao W. Wang , Henry H. Chopp , Oliver Cossairt , Aggelos Katsaggelos

Cardiovascular disease (CVDs) is one of the universal deadly diseases, and the detection of it in the early stage is a challenging task to tackle. Recently, deep learning and convolutional neural networks have been employed widely for the…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Hanshi Sun , Ao Wang , Ninghao Pu , Zhiqing Li , Junguang Huang , Hao Liu , Zhi Qi

Artificial intelligence have contributed to advancements across various industries. However, the rapid growth of artificial intelligence technologies also raises concerns about their environmental impact, due to associated carbon footprints…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Szymon Mazurek , Monika Pytlarz , Sylwia Malec , Alessandro Crimi

Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge.…

Sound · Computer Science 2022-05-27 Chendong Zhao , Jianzong Wang , Leilai Li , Xiaoyang Qu , Jing Xiao

Despite the success of deep neural networks (DNNs), state-of-the-art models are too large to deploy on low-resource devices or common server configurations in which multiple models are held in memory. Model compression methods address this…

An increasing number of artificial intelligence (AI) applications involve the execution of deep neural networks (DNNs) on edge devices. Many practical reasons motivate the need to update the DNN model on the edge device post-deployment,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Bo Chen , Ali Bakhshi , Gustavo Batista , Brian Ng , Tat-Jun Chin

The high computational costs associated with large deep learning models significantly hinder their practical deployment. Model pruning has been widely explored in deep learning literature to reduce their computational burden, but its…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Md Adnan Faisal Hossain , Fengqing Zhu

The high memory consumption and computational costs of Recurrent neural network language models (RNNLMs) limit their wider application on resource constrained devices. In recent years, neural network quantization techniques that are capable…

Machine Learning · Computer Science 2021-12-01 Junhao Xu , Xie Chen , Shoukang Hu , Jianwei Yu , Xunying Liu , Helen Meng