English
Related papers

Related papers: Dynamic nsNet2: Efficient Deep Noise Suppression w…

200 papers

Traditional denoising methods for noise removal have largely relied on handcrafted priors, often perform well in controlled environments but struggle to address the complexity and variability of real noise. In contrast, deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Weimin Yuan , Cai Meng

The ability to dynamically adjust the computational load of neural models during inference in a resource aware manner is crucial for on-device processing scenarios, characterised by limited and time-varying computational resources.…

Computation and Language · Computer Science 2025-06-24 Maxence Lasbordes , Daniele Falavigna , Alessio Brutti

Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks allow easy samples to be output at early exits, removing…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yizeng Han , Yifan Pu , Zihang Lai , Chaofei Wang , Shiji Song , Junfen Cao , Wenhui Huang , Chao Deng , Gao Huang

Self-supervised speech models have shown to be useful for various tasks, but their large size limits the use in devices with low computing power and memory. In this work, we explore early exit, an approach for reducing latency by exiting…

Sound · Computer Science 2024-09-02 Tzu-Quan Lin , Hung-yi Lee , Hao Tang

Deep learning (DL) techniques are increasingly pervasive across various domains, including wireless communication, where they extract insights from raw radio signals. However, the computational demands of DL pose significant challenges,…

Signal Processing · Electrical Eng. & Systems 2024-09-05 Dieter Verbruggen , Hazem Sallouha , Sofie Pollin

Ensuring the safety and efficiency of AI systems is a central goal of modern research. Formal verification provides guarantees of neural network robustness, while early exits improve inference efficiency by enabling intermediate…

Machine Learning · Computer Science 2025-12-25 Yizhak Yisrael Elboher , Avraham Raviv , Amihay Elboher , Zhouxing Shi , Omri Azencot , Hillel Kugler , Guy Katz

Deep learning (DL) models have emerged as a promising solution for the Internet of Things (IoT). However, due to their computational complexity, DL models consume significant amounts of energy, which can rapidly drain the battery and…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

By leveraging the data sample diversity, the early-exit network recently emerges as a prominent neural network architecture to accelerate the deep learning inference process. However, intermediate classifiers of the early exits introduce…

Machine Learning · Computer Science 2022-06-22 Rongkang Dong , Yuyi Mao , Jun Zhang

In many deep neural network (DNN) applications, the difficulty of gathering high-quality data in the industry field hinders the practical use of DNN. Thus, the concept of transfer learning has emerged, which leverages the pretrained…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Youngkee Kim , Won Joon Yun , Youn Kyu Lee , Soyi Jung , Joongheon Kim

With recent research advancements, deep learning models are becoming attractive and powerful choices for speech enhancement in real-time applications. While state-of-the-art models can achieve outstanding results in terms of speech quality…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-20 Sebastian Braun , Hannes Gamper , Chandan K. A. Reddy , Ivan Tashev

The growing demand for intelligent applications beyond the network edge, coupled with the need for sustainable operation, are driving the seamless integration of deep learning (DL) algorithms into energy-limited, and even energy-harvesting…

Machine Learning · Computer Science 2024-11-08 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

Deep Neural Networks (DNNs) have drawn attention because of their outstanding performance on various tasks. However, deploying full-fledged DNNs in resource-constrained devices (edge, mobile, IoT) is difficult due to their large size. To…

Machine Learning · Computer Science 2023-09-19 Divya J. Bajpai , Vivek K. Trivedi , Sohan L. Yadav , Manjesh K. Hanawal

Distributed DNN inference is becoming increasingly important as the demand for intelligent services at the network edge grows. By leveraging the power of distributed computing, edge devices can perform complicated and resource-hungry…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Xian Peng , Xin Wu , Lianming Xu , Li Wang , Aiguo Fei

Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at…

Neural and Evolutionary Computing · Computer Science 2017-09-07 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

Mobile devices such as smartphones and autonomous vehicles increasingly rely on deep neural networks (DNNs) to execute complex inference tasks such as image classification and speech recognition, among others. However, continuously…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Yoshitomo Matsubara , Marco Levorato , Francesco Restuccia

Deep neural network (DNN) models are increasingly popular in edge video analytic applications. However, the compute-intensive nature of DNN models pose challenges for energy-efficient inference on resource-constrained edge devices. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ziyang Zhang , Yang Zhao , Ming-Ching Chang , Changyao Lin , Jie Liu

This paper introduces an innovative method for reducing the computational complexity of deep neural networks in real-time speech enhancement on resource-constrained devices. The proposed approach utilizes a two-stage processing framework,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Shrishti Saha Shetu , Soumitro Chakrabarty , Oliver Thiergart , Edwin Mabande

We study the role of magnitude structured pruning as an architecture search to speed up the inference time of a deep noise suppression (DNS) model. While deep learning approaches have been remarkably successful in enhancing audio quality,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Jerry Chee , Sebastian Braun , Vishak Gopal , Ross Cutler

We propose a novel deep neural network architecture for speech recognition that explicitly employs knowledge of the background environmental noise within a deep neural network acoustic model. A deep neural network is used to predict the…

Computation and Language · Computer Science 2016-10-03 Suyoun Kim , Bhiksha Raj , Ian Lane

In machine learning, there is a fundamental trade-off between ease of optimization and expressive power. Neural Networks, in particular, have enormous expressive power and yet are notoriously challenging to train. The nature of that…

Machine Learning · Computer Science 2015-11-24 Diogo Almeida , Nate Sauder