English
Related papers

Related papers: Robust Residual Finite Scalar Quantization for Neu…

200 papers

Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 S M A Sharif , Rizwan Ali Naqvi , Woong-Kee Loh

We present a comprehensive study of deep bidirectional long short-term memory (LSTM) recurrent neural network (RNN) based acoustic models for automatic speech recognition (ASR). We study the effect of size and depth and train models of up…

Neural and Evolutionary Computing · Computer Science 2019-08-06 Albert Zeyer , Patrick Doetsch , Paul Voigtlaender , Ralf Schlüter , Hermann Ney

Federated learning (FL) often suffers from performance degradation due to key challenges such as data heterogeneity and communication constraints. To address these limitations, we present a novel FL framework called FedWSQ, which integrates…

Machine Learning · Computer Science 2025-07-23 Seung-Wook Kim , Seongyeol Kim , Jiah Kim , Seowon Ji , Se-Ho Lee

Deploying Large Language Models (LLMs) on edge devices is increasingly important, as it eliminates reliance on network connections, reduces expensive API calls, and enhances user privacy. However, on-device deployment is challenging due to…

Machine Learning · Computer Science 2025-05-26 Yijiang Liu , Hengyu Fang , Liulu He , Rongyu Zhang , Yichuan Bai , Yuan Du , Li Du

Large Language Models (LLMs) have demonstrated impressive performance on a range of Natural Language Processing (NLP) tasks. Unfortunately, the immense amount of computations and memory accesses required for LLM training makes them…

Machine Learning · Computer Science 2023-03-10 Guo Yang , Daniel Lo , Robert Mullins , Yiren Zhao

Using a dissipative quantum neural network (DQNN) accompanied by conjugate layers, we upgrade the performance of the existing quantum auto-encoder (QAE) network as a quantum denoiser of a noisy m-qubit GHZ state. Our new denoising…

Quantum Physics · Physics 2023-11-20 Armin Ahmadkhaniha , Marzieh Bathaee

Quantum Recurrent Neural Networks (QRNNs) are robust candidates for modelling and predicting future values in multivariate time series. However, the effective implementation of some QRNN models is limited by the need for mid-circuit…

Quantum Physics · Physics 2025-01-31 José Daniel Viqueira , Daniel Faílde , Mariamo M. Juane , Andrés Gómez , David Mera

Most current speech enhancement models use spectrogram features that require an expensive transformation and result in phase information loss. Previous work has overcome these issues by using convolutional networks to learn long-range…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-17 Jalal Abdulbaqi , Yue Gu , Ivan Marsic

Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Samuel Yen-Chi Chen , Daniel Fry , Amol Deshmukh , Vladimir Rastunkov , Charlee Stefanski

Quantum Arithmetic faces limitations such as noise and resource constraints in the current Noisy Intermediate Scale Quantum (NISQ) era quantum computers. We propose using Distributed Quantum Computing (DQC) to overcome these limitations by…

Quantum Physics · Physics 2024-06-11 Bhaskar Gaur , Travis S. Humble , Himanshu Thapliyal

Quantization is an effective technique to reduce memory footprint, inference latency, and power consumption of deep learning models. However, existing quantization methods suffer from accuracy degradation compared to full-precision (FP)…

Machine Learning · Computer Science 2022-10-14 Zheng Wang , Juncheng B Li , Shuhui Qu , Florian Metze , Emma Strubell

The decomposition of non-stationary signals is an important and challenging task in the field of signal time-frequency analysis. In the recent two decades, many signal decomposition methods led by the empirical mode decomposition, which was…

Machine Learning · Computer Science 2023-07-06 Feng Zhou , Antonio Cicone , Haomin Zhou

Clinical deployment requires segmentation models to stay stable under distribution shifts and perturbations. The mainstream solution is adversarial training (AT) to improve robustness; however, AT often brings a clean--robustness trade-off…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yuting Lu , Ziliang Wang , Weixin Xu , Wei Zhang , Yongqiang Zhao , Yang Yu , Xiaohong Zhang

Despite the rapid progress of neuromorphic computing, the inadequate depth and the resulting insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and…

Neural and Evolutionary Computing · Computer Science 2022-02-18 Yifan Hu , Yujie Wu , Lei Deng , Guoqi Li

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li

Reinforcement learning (RL) for complex tasks remains a challenge, primarily due to the difficulties of engineering scalar reward functions and the inherent inefficiency of training models from scratch. Instead, it would be better to…

Artificial Intelligence · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes Andreas Stork

Large language models (LLMs) have shown immense potential across various domains, but their high memory requirements and inference costs remain critical challenges for deployment. Post-training quantization (PTQ) has emerged as a promising…

Machine Learning · Computer Science 2026-01-05 Tianyi Zhang , Anshumali Shrivastava

Noisy intermediate-scale quantum (NISQ) computers could solve quantum-mechanical simulation problems that are beyond the capabilities of classical computers. However, NISQ devices experience significant errors which, if not corrected, can…

Quantum Physics · Physics 2021-02-04 Ashley Montanaro , Stasja Stanisic

In ICASSP 2023 speech signal improvement challenge, we developed a dual-stage neural model which improves speech signal quality induced by different distortions in a stage-wise divide-and-conquer fashion. Specifically, in the first stage,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Mingshuai Liu , Shubo Lv , Zihan Zhang , Runduo Han , Xiang Hao , Xianjun Xia , Li Chen , Yijian Xiao , Lei Xie

Neural rendering can be used to reconstruct implicit representations of shapes without 3D supervision. However, current neural surface reconstruction methods have difficulty learning high-frequency geometry details, so the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Yiqun Wang , Ivan Skorokhodov , Peter Wonka