English
Related papers

Related papers: Ultra Dual-Path Compression For Joint Echo Cancell…

200 papers

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-08-29 Xing Wang , Jie Liang

Bilinear time-frequency representations (TFRs) provide high-resolution time-varying frequency characteristics of nonstationary signals. However, they suffer from crossterms due to the bilinear nature. Existing crossterm-reduced TFRs focus…

Signal Processing · Electrical Eng. & Systems 2020-07-08 Shuimei Zhang , Yimin D. Zhang

Time delay estimation has long been an active area of research. In this work, we show that compressive sensing with interpolation may be used to achieve good estimation precision while lowering the sampling frequency. We propose an…

Information Theory · Computer Science 2013-06-12 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen

The unstructured sparsity after pruning poses a challenge to the efficient implementation of deep learning models in existing regular architectures like systolic arrays. On the other hand, coarse-grained structured pruning is suitable for…

Machine Learning · Computer Science 2024-11-22 Xizi Chen , Jingyang Zhu , Jingbo Jiang , Chi-Ying Tsui

Full-duplex wireless communication has the potential to double the capacity of wireless networks by reducing the band occupancy of transmissions. However, a full-duplex capability cannot always reduce the band occupancy because the real…

Networking and Internet Architecture · Computer Science 2018-12-18 Makoto Kobayashi , Shunsuke Saruwatari , Takashi Watanabe

We experimentally demonstrate a versatile technique for performing dual-comb interferometry using a single frequency comb. By rapid switching of the repetition rate, the output pulse train can be delayed and heterodyned with itself to…

Instrumentation and Detectors · Physics 2018-08-15 David R. Carlson , Daniel D. Hickstein , Daniel C. Cole , Scott A. Diddams , Scott B. Papp

Leveraging second-order information about the loss at the scale of deep networks is one of the main lines of approach for improving the performance of current optimizers for deep learning. Yet, existing approaches for accurate full-matrix…

Machine Learning · Computer Science 2024-06-06 Ionut-Vlad Modoranu , Aleksei Kalinov , Eldar Kurtic , Elias Frantar , Dan Alistarh

In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we…

Deep convolutional neural networks (CNNs) with a large number of parameters require intensive computational resources, and thus are hard to be deployed in resource-constrained platforms. Decomposition-based methods, therefore, have been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Shaowu Chen , Jiahao Zhou , Weize Sun , Lei Huang

Fine-tuning pre-trained language models improves the quality of commercial reply suggestion systems, but at the cost of unsustainable training times. Popular training time reduction approaches are resource intensive, thus we explore…

Computation and Language · Computer Science 2021-11-30 Vaishnavi Shrivastava , Radhika Gaonkar , Shashank Gupta , Abhishek Jha

Large language models (LLMs) exhibit excellent performance in various tasks. However, the memory requirements of LLMs present a great challenge when deploying on memory-limited devices, even for quantized LLMs. This paper introduces a…

Computation and Language · Computer Science 2025-02-24 Weilan Wang , Yu Mao , Dongdong Tang , Hongchao Du , Nan Guan , Chun Jason Xue

User data confidentiality protection is becoming a rising challenge in the present deep learning research. Without access to data, conventional data-driven model compression faces a higher risk of performance degradation. Recently, some…

Machine Learning · Computer Science 2022-01-28 Yuhang Li , Feng Zhu , Ruihao Gong , Mingzhu Shen , Xin Dong , Fengwei Yu , Shaoqing Lu , Shi Gu

Acoustic Echo Cancellation (AEC) plays a key role in voice interaction. Due to the explicit mathematical principle and intelligent nature to accommodate conditions, adaptive filters with different types of implementations are always used…

Sound · Computer Science 2020-05-20 Lu Ma , Hua Huang , Pei Zhao , Tengrong Su

This chapter focuses on the performance enhancement brought by the addition of caching capabilities to full-duplex (FD) radios in the context of ultra-dense networks (UDNs). More specifically, we aim at showing that the interference…

Information Theory · Computer Science 2020-04-09 Italo Atzeni , Marco Maso

Recently it has been shown that the intensity time-bandwidth product of optical signals can be engineered to match that of the data acquisition instrument. In particular, it is possible to slow down an ultrafast signal, resulting in…

Optics · Physics 2015-06-22 Jacky Chan , Ata Mahjoubfar , Mohammad H. Asghari , Bahram Jalali

Large-scale deep neural networks (DNN) have been successfully used in a number of tasks from image recognition to natural language processing. They are trained using large training sets on large models, making them computationally and…

Machine Learning · Computer Science 2017-03-28 Sek Chai , Aswin Raghavan , David Zhang , Mohamed Amer , Tim Shields

In portable, three dimensional, and ultra-fast ultrasound imaging systems, there is an increasing demand for the reconstruction of high quality images from a limited number of radio-frequency (RF) measurements due to receiver (Rx) or…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Yeo Hun Yoon , Shujaat Khan , Jaeyoung Huh , Jong Chul Ye

Context-aware compression techniques have gained increasing attention as model sizes continue to grow, introducing computational bottlenecks that hinder efficient deployment. A structured encoding approach was proposed to selectively…

Computation and Language · Computer Science 2025-02-13 Barnaby Schmitt , Alistair Grosvenor , Matthias Cunningham , Clementine Walsh , Julius Pembrokeshire , Jonathan Teel

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

Machine Learning · Computer Science 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

Modern deep neural networks (DNNs) are extremely powerful; however, this comes at the price of increased depth and having more parameters per layer, making their training and inference more computationally challenging. In an attempt to…

Machine Learning · Statistics 2024-03-04 Lingyu Gu , Yongqi Du , Yuan Zhang , Di Xie , Shiliang Pu , Robert C. Qiu , Zhenyu Liao