English
Related papers

Related papers: Simplicity is Key: An Unsupervised Pretraining App…

200 papers

We demonstrate the possibility of what we call sparse learning: accelerated training of deep neural networks that maintain sparse weights throughout training while achieving dense performance levels. We accomplish this by developing sparse…

Machine Learning · Computer Science 2019-08-27 Tim Dettmers , Luke Zettlemoyer

Self-supervised learning (SSL) based speech pre-training has attracted much attention for its capability of extracting rich representations learned from massive unlabeled data. On the other hand, the use of weakly-supervised data is less…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-30 Wangyou Zhang , Yanmin Qian

We address the problem of recovering a sparse signal observed by a resource constrained wireless sensor network under channel fading. Sparse random matrices are exploited to reduce the communication cost in forwarding information to a…

Information Theory · Computer Science 2015-04-16 Thakshila Wimalajeewa , Pramod K. Varshney

Compressed sensing is a powerful tool in applications such as magnetic resonance imaging (MRI). It enables accurate recovery of images from highly undersampled measurements by exploiting the sparsity of the images or image patches in a…

Machine Learning · Statistics 2016-10-04 Saiprasad Ravishankar , Yoram Bresler

This paper proposes a deep learning framework to design distributed compression strategies in which distributed agents need to compress high-dimensional observations of a source, then send the compressed bits via bandwidth limited links to…

Information Theory · Computer Science 2022-03-10 Foad Sohrabi , Tao Jiang , Wei Yu

Intelligent reflecting surface (IRS) is a promising technology to improve the performance of backscatter communication systems by smartly reconfiguring the multi-reflection channel. To fully exploit the passive beamforming gain of IRS in…

Information Theory · Computer Science 2021-03-17 Samith Abeywickrama , Changsheng You , Rui Zhang , Chau Yuen

Accurate channel estimation remains challenging in high-mobility wireless systems because Doppler shifts induce severe inter-carrier interference (ICI) in Orthogonal Frequency Division Multiplexing (OFDM). We propose an unsupervised online…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Bohao Shi , Tianfu Qi , Xiaonan Chen , Jun Wang

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang

This paper considers the design of tunable decision schemes capable of rejecting with high probability mismatched signals embedded in Gaussian interference with unknown covariance matrix. To this end, a sparse recovery technique is…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Sudan Han , Luca Pallotta , Xiaotao Huang , Gaetano Giunta , Danilo Orlando

Deep learning-based channel state information (CSI) feedback schemes demonstrate strong compression capabilities but are typically constrained to fixed system configurations, limiting their generalization and flexibility. To address this…

Signal Processing · Electrical Eng. & Systems 2025-08-08 Xuanyu Liu , Shijian Gao , Boxun Liu , Xiang Cheng , Liuqing Yang

The resurgence of convolutional neural networks (CNNs) in visual recognition tasks, exemplified by ConvNeXt, has demonstrated their capability to rival transformer-based architectures through advanced training methodologies and ViT-inspired…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Quan Bi Pay , Vishnu Monn Baskaran , Junn Yong Loo , KokSheik Wong , Simon See

Deep learning can help uncover patterns in resting-state functional Magnetic Resonance Imaging (rs-fMRI) associated with psychiatric disorders and personal traits. Yet the problem of interpreting deep learning findings is rarely more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Camila González , Yanis Miraoui , Yiran Fan , Ehsan Adeli , Kilian M. Pohl

In wireless communication, accurate channel state information (CSI) is of pivotal importance. In practice, due to processing and feedback delays, estimated CSI can be outdated, which can severely deteriorate the performance of the…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Muhammad Karam Shehzad , Luca Rose , Mohamad Assaad

Single Image Super-Resolution (SISR) is a crucial task in low-level computer vision, aiming to reconstruct high-resolution images from low-resolution counterparts. Conventional attention mechanisms have significantly improved SISR…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Cheng Wan , Hongyuan Yu , Zhiqi Li , Yihang Chen , Yajun Zou , Yuqing Liu , Xuanwu Yin , Kunlong Zuo

The WLAN packet format has a short training field (STF) for synchronization followed by a long training field (LTF) for channel estimation. To enable MIMO channel estimation, the LTF is repeated as many times as the number of spatial…

Signal Processing · Electrical Eng. & Systems 2021-06-29 Prasanna Sethuraman

Compressed sensing can decrease scanning transmission electron microscopy electron dose and scan time with minimal information loss. Traditionally, sparse scans used in compressed sensing sample a static set of probing locations. However,…

Machine Learning · Computer Science 2021-03-12 Jeffrey M. Ede

We consider the joint estimation of multipath channels obtained with a set of receiving antennas and uniformly probed in the frequency domain. This scenario fits most of the modern outdoor communication protocols for mobile access or…

Systems and Control · Computer Science 2012-04-23 Y. Barbotin , M. Vetterli

Device-free crowd-counting using WiFi Channel State Information (CSI) is a key enabling technology for a new generation of privacy-preserving Internet of Things (IoT) applications. However, practical deployment is severely hampered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Oliver Custance , Saad Khan , Simon Parkinson , Quan Z. Sheng

Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a specific…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Boxun Liu , Shijian Gao , Xuanyu Liu , Xiang Cheng , Liuqing Yang

Hybrid beamforming is a promising technique to reduce the complexity and cost of massive multiple-input multiple-output (MIMO) systems while providing high data rate. However, the hybrid precoder design is a challenging task requiring…

Signal Processing · Electrical Eng. & Systems 2021-05-28 Hamed Hojatian , Jeremy Nadal , Jean-Francois Frigon , Francois Leduc-Primeau