English
Related papers

Related papers: Attention-Infused Autoencoder for Massive MIMO CSI…

200 papers

Massive MIMO basestations, operating with frequency-division duplexing (FDD), require the users to feedback their channel state information (CSI) in order to design the precoding matrices. Given the powerful capabilities of deep neural…

Information Theory · Computer Science 2024-01-17 Yu Zhang , Ahmed Alkhateeb

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Acquiring accurate channel state information (CSI) at an access point (AP) is challenging for wideband millimeter wave (mmWave) ultra-massive multiple-input and multiple-output (UMMIMO) systems, due to the high-dimensional channel matrices,…

Information Theory · Computer Science 2024-03-20 Kuiyu Wang , Zhen Gao , Sheng Chen , Boyu Ning , Gaojie Chen , Yu Su , Zhaocheng Wang , H. Vincent Poor

Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taekyung Kim , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

Deep learning has recently attracted significant attention in the field of hyperspectral images (HSIs) classification. However, the construction of an efficient deep neural network (DNN) mostly relies on a large number of labeled samples…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Cheng Deng , Yumeng Xue , Xianglong Liu , Chao Li , Dacheng Tao

We introduce a novel physical layer scheme for single user Multiple-Input Multiple-Output (MIMO) communications based on unsupervised deep learning using an autoencoder. This method extends prior work on the joint optimization of physical…

Information Theory · Computer Science 2017-07-26 Timothy J. O'Shea , Tugba Erpek , T. Charles Clancy

Attention mechanisms are widely used in current encoder/decoder frameworks of image captioning, where a weighted average on encoded vectors is generated at each time step to guide the caption decoding process. However, the decoder has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Lun Huang , Wenmin Wang , Jie Chen , Xiao-Yong Wei

Automated histopathological image analysis plays a vital role in computer-aided diagnosis of various diseases. Among developed algorithms, deep learning-based approaches have demonstrated excellent performance in multiple tasks, including…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Nima Torbati , Anastasia Meshcheryakova , Ramona Woitek , Diana Mechtcheriakova , Amirreza Mahbod

Attention mechanisms have significantly advanced deep learning by enhancing feature representation through selective focus. However, existing approaches often independently model channel importance and spatial saliency, overlooking their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhenkai Qin , Jiaquan Liang , Qiao Fang

Recent popular decoder-only text-to-speech models are known for their ability of generating natural-sounding speech. However, such models sometimes suffer from word skipping and repeating due to the lack of explicit monotonic alignment…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-21 Hankun Wang , Chenpeng Du , Yiwei Guo , Shuai Wang , Xie Chen , Kai Yu

Channel Attention reigns supreme as an effective technique in the field of computer vision. However, the proposed channel attention by SENet suffers from information loss in feature learning caused by the use of Global Average Pooling (GAP)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hadi Salman , Caleb Parks , Shi Yin Hong , Justin Zhan

Semantic segmentation for extracting buildings and roads from uncrewed aerial vehicle (UAV) remote sensing images by deep learning becomes a more efficient and convenient method than traditional manual segmentation in surveying and mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Xiaoxiang Han , Yiman Liu , Gang Liu , Yuanjie Lin , Qiaohong Liu

In this work, we develop a joint denoising and feedback strategy for channel state information in frequency division duplex systems. In such systems, the biggest challenge is the overhead incurred when the mobile terminal has to send the…

Information Theory · Computer Science 2025-09-05 Valentina Rizzello , Wolfgang Utschick

Obtaining accurate channel state information (CSI) is crucial and challenging for multiple-input multiple-output (MIMO) wireless communication systems. With the increasing antenna scale and user mobility, traditional channel estimation…

Signal Processing · Electrical Eng. & Systems 2025-04-29 Zhuoran Xiao

Recent works in dataset distillation seek to minimize training expenses by generating a condensed synthetic dataset that encapsulates the information present in a larger real dataset. These approaches ultimately aim to attain test accuracy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Samir Khaki , Ahmad Sajedi , Kai Wang , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Deep learning models are state-of-the-art in compressive spectral imaging (CSI) recovery. These methods use a deep neural network (DNN) as an image generator to learn non-linear mapping from compressed measurements to the spectral image.…

Image and Video Processing · Electrical Eng. & Systems 2022-09-12 Brayan Monroy , Jorge Bacca , Henry Arguello

Deep learning methods have shown promising performances in remote sensing image change detection (CD). However, existing methods usually train a dataset-specific deep network for each dataset. Due to the significant differences in the data…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Dou Quan , Rufan Zhou , Shuang Wang , Ning Huyan , Dong Zhao , Yunan Li , Licheng Jiao

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao

Objective: We develop a channel-adaptive (CA) architecture that seamlessly processes multi-variate time-series with an arbitrary number of channels, and in particular intracranial electroencephalography (iEEG) recordings. Methods: Our CA…

Machine Learning · Computer Science 2025-12-23 Francesco Carzaniga , Michael Hersche , Kaspar Schindler , Abbas Rahimi

The realization of practical intelligent reflecting surface (IRS)-assisted multi-user communication (IRS-MUC) systems critically depends on the proper beamforming design exploiting accurate channel state information (CSI). However, channel…

Information Theory · Computer Science 2021-04-27 Chang Liu , Xuemeng Liu , Zhiqiang Wei , Shaokang Hu , Derrick Wing Kwan Ng , Jinhong Yuan