English
Related papers

Related papers: WiFo-E: A Scalable Wireless Foundation Model for E…

200 papers

As a popular distributed learning paradigm, federated learning (FL) over mobile devices fosters numerous applications, while their practical deployment is hindered by participating devices' computing and communication heterogeneity. Some…

Machine Learning · Computer Science 2025-03-03 Huai-an Su , Jiaxiang Geng , Liang Li , Xiaoqi Qin , Yanzhao Hou , Hao Wang , Xin Fu , Miao Pan

Radio frequency wireless energy transfer (WET) is a promising solution for powering autonomous Internet of Things (IoT) deployments. In this work, we leverage energy beamforming for powering multiple user equipments (UEs) with stringent…

Information Theory · Computer Science 2022-03-02 Onel L. A. López , Dileep Kumar , Richard Demo Souza , Petar Popovski , Antti Tölli , Matti Latva-aho

Large and sparse feed-forward layers (S-FFN) such as Mixture-of-Experts (MoE) have proven effective in scaling up Transformers model size for \textit{pretraining} large language models. By only activating part of the FFN parameters…

Computation and Language · Computer Science 2023-10-25 Zeyu Leo Liu , Tim Dettmers , Xi Victoria Lin , Veselin Stoyanov , Xian Li

Deep learning has been widely applied for the channel state information (CSI) feedback in frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) system. For the typical supervised training of the feedback model,…

Information Theory · Computer Science 2022-07-26 Boyuan Zhang , Haozhen Li , Xin Liang , Xinyu Gu , Lin Zhang

End-to-end (E2E) speech-to-text translation (ST) often depends on pretraining its encoder and/or decoder using source transcripts via speech recognition or text translation tasks, without which translation performance drops substantially.…

Computation and Language · Computer Science 2022-06-10 Biao Zhang , Barry Haddow , Rico Sennrich

Accurate multiple-input multiple-output (MIMO) channel estimation is critical for next-generation wireless systems, enabling enhanced communication and sensing performance. Traditional model-based channel estimation methods suffer, however,…

Signal Processing · Electrical Eng. & Systems 2026-02-02 Seyed Alireza Javid , Nuria González-Prelcic

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Multimodal image fusion and object detection are crucial for autonomous driving. While current methods have advanced the fusion of texture details and semantic information, their complex training processes hinder broader applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Jiaqing Zhang , Mingxiang Cao , Weiying Xie , Jie Lei , Daixun Li , Wenbo Huang , Yunsong Li , Xue Yang

This paper investigates the design of precoders for single-user multiple-input multiple-output (MIMO) channels, and in particular for finite-alphabet signals. Based on an asymptotic expression for the mutual information of channels…

Information Theory · Computer Science 2017-04-18 Yongpeng Wu , Chao-Kai Wen , Derrick Wing Kwan Ng , Robert Schober , Angel Lozano

The advent of artificial intelligence (AI)-native wireless communication is fundamentally reshaping the design paradigm of next-generation (NextG) systems, where intelligent air interfaces are expected to operate adaptively and efficiently…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Jiaming Cheng , Wei Chen , Bo Ai

We address the problem of analyzing and classifying in groups the downlink channel environment in a millimeter-wavelength cell, accounting for path loss, multipath fading, and User Equipment (UE) blocking, by employing a hybrid propagation…

Information Theory · Computer Science 2020-02-06 Thomas Ketseoglou , Matthew. C. Valenti , Ender Ayanoglu

Recent efforts on Diffusion Mixture-of-Experts (MoE) models have primarily focused on developing more sophisticated routing mechanisms. However, we observe that the underlying architectural configuration space remains markedly…

Machine Learning · Computer Science 2025-12-02 Yahui Liu , Yang Yue , Jingyuan Zhang , Chenxi Sun , Yang Zhou , Wencong Zeng , Ruiming Tang , Guorui Zhou

While initial applications of artificial intelligence (AI) in wireless communications over the past decade have demonstrated considerable potential using specialized models for targeted communication tasks, the revolutionary demands of…

Information Theory · Computer Science 2026-03-26 Jian Xiao , Ji Wang , Kunrui Cao , Xingwang Li , Zhao Chen , Chau Yuen

Sparsely-gated mixture-of-experts (MoE) has been widely adopted to scale deep learning models to trillion-plus parameters with fixed computational cost. The algorithmic performance of MoE relies on its token routing mechanism that forwards…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Changho Hwang , Wei Cui , Yifan Xiong , Ziyue Yang , Ze Liu , Han Hu , Zilong Wang , Rafael Salas , Jithin Jose , Prabhat Ram , Joe Chau , Peng Cheng , Fan Yang , Mao Yang , Yongqiang Xiong

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming example. The result is a sparsely-activated model -- with…

Machine Learning · Computer Science 2022-06-20 William Fedus , Barret Zoph , Noam Shazeer

This paper investigates the design of distributed precoding for multi-satellite massive MIMO transmissions. We first conduct a detailed analysis of the transceiver model, in which delay and Doppler precompensation is introduced to ensure…

Signal Processing · Electrical Eng. & Systems 2026-01-13 Yafei Wang , Vu Nguyen Ha , Konstantinos Ntontin , Hong Yan , Wenjin Wang , Symeon Chatzinotas , Björn Ottersten

In a multiple-input multiple-output frequency-division duplexing (MIMO-FDD) system, the user equipment (UE) sends the downlink channel state information (CSI) to the base station to report link status. Due to the complexity of MIMO systems,…

Networking and Internet Architecture · Computer Science 2022-07-19 Mostafa Hussien , Kim Khoa Nguyen , Mohamed Cheriet

Diffractive deep neural network (D2NN), also referred to as reconfigurable intelligent metasurface based deep neural networks (Rb-DNNs) or stacked intelligent metasurfaces (SIMs) in the field of wireless communications, has emerged as a…

Signal Processing · Electrical Eng. & Systems 2025-06-04 Xiaokun Teng , Wankai Tang , Xiao Li , Shi Jin