English
Related papers

Related papers: Bridging the Modality Gap: Enhancing Channel Predi…

200 papers

Large language models (LLMs) have achieved remarkable advancements in natural language processing. However, the massive scale and computational demands of these models present formidable challenges when considering their practical…

Computation and Language · Computer Science 2024-04-09 Weize Liu , Guocong Li , Kai Zhang , Bang Du , Qiyuan Chen , Xuming Hu , Hongxia Xu , Jintai Chen , Jian Wu

In mobile communication scenarios, the acquired channel state information (CSI) rapidly becomes outdated due to fast-changing channels. Opportunistic transmitter selection based on current CSI for secrecy improvement may be outdated during…

Signal Processing · Electrical Eng. & Systems 2024-05-02 Shashi Bhushan Kotwal , Chinmoy Kundu , Sudhakar Modem , Holger Claussen , Lester Ho

Audio large language models (LLMs) are considered experts at recognizing sound objects, yet their performance relative to LLMs in other sensory modalities, such as visual or audio-visual LLMs, and to humans using their ears, eyes, or both…

Sound · Computer Science 2025-05-13 Xilin Jiang , Junkai Wu , Vishal Choudhari , Nima Mesgarani

Standard Knowledge Distillation (KD) compresses Large Language Models (LLMs) by optimizing final outputs, yet it typically treats the teacher's intermediate layer's thought process as a black box. While feature-based distillation attempts…

Computation and Language · Computer Science 2026-02-17 Manish Dhakal , Uthman Jinadu , Anjila Budathoki , Rajshekhar Sunderraman , Yi Ding

Conversational Search (CS) involves retrieving relevant documents from a corpus while considering the conversational context, integrating retrieval with context modeling. Recent advancements in Large Language Models (LLMs) have…

Information Retrieval · Computer Science 2025-05-19 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Though achieving marvelous progress in various scenarios, existing semantic communication frameworks mainly consider single-input single-output Gaussian channels or Rayleigh fading channels, neglecting the widely-used multiple-input…

Information Theory · Computer Science 2024-06-12 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Wenjun Zhang , Shuguang Cui , Merouane Debbah

Large language models (LLMs) have garnered increasing attention owing to their powerful logical reasoning capabilities. Generally, larger LLMs (L-LLMs) that require paid interfaces exhibit significantly superior performance compared to…

Artificial Intelligence · Computer Science 2025-11-11 Dong Chen , Shilin Zhang , Fei Gao , Yueting Zhuang , Siliang Tang , Qidong Liu , Mingliang Xu

The distillation of knowledge from Large Language Models (LLMs) into Smaller Language Models (SLMs), preserving the capabilities and performance of LLMs while reducing model size, has played a key role in the proliferation of LLMs. Because…

Computation and Language · Computer Science 2025-07-14 Henry J. Xie , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu

The exponential growth of Large Language Models (LLMs) continues to highlight the need for efficient strategies to meet ever-expanding computational and data demands. This survey provides a comprehensive analysis of two complementary…

Delay alignment modulation (DAM) is a promising technology for inter-symbol interference (ISI)-free communication without relying on sophisticated channel equalization or multi-carrier transmissions. The key ideas of DAM are delay…

Information Theory · Computer Science 2023-04-03 Dingyang Ding , Yong Zeng

A new wave of wireless services, including virtual reality, autonomous driving and internet of things, is driving the design of new generations of wireless systems to deliver ultra-high data rates, massive number of connected devices and…

Information Theory · Computer Science 2019-12-24 Zhenyu Liu , Lin Zhang , Zhi Ding

Channel state information (CSI) at the base station (BS) is crucial to achieve beamforming and multiplexing gains in multiple-input multiple-output (MIMO) systems. State-of-the-art limited feedback schemes require feedback overhead that…

Information Theory · Computer Science 2018-10-17 Panos N. Alevizos , Xiao Fu , Nicholas D. Sidiropoulos , Yang Ye , Aggelos Bletsas

The diagnosis of oral diseases presents a problematic clinical challenge, characterized by a wide spectrum of pathologies with overlapping symptomatology. To address this, we developed Clinical Semantic Intelligence (CSI), a novel…

Artificial Intelligence · Computer Science 2025-07-22 Mohammad Mashayekhi , Sara Ahmadi Majd , Arian AmirAmjadi , Parsa Hosseini

Recent studies have focused on leveraging large-scale artificial intelligence (LAI) models to improve semantic representation and compression capabilities. However, the substantial computational demands of LAI models pose significant…

Machine Learning · Computer Science 2025-06-17 Chuanhong Liu , Caili Guo , Yang Yang , Mingzhe Chen , Tony Q. S. Quek

Dataset distillation (DD) aims to minimize the time and memory consumption needed for training deep neural networks on large datasets, by creating a smaller synthetic dataset that has similar performance to that of the full real dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xinhao Zhong , Bin Chen , Hao Fang , Xulin Gu , Shu-Tao Xia , En-Hui Yang

Large Language models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities, where a LLM makes predictions for a given test input together with a few input-output pairs (demonstrations). Nevertheless, the inclusion of…

Computation and Language · Computer Science 2024-03-13 Yichuan Li , Xiyao Ma , Sixing Lu , Kyumin Lee , Xiaohu Liu , Chenlei Guo

Massive multiple-input multiple-output (MIMO) system is promising in providing unprecedentedly high data rate. To achieve its full potential, the transceiver needs complete channel state information (CSI) to perform transmit/receive…

Information Theory · Computer Science 2022-02-08 Yu Zhang , Ahmed Alkhateeb , Pranav Madadi , Jeongho Jeon , Joonyoung Cho , Charlie Zhang

Advances in multi-modal large language models (MLLMs) have inspired time series understanding and reasoning tasks, that enable natural language querying over time series, producing textual analyses of complex temporal dynamics. Recent…

Machine Learning · Computer Science 2026-02-05 Hang Ni , Weijia Zhang , Fei Wang , Zezhi Shao , Hao Liu

We propose DISC-MedLLM, a comprehensive solution that leverages Large Language Models (LLMs) to provide accurate and truthful medical response in end-to-end conversational healthcare services. To construct high-quality Supervised…

Computation and Language · Computer Science 2023-08-29 Zhijie Bao , Wei Chen , Shengze Xiao , Kuang Ren , Jiaao Wu , Cheng Zhong , Jiajie Peng , Xuanjing Huang , Zhongyu Wei

Previous studies have proved that cross-lingual knowledge distillation can significantly improve the performance of pre-trained models for cross-lingual similarity matching tasks. However, the student model needs to be large in this…

Computation and Language · Computer Science 2022-09-14 Kunbo Ding , Weijie Liu , Yuejian Fang , Zhe Zhao , Qi Ju , Xuefeng Yang