English
Related papers

Related papers: Task-Oriented Multimodal Token Transmission in Res…

200 papers

We consider a system that is composed of an energy constrained sensor node and a sink node, and devise optimal data compression and transmission policies with an objective to prolong the lifetime of the sensor node. While applying…

Information Theory · Computer Science 2018-11-21 Sheeraz A. Alvi , Xiangyun Zhou , Salman Durrani

Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature…

Machine Learning · Computer Science 2023-10-24 Qi-Le Zhou , Han-Jia Ye , Le-Ye Wang , De-Chuan Zhan

The Space-Air-Ground-Sea integrated network calls for more robust and secure transmission techniques against jamming. In this paper, we propose a textual semantic transmission framework for robust transmission, which utilizes the advanced…

Computation and Language · Computer Science 2023-07-25 Shicong Liu , Zhen Gao , Gaojie Chen , Yu Su , Lu Peng

In this work, we aim to compress the vision tokens of a Large Vision Language Model (LVLM) into a representation that is simultaneously suitable for (a) generative and (b) discriminative tasks, (c) is nearly lossless, and (d) is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Adrian Bulat , Yassine Ouali , Georgios Tzimiropoulos

In this paper we study energy efficient joint power allocation and beamforming for coordinated multicell multiuser downlink systems. The considered optimization problem is in a non-convex fractional form and hard to tackle. We propose to…

Information Theory · Computer Science 2013-10-09 He Shiwen , Huang Yongming , Jin Shi , Yang Luxi

Conventional online multi-task learning algorithms suffer from two critical limitations: 1) Heavy communication caused by delivering high velocity of sequential data to a central machine; 2) Expensive runtime complexity for building task…

Machine Learning · Statistics 2020-04-06 Peng Yang , Ping Li

We propose semantic communication over wireless channels for various modalities, e.g., text and images, in a task-oriented communications setup where the task is classification. We present two approaches based on memory and learning. Both…

Information Theory · Computer Science 2024-02-01 Emrecan Kutay , Aylin Yener

In this paper, we propose a novel resource management scheme that jointly allocates the transmit power and computational resources in a centralized radio access network architecture. The network comprises a set of computing nodes to which…

Networking and Internet Architecture · Computer Science 2021-06-24 Mohsen Tajallifar , Sina Ebrahimi , Mohammad Reza Javan , Nader Mokari , Luca Chiaraviglio

Mobile edge computing (MEC) and millimeter wave (mmWave) communications are capable of significantly reducing the network's delay and enhancing its capacity. In this paper we investigate a mmWave and device-to-device (D2D) assisted MEC…

Signal Processing · Electrical Eng. & Systems 2022-07-19 Yanzhen Liu , Yunlong Cai , An Liu , Minjian Zhao , Lajos Hanzo

We propose X-Fusion, a framework that extends pretrained Large Language Models (LLMs) for multimodal tasks while preserving their language capabilities. X-Fusion employs a dual-tower design with modality-specific weights, keeping the LLM's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Sicheng Mo , Thao Nguyen , Xun Huang , Siddharth Srinivasan Iyer , Yijun Li , Yuchen Liu , Abhishek Tandon , Eli Shechtman , Krishna Kumar Singh , Yong Jae Lee , Bolei Zhou , Yuheng Li

In Multi-Task Learning (MTL), it is a common practice to train multi-task networks by optimizing an objective function, which is a weighted average of the task-specific objective functions. Although the computational advantages of this…

Machine Learning · Computer Science 2022-07-19 Lucas Pascal , Pietro Michiardi , Xavier Bost , Benoit Huet , Maria A. Zuluaga

While semantic communications have shown the potential in the case of single-modal single-users, its applications to the multi-user scenario remain limited. In this paper, we investigate deep learning (DL) based multi-user semantic…

Signal Processing · Electrical Eng. & Systems 2021-12-21 Huiqiang Xie , Zhijin Qin , Xiaoming Tao , Khaled B. Letaief

In this paper, we describe a conceptual design methodology to design distributed neural network architectures that can perform efficient inference within sensor networks with communication bandwidth constraints. The different sensor…

Machine Learning · Computer Science 2022-10-17 Thomas Strypsteen , Alexander Bertrand

This paper addresses the Optimal Transmission Switching (OTS) problem in electricity networks, which aims to find an optimal power grid topology that minimizes system operation costs while satisfying physical and operational constraints.…

Optimization and Control · Mathematics 2024-04-08 Salvador Pineda , Juan Miguel Morales , Álvaro Porras , Concepción Domínguez

In this paper, we propose an efficient transformer architecture that uses reinforced positional embedding to obtain superior performance with half the number of encoder decoder layers. We demonstrate that concatenating positional encoding…

Computation and Language · Computer Science 2024-10-08 Yen-Che Hsiao , Abhishek Dutta

Multi-task learning (MTL) aims to leverage shared information among tasks to improve learning efficiency and accuracy. However, MTL often struggles to effectively manage positive and negative transfer between tasks, which can hinder…

Machine Learning · Computer Science 2025-05-19 Chenguang Wang , Xuanhao Pan , Tianshu Yu

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Jiawei Shao , Yuyi Mao , Jun Zhang

Large language models have steadily increased in size to achieve improved performance; however, this growth has also led to greater inference time and computational demands. Consequently, there is rising interest in model size reduction…

By offering shared computational facilities to which mobile devices can offload their computational tasks, the mobile edge computing framework is expanding the scope of applications that can be provided on resource-constrained devices. When…

Information Theory · Computer Science 2018-10-16 Mahsa Salmani , Timothy N. Davidson

Token communication has emerged as a promising framework for efficient wireless transmission by representing source data as compact semantic tokens. However, transmitting full semantic tokens still incurs considerable communication…

Information Theory · Computer Science 2026-05-05 Weixuan Chen , Qianqian Yang