English
Related papers

Related papers: Deep Joint Source-Channel Coding for Multi-Task Ne…

200 papers

Generative joint source-channel coding (GJSCC) has emerged as a new Deep JSCC paradigm for achieving high-fidelity and robust image transmission under extreme wireless channel conditions, such as ultra-low bandwidth and low signal-to-noise…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Kailin Tan , Jincheng Dai , Sixian Wang , Guo Lu , Shuo Shao , Kai Niu , Wenjun Zhang , Ping Zhang

The advent of 6G networks demands unprecedented levels of intelligence, adaptability, and efficiency to address challenges such as ultra-high-speed data transmission, ultra-low latency, and massive connectivity in dynamic environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chen Zhu , Kang Liang , Jianrong Bao , Zhouxiang Zhao , Zhaohui Yang , Zhaoyang Zhang , Mohammad Shikh-Bahaei

The goal of semantic communication is to surpass optimal Shannon's criterion regarding a notable problem for future communication which lies in the integration of collaborative efforts between the intelligence of the transmission source and…

Information Theory · Computer Science 2023-10-03 Xinchao Zhong , Sean Longyu Ma , Hong-fu Chou , Arsham Mostaani , Thang X. Vu , Symeon Chatzinotas

Neural-based multi-task learning (MTL) has gained significant improvement, and it has been successfully applied to recommendation system (RS). Recent deep MTL methods for RS (e.g. MMoE, PLE) focus on designing soft gating-based…

Artificial Intelligence · Computer Science 2023-08-21 Qi Liu , Zhilong Zhou , Gangwei Jiang , Tiezheng Ge , Defu Lian

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

Machine Learning · Statistics 2014-11-11 Chen Fang , Daniel N. Rockmore

This paper introduces a universal federated learning framework that enables over-the-air computation via digital communications, using a new joint source-channel coding scheme. Without relying on channel state information at devices, this…

Information Theory · Computer Science 2024-03-05 Seyed Mohammad Azimi-Abarghouyi , Lav R. Varshney

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Modern NLP applications have enjoyed a great boost utilizing neural networks models. Such deep neural models, however, are not applicable to most human languages due to the lack of annotated training data for various NLP tasks.…

Computation and Language · Computer Science 2019-06-06 Xilun Chen , Ahmed Hassan Awadallah , Hany Hassan , Wei Wang , Claire Cardie

Multi-task learning (MTL) is often achieved by merging datasets before fine-tuning, but the growing availability of fine-tuned models has led to new approaches such as model merging via task arithmetic. A major challenge in this setting is…

Machine Learning · Computer Science 2025-09-15 Brahim Touayouch , Loïc Fosse , Géraldine Damnati , Gwénolé Lecorvé

Training a Deep Neural Network (DNN) from scratch requires a large amount of labeled data. For a classification task where only small amount of training data is available, a common solution is to perform fine-tuning on a DNN which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Ying Lu , Liming Chen , Alexandre Saidi

In this paper, we present a new MTL framework that searches for structures optimized for multiple tasks with diverse graph topologies and shares features among tasks. We design a restricted DAG-based central network with read-in/read-out…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Wonhyeok Choi , Sunghoon Im

Lightweight and efficient deep joint source-channel coding (JSCC) is a key technology for semantic communications. In this paper, we design a novel JSCC scheme named MambaJSCC, which utilizes a visual state space model with channel…

Information Theory · Computer Science 2024-05-07 Tong Wu , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Wenjun Zhang , Ping Zhang

Integrated Sensing and Communication (ISAC) systems have garnered significant attention due to their capability to simultaneously achieve efficient communication and environmental sensing. A core objective in this field is characterizing…

Information Theory · Computer Science 2026-01-16 Gefei Peng , Youlong Wu

Multi-task large language models (MTLLMs) are important for many applications at the wireless edge, where users demand specialized models to handle multiple tasks efficiently. However, training MTLLMs is complex and exhaustive, particularly…

Signal Processing · Electrical Eng. & Systems 2026-02-09 Aladin Djuhera , Vlad C. Andrei , Mohsen Pourghasemian , Haris Gacanin , Holger Boche , Walid Saad

Deep learning-based massive MIMO CSI feedback has received a lot of attention in recent years. Now, there exists a plethora of CSI feedback models mostly based on auto-encoders (AE) architecture with an encoder network at the user equipment…

Information Theory · Computer Science 2022-12-02 Sharan Mourya , SaiDhiraj Amuru , Kiran Kumar Kuchi

In this paper, we address the problem of Multiple Transmitter Localization (MTL). MTL is to determine the locations of potential multiple transmitters in a field, based on readings from a distributed set of sensors. In contrast to the…

Networking and Internet Architecture · Computer Science 2022-03-23 Caitao Zhan , Mohammad Ghaderibaneh , Pranjal Sahu , Himanshu Gupta

While existing studies have highlighted the advantages of deep learning (DL)-based joint source-channel coding (JSCC) schemes in enhancing transmission efficiency, they often overlook the crucial aspect of resource management during the…

Information Theory · Computer Science 2024-04-01 Kaiyi Chi , Qianqian Yang , Yuanchao Shu , Zhaohui Yang , Zhiguo Shi

Multi-task dense prediction aims to perform multiple pixel-level tasks simultaneously. However, capturing global cross-task interactions remains non-trivial due to the quadratic complexity of standard self-attention on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Chen Liu , Hengyu Man , Xiaopeng Fan , Debin Zhao

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivated by a practical scenario where a resource constrained edge…

Machine Learning · Computer Science 2025-05-26 Alessio Devoto , Jary Pomponi , Mattia Merluzzi , Paolo Di Lorenzo , Simone Scardapane