English
Related papers

Related papers: Vision Transformer-based Semantic Communications W…

200 papers

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Vision Transformers (ViT) serve as powerful vision models. Unlike convolutional neural networks, which dominated vision research in previous years, vision transformers enjoy the ability to capture long-range dependencies in the data.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Moab Arar , Ariel Shamir , Amit H. Bermano

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong

Recently, semantic communications are envisioned as a key enabler of future 6G networks. Back to Shannon's information theory, the goal of communication has long been to guarantee the correct reception of transmitted messages irrespective…

Information Theory · Computer Science 2021-10-18 Mohamed Sana , Emilio Calvanese Strinati

The Vision Transformer (ViT) demonstrates exceptional performance in various computer vision tasks. Attention is crucial for ViT to capture complex wide-ranging relationships among image patches, allowing the model to weigh the importance…

Machine Learning · Statistics 2024-01-22 Tomohiro Shiraishi , Daiki Miwa , Teruyuki Katsuoka , Vo Nguyen Le Duy , Kouichi Taji , Ichiro Takeuchi

Vision Transformers (ViTs) have delivered remarkable progress through global self-attention, yet their quadratic complexity can become prohibitive for high-resolution inputs. In this work, we present ViT-Linearizer, a cross-architecture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Rama Chellappa

Recent advances in vision transformers (ViTs) have achieved great performance in visual recognition tasks. Convolutional neural networks (CNNs) exploit spatial inductive bias to learn visual representations, but these networks are spatially…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Youpeng Zhao , Huadong Tang , Yingying Jiang , Yong A , Qiang Wu

The growing demand for efficient semantic communication systems capable of managing diverse tasks and adapting to fluctuating channel conditions has driven the development of robust, resource-efficient frameworks. This article introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Xiang Chen , Shuying Gan , Chenyuan Feng , Xijun Wang , Tony Q. S. Quek

Digital semantic communication systems, which often leverage the Vector Quantized Variational Autoencoder (VQ-VAE) framework, are pivotal for future wireless networks. In a VQ-VAE-based semantic communication system, the transmission rate…

Information Theory · Computer Science 2026-02-03 Shumin Yao , Hui Du , Lifeng Xie , Yaping Sun , Hao Chen , Nan Ma , Xiaodong Xu

With the rapid development of Artificial Intelligent Internet of Things (AIoT), the image data from AIoT devices has been witnessing the explosive increasing. In this paper, a novel deep image semantic communication model is proposed for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Li Ping Qian , Yi Zhang , Sikai Lyu , Huijie Zhu , Yuan Wu , Xuemin Sherman Shen , Xiaoniu Yang

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

Vision Transformers (ViTs) have emerged as state-of-the-art models for various vision tasks recently. However, their heavy computation costs remain daunting for resource-limited devices. To address this, researchers have dedicated…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Ao Wang , Hui Chen , Zijia Lin , Sicheng Zhao , Jungong Han , Guiguang Ding

The Transformer architecture has become the state-of-art model for natural language processing tasks and, more recently, also for computer vision tasks, thus defining the Vision Transformer (ViT) architecture. The key feature is the ability…

Disordered Systems and Neural Networks · Physics 2023-06-13 Luciano Loris Viteritti , Riccardo Rende , Federico Becca

Vision transformers (ViTs) have demonstrated remarkable performance across various visual tasks. However, ViT models suffer from substantial computational and memory requirements, making it challenging to deploy them on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Navin Ranjan , Andreas Savakis

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while…

Signal Processing · Electrical Eng. & Systems 2021-12-15 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

A vision transformer (ViT) is the dominant model in the computer vision field. Despite numerous studies that mainly focus on dealing with inductive bias and complexity, there remains the problem of finding better transformer networks. For…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Jaesin Ahn , Jiuk Hong , Jeongwoo Ju , Heechul Jung

Transformers have emerged as a competitive alternative to convnets in vision tasks, yet they lack the architectural inductive bias of convnets, which may hinder their potential performance. Specifically, Vision Transformers (ViTs) are not…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hagay Michaeli , Daniel Soudry

A large body of recent work targets semantically conditioned image generation. Most such methods focus on the narrower task of pose transfer and ignore the more challenging task of subject transfer that consists in not only transferring the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicolas Dufour , David Picard , Vicky Kalogeiton

Image quality assessment (IQA) algorithm aims to quantify the human perception of image quality. Unfortunately, there is a performance drop when assessing the distortion images generated by generative adversarial network (GAN) with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Shanshan Lao , Yuan Gong , Shuwei Shi , Sidi Yang , Tianhe Wu , Jiahao Wang , Weihao Xia , Yujiu Yang