English
Related papers

Related papers: Efficient Semantic Communication Through Transform…

200 papers

The state of the art in learning meaningful semantic representations of words is the Transformer model and its attention mechanisms. Simply put, the attention mechanisms learn to attend to specific parts of the input dispensing recurrence…

Computation and Language · Computer Science 2020-12-24 Dongsheng Wang , Casper Hansen , Lucas Chaves Lima , Christian Hansen , Maria Maistro , Jakob Grue Simonsen , Christina Lioma

Semantic communications conveys task-relevant meaning rather than focusing solely on message reconstruction, improving bandwidth efficiency and robustness for next-generation wireless systems. However, learned semantic representations can…

Networking and Internet Architecture · Computer Science 2026-01-01 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

In this work, we investigate the challenging problem of on-demand semantic communication over heterogeneous wireless networks. We propose a fidelity-adjustable semantic transmission framework (FAST) that empowers wireless devices to send…

Networking and Internet Architecture · Computer Science 2023-10-31 Peichun Li , Guoliang Cheng , Jiawen Kang , Rong Yu , Liping Qian , Yuan Wu , Dusit Niyato

Semantic communication is emerging as a key paradigm for 6G networks, where the goal is not to perfectly reconstruct bits but to preserve the meaning that matters for a given task. This shift can improve bandwidth efficiency, robustness,…

Networking and Internet Architecture · Computer Science 2026-03-16 Tuğçe Bilen , Ian F. Akyildiz

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Efficient transmission of 3D point cloud data is critical for advanced perception in centralized and decentralized multi-agent robotic systems, especially nowadays with the growing reliance on edge and cloud-based processing. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Nikolaos Stathoulopoulos , Christoforos Kanellakis , George Nikolakopoulos

Generating robust and reliable correspondences across images is a fundamental task for a diversity of applications. To capture context at both global and local granularity, we propose ASpanFormer, a Transformer-based detector-free matcher…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Hongkai Chen , Zixin Luo , Lei Zhou , Yurun Tian , Mingmin Zhen , Tian Fang , David Mckinnon , Yanghai Tsin , Long Quan

Semantic correspondence is the problem of establishing correspondences across images depicting different instances of the same object or scene class. One of recent approaches to this problem is to estimate parameters of a global…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Paul Hongsuck Seo , Jongmin Lee , Deunsol Jung , Bohyung Han , Minsu Cho

The quadratic cost of attention in transformers motivated the development of efficient approaches: namely sparse and sliding window attention, convolutions and linear attention. Although these approaches result in impressive reductions in…

Machine Learning · Computer Science 2025-11-10 Jatin Prakash , Aahlad Puli , Rajesh Ranganath

In recent years, layered image compression is demonstrated to be a promising direction, which encodes a compact representation of the input image and apply an up-sampling network to reconstruct the image. To further improve the quality of…

Image and Video Processing · Electrical Eng. & Systems 2021-02-02 Trinh Man Hoang , Jinjia Zhou , Yibo Fan

Transformer-based methods have demonstrated impressive performance in low-level visual tasks such as Image Super-Resolution (SR). However, its computational complexity grows quadratically with the spatial resolution. A series of works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xin Liu , Jie Liu , Jie Tang , Gangshan Wu

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

This paper studies the computational offloading of CNN inference in device-edge co-inference systems. Inspired by the emerging paradigm semantic communication, we propose a novel autoencoder-based CNN architecture (AECNN), for effective…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Nan Li , Alexandros Iosifidis , Qi Zhang

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

Computation and Language · Computer Science 2020-04-02 Prakhar Thapak , Prodip Hore

Semantic communication is expected to be one of the cores of next-generation AI-based communications. One of the possibilities offered by semantic communication is the capability to regenerate, at the destination side, images or videos…

Artificial Intelligence · Computer Science 2026-05-18 Eleonora Grassucci , Sergio Barbarossa , Danilo Comminiello

Semantic segmentation has made significant strides in pixel-level image understanding, yet it remains limited in capturing contextual and semantic relationships between objects. Current models, such as CNN and Transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ben Rahman

This article studies the problem of image segmentation-based semantic communication in autonomous driving. In real traffic scenes, detecting the key objects (e.g., vehicles, pedestrians and obstacles) is more crucial than that of other…

Networking and Internet Architecture · Computer Science 2024-01-19 Jie Lv , Haonan Tong , Qiang Pan , Zhilong Zhang , Xinxin He , Tao Luo , Changchuan Yin

Semantic segmentation, which aims to classify every pixel in an image, is a key task in machine perception, with many applications across robotics and autonomous driving. Due to the high dimensionality of this task, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Alex Zihao Zhu , Jieru Mei , Siyuan Qiao , Hang Yan , Yukun Zhu , Liang-Chieh Chen , Henrik Kretzschmar

Vision transformer has demonstrated great potential in abundant vision tasks. However, it also inevitably suffers from poor generalization capability when the distribution shift occurs in testing (i.e., out-of-distribution data). To…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Xin Li , Cuiling Lan , Guoqiang Wei , Zhibo Chen