中文
相关论文

相关论文: SA-OOSC: A Multimodal LLM-Distilled Semantic Commu…

200 篇论文

The performance of object instance segmentation in remote sensing images has been greatly improved through the introduction of many landmark frameworks based on convolutional neural network. However, the object densely issue still affects…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Yingchao Feng , Wenhui Diao , Zhonghan Chang , Menglong Yan , Xian Sun , Xin Gao

Multimodal Large Language Models (MLLMs) have achieved strong performance on general visual benchmarks but struggle with out-of-distribution (OOD) tasks in specialized domains such as medical imaging, where labeled data is limited and…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Ci-Siang Lin , Min-Hung Chen , Yu-Yang Sheng , Yu-Chiang Frank Wang

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava

Watermarking LLM-generated text is critical for content attribution and misinformation prevention. However, existing methods compromise text quality, require white-box model access and logit manipulation. These limitations exclude API-based…

计算与语言 · 计算机科学 2026-01-13 Zhuohao Yu , Xingru Jiang , Weizheng Gu , Yidong Wang , Qingsong Wen , Shikun Zhang , Wei Ye

Large Vision-Language Models (LVLMs) have demonstrated strong multimodal reasoning capabilities on long and complex documents. However, their high memory footprint makes them impractical for deployment on resource-constrained edge devices.…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Tanveer Hannan , Dimitrios Mallios , Parth Pathak , Faegheh Sardari , Thomas Seidl , Gedas Bertasius , Mohsen Fayyaz , Sunando Sengupta

Interpretability remains a key challenge for deploying large language models (LLMs) in clinical settings such as Alzheimer's disease progression diagnosis, where early and trustworthy predictions are essential. Existing attribution methods…

Large Language Models (LLMs) demonstrate exceptional reasoning capabilities, often achieving state-of-the-art performance in various tasks. However, their substantial computational and memory demands, due to billions of parameters, hinder…

计算与语言 · 计算机科学 2024-11-25 Xunyu Zhu , Jian Li , Can Ma , Weiping Wang

This work proposes a grammar-based chunking strategy that segments input streams into semantically complete units by parsing dependency relations (e.g., noun phrase boundaries, verb-object structures) and punctuation features. The method…

计算与语言 · 计算机科学 2025-08-12 Zeyu Yang , Lai Wei , Roman Koshkin , Xi Chen , Satoshi Nakamura

Large language models (LLMs) have demonstrated remarkable performance across a wide range of industrial applications, from search and recommendation systems to generative tasks. Although scaling laws indicate that larger models generally…

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

多媒体 · 计算机科学 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Recently many multi-label image recognition (MLR) works have made significant progress by introducing pre-trained object detection models to generate lots of proposals or utilizing statistical label co-occurrence enhance the correlation…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Tao Pu , Mingzhan Sun , Hefeng Wu , Tianshui Chen , Ling Tian , Liang Lin

The surge in connected devices in 6G with typical complex tasks requiring multi-user cooperation, such as smart agriculture and smart cities, poses significant challenges to unsustainable traditional communication. Fortunately, the booming…

网络与互联网体系结构 · 计算机科学 2025-02-24 Wanting Yang , Zehui Xiong , Shiwen Mao , Tony Q. S. Quek , Ping Zhang , Merouane Debbah , Rahim Tafazolli

Modern Earth Observation (EO) systems increasingly rely on high-resolution imagery to support critical applications such as environmental monitoring, disaster response, and land-use analysis. Although these applications benefit from…

Sign languages, used by around 70 million Deaf individuals globally, are visual languages that convey visual and contextual information. Current methods in vision-based sign language recognition (SLR) and translation (SLT) struggle with…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yuqi Liu , Wenqian Zhang , Sihan Ren , Chengyu Huang , Jingyi Yu , Lan Xu

Task-oriented semantic communications (TSC) enhance radio resource efficiency by transmitting task-relevant semantic information. However, current research often overlooks the inherent semantic distinctions among encoded features. Due to…

信息论 · 计算机科学 2024-05-02 Shuai Lyu , Yao Sun , Linke Guo , Xiaoyong Yuan , Fang Fang , Lan Zhang , Xianbin Wang

We propose Vision-Language Feature-based Multimodal Semantic Communication (VLF-MSC), a unified system that transmits a single compact vision-language representation to support both image and text generation at the receiver. Unlike existing…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Gwangyeon Ahn , Jiwan Seo , Joonhyuk Kang

Semantic communication (SemComm) has emerged as a new communication paradigm. To enhance efficiency, multiple-input-multiple-output (MIMO) technology has been further integrated into SemComm systems. However, existing MIMO SemComm systems…

信号处理 · 电气工程与系统科学 2025-09-05 Mingze Gong , Shuoyao Wang , Shijian Gao , Jia Yan , Suzhi Bi

Image-Text pretraining on web-scale image caption datasets has become the default recipe for open vocabulary classification and retrieval models thanks to the success of CLIP and its variants. Several works have also used CLIP features for…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Muhammad Ferjad Naeem , Yongqin Xian , Xiaohua Zhai , Lukas Hoyer , Luc Van Gool , Federico Tombari

Multimodal large language models (MLLMs) have demonstrated impressive capabilities in visual reasoning and text generation. While previous studies have explored the application of MLLM for detecting out-of-context (OOC) misinformation, our…

多媒体 · 计算机科学 2025-10-28 Fanxiao Li , Jiaying Wu , Canyuan He , Wei Zhou

Large Language Models (LLMs) are now capable of resolving real-world GitHub issues. However, current approaches overapproximate the code context and suffer from two compounding problems: the prohibitive cost of processing massive inputs,…

软件工程 · 计算机科学 2026-03-31 Haoxiang Jia , Earl T. Barr , Sergey Mechtaev