中文
相关论文

相关论文: TextShield-R1: Reinforced Reasoning for Tampered T…

200 篇论文

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee

Visual Text Rendering (VTR) remains a critical challenge in text-to-image generation, where even advanced models frequently produce text with structural anomalies such as distortion, blurriness, and misalignment. However, we find that…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Hanshen Zhu , Yuliang Liu , Xuecheng Wu , An-Lan Wang , Hao Feng , Dingkang Yang , Chao Feng , Can Huang , Jingqun Tang , Xiang Bai

Face recognition remains vulnerable to presentation attacks, calling for robust Face Anti-Spoofing (FAS) solutions. Recent MLLM-based FAS methods reformulate the binary classification task as the generation of brief textual descriptions to…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Haoyuan Zhang , Keyao Wang , Guosheng Zhang , Haixiao Yue , Zhiwen Tan , Siran Peng , Tianshuo Zhang , Xiao Tan , Kunbin Chen , Wei He , Jingdong Wang , Ajian Liu , Xiangyu Zhu , Zhen Lei

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Safe reinforcement learning (RL) agents accomplish given tasks while adhering to specific constraints. Employing constraints expressed via easily-understandable human language offers considerable potential for real-world applications due to…

机器学习 · 计算机科学 2024-05-16 Xingzhou Lou , Junge Zhang , Ziyan Wang , Kaiqi Huang , Yali Du

The deployment of Vision-Language Models (VLMs) in safety-critical domains like autonomous driving (AD) is critically hindered by reliability failures, most notably object hallucination. This failure stems from their reliance on ungrounded,…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Zhenguo Zhang , Haohan Zheng , Yishen Wang , Le Xu , Tianchen Deng , Xuefeng Chen , Qu Chen , Bo Zhang , Wuxiong Huang

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Multimodal Large Language Models (MLLMs) with unified architectures excel across a wide range of vision-language tasks, yet aligning them with personalized image generation remains a significant challenge. Existing methods for MLLMs are…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Qian Liang , Yujia Wu , Kuncheng Li , Jiwei Wei , Shiyuan He , Jinyu Guo , Ning Xie

The growing capability of video generation poses escalating security risks, making reliable detection increasingly essential. In this paper, we introduce VideoVeritas, a framework that integrates fine-grained perception and fact-based…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Hao Tan , Jun Lan , Senyuan Shi , Zichang Tan , Zijian Yu , Huijia Zhu , Weiqiang Wang , Jun Wan , Zhen Lei

Large Language Models (LLMs) have achieved human-level fluency in text generation, making it difficult to distinguish between human-written and LLM-generated texts. This poses a growing risk of misuse of LLMs and demands the development of…

计算与语言 · 计算机科学 2024-02-20 Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

While rule-based reinforcement learning has recently catalyzed explicit reasoning in multimodal models, tactile reasoning remains largely underexplored. Existing tactile-language models primarily rely on supervised or contrastive…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yingxin Lai , Yafei Zhou , Fucai Zhu , Siyu Zhu , Weihao Yuan

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

Reinforcement learning from verifiable rewards (RLVR) has recently been extended from text-only LLMs to vision-language models (VLMs) to elicit long-chain multimodal reasoning. However, RLVR-trained VLMs still exhibit two persistent failure…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hoang Anh Just , Yifei Fan , Handong Zhao , Jiuxiang Gu , Ruiyi Zhang , Simon Jenni , Kushal Kafle , Ruoxi Jia , Jing Shi

Super-resolution (SR) is an ill-posed inverse problem with many feasible solutions consistent with a given low-resolution image. On one hand, regressive SR models aim to balance fidelity and perceptual quality to yield a single solution,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Cansu Korkmaz , Ahmet Murat Tekalp , Zafer Dogan

Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document length increases. This stems from two fundamental challenges: 1) a low Signal-to-Noise…

人工智能 · 计算机科学 2026-05-12 Hao Yan , Yuliang Liu , Xingchen Liu , Yuyi Zhang , Minghui Liao , Jihao Wu , Wei Chen , Xiang Bai

Scoring the Optical Character Recognition (OCR) capabilities of Large Multimodal Models (LMMs) has witnessed growing interest. Existing benchmarks have highlighted the impressive performance of LMMs in text recognition; however, their…

The development of Large Language Models (LLMs) often confronts challenges stemming from the heavy reliance on human annotators in the reinforcement learning with human feedback (RLHF) framework, or the frequent and costly external queries…

计算与语言 · 计算机科学 2025-03-04 Shangding Gu , Alois Knoll , Ming Jin

Multimodal Large Language Models (MLLMs) have demonstrated exceptional success in various multimodal tasks, yet their deployment is frequently limited by substantial computational demands and prolonged inference times. Given that the vision…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Zihui Zhao , Yingxin Li , Yang Li