English
Related papers

Related papers: From Sparse Decisions to Dense Reasoning: A Multi-…

200 papers

Learning-based quadruped controllers achieve impressive agility but typically lack formal safety guarantees under model uncertainty, perception noise, and unstructured contact conditions. We introduce SafeMind, a differentiable stochastic…

Robotics · Computer Science 2026-04-13 Zukun Zhang , Kai Shu , Mingqiao Mo

Unified Multimodal Models (UMMs) offer powerful cross-modality capabilities but introduce new safety risks not observed in single-task models. Despite their emergence, existing safety benchmarks remain fragmented across tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Segyu Lee , Boryeong Cho , Hojung Jung , Seokhyun An , Juhyeong Kim , Jaehyun Kwak , Yongjin Yang , Sangwon Jang , Youngrok Park , Wonjun Chang , Se-Young Yun

Unified Multimodal Models (UMMs) built on shared autoregressive (AR) transformers are attractive for their architectural simplicity. However, we identify a critical limitation: when trained on multimodal inputs, modality-shared transformers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jitai Hao , Hao Liu , Xinyan Xiao , Qiang Huang , Jun Yu

Image generation models (IGMs), while capable of producing impressive and creative content, often memorize a wide range of undesirable concepts from their training data, leading to the reproduction of unsafe content such as NSFW imagery and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Renyang Liu , Kangjie Chen , Han Qiu , Jie Zhang , Kwok-Yan Lam , Tianwei Zhang , See-Kiong Ng

Cross-modal retrieval (CMR) aims to establish interaction between different modalities, among which supervised CMR is emerging due to its flexibility in learning semantic category discrimination. Despite the remarkable performance of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Haochen Han , Minnan Luo , Huan Liu , Fang Nan

Multimodal sarcasm detection requires resolving pragmatic incongruity across textual, acoustic, and visual cues through cross-modal reasoning. To enable robust sarcasm reasoning with foundation models, we propose SarcasmMiner, a…

Multimedia · Computer Science 2026-03-06 Zhu Li , Yongjian Chen , Huiyuan Lai , Xiyuan Gao , Shekhar Nayak , Matt Coler

Unified multimodal models (UMMs) aim to integrate multimodal understanding and generation within a unified architecture, yet it remains unclear to what extent their representations are truly aligned across modalities. To investigate this…

Computation and Language · Computer Science 2026-04-08 Cheng Yang , Chufan Shi , Bo Shui , Yaokang Wu , Muzi Tao , Huijuan Wang , Ivan Yee Lee , Yong Liu , Xuezhe Ma , Taylor Berg-Kirkpatrick

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

Toxicity detection in multimodal text-image content faces growing challenges, especially with multimodal implicit toxicity, where each modality appears benign on its own but conveys hazard when combined. Multimodal implicit toxicity appears…

Multimedia · Computer Science 2025-05-21 Shiyao Cui , Qinglin Zhang , Xuan Ouyang , Renmiao Chen , Zhexin Zhang , Yida Lu , Hongning Wang , Han Qiu , Minlie Huang

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

Artificial Intelligence · Computer Science 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

The rapid advancement of multi-modal large reasoning models (MLRMs) -- enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities -- has revolutionized diverse applications. However, their safety…

Machine Learning · Computer Science 2025-04-15 Junfeng Fang , Yukai Wang , Ruipeng Wang , Zijun Yao , Kun Wang , An Zhang , Xiang Wang , Tat-Seng Chua

Representation Learning is a significant and challenging task in multimodal learning. Effective modality representations should contain two parts of characteristics: the consistency and the difference. Due to the unified multimodal…

Computation and Language · Computer Science 2021-02-10 Wenmeng Yu , Hua Xu , Ziqi Yuan , Jiele Wu

Consistency models (CMs) have shown promise in the efficient generation of both image and text. This raises the natural question of whether we can learn a unified CM for efficient multimodal generation (e.g., text-to-image) and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chenkai Xu , Xu Wang , Zhenyi Liao , Yishun Li , Tianqi Hou , Zhijie Deng

Large Reasoning Models (LRMs) have advanced automated multi-step reasoning, but their ability to generate complex Chain-of-Thought (CoT) trajectories introduces severe privacy risks, as sensitive information may be deeply embedded…

Artificial Intelligence · Computer Science 2026-01-15 Jingjing Zhou , Gaoxiang Cong , Li Su , Liang Li

Current coding benchmarks often inflate Large Language Model (LLM) capabilities due to static paradigms and data contamination, enabling models to exploit statistical shortcuts rather than genuine reasoning. To address this, we introduce…

Software Engineering · Computer Science 2026-02-17 Xinyue Zheng , Haowei Lin , Shaofei Cai , Zilong Zheng , Yaodong Yang , Yitao Liang

Chain-of-Thought (CoT) reasoning has been widely adopted to enhance Large Language Models (LLMs) by decomposing complex tasks into simpler, sequential subtasks. However, extending CoT to vision-language reasoning tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Luozheng Qin , Jia Gong , Yuqing Sun , Tianjiao Li , Mengping Yang , Xiaomeng Yang , Chao Qu , Zhiyu Tan , Hao Li

Deployed language models must decide not only what to answer but also when not to answer. We present UniCR, a unified framework that turns heterogeneous uncertainty evidence including sequence likelihoods, self-consistency dispersion,…

Computation and Language · Computer Science 2025-12-30 Markus Oehri , Giulia Conti , Kaviraj Pather , Alexandre Rossi , Laia Serra , Adrian Parody , Rogvi Johannesen , Aviaja Petersen , Arben Krasniqi

Accurate vehicle rating prediction can facilitate designing and configuring good vehicles. This prediction allows vehicle designers and manufacturers to optimize and improve their designs in a timely manner, enhance their product…

Machine Learning · Computer Science 2024-01-05 Hanqi Su , Binyang Song , Faez Ahmed

Social media platforms struggle to protect users from harmful content through content moderation. These platforms have recently leveraged machine learning models to cope with the vast amount of user-generated content daily. Since moderation…

Machine Learning · Computer Science 2023-01-27 Donghyun Son , Byounggyu Lew , Kwanghee Choi , Yongsu Baek , Seungwoo Choi , Beomjun Shin , Sungjoo Ha , Buru Chang

With the powerful reasoning capabilities of large language models (LLMs) and vision-language models (VLMs), many recent works have explored using them for decision-making. However, most of these approaches rely solely on language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihao Sun , Zhilong Zhang , Yang Yu , Pierre-Luc Bacon