English
Related papers

Related papers: Steering Multimodal Large Language Models Decoding…

200 papers

Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities for capturing and reasoning over multimodal inputs. However, these models are prone to parametric knowledge conflicts, which arise from inconsistencies of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tinghui Zhu , Qin Liu , Fei Wang , Zhengzhong Tu , Muhao Chen

Large vision-language models (LVLMs) have shown remarkable performance in visual-language understanding for downstream multimodal tasks. While their capabilities are improving, problems emerge simultaneously. Among those problems, the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Jingyuan Deng , Yujiu Yang

Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks by leveraging pre-trained (i.e., parametric) and external (i.e., contextual) knowledge. While substantial efforts have been made to enhance the…

Computation and Language · Computer Science 2025-05-19 Hyuhng Joon Kim , Youna Kim , Sang-goo Lee , Taeuk Kim

We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the…

Computation and Language · Computer Science 2024-08-28 Shannon Zejiang Shen , Hunter Lang , Bailin Wang , Yoon Kim , David Sontag

Multimodal large language models (MLLMs) have shown impressive reasoning abilities. However, they are also more vulnerable to jailbreak attacks than their LLM predecessors. Although still capable of detecting the unsafe responses, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung , James T. Kwok , Yu Zhang

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

This paper introduces Multimodal Speculative Decoding (MSD) to accelerate Multimodal Large Language Models (MLLMs) inference. Speculative decoding has been shown to accelerate Large Language Models (LLMs) without sacrificing accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Luxi Lin , Zhihang Lin , Zhanpeng Zeng , Rongrong Ji

Zero-shot In-context learning is the phenomenon where models can perform the task simply given the instructions. However, pre-trained large language models are known to be poorly calibrated for this task. One of the most effective…

Computation and Language · Computer Science 2024-04-04 Suzanna Sia , Alexandra DeLucia , Kevin Duh

While reasoning models have achieved remarkable success in complex reasoning tasks, their increasing power necessitates stringent safety measures. For safety alignment, the core challenge lies in the inherent trade-off between safety and…

Cryptography and Security · Computer Science 2026-02-17 Yanbo Wang , Minzheng Wang , Jian Liang , Lu Wang , Yongcan Yu , Ran He

Decoding from large language models (LLMs) typically relies on fixed sampling hyperparameters (e.g., temperature, top-p), despite substantial variation in task difficulty and uncertainty across prompts and individual decoding steps. We…

Machine Learning · Computer Science 2026-03-17 Chloe H. Su , Zhe Ye , Samuel Tenka , Aidan Yang , Soonho Kong , Udaya Ghai

Large vision-language models (LVLMs) have shown remarkable capabilities in visual-language understanding for downstream multi-modal tasks. Despite their success, LVLMs still suffer from generating hallucinations in complex generation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiaming Li , Jiacheng Zhang , Zequn Jie , Lin Ma , Guanbin Li

Large language models (LLMs) have showcased impressive multilingual machine translation ability. However, unlike encoder-decoder style models, decoder-only LLMs lack an explicit alignment between source and target contexts. Analyzing…

Computation and Language · Computer Science 2024-06-12 Hongbin Zhang , Kehai Chen , Xuefeng Bai , Yang Xiang , Min Zhang

Ensuring that large language models (LMs) are fair, robust and useful requires an understanding of how different modifications to their inputs impact the model's behaviour. In the context of open-text generation tasks, however, such an…

Computation and Language · Computer Science 2023-05-15 Gal Yona , Or Honovich , Itay Laish , Roee Aharoni

Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build context through seemingly benign conversational turns to circumvent safety measures and elicit…

Cryptography and Security · Computer Science 2025-03-21 Prashant Kulkarni , Assaf Namer

Despite extensive efforts to align Large Language Models (LLMs) with human values and safety rules, jailbreak attacks that exploit certain vulnerabilities continuously emerge, highlighting the need to strengthen existing LLMs with…

Machine Learning · Computer Science 2025-09-30 Xuekang Wang , Shengyu Zhu , Xueqi Cheng

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

As Multimodal Large Language Models (MLLMs) gain widespread applicability, it is becoming increasingly desirable to adapt them for diverse user needs. In this paper, we study the adaptation of MLLMs through controlled decoding. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Oscar Mañas , Pierluca D'Oro , Koustuv Sinha , Adriana Romero-Soriano , Michal Drozdzal , Aishwarya Agrawal

Video large language models (Vid-LLMs), which excel in diverse video-language tasks, can be effectively constructed by adapting image-pretrained vision-language models (VLMs). However, this adaptation remains challenging, as it requires…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yiyang Huang , Yizhou Wang , Yun Fu

Fine-tuning large language models (LLMs) to adapt to evolving safety policies is costly and impractical. Mechanistic interpretability enables inference-time control through latent activation steering, yet its potential for precise,…

Machine Learning · Computer Science 2025-06-06 Shaona Ghosh , Amrita Bhattacharjee , Yftah Ziser , Christopher Parisien

Large Language Diffusion Models (LLDMs) benefit from a flexible decoding mechanism that enables parallelized inference and controllable generations over autoregressive models. Yet such flexibility introduces a critical challenge: inference…

Machine Learning · Computer Science 2025-12-05 Yichuan Mo , Quan Chen , Mingjie Li , Zeming Wei , Yisen Wang