English
Related papers

Related papers: Selective Safety Steering via Value-Filtered Decod…

200 papers

Sparse Autoencoders uncover thousands of features in vision models, yet explaining these features without requiring human intervention remains an open challenge. While previous work has proposed generating correlation-based explanations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Javier Ferrando , Enrique Lopez-Cuena , Pablo Agustin Martin-Torres , Daniel Hinjos , Anna Arias-Duart , Dario Garcia-Gasulla

Data selection in instruction tuning emerges as a pivotal process for acquiring high-quality data and training instruction-following large language models (LLMs), but it is still a new and unexplored research area for vision-language models…

Computation and Language · Computer Science 2024-02-21 Ruibo Chen , Yihan Wu , Lichang Chen , Guodong Liu , Qi He , Tianyi Xiong , Chenxi Liu , Junfeng Guo , Heng Huang

Achieving robust safety alignment in large language models (LLMs) while preserving their utility remains a fundamental challenge. Existing approaches often struggle to balance comprehensive safety with fine-grained controllability at the…

Artificial Intelligence · Computer Science 2025-09-25 Huizhen Shu , Xuying Li , Zhuo Li

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

Computation and Language · Computer Science 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Pedestrian safety is a critical component of urban mobility and is strongly influenced by the interactions between pedestrian decision-making and driver yielding behavior at crosswalks. Modeling driver--pedestrian interactions at…

Computation and Language · Computer Science 2025-09-25 Yicheng Yang , Zixian Li , Jean Paul Bizimana , Niaz Zafri , Yongfeng Dong , Tianyi Li

Large Language Models (LLMs) often generate inconsistent responses when prompted with semantically equivalent paraphrased inputs. Recently, activation steering, a technique that modulates LLMs' behaviours by adjusting their latent…

Computation and Language · Computer Science 2025-01-23 Jingyuan Yang , Rongjun Li , Weixuan Wang , Ziyu Zhou , Zhiyong Feng , Wei Peng

Core to the vision-and-language navigation (VLN) challenge is building robust instruction representations and action decoding schemes, which can generalize well to previously unseen instructions and environments. In this paper, we report…

Computation and Language · Computer Science 2019-09-06 Xiujun Li , Chunyuan Li , Qiaolin Xia , Yonatan Bisk , Asli Celikyilmaz , Jianfeng Gao , Noah Smith , Yejin Choi

As one of their many applications, large language models (LLMs) have recently shown promise in automating register transfer level (RTL) code generation. However, conventional LLM decoding strategies, originally designed for natural…

Programming Languages · Computer Science 2025-07-04 Mohammad Akyash , Kimia Azar , Hadi Kamali

To deliver high-quality, personalized responses, large language models (LLMs) must effectively incorporate context -- personal, demographic, and cultural information specific to an end-user. For example, asking the model to explain Newton's…

Computation and Language · Computer Science 2025-02-07 Jerry Zhi-Yang He , Sashrika Pandey , Mariah L. Schrum , Anca Dragan

Scheduled sampling is widely used to mitigate the exposure bias problem for neural machine translation. Its core motivation is to simulate the inference scene during training by replacing ground-truth tokens with predicted tokens, thus…

Computation and Language · Computer Science 2021-09-01 Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Autonomous Driving (AD) encounters significant safety hurdles in long-tail unforeseen driving scenarios, largely stemming from the non-interpretability and poor generalization of the deep neural networks within the AD system, particularly…

Artificial Intelligence · Computer Science 2024-03-25 Yixuan Wang , Ruochen Jiao , Sinong Simon Zhan , Chengtian Lang , Chao Huang , Zhaoran Wang , Zhuoran Yang , Qi Zhu

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in models such as DeepSeek-R1, significantly enhances this reasoning…

Computation and Language · Computer Science 2025-07-15 Zihao Li , Xu Wang , Yuzhe Yang , Ziyu Yao , Haoyi Xiong , Mengnan Du

The safety of Large Language Models (LLMs) has gained increasing attention in recent years, but there still lacks a comprehensive approach for detecting safety issues within LLMs' responses in an aligned, customizable and explainable…

Computation and Language · Computer Science 2024-11-06 Zhexin Zhang , Yida Lu , Jingyuan Ma , Di Zhang , Rui Li , Pei Ke , Hao Sun , Lei Sha , Zhifang Sui , Hongning Wang , Minlie Huang

We propose ControlMLLM++, a novel test-time adaptation framework that injects learnable visual prompts into frozen multimodal large language models (MLLMs) to enable fine-grained region-based visual reasoning without any model retraining or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Zhiyuan Liu , Liujuan Cao , Ming-Ming Cheng , Rongrong Ji

Test-time scaling has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs) by allocating additional computational resources during inference. However, this paradigm is inherently…

Computation and Language · Computer Science 2025-09-08 Shengyin Sun , Yiming Li , Xing Li , Yingzhao Lian , Weizhe Lin , Hui-Ling Zhen , Zhiyuan Yang , Chen Chen , Xianzhi Yu , Mingxuan Yuan , Chen Ma

Large language models (LLMs) exhibit reasoning biases, often conflating content plausibility with formal logical validity. This can lead to wrong inferences in critical domains, where plausible arguments are incorrectly deemed logically…

Artificial Intelligence · Computer Science 2026-04-02 Marco Valentino , Geonhee Kim , Dhairya Dalal , Zhixue Zhao , André Freitas

Fine-tuning large language models (LLMs) based on human preferences, commonly achieved through reinforcement learning from human feedback (RLHF), has been effective in improving their performance. However, maintaining LLM safety throughout…

Artificial Intelligence · Computer Science 2025-02-18 Yingshui Tan , Yilei Jiang , Yanshi Li , Jiaheng Liu , Xingyuan Bu , Wenbo Su , Xiangyu Yue , Xiaoyong Zhu , Bo Zheng

An unintended consequence of the vast pretraining of Large Language Models (LLMs) is the verbatim memorization of fragments of their training data, which may contain sensitive or copyrighted information. In recent years, unlearning has…

Computation and Language · Computer Science 2024-11-06 Atakan Seyitoğlu , Aleksei Kuvshinov , Leo Schwinn , Stephan Günnemann

Vision-language models (VLMs) are increasingly deployed in real-world and embodied settings where safety decisions depend on visual context. However, it remains unclear which visual evidence drives these judgments. We study whether…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Carlos Hinojosa , Clemens Grange , Bernard Ghanem

Large language models (LLMs) often benefit from intermediate steps of reasoning to generate answers to complex problems. When these intermediate steps of reasoning are used to monitor the activity of the model, it is essential that this…

Machine Learning · Computer Science 2023-11-02 Fabien Roger , Ryan Greenblatt