English
Related papers

Related papers: Geometry-Lite: Interpretable Safety Probing via La…

200 papers

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lightweight,…

Computation and Language · Computer Science 2025-10-16 Juan Ren , Mark Dras , Usman Naseem

Geometric problem solving, as a typical multimodal reasoning problem, has attracted much attention and made great progress recently, however most of works focus on plane geometry while usually fail in solid geometry due to 3D spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruoran Xu , Haoyu Cheng , Bin Dong , Qiufeng Wang

Safety benchmarks are routinely treated as evidence about how a language model will behave once deployed, but this inference is fragile if behavior depends on whether a prompt looks like an evaluation. We define evaluation-context…

Computation and Language · Computer Science 2026-05-08 Florian A. D. Burnat , Brittany I. Davidson

The task of room layout estimation is to locate the wall-floor, wall-ceiling, and wall-wall boundaries. Most recent methods solve this problem based on edge/keypoint detection or semantic segmentation. However, these approaches have shown…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Weidong Zhang , Wei Zhang , Yinda Zhang

The growing awareness of safety concerns in large language models (LLMs) has sparked considerable interest in the evaluation of safety. This study investigates an under-explored issue about the evaluation of LLMs, namely the substantial…

Computation and Language · Computer Science 2024-04-02 Yixu Wang , Yan Teng , Kexin Huang , Chengqi Lyu , Songyang Zhang , Wenwei Zhang , Xingjun Ma , Yu-Gang Jiang , Yu Qiao , Yingchun Wang

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for detecting jailbreak prompts are primarily online moderation APIs or finetuned LLMs. These strategies, however, often require extensive and…

Computation and Language · Computer Science 2024-05-31 Yueqi Xie , Minghong Fang , Renjie Pi , Neil Gong

Large Language Models (LLMs) can comply with harmful instructions, raising serious safety concerns despite their impressive capabilities. Recent work has leveraged probing-based approaches to study the separability of malicious and benign…

Computation and Language · Computer Science 2025-12-16 Cheng Wang , Zeming Wei , Qin Liu , Muhao Chen

This paper explores the potential of Large Language Models(LLMs) in zero-shot anomaly detection for safe visual navigation. With the assistance of the state-of-the-art real-time open-world object detection model Yolo-World and specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Hao Wang , Jiayou Qin , Ashish Bastola , Xiwen Chen , John Suchanek , Zihao Gong , Abolfazl Razi

Consistency under paraphrase, the property that semantically equivalent prompts yield identical predictions, is increasingly used as a proxy for reliability when deploying medical vision-language models (VLMs). We show this proxy is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Binesh Sadanandan , Vahid Behzadan

Current safety alignment methods encode safe behavior implicitly within model parameters, creating a fundamental opacity: we cannot easily inspect why a model refuses a request, nor intervene when its safety judgments fail. We propose Safe…

Machine Learning · Computer Science 2026-03-10 Jingyuan Feng , Andrew Gambardella , Gouki Minegishi , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

Transformer-based language models create hidden representations of their inputs at every layer, but only use final-layer representations for prediction. This obscures the internal decision-making process of the model and the utility of its…

Computation and Language · Computer Science 2024-06-21 Alexander Yom Din , Taelin Karidi , Leshem Choshen , Mor Geva

Graph representation learning (GRL) has evolved from topology-only graph embeddings to task-specific supervised GNNs, and more recently to reusable representations and graph foundation models (GFMs). However, existing evaluations mainly…

Machine Learning · Computer Science 2026-05-08 Xiaoguang Guo , Zehong Wang , Ziming Li , Shawn Spitzel , Soonwoo Kwon , Tianyi Ma , Yanfang Ye , Chuxu Zhang

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

Machine Learning · Computer Science 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

Large Language Models (LLMs) perform internal computations in continuous vector spaces yet produce discrete tokens -- a fundamental mismatch whose geometric consequences remain poorly understood. We develop a mathematical framework that…

Machine Learning · Computer Science 2026-03-25 Mohamed A. Mabrok

Recent vision-language models (VLMs) such as CLIP, OpenCLIP, EVA02-CLIP and SigLIP achieve strong zero-shot performance, but it is unclear how reliably they respond to controlled linguistic perturbations. We introduce Language-Guided…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Jae Joong Lee

Fine-tuning large language models (LLMs) is a common practice to adapt generalist models to specialized domains. However, recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical…

Computation and Language · Computer Science 2026-04-24 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Holger Boche

We investigate whether independently trained language models converge to geometrically compatible latent representations, and whether this compatibility can be exploited to correct model behavior at inference time without any weight…

Machine Learning · Computer Science 2026-03-24 Marcus Armstrong , Navid Ayoobi , Arjun Mukherjee

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Muhammad Adil , Gaang Lee , Vicente A. Gonzalez , Qipei Mei