English
Related papers

Related papers: Geometry-Lite: Interpretable Safety Probing via La…

200 papers

Large language models (LLMs) often exhibit a puzzling disconnect between their asserted confidence and actual problem-solving competence. We offer a mechanistic account of this decoupling by analyzing the geometry of internal states across…

Computation and Language · Computer Science 2025-10-30 Debdeep Sanyal , Manya Pandey , Dhruv Kumar , Saurabh Deshpande , Murari Mandal

Predicting problem-difficulty in large language models (LLMs) refers to estimating how difficult a task is according to the model itself, typically by training linear probes on its internal representations. In this work, we study the…

Computation and Language · Computer Science 2026-01-21 Stefano Civelli , Pietro Bernardelle , Nicolò Brunello , Gianluca Demartini

Prompt engineering is essential for optimizing large language models (LLMs), yet the link between prompt structures and task performance remains underexplored. This work introduces an evolutionary approach that combines context-free grammar…

Computation and Language · Computer Science 2025-04-22 Gabriel Machado Santos , Rita Maria da Silva Julia , Marcelo Zanchetta do Nascimento

Prompt-guided generative AI models have rapidly expanded across vision and language domains, producing realistic and diverse outputs from textual inputs. The growing variety of such models, trained with different data and architectures,…

Machine Learning · Computer Science 2026-02-09 Mehdi Lotfian , Mohammad Jalali , Farzan Farnia

The geometric structure of latent representations in large language models (LLMs) is an active area of research, driven in part by its implications for model transparency and AI safety. Existing literature has focused mainly on general…

Machine Learning · Computer Science 2026-04-14 Benjamin J. Choi , Melanie Weber

RLHF-style alignment trains language models to refuse unsafe requests, but how much operational margin does this refusal rest on? We introduce the refusal-affirmation logit gap: the difference between the top refusal-token logit and the top…

Cryptography and Security · Computer Science 2026-05-05 Tung-Ling Li , Hongliang Liu

Multiple instance learning (MIL) is the standard approach for whole-slide image (WSI) classification and survival prediction, where attention-based models ag gregate patch features into slide-level predictions. These models treat attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiangyu Li , Ran Su

Large language models (LLMs) generalize smoothly across continuous semantic spaces, yet strict logical reasoning demands the formation of discrete decision boundaries. Prevailing theories relying on linear isometric projections fail to…

Machine Learning · Computer Science 2026-03-26 Long Zhang , Dai-jun Lin , Wei-neng Chen

We present a novel two-view geometry estimation framework which is based on a differentiable robust loss function fitting. We propose to treat the robust fundamental matrix estimation as an implicit layer, which allows us to avoid…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Vladislav Pyatov , Iaroslav Koshelev , Stamatis Lefkimmiatis

Applying AI foundation models directly to geospatial datasets remains challenging due to their limited ability to represent and reason with geographical entities, specifically vector-based geometries and natural language descriptions of…

Computation and Language · Computer Science 2025-05-26 Yuhan Ji , Song Gao , Ying Nie , Ivan Majić , Krzysztof Janowicz

Safety alignment is crucial to ensure that large language models (LLMs) behave in ways that align with human preferences and prevent harmful actions during inference. However, recent studies show that the alignment can be easily compromised…

Machine Learning · Computer Science 2024-11-01 ShengYun Peng , Pin-Yu Chen , Matthew Hull , Duen Horng Chau

Linear probes can detect when language models produce outputs they "know" are wrong, a capability relevant to both deception and reward hacking. However, single-layer probes are fragile: the best layer varies across models and tasks, and…

Machine Learning · Computer Science 2026-04-16 Erik Nordby , Tasha Pais , Aviel Parrack

As state-of-the-art Large Language Models (LLMs) have become ubiquitous, ensuring equitable performance across diverse demographics is critical. However, it remains unclear whether these disparities arise from the explicitly stated identity…

Computers and Society · Computer Science 2026-04-24 Irti Haq , Belén Saldías

Large language models (LLMs) generate not only reasoning text, but also token-level confidence trajectories that record how uncertainty evolves during inference. Whether these trajectories are relevant to reasoning correctness remains…

Machine Learning · Computer Science 2026-05-19 Shuo Liu , Ding Liu , Shi-Ju Ran

This paper tests whether large language models (LLMs) can support interpretative citation context analysis (CCA) by scaling in thick, text-grounded readings of a single hard case rather than scaling up typological labels. It foregrounds…

Computation and Language · Computer Science 2026-02-27 Arno Simons

Large language models (LLMs) form implicit beliefs (posteriors over latent variables) from prompts, but we lack a mechanistic account of how these beliefs are encoded in representation space, how they update with new evidence, and how…

Conventional video segmentation approaches rely heavily on appearance models. Such methods often use appearance descriptors that have limited discriminative power under complex scenarios. To improve the segmentation performance, this paper…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Wenguan Wang , Jianbing Shen , Fatih Porikli

Prompt engineering reduces reasoning mistakes in Large Language Models (LLMs). However, its effectiveness in mitigating vulnerabilities in LLM-generated code remains underexplored. To address this gap, we implemented a benchmark to…

Software Engineering · Computer Science 2025-02-11 Marc Bruni , Fabio Gabrielli , Mohammad Ghafari , Martin Kropp

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in 2D visual tasks but still exhibit limited physical spatial awareness when processing real-world visual streams. Recently, feed-forward geometric foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Chongyu Wang , Ting Huang , Chunyu Sun , Xinyu Ning , Di Wang , Hao Tang

Skeleton-based isolated sign language recognition (ISLR) demands fine-grained understanding of articulated motion across multiple spatial scales, from subtle finger movements to global body dynamics. Existing approaches typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Muxin Pu , Mei Kuan Lim , Chun Yong Chong , Chen Change Loy