English
Related papers

Related papers: Certified Robustness for Large Language Models wit…

200 papers

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

This paper presents a defense framework for enhancing the safety of large language model (LLM) empowered multi-agent systems (MAS) in safety-critical domains such as aerospace. We apply randomized smoothing, a statistical robustness…

Artificial Intelligence · Computer Science 2025-07-08 Jinwei Hu , Yi Dong , Zhengtao Ding , Xiaowei Huang

Large Multimodal Models (LMMs) such as LLaVA are typically trained with an autoregressive language modeling objective, providing only indirect supervision to visual tokens. This often yields weak internal visual representations and brittle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Dhruv Parikh , Jacob Fein-Ashley , Rajgopal Kannan , Viktor Prasanna

The advent of instruction-tuned Large Language Models designed for coding tasks (Code LLMs) has transformed software engineering practices. However, their robustness against various input challenges remains a critical concern. This study…

Software Engineering · Computer Science 2024-12-02 Md Imran Hossen , Xiali Hei

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai

Large Language Models (LLMs) have gained enormous attention in recent years due to their capability of understanding and generating natural languages. With the rapid development and wild-range applications (e.g., Agents, Embodied…

Computation and Language · Computer Science 2025-07-10 Kun Zhang , Le Wu , Kui Yu , Guangyi Lv , Dacao Zhang

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba

Large Language Models (LLMs) have recently emerged as powerful tools for autoformalization. Despite their impressive performance, these models can still struggle to produce grounded and verifiable formalizations. Recent work in text-to-SQL,…

Computation and Language · Computer Science 2025-12-05 Hayden Moore , Asfahan Shah

Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g. misclassify several…

Machine Learning · Computer Science 2024-02-27 Jan Schuchardt , Tom Wollschläger , Aleksandar Bojchevski , Stephan Günnemann

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

Computation and Language · Computer Science 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial input uncertainty, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Quantization has emerged as a mainstream method for compressing Large Language Models (LLMs), reducing memory requirements and accelerating inference without architectural modifications. While existing research primarily focuses on…

Software Engineering · Computer Science 2025-07-01 Sen Fang , Weiyuan Ding , Antonio Mastropaolo , Bowen Xu

Randomized smoothing is a technique for providing provable robustness guarantees against adversarial attacks while making minimal assumptions about a classifier. This method relies on taking a majority vote of any base classifier over…

Machine Learning · Computer Science 2023-05-09 Ambar Pal , Jeremias Sulam

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Large Language Models (LLMs) are increasingly applied to complex tasks that require extended reasoning. In such settings, models often benefit from diverse chains-of-thought to arrive at multiple candidate solutions. This requires two…

Machine Learning · Computer Science 2025-10-08 Xueyan Li , Guinan Su , Mrinmaya Sachan , Jonas Geiping

Large Language Models (LLMs) have the potential to revolutionize scientific research, yet their robustness and reliability in domain-specific applications remain insufficiently explored. In this study, we evaluate the performance and…

Computation and Language · Computer Science 2025-08-15 Hongchen Wang , Kangming Li , Scott Ramsay , Yao Fehlis , Edward Kim , Jason Hattrick-Simpers

Best-of-N selection is a key technique for improving the reasoning performance of Large Language Models (LLMs) through increased test-time computation. Current state-of-the-art methods often employ computationally intensive reward models…

Computation and Language · Computer Science 2025-12-15 Zhewei Kang , Xuandong Zhao , Dawn Song

Large language models (LLMs) are increasingly used as automated judges and synthetic labelers, especially in low-label settings. Yet these systems are stochastic and often overconfident, which makes deployment decisions difficult when…

Machine Learning · Computer Science 2026-03-19 Maxim Khomiakov , Jes Frellsen

Discriminative pre-trained language models (PrLMs) can be generalized as denoising auto-encoders that work with two procedures, ennoising and denoising. First, an ennoising process corrupts texts with arbitrary noising functions to…

Computation and Language · Computer Science 2022-10-12 Zhuosheng Zhang , Hai Zhao , Ming Zhou