English
Related papers

Related papers: Towards eliciting latent knowledge from LLMs with …

200 papers

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text. It is thus natural to ask whether it is possible to leverage these large models as knowledge bases for downstream…

Computation and Language · Computer Science 2022-11-09 Yanyang Li , Jianqiao Zhao , Michael R. Lyu , Liwei Wang

Recently, large language models (LLMs) have emerged as a notable field, attracting significant attention for its ability to automatically generate intelligent contents for various application domains. However, LLMs still suffer from…

Cryptography and Security · Computer Science 2024-04-29 Kongyang Chen , Zixin Wang , Bing Mi , Waixi Liu , Shaowei Wang , Xiaojun Ren , Jiaxing Shen

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Large language models are increasingly used to predict human preferences in both scientific and business endeavors, yet current approaches rely exclusively on analyzing model outputs without considering the underlying mechanisms. Using…

Computers and Society · Computer Science 2026-02-04 Sarah Ball , Simeon Allmendinger , Niklas Kühl , Frauke Kreuter

Large language models (LLMs) trained purely on text ostensibly lack any direct perceptual experience, yet their internal representations are implicitly shaped by multimodal regularities encoded in language. We test the hypothesis that…

Computation and Language · Computer Science 2025-10-06 Sophie L. Wang , Phillip Isola , Brian Cheung

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Recent advances in Large Language Models (LLMs) have opened new perspectives for automation in optimization. While several studies have explored how LLMs can generate or solve optimization models, far less is understood about what these…

Artificial Intelligence · Computer Science 2025-12-16 Francesca Da Ros , Luca Di Gaspero , Kevin Roitero

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

Computation and Language · Computer Science 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

This survey paper delves into the emerging and critical area of symbolic knowledge distillation in Large Language Models (LLMs). As LLMs like Generative Pre-trained Transformer-3 (GPT-3) and Bidirectional Encoder Representations from…

Computation and Language · Computer Science 2024-08-21 Kamal Acharya , Alvaro Velasquez , Houbing Herbert Song

When a language model generates text, the selection of individual tokens might lead it down very different reasoning paths, making uncertainty difficult to quantify. In this work, we consider whether reasoning language models represent the…

Computation and Language · Computer Science 2025-11-07 Amir Zur , Atticus Geiger , Ekdeep Singh Lubana , Eric Bigelow

Large language models (LLMs) are demonstrably capable of cross-lingual transfer, but can produce inconsistent output when prompted with the same queries written in different languages. To understand how language models are able to…

Computation and Language · Computer Science 2025-09-29 Zheng Wei Lim , Alham Fikri Aji , Trevor Cohn

The potential for large language models (LLMs) to hide messages within plain text (steganography) poses a challenge to detection and thwarting of unaligned AI agents, and undermines faithfulness of LLMs reasoning. We explore the…

Artificial Intelligence · Computer Science 2025-05-07 Artem Karpov , Tinuade Adeleke , Seong Hah Cho , Natalia Perez-Campanero

Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black…

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

Computation and Language · Computer Science 2026-01-21 Tyler Lizzo , Larry Heck

Language models trained on billions of tokens have recently led to unprecedented results on many NLP tasks. This success raises the question of whether, in principle, a system can ever ``understand'' raw text without access to some form of…

Computation and Language · Computer Science 2021-06-23 William Merrill , Yoav Goldberg , Roy Schwartz , Noah A. Smith

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

Computation and Language · Computer Science 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini