中文
相关论文

相关论文: More than Correlation: Do Large Language Models Le…

200 篇论文

Geometric analyses of large language model (LLM) representations reveal structured variation across depth but remain fundamentally correlational with respect to token prediction formation. Meanwhile, causal interventions expose…

机器学习 · 计算机科学 2026-05-27 Shahar Haim , Daniel C McNamee

This research focuses on assessing the ability of AI foundation models in representing the trajectories of movements. We utilize one of the large language models (LLMs) (i.e., GPT-J) to encode the string format of trajectories and then…

计算与语言 · 计算机科学 2024-09-04 Yuhan Ji , Song Gao

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

计算与语言 · 计算机科学 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

计算与语言 · 计算机科学 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Recent advances in mechanistic interpretability have revealed that large language models (LLMs) develop internal representations corresponding not only to concrete entities but also distinct, human-understandable abstract concepts and…

机器学习 · 计算机科学 2025-12-01 Rio Alexa Fear , Payel Mukhopadhyay , Michael McCabe , Alberto Bietti , Miles Cranmer

We have only limited understanding of how and why large language models (LLMs) respond in the ways that they do. Their neural networks have proven challenging to interpret, and we are only beginning to tease out the function of individual…

计算与语言 · 计算机科学 2025-11-12 Dillon Plunkett , Adam Morris , Keerthi Reddy , Jorge Morales

Many social science questions ask how linguistic properties causally affect an audience's attitudes and behaviors. Because text properties are often interlinked (e.g., angry reviews use profane language), we must control for possible latent…

统计方法学 · 统计学 2025-10-13 Graham Tierney , Srikar Katta , Christopher Bail , Sunshine Hillygus , Alexander Volfovsky

The causal capabilities of large language models (LLMs) are a matter of significant debate, with critical implications for the use of LLMs in societally impactful domains such as medicine, science, law, and policy. We conduct a "behavorial"…

人工智能 · 计算机科学 2024-08-21 Emre Kıcıman , Robert Ness , Amit Sharma , Chenhao Tan

Understanding what defines a good representation in large language models (LLMs) is fundamental to both theoretical understanding and practical applications. In this paper, we investigate the quality of intermediate representations in…

机器学习 · 计算机科学 2024-12-13 Oscar Skean , Md Rifat Arefin , Yann LeCun , Ravid Shwartz-Ziv

Large language models (LLMs) achieve impressive results over various tasks, and ever-expanding public repositories contain an abundance of pre-trained models. Therefore, identifying the best-performing LLM for a given task is a significant…

计算与语言 · 计算机科学 2025-11-13 Idan Kashani , Avi Mendelson , Yaniv Nemcovsky

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

计算与语言 · 计算机科学 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum

Applying AI foundation models directly to geospatial datasets remains challenging due to their limited ability to represent and reason with geographical entities, specifically vector-based geometries and natural language descriptions of…

计算与语言 · 计算机科学 2025-05-26 Yuhan Ji , Song Gao , Ying Nie , Ivan Majić , Krzysztof Janowicz

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

机器学习 · 计算机科学 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Both humans and large language models (LLMs) exhibit content effects: biases in which the plausibility of the semantic content of a reasoning problem influences judgments regarding its logical validity. While this phenomenon in humans is…

计算与语言 · 计算机科学 2026-04-21 Leonardo Bertolazzi , Sandro Pezzelle , Raffaella Bernardi

The theory of Conceptual Spaces is an influential cognitive-linguistic framework for representing the meaning of concepts. Conceptual spaces are constructed from a set of quality dimensions, which essentially correspond to primitive…

计算与语言 · 计算机科学 2023-10-10 Usashi Chatterjee , Amit Gajbhiye , Steven Schockaert

Evaluating the surroundings to gain understanding, frame perspectives, and anticipate behavioral reactions is an inherent human trait. However, these continuous encounters are diverse and complex, posing challenges to their study and…

计算机与社会 · 计算机科学 2026-02-26 Deepank Verma , Olaf Mumm , Vanessa Miriam Carlow

Qualitative Spatial Reasoning is a well explored area of Knowledge Representation and Reasoning and has multiple applications ranging from Geographical Information Systems to Robotics and Computer Vision. Recently, many claims have been…

计算与语言 · 计算机科学 2024-12-02 Anthony G Cohn , Robert E Blackwell

As large language models (LLMs) advance in their linguistic capacity, understanding how they capture aspects of language competence remains a significant challenge. This study therefore employs psycholinguistic paradigms in English, which…

计算与语言 · 计算机科学 2024-12-12 Xufeng Duan , Xinyu Zhou , Bei Xiao , Zhenguang G. Cai

Large Language Models (LLMs) inherently carry the biases contained in their training corpora, which can lead to the perpetuation of societal harm. As the impact of these foundation models grows, understanding and evaluating their biases…

计算与语言 · 计算机科学 2024-10-08 Rohin Manvi , Samar Khanna , Marshall Burke , David Lobell , Stefano Ermon

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

计算机与社会 · 计算机科学 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli