English
Related papers

Related papers: A systematic framework for generating novel experi…

200 papers

Language models are typically evaluated on their success at predicting the distribution of specific words in specific contexts. Yet linguistic knowledge also encodes relationships between contexts, allowing inferences between word…

Computation and Language · Computer Science 2023-11-09 Michael Wilson , Jackson Petty , Robert Frank

Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including…

Artificial Intelligence · Computer Science 2021-10-26 Robert E. Wray , III , James R. Kirk , John E. Laird

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor…

Computation and Language · Computer Science 2022-10-17 Anthony Sicilia , Malihe Alikhani

Language models (LMs) have been used in cognitive modeling as well as engineering studies -- they compute information-theoretic complexity metrics that simulate humans' cognitive load during reading. This study highlights a limitation of…

Computation and Language · Computer Science 2022-11-02 Tatsuki Kuribayashi , Yohei Oseki , Ana Brassard , Kentaro Inui

Modeling subrational agents, such as humans or economic households, is inherently challenging due to the difficulty in calibrating reinforcement learning models or collecting data that involves human subjects. Existing work highlights the…

Artificial Intelligence · Computer Science 2024-02-15 Andrea Coletta , Kshama Dwarakanath , Penghang Liu , Svitlana Vyetrenko , Tucker Balch

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to…

Artificial Intelligence · Computer Science 2025-12-05 Peter B. Walker , Hannah Davidson , Aiden Foster , Matthew Lienert , Thomas Pardue , Dale Russell

Language models (LMs) are increasingly used to simulate human-like responses in scenarios where accurately mimicking a population's behavior can guide decision-making, such as in developing educational materials and designing public…

Computation and Language · Computer Science 2024-07-23 Joy He-Yueya , Wanjing Anya Ma , Kanishk Gandhi , Benjamin W. Domingue , Emma Brunskill , Noah D. Goodman

Real world decision-making requires constructing mental models under uncertainty over evidence, over the underlying causal rules, and over the state of the world itself. Which computational principles underpin human inference under such…

Artificial Intelligence · Computer Science 2026-05-26 Jeffrey Qin , Wasu Top Piriyakulki , Zhuangfei Gao , Mia Radovanovic , Jessica Sommerville , Kevin Ellis , Marta Kryven

Language models (LMs) are trained on collections of documents, written by individual human agents to achieve specific goals in an outside world. During training, LMs have access only to text of these documents, with no direct evidence of…

Computation and Language · Computer Science 2022-12-06 Jacob Andreas

Deep Language Models (DLMs) provide a novel computational paradigm for understanding the mechanisms of natural language processing in the human brain. Unlike traditional psycholinguistic models, DLMs use layered sequences of continuous…

This paper presents a method to analyze the inference patterns used by Large Language Models (LLMs) for judgment in a case study on legal LLMs, so as to identify potential incorrect representations of the LLM, according to human domain…

Artificial Intelligence · Computer Science 2025-05-21 Lu Chen , Yuxuan Huang , Yixing Li , Dongrui Liu , Qihan Ren , Shuai Zhao , Kun Kuang , Zilong Zheng , Quanshi Zhang

Scientific idea generation has been extensively studied in creativity theory and computational creativity research, providing valuable frameworks for understanding and implementing creative processes. However, recent work using Large…

Artificial Intelligence · Computer Science 2025-02-18 Tianyang Gu , Jingjin Wang , Zhihao Zhang , HaoHong Li

The self-rationalising capabilities of LLMs are appealing because the generated explanations can give insights into the plausibility of the predictions. However, how faithful the explanations are to the predictions is questionable, raising…

Computation and Language · Computer Science 2024-12-18 Marc Braun , Jenny Kunz

Large Language Models (LLMs) possess general world knowledge but often struggle to generate precise predictions in structured, domain-specific contexts such as simulations. These limitations arise from their inability to ground their broad,…

Artificial Intelligence · Computer Science 2026-01-30 Guillaume Levy , Cedric Colas , Pierre-Yves Oudeyer , Thomas Carta , Clement Romac

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Forecasting future events is important for policy and decision making. In this work, we study whether language models (LMs) can forecast at the level of competitive human forecasters. Towards this goal, we develop a retrieval-augmented LM…

Machine Learning · Computer Science 2024-02-29 Danny Halawi , Fred Zhang , Chen Yueh-Han , Jacob Steinhardt

Futrell and Mahowald (2025) frame the success of neural language models (LMs) as supporting gradient, usage-based linguistic theories. I argue that LMs can also instantiate theories based on formal structures - the types of theories seen in…

Computation and Language · Computer Science 2026-05-12 R. Thomas McCoy