English
Related papers

Related papers: Bears, all bears, and some bears. Language Constra…

200 papers

Most large language models are trained on linguistic input alone, yet humans appear to ground their understanding of words in sensorimotor experience. A natural solution is to augment LM representations with human judgments of a word's…

Computation and Language · Computer Science 2022-03-14 Sean Trott , Benjamin Bergen

Language models (LMs) are statistical models trained to assign probability to human-generated text. As such, it is reasonable to question whether they approximate linguistic variability exhibited by humans well. This form of statistical…

Computation and Language · Computer Science 2024-03-19 Evgenia Ilia , Wilker Aziz

The learning trajectories of linguistic phenomena in humans provide insight into linguistic representation, beyond what can be gleaned from inspecting the behavior of an adult speaker. To apply a similar approach to analyze neural language…

Computation and Language · Computer Science 2022-04-07 Leshem Choshen , Guy Hacohen , Daphna Weinshall , Omri Abend

How well do representations learned by ML models align with those of humans? Here, we consider concept representations learned by deep learning models and evaluate whether they show a fundamental behavioral signature of human concepts, the…

Artificial Intelligence · Computer Science 2024-05-28 Siddhartha K. Vemuri , Raj Sanjay Shah , Sashank Varma

Strong inductive biases give humans the ability to quickly learn to perform a variety of tasks. Although meta-learning is a method to endow neural networks with useful inductive biases, agents trained by meta-learning may sometimes acquire…

Generic sentences express generalisations about the world without explicit quantification. Although generics are central to everyday communication, building a precise semantic framework has proven difficult, in part because speakers use…

Computation and Language · Computer Science 2024-12-17 Gustavo Cilleruelo Calderón , Emily Allaway , Barry Haddow , Alexandra Birch

Pretraining Neural Language Models (NLMs) over a large corpus involves chunking the text into training examples, which are contiguous text segments of sizes processable by the neural architecture. We highlight a bias introduced by this…

Computation and Language · Computer Science 2022-03-22 Yoav Levine , Noam Wies , Daniel Jannai , Dan Navon , Yedid Hoshen , Amnon Shashua

Recent advances in foundation models present new opportunities for interpretable visual recognition -- one can first query Large Language Models (LLMs) to obtain a set of attributes that describe each class, then apply vision-language…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 An Yan , Yu Wang , Yiwu Zhong , Chengyu Dong , Zexue He , Yujie Lu , William Wang , Jingbo Shang , Julian McAuley

Much of the world's population experiences some form of disability during their lifetime. Caution must be exercised while designing natural language processing (NLP) systems to prevent systems from inadvertently perpetuating ableist bias…

Computation and Language · Computer Science 2021-10-04 Saad Hassan , Matt Huenerfauth , Cecilia Ovesdotter Alm

Are the predictions of humans and language models affected by similar things? Research suggests that while comprehending language, humans make predictions about upcoming words, with more predictable words being processed more easily.…

Computation and Language · Computer Science 2022-11-11 James A. Michaelov , Benjamin K. Bergen

When children learn new words, they employ constraints such as the mutual exclusivity (ME) bias: a novel word is mapped to a novel object rather than a familiar one. This bias has been studied computationally, but only in models that use…

Computation and Language · Computer Science 2024-03-25 Leanne Nortje , Dan Oneaţă , Yevgen Matusevych , Herman Kamper

Throughout language history, words are borrowed from one language to another and gradually become integrated into the recipient's lexicon. Speakers can often differentiate these loanwords from native vocabulary, particularly in bilingual…

Computation and Language · Computer Science 2026-03-04 Mérilin Sousa Silva , Sina Ahmadi

Although an object may appear in numerous contexts, we often describe it in a limited number of ways. Language allows us to abstract away visual variation to represent and communicate concepts. Building on this intuition, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Mohamed El Banani , Karan Desai , Justin Johnson

Children's early speech often bears little resemblance to that of adults, and yet parents and other caregivers are able to interpret that speech and react accordingly. Here we investigate how these adult inferences as listeners reflect…

Computation and Language · Computer Science 2023-03-17 Stephan C. Meylan , Ruthe Foushee , Nicole H. Wong , Elika Bergelson , Roger P. Levy

Language models (LMs) are used for a diverse range of tasks, from question answering to writing fantastical stories. In order to reliably accomplish these tasks, LMs must be able to discern the modal category of a sentence (i.e., whether it…

Computation and Language · Computer Science 2026-04-29 Michael A. Lepori , Jennifer Hu , Ishita Dasgupta , Roma Patel , Thomas Serre , Ellie Pavlick

Language models (LMs) trained on large quantities of text have been claimed to acquire abstract linguistic representations. Our work tests the robustness of these abstractions by focusing on the ability of LMs to learn interactions between…

Computation and Language · Computer Science 2020-10-13 Forrest Davis , Marten van Schijndel

Large language models are powerful systems that excel at many tasks, ranging from translation to mathematical reasoning. Yet, at the same time, these models often show unhuman-like characteristics. In the present paper, we address this gap…

Computation and Language · Computer Science 2023-06-08 Marcel Binz , Eric Schulz

The ability to derive underlying principles from a handful of observations and then generalize to novel situations -- known as inductive reasoning -- is central to human intelligence. Prior work suggests that language models (LMs) often…

Computation and Language · Computer Science 2024-05-24 Linlu Qiu , Liwei Jiang , Ximing Lu , Melanie Sclar , Valentina Pyatkin , Chandra Bhagavatula , Bailin Wang , Yoon Kim , Yejin Choi , Nouha Dziri , Xiang Ren

The surge in popularity of large language models has given rise to concerns about biases that these models could learn from humans. We investigate whether ingroup solidarity and outgroup hostility, fundamental social identity biases known…

Computation and Language · Computer Science 2024-06-18 Tiancheng Hu , Yara Kyrychenko , Steve Rathje , Nigel Collier , Sander van der Linden , Jon Roozenbeek

The ability to combine linguistic guidance from others with direct experience is central to human development, enabling safe and rapid learning in new environments. How do people integrate these two sources of knowledge, and how might AI…

Artificial Intelligence · Computer Science 2026-02-19 Cédric Colas , Tracey Mills , Ben Prystawski , Michael Henry Tessler , Noah Goodman , Jacob Andreas , Joshua Tenenbaum