English
Related papers

Related papers: Many Minds from One Model: Bayesian-Inspired Trans…

200 papers

While behavior learning has made impressive progress in recent times, it lags behind computer vision and natural language processing due to its inability to leverage large, human-generated datasets. Human behaviors have wide variance,…

Machine Learning · Computer Science 2022-10-13 Nur Muhammad Mahi Shafiullah , Zichen Jeff Cui , Ariuntuya Altanzaya , Lerrel Pinto

Despite the great promise of Transformers in many sequence modeling tasks (e.g., machine translation), their deterministic nature hinders them from generalizing to high entropy tasks such as dialogue response generation. Previous work…

Computation and Language · Computer Science 2020-03-31 Zhaojiang Lin , Genta Indra Winata , Peng Xu , Zihan Liu , Pascale Fung

State-of-the-art neural language models (LMs) represented by Transformers are highly complex. Their use of fixed, deterministic parameter estimates fail to account for model uncertainty and lead to over-fitting and poor generalization when…

Computation and Language · Computer Science 2021-02-10 Boyang Xue , Jianwei Yu , Junhao Xu , Shansong Liu , Shoukang Hu , Zi Ye , Mengzhe Geng , Xunying Liu , Helen Meng

Transfer learning enhances the training of novel sensory and decision models by employing rich feature representations from large, pre-trained teacher models. Cognitive neuroscience shows that the human brain creates low-dimensional,…

The use of multiple Decision Models (DMs) enables to enhance the accuracy in decisions and at the same time allows users to evaluate the confidence in decision making. In this paper we explore the ability of multiple DMs to learn from a…

Artificial Intelligence · Computer Science 2008-05-27 Vitaly Schetinin , Dayou Li , Carsten Maple

Researchers in social science and psychology have recently proposed using large language models (LLMs) as replacements for humans in behavioral research. In addition to arguments about whether LLMs accurately capture population-level…

Computation and Language · Computer Science 2025-07-09 Sonia K. Murthy , Tomer Ullman , Jennifer Hu

As a result of the growing importance of lane change intention prediction for a safe and efficient driving experience in complex driving scenarios, researchers have in recent years started to train novel machine learning algorithms on…

Machine Learning · Computer Science 2025-09-09 Francesco De Cristofaro , Cornelia Lex , Jia Hu , Arno Eichberger

We generalise the problem of inverse reinforcement learning to multiple tasks, from multiple demonstrations. Each one may represent one expert trying to solve a different task, or as different experts trying to solve the same task. Our main…

Machine Learning · Statistics 2012-09-04 Christos Dimitrakakis , Constantin Rothkopf

In cognition theory, human thinking is governed by two systems: the fast and intuitive System 1 and the slower but more deliberative System 2. Analogously, Large Language Models (LLMs) can operate in two reasoning modes: outputting only the…

Artificial Intelligence · Computer Science 2025-07-14 DiJia Su , Sainbayar Sukhbaatar , Michael Rabbat , Yuandong Tian , Qinqing Zheng

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

Recent advancements in imitation learning have led to transformer-based behavior foundation models (BFMs) that enable multi-modal, human-like control for humanoid agents. While excelling at zero-shot generation of robust behaviors, BFMs…

Machine Learning · Computer Science 2026-03-30 Ron Vainshtein , Zohar Rimon , Shie Mannor , Chen Tessler

There is increasing appetite for analysing populations of network data due to the fast-growing body of applications demanding such methods. While methods exist to provide readily interpretable summaries of heterogeneous network populations,…

Applications · Statistics 2023-06-21 Anastasia Mantziou , Simon Lunagomez , Robin Mitra

With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods allow LLMs to generate…

Computation and Language · Computer Science 2024-10-31 Yi Ren , Shangmin Guo , Linlu Qiu , Bailin Wang , Danica J. Sutherland

Although there is a rapidly growing literature on dynamic connectivity methods, the primary focus has been on separate network estimation for each individual, which fails to leverage common patterns of information. We propose novel…

Methodology · Statistics 2021-01-15 Suprateek Kundu , Jin Ming , Joe Nocera , Keith M. McGregor

Bayesian inference provides a powerful tool for leveraging observational data to inform model predictions and uncertainties. However, when such data is limited, Bayesian inference may not adequately constrain uncertainty without the use of…

Methodology · Statistics 2025-06-26 Rebekah D. White , John D. Jakeman , Tim Wildey , Troy Butler

Normative and task-driven theories offer powerful top-down explanations for biological systems, yet the goals of quantitatively arbitrating between competing theories, and utilizing them as inductive biases to improve data-driven fits of…

Artificial Intelligence · Computer Science 2025-09-30 Bahti Zakirov , Gašper Tkačik

All biological and artificial agents must learn and make decisions given limits on their ability to process information. As such, a general theory of adaptive behavior should be able to account for the complex interactions between an…

Machine Learning · Computer Science 2023-05-08 Dilip Arumugam , Mark K. Ho , Noah D. Goodman , Benjamin Van Roy

We present an algorithm for model-based reinforcement learning that combines Bayesian neural networks (BNNs) with random roll-outs and stochastic optimization for policy learning. The BNNs are trained by minimizing $\alpha$-divergences,…

Machine Learning · Statistics 2017-03-09 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

Large language models are increasingly used as computational tools for modeling human-like behavior. We introduce a behavioral induction framework that modifies model policies through fine-tuning on structured decision-making tasks: using…

Computation and Language · Computer Science 2026-05-22 Nicola Milano , Davide Marocco

This paper examines biases in large language models (LLMs) when generating synthetic populations from responses to personality questionnaires. Using five LLMs, we first assess the representativeness and potential biases in the…

Computers and Society · Computer Science 2026-02-04 Jacopo Amidei , Gregorio Ferreira , Mario Muñoz Serrano , Rubén Nieto , Andreas Kaltenbrunner