English
Related papers

Related papers: An Information-Theoretic Framework For Optimizing …

200 papers

Experiments in research on memory, language, and in other areas of cognitive science are increasingly being analyzed using Bayesian methods. This has been facilitated by the development of probabilistic programming languages such as Stan,…

Methodology · Statistics 2020-03-02 Daniel J. Schad , Michael Betancourt , Shravan Vasishth

Despite significant progress in the quality of language generated from abstractive summarization models, these models still exhibit the tendency to hallucinate, i.e., output content not supported by the source document. A number of works…

Computation and Language · Computer Science 2022-11-01 Liam van der Poel , Ryan Cotterell , Clara Meister

Bayesian Networks may be appealing for clinical decision-making due to their inclusion of causal knowledge, but their practical adoption remains limited as a result of their inability to deal with unstructured data. While neural networks do…

Machine Learning · Computer Science 2022-11-16 Paloma Rabaey , Cedric De Boom , Thomas Demeester

Bayesian persuasion and its derived information design problem has been one of the main research agendas in the economics and computation literature over the past decade. However, when attempting to apply its model and theory, one is often…

Computer Science and Game Theory · Computer Science 2023-03-21 Bonan Ni , Weiran Shen , Pingzhong Tang

Recent work on reducing bias in NLP models usually focuses on protecting or isolating information related to a sensitive attribute (like gender or race). However, when sensitive information is semantically entangled with the task…

Computation and Language · Computer Science 2022-10-25 Zexue He , Yu Wang , Julian McAuley , Bodhisattwa Prasad Majumder

Bayesian persuasion studies how an informed sender should partially disclose information so as to influence the behavior of self-interested receivers. In the last years, a growing attention has been devoted to relaxing the assumption that…

Computer Science and Game Theory · Computer Science 2022-09-02 Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Simulation-based inference (SBI) is a method to perform inference on a variety of complex scientific models with challenging inference (inverse) problems. Bayesian Optimal Experimental Design (BOED) aims to efficiently use experimental…

Machine Learning · Statistics 2025-02-13 Vincent D. Zaballa , Elliot E. Hui

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features…

Neural and Evolutionary Computing · Computer Science 2016-02-17 David Kappel , Stefan Habenschuss , Robert Legenstein , Wolfgang Maass

Sequential neuronal activity underlies a wide range of processes in the brain. Neuroscientific evidence for neuronal sequences has been reported in domains as diverse as perception, motor control, speech, spatial navigation and memory.…

Adaptation and Self-Organizing Systems · Physics 2020-04-03 Sascha Frölich , Dimitrije Marković , Stefan J. Kiebel

Understanding brain function, constructing computational models and engineering neural prosthetics require assessing two problems, namely encoding and decoding, but their relation remains controversial. For decades, the encoding problem has…

Neurons and Cognition · Quantitative Biology 2017-01-16 Hugo Gabriel Eyherabide

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

The relationship between Integrated Information Theory (IIT) and the Free-Energy Principle (FEP) remains unresolved, particularly with respect to how integrated information, proposed as the intrinsic substrate of consciousness, behaves…

Neurons and Cognition · Quantitative Biology 2025-10-07 Teruki Mayama , Sota Shimizu , Yuki Takano , Dai Akita , Hirokazu Takahashi

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

Humans systematically misrepresent probability in a stereotyped inverse-S pattern. It has been documented for decades, but its origin remains unexplained. We propose a Bayesian encoding-decoding account in which probabilities are…

Neurons and Cognition · Quantitative Biology 2026-05-14 Xin Tong , Thi Thu Uyen Hoang , Xue-Xin Wei , Michael Hahn

DeGroot (1962) developed a general framework for constructing Bayesian measures of the expected information that an experiment will provide for estimation. We propose an analogous framework for measures of information for hypothesis…

Statistics Theory · Mathematics 2019-06-18 David E. Jones , Xiao-Li Meng

This article reviews how organisms learn and recognize the world through the dynamics of neural networks from the perspective of Bayesian inference, and introduces a view on how such dynamics is described by the laws for the entropy of…

Neurons and Cognition · Quantitative Biology 2020-06-24 Hideaki Shimazaki

The explosive growth of scientists, scientific journals, articles and findings in recent years exponentially increases the difficulty scientists face in navigating prior knowledge. This challenge is exacerbated by uncertainty about the…

Social and Information Networks · Computer Science 2025-01-27 Alexander V. Belikov , Andrey Rzhetsky , James Evans

Positive correlations in the activity of neurons are widely observed in the brain. Previous studies have shown these correlations to be detrimental to the fidelity of population codes or at best marginally favorable compared to independent…

Neurons and Cognition · Quantitative Biology 2013-07-22 Rava Azeredo da Silveira , Michael J. Berry

Progress in neuroscience has provided unprecedented opportunities to advance our understanding of brain alterations and their correspondence to phenotypic profiles. With data collected from various imaging techniques, studies have…

Methodology · Statistics 2024-08-01 Zhe Sun , Wanwan Xu , Tianxi Li , Jian Kang , Gregorio Alanis-Lobato , Yize Zhao

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang