English
Related papers

Related papers: Bounded Rational Decision-Making with Adaptive Neu…

200 papers

Although many investigators affirm a desire to build reasoning systems that behave consistently with the axiomatic basis defined by probability theory and utility theory, limited resources for engineering and computation can make a complete…

Artificial Intelligence · Computer Science 2013-04-11 Eric J. Horvitz

Bayesian decision theory provides an elegant framework for acting optimally under uncertainty when tractable posterior distributions are available. Modern Bayesian models, however, typically involve intractable posteriors that are…

Machine Learning · Computer Science 2021-06-15 Meet P. Vadera , Soumya Ghosh , Kenney Ng , Benjamin M. Marlin

Rational and neural network based approximations are efficient tools in modern approximation. These approaches are able to produce accurate approximations to nonsmooth and non-Lipschitz functions, including multivariate domain functions. In…

Optimization and Control · Mathematics 2023-09-08 Vinesha Peiris , Reinier Diaz Millan , Nadezda Sukhorukova , Julien Ugon

Selective rationalization improves neural network interpretability by identifying a small subset of input features -- the rationale -- that best explains or supports the prediction. A typical rationalization criterion, i.e. maximum mutual…

Machine Learning · Computer Science 2020-03-24 Shiyu Chang , Yang Zhang , Mo Yu , Tommi S. Jaakkola

We study zeroth-order optimization where solutions must minimize a cost $d(s)$ while maintaining high probability under a complex generative prior $L(s)$ (e.g., a parameterized model). This reduces to sampling from a target distribution…

Machine Learning · Computer Science 2026-05-06 Pranjal Awasthi , Sreenivas Gollapudi , Ravi Kumar , Kamesh Munagala

The success of neural networks comes hand in hand with a desire for more interpretability. We focus on text classifiers and make them more interpretable by having them provide a justification, a rationale, for their predictions. We approach…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Wilker Aziz , Ivan Titov

Optimal planning with respect to learned neural network (NN) models in continuous action and state spaces using mixed-integer linear programming (MILP) is a challenging task for branch-and-bound solvers due to the poor linear relaxation of…

Artificial Intelligence · Computer Science 2019-07-29 Buser Say , Scott Sanner , Sylvie Thiébaux

We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as…

Data Analysis, Statistics and Probability · Physics 2018-02-16 Henry H. Mattingly , Mark K. Transtrum , Michael C. Abbott , Benjamin B. Machta

Rational decision making in its linguistic description means making logical decisions. In essence, a rational agent optimally processes all relevant information to achieve its goal. Rationality has two elements and these are the use of…

Artificial Intelligence · Computer Science 2019-02-14 Tshilidzi Marwala

We study the subtlety of optimal paternalism when a utilitarian planner has the power to design a discrete choice set for a heterogeneous population with bounded rationality. We first consider the planning problem in abstraction. We show…

Econometrics · Economics 2026-01-23 Charles F. Manski , Eytan Sheshinski

We propose information-directed sampling -- a new approach to online optimization problems in which a decision-maker must balance between exploration and exploitation while learning from partial feedback. Each action is sampled in a manner…

Machine Learning · Computer Science 2017-07-10 Daniel Russo , Benjamin Van Roy

Human decisional processes result from the employment of selected quantities of relevant information, generally synthesized from environmental incoming data and stored memories. Their main goal is the production of an appropriate and…

Artificial Intelligence · Computer Science 2016-09-08 Graziano Barnabei , Franco Bagnoli , Ciro Conversano , Elena Lensi

Classic decision-theory is based on the maximum expected utility (MEU) principle, but crucially ignores the resource costs incurred when determining optimal decisions. Here we propose an axiomatic framework for bounded decision-making that…

Artificial Intelligence · Computer Science 2010-07-09 Pedro A. Ortega , Daniel A. Braun

Predictive uncertainty quantification is crucial for reliable decision-making in various applied domains. Bayesian neural networks offer a powerful framework for this task. However, defining meaningful priors and ensuring computational…

Machine Learning · Computer Science 2024-04-30 Yijia Liu , Xiao Wang

We study the problem of modeling a population of agents pursuing unknown goals subject to unknown computational constraints. In standard models of bounded rationality, sub-optimal decision-making is simulated by adding homoscedastic noise…

Artificial Intelligence · Computer Science 2023-12-08 Athul Paul Jacob , Abhishek Gupta , Jacob Andreas

We analyze boundedly rational updating from aggregate statistics in a model with binary actions and binary states. Agents each take an irreversible action in sequence after observing the unordered set of previous actions. Each agent first…

Machine Learning · Computer Science 2021-01-11 Itai Arieli , Yakov Babichenko , Manuel Mueller-Frank

We propose a new framework for reasoning about information in complex systems. Our foundation is based on a variational extension of Shannon's information theory that takes into account the modeling power and computational constraints of…

Machine Learning · Computer Science 2020-02-26 Yilun Xu , Shengjia Zhao , Jiaming Song , Russell Stewart , Stefano Ermon

In experimental applications of bounded-reasoning models, behavior is often summarized by distributions of "levels". We argue that such summaries conflate two conceptually distinct dimensions: a player's type, capturing beliefs about what…

Theoretical Economics · Economics 2026-04-15 Shuige Liu , Gabriel Ziegler

Neural networks can be compressed to reduce memory and computational requirements, or to increase accuracy by facilitating the use of a larger base architecture. In this paper we focus on pruning individual neurons, which can simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Bin Dai , Chen Zhu , David Wipf

In meta-learning an agent extracts knowledge from observed tasks, aiming to facilitate learning of novel future tasks. Under the assumption that future tasks are 'related' to previous tasks, the accumulated knowledge should be learned in a…

Machine Learning · Statistics 2019-05-21 Ron Amit , Ron Meir