English
Related papers

Related papers: Modeling information acquisition via f-divergence …

200 papers

In this paper, we investigate cost-aware joint learning and optimization for multi-channel opportunistic spectrum access in a cognitive radio system. We investigate a discrete time model where the time axis is partitioned into frames. Each…

Networking and Internet Architecture · Computer Science 2018-04-12 Chao Gan , Ruida Zhou , Jing Yang , Cong Shen

Most psychophysical experiments discard half the data collected. Specifically, experiments discard reaction time data, and use binary responses (e.g. yes/no) to measure performance. Here, Shannon's information theory is used to define…

Neurons and Cognition · Quantitative Biology 2021-12-14 James V Stone

This paper considers derivation of $f$-divergence inequalities via the approach of functional domination. Bounds on an $f$-divergence based on one or several other $f$-divergences are introduced, dealing with pairs of probability measures…

Information Theory · Computer Science 2016-10-31 Igal Sason , Sergio Verdú

Social learning, a fundamental process through which individuals shape their beliefs and perspectives via observation and interaction with others, is critical for the development of our society and the functioning of social governance.…

Social and Information Networks · Computer Science 2024-10-22 Yiqing Lin , Zhanjiang Chen , Huisheng Wang , H. Vicky Zhao

Recent years have experienced increasing utilization of complex machine learning models across multiple sources of data to inform more generalizable decision-making. However, distribution shifts across data sources and privacy concerns…

Methodology · Statistics 2024-05-16 Yi Liu , Alexander W. Levis , Sharon-Lise Normand , Larry Han

Mutual information has been successfully adopted in filter feature-selection methods to assess both the relevancy of a subset of features in predicting the target variable and the redundancy with respect to other variables. However,…

Machine Learning · Computer Science 2019-07-18 Mario Beraha , Alberto Maria Metelli , Matteo Papini , Andrea Tirinzoni , Marcello Restelli

In most real-world settings such as recommender systems, finance, and healthcare, collecting useful information is costly and requires an active choice on the part of the decision maker. The decision-maker needs to learn simultaneously what…

Machine Learning · Statistics 2017-10-24 Onur Atan , Mihaela van der Schaar

We consider a discrete time financial market with proportional transaction costs under model uncertainty, and study a num\'eraire-based semi-static utility maximization problem with an exponential utility preference. The randomization…

Mathematical Finance · Quantitative Finance 2019-08-02 Shuoqing Deng , Xiaolu Tan , Xiang Yu

Precise estimation of uncertainty in predictions for AI systems is a critical factor in ensuring trust and safety. Deep neural networks trained with a conventional method are prone to over-confident predictions. In contrast to Bayesian…

Machine Learning · Computer Science 2021-01-05 Theodoros Tsiligkaridis

Though learning has become a core component of modern information processing, there is now ample evidence that it can lead to biased, unsafe, and prejudiced systems. The need to impose requirements on learning is therefore paramount,…

Machine Learning · Computer Science 2022-10-20 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

We introduce a rational inattention model which produces a unique, interior, weighted multinomial logit conditional choice probability for an agent who acquires costly information about the hedonic characteristics (e.g. whether an insurance…

Theoretical Economics · Economics 2026-01-27 Chris Engh

The article poses a general model for optimal control subject to information constraints, motivated in part by recent work of Sims and others on information-constrained decision-making by economic agents. In the average-cost optimal control…

Optimization and Control · Mathematics 2016-02-24 Ehsan Shafieepoorfard , Maxim Raginsky , Sean P. Meyn

This paper addresses an autonomous exploration problem in which a mobile sensor, placed in a previously unseen search area, utilizes an information-theoretic navigation cost function to dynamically select the next sensing action, i.e.,…

Signal Processing · Electrical Eng. & Systems 2020-07-13 Christopher Robbiano , Edwin K. P. Chong , Mahmood R. Azimi-Sadjadi

We study a data analyst's problem of acquiring data from self-interested individuals to obtain an accurate estimation of some statistic of a population, subject to an expected budget constraint. Each data holder incurs a cost, which is…

Computer Science and Game Theory · Computer Science 2019-05-15 Yiling Chen , Shuran Zheng

We investigate attention as the active pursuit of useful information. This contrasts with attention as a mechanism for the attenuation of irrelevant information. We also consider the role of short-term memory, whose use is critical to any…

Machine Learning · Computer Science 2015-11-02 Philip Bachman , David Krueger , Doina Precup

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

Attention can be used to inform choice selection in contextual bandit tasks even when context features have not been previously experienced. One example of this is in dimensional shifts, where additional feature values are introduced and…

Machine Learning · Computer Science 2025-05-16 Tailia Malloy , Roderick Seow , Cleotilde Gonzalez

We relate models based on costs of switching beliefs (e.g. due to inattention) to hypothesis tests. Specifically, for an inference problem with a penalty for mistakes and for switching the inferred value, a band of inaction is optimal. We…

General Economics · Economics 2018-08-30 Samuel N. Cohen , Timo Henckel , Gordon D. Menzies , Johannes Muhle-Karbe , Daniel J. Zizzo

Observation of other people's choices can provide useful information in many circumstances. However, individuals may not utilize this information efficiently, i.e., they may make decision-making errors in social interactions. In this paper,…

General Economics · Economics 2021-08-10 Mohsen Foroughifar

Many causal estimands are only partially identifiable since they depend on the unobservable joint distribution between potential outcomes. Stratification on pretreatment covariates can yield sharper bounds; however, unless the covariates…

Econometrics · Economics 2024-11-19 Wenlong Ji , Lihua Lei , Asher Spector