English
Related papers

Related papers: Increasing Value of Information Implies Separable …

200 papers

We provide a general theoretical analysis of expected out-of-sample utility, also referred to as decision-theoretic classification, for non-decomposable binary classification metrics such as F-measure and Jaccard coefficient. Our key result…

Machine Learning · Computer Science 2015-05-08 Nagarajan Natarajan , Oluwasanmi Koyejo , Pradeep Ravikumar , Inderjit S. Dhillon

One purpose -- quite a few thinkers would say the main purpose -- of seeking knowledge about the world is to enhance our ability to make good decisions. An item of knowledge that can make no conceivable difference with regard to anything we…

Artificial Intelligence · Computer Science 2013-04-12 Henry E. Kyburg

The accessible information and the informational power quantify the maximum amount of information that can be extracted from a quantum ensemble and by a quantum measurement, respectively. Here, we investigate the tradeoff between the…

Quantum Physics · Physics 2019-06-05 Michele Dall'Arno , Francesco Buscemi

We consider a dual model of decision making, in which an individual forms its opinion based on contrasting mechanisms of imitation and rational calculation. The decision making model (DMM) implements imitating behavior by means of a network…

Adaptation and Self-Organizing Systems · Physics 2015-06-22 Malgorzata Turalska , Bruce J. West

Mutual information is one of the essential building blocks of information theory. Yet, it is only finitely defined for distributions with fast decaying tails on a countable joint alphabet of two random elements. The unboundedness of mutual…

Information Theory · Computer Science 2019-07-15 Zhiyi Zhang

We study the problem of fairly allocating indivisible goods among a set of agents. Our focus is on the existence of allocations that give each agent their maximin fair share--the value they are guaranteed if they divide the goods into as…

Computer Science and Game Theory · Computer Science 2024-07-19 Sirin Botan , Angus Ritossa , Mashbat Suzuki , Toby Walsh

Auction-based Federated Learning (AFL) has attracted extensive research interest due to its ability to motivate data owners to join FL through economic means. Existing works assume that only one data consumer and multiple data owners exist…

Machine Learning · Computer Science 2023-05-16 Xiaoli Tang , Han Yu

What is the best compromise in a situation where different people value different things? The most commonly accepted method for answering this question -- in fields across the behavioral and social sciences, decision theory, philosophy, and…

Artificial Intelligence · Computer Science 2024-10-10 Jared Moore , Yejin Choi , Sydney Levine

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

This paper establishes a general equivalence between discrete choice and rational inattention models. Matejka and McKay (2015, AER) showed that when information costs are modelled using the Shannon entropy function, the resulting choice…

Econometrics · Economics 2017-09-27 Mogens Fosgerau , Emerson Melo , Andre de Palma , Matthew Shum

Scientific Computing typically requires large computational needs which have been addressed with High Performance Distributed Computing. It is essential to efficiently deploy a number of complex scientific applications, which have different…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Mariza Ferro , Antonio R. Mury , Bruno Schulze

We investigate notions of ambiguity and partial information in categorical distributional models of natural language. Probabilistic ambiguity has previously been studied using Selinger's CPM construction. This construction works well for…

Logic in Computer Science · Computer Science 2017-01-04 Dan Marsden

Information theory has explained the organization of many biological phenomena, from the physiology of sensory receptive fields to the variability of certain DNA sequence ensembles. Some scholars have proposed that information should…

Other Quantitative Biology · Quantitative Biology 2010-10-25 Edward K. Agarwala , Hillel J. Chiel , Peter J. Thomas

Computation of Mutual Information (MI) helps understand the amount of information shared between a pair of random variables. Automated feature selection techniques based on MI ranking are regularly used to extract information from sensitive…

Cryptography and Security · Computer Science 2020-09-24 Ankit Srivastava , Samira Pouyanfar , Joshua Allen , Ken Johnston , Qida Ma

Decision making in modern stochastic systems, including e-commerce platforms, financial markets and healthcare systems, has evolved into a multifaceted process that combines information acquisition and adaptive information sources. This…

Optimization and Control · Mathematics 2026-01-07 Renyuan Xu , Thaleia Zariphopoulou , Luhao Zhang

The exploration-exploitation trade-off is central to the description of adaptive behaviour in fields ranging from machine learning, to biology, to economics. While many approaches have been taken, one approach to solving this trade-off has…

Machine Learning · Computer Science 2021-11-29 Beren Millidge , Anil Seth , Christopher Buckley

We investigate the sets of joint probability distributions that maximize the average multi-information over a collection of margins. These functionals serve as proxies for maximizing the multi-information of a set of variables or the mutual…

Information Theory · Computer Science 2019-06-14 Thomas Merkh , Guido Montúfar

We consider the robust exponential utility maximization problem in discrete time: An investor maximizes the worst case expected exponential utility with respect to a family of nondominated probabilistic models of her endowment by…

Portfolio Management · Quantitative Finance 2019-02-12 Daniel Bartl

We study the convex duality method for robust utility maximization in the presence of a random endowment. When the underlying price process is a locally bounded semimartingale, we show that the fundamental duality relation holds true for a…

Computational Finance · Quantitative Finance 2015-03-17 Keita Owari

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets