English
Related papers

Related papers: A New Decision- Making Method Based on Shannon Ent…

200 papers

Cone distribution functions from statistics are turned into Multi-Criteria Decision Making tools. It is demonstrated that this procedure can be considered as an upgrade of the weighted sum scalarization insofar as it absorbs a whole…

Artificial Intelligence · Computer Science 2024-01-17 Andreas H Hamel , Daniel Kostner

We study the problem of supervised linear dimensionality reduction, taking an information-theoretic viewpoint. The linear projection matrix is designed by maximizing the mutual information between the projected signal and the class label…

Machine Learning · Computer Science 2012-07-03 Minhua Chen , William Carson , Miguel Rodrigues , Robert Calderbank , Lawrence Carin

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

We consider a generalization of the discrete-time Self Healing Umbrella Sampling method, which is an adaptive importance technique useful to sample multimodal target distributions. The importance function is based on the weights (namely the…

Probability · Mathematics 2017-09-04 Gersende Fort , Benjamin Jourdain , Tony Lelièvre , Gabriel Stoltz

This paper proposes a new class of online policies for scheduling in input-buffered crossbar switches. Our policies are throughput optimal for a large class of arrival processes which satisfy strong-law of large numbers. Given an initial…

Networking and Internet Architecture · Computer Science 2009-02-09 Gagan Raj Gupta , Sujay Sanghavi , Ness B. Shroff

Many decision-making problems feature multiple objectives where it is not always possible to know the preferences of a human or agent decision-maker for different objectives. However, demonstrated behaviors from the decision-maker are often…

Artificial Intelligence · Computer Science 2024-10-01 Junlin Lu , Patrick Mannion , Karl Mason

We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a…

Systems and Control · Electrical Eng. & Systems 2021-11-30 Kiran Rokade , Rachel Kalpana Kalaimani

Envelope methodology is succinctly pitched as a class of procedures for increasing efficiency in multivariate analyses without altering traditional objectives \citep[first sentence of page 1]{cook2018introduction}. This description is true…

Methodology · Statistics 2020-02-05 Daniel J. Eck

We present a framework to address a class of sequential decision making problems. Our framework features learning the optimal control policy with robustness to noisy data, determining the unknown state and action parameters, and performing…

Machine Learning · Computer Science 2022-01-20 Amber Srivastava , Srinivasa M Salapaka

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Large-scale data analysis is growing at an exponential rate as data proliferates in our societies. This abundance of data has the advantage of allowing the decision-maker to implement complex models in scenarios that were prohibitive…

Optimization and Control · Mathematics 2022-01-11 Marco Repetto , Davide La Torre , Muhammad Tariq

Remarkable progress has been made in difference-in-differences (DID) approaches to causal inference that estimate the average effect of a treatment on the treated (ATT). Of these, the semiparametric DID (SDID) approach incorporates a…

Methodology · Statistics 2026-03-09 Takamichi Baba , Yoshiyuki Ninomiya

Our objective is to sample the node set of a large unknown graph via crawling, to accurately estimate a given metric of interest. We design a random walk on an appropriately defined weighted graph that achieves high efficiency by…

Social and Information Networks · Computer Science 2011-03-29 M. Kurant , M. Gjoka , C. T. Butts , A. Markopoulou

In this article we provide initial findings regarding the problem of solving likelihood equations by means of a maximum entropy approach. Unlike standard procedures that require equating at zero the score function of the maximum-likelihood…

Computation · Statistics 2019-06-18 Antonio Calcagnì , Livio Finos , Gianmarco Altoè , Massimiliano Pastore

Stacking, a potent ensemble learning method, leverages a meta-model to harness the strengths of multiple base models, thereby enhancing prediction accuracy. Traditional stacking techniques typically utilize established learning models, such…

Machine Learning · Computer Science 2024-10-31 Wei Wu , Liang Tang , Zhongjie Zhao , Chung-Piaw Teo

In the context of modern environmental and societal concerns, there is an increasing demand for methods able to identify management strategies for civil engineering systems, minimizing structural failure risks while optimally planning…

Artificial Intelligence · Computer Science 2023-04-17 Pablo G. Morato , Charalampos P. Andriotis , Konstantinos G. Papakonstantinou , Philippe Rigo

We aim to create the highest possible quality of treatment-control matches for categorical data in the potential outcomes framework. Matching methods are heavily used in the social sciences due to their interpretability, but most matching…

Machine Learning · Statistics 2019-06-11 Yameng Liu , Aw Dieng , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

We show how the Shannon entropy function can be used as a basis to set up complexity measures weighting the economic efficiency of countries and the specialization of products beyond bare diversification. This entropy function guarantees…

Physics and Society · Physics 2021-06-04 Gianluca Teza , Michele Caraglio , Attilio L. Stella

When facing uncertainty, decision-makers want predictions they can trust. A machine learning provider can convey confidence to decision-makers by guaranteeing their predictions are distribution calibrated -- amongst the inputs that receive…

Machine Learning · Statistics 2021-07-14 Shengjia Zhao , Michael P. Kim , Roshni Sahoo , Tengyu Ma , Stefano Ermon

Due to its ability to combine multiple base clusterings into a probably better and more robust clustering, the ensemble clustering technique has been attracting increasing attention in recent years. Despite the significant success, one…

Machine Learning · Computer Science 2020-01-01 Dong Huang , Chang-Dong Wang , Jian-Huang Lai