English
Related papers

Related papers: Data Informativeness in Linear Optimization under …

200 papers

We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman

Taking uncertainty into account is crucial when making strategic decisions. To guard against the risk of adverse scenarios, traditional optimisation techniques incorporate uncertainty on the basis of prior knowledge on its distribution. In…

Optimization and Control · Mathematics 2022-12-06 Julien Vaes , Vassilis M. Charitopoulos

Machine learning can significantly improve performance for decision-making under uncertainty across a wide range of domains. However, ensuring robustness guarantees requires well-calibrated uncertainty estimates, which can be difficult to…

Machine Learning · Computer Science 2026-02-03 Christopher Yeh , Nicolas Christianson , Alan Wu , Adam Wierman , Yisong Yue

Linearized models of power systems are often desirable to formulate tractable control and optimization problems that still reflect real-world physics adequately under various operating conditions. In this paper, we propose an approach that…

Optimization and Control · Mathematics 2018-05-28 Marc Hohmann , Joseph Warrington , John Lygeros

Estimating the internal state of a robotic system is complex: this is performed from multiple heterogeneous sensor inputs and knowledge sources. Discretization of such inputs is done to capture saliences, represented as symbolic…

Computation and Language · Computer Science 2015-10-15 Simon Kaltenbacher , Nicholas H. Kirk , Dongheui Lee

We develop a tractable and flexible approach for incorporating side information into dynamic optimization under uncertainty. The proposed framework uses predictive machine learning methods (such as $k$-nearest neighbors, kernel regression,…

Optimization and Control · Mathematics 2020-07-23 Dimitris Bertsimas , Christopher McCord , Bradley Sturt

A central push in operations models over the last decade has been the incorporation of models of customer choice. Real world implementations of many of these models face the formidable stumbling block of simply identifying the `right' model…

Applications · Statistics 2011-06-23 Vivek F. Farias , Srikanth Jagabathula , Devavrat Shah

We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset.…

Machine Learning · Computer Science 2020-11-10 Daniel Bashir , George D. Montanez , Sonia Sehra , Pedro Sandoval Segura , Julius Lauw

We present a novel, input-output data-driven approach to uncertainty model identification. As the true bounds and distributions of system uncertainties ultimately remain unknown, we depart from the goal of identifying the uncertainty model…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Jannes Hühnerbein , Jad Wehbeh , Eric C. Kerrigan

We propose a new approach for solving a class of discrete decision making problems under uncertainty with positive cost. This issue concerns multiple and diverse fields such as engineering, economics, artificial intelligence, cognitive…

Artificial Intelligence · Computer Science 2014-01-03 Steve N'Guyen , Clément Moulin-Frier , Jacques Droulez

A fundamental question in data-driven decision making is how to quantify the uncertainty of predictions in ways that can usefully inform downstream action. This interface between prediction uncertainty and decision-making is especially…

Machine Learning · Computer Science 2025-02-05 Shayan Kiyani , George Pappas , Aaron Roth , Hamed Hassani

Synthetic data becomes crucial for large language model training, but its effectiveness is highly inconsistent. We provide an information-theoretic account of this inconsistency: synthetic data improves a model only when the…

Machine Learning · Computer Science 2026-05-19 Hanyu Li , Zhengqi Sun , Xiaotie Deng

We are witnessing an increasing use of data-driven predictive models to inform decisions. As decisions have implications for individuals and society, there is increasing pressure on decision makers to be transparent about their decision…

Many data management applications must deal with data which is uncertain, incomplete, or noisy. However, on existing uncertain data representations, we cannot tractably perform the important query evaluation tasks of determining query…

Databases · Computer Science 2016-07-19 Antoine Amarilli

Model selection in clustering requires (i) to specify a suitable clustering principle and (ii) to control the model order complexity by choosing an appropriate number of clusters depending on the noise level in the data. We advocate an…

Information Theory · Computer Science 2010-06-03 Joachim M. Buhmann

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović

Starting from the Avellaneda-Stoikov framework, we consider a market maker who wants to optimally set bid/ask quotes over a finite time horizon, to maximize her expected utility. The intensities of the orders she receives depend not only on…

Trading and Market Microstructure · Quantitative Finance 2020-06-29 Diego Zabaljauregui , Luciano Campi

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

Machine Learning · Statistics 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

Optimization models have been broadly used within side the energy industry as useful decision-making systems for scheduling and dispatching electric powered energy resources; this is applied in a system called unit commitment (UC). Unit…

Optimization and Control · Mathematics 2022-04-01 Angel Zambrano

Economists often estimate economic models on data and use the point estimates as a stand-in for the truth when studying the model's implications for optimal decision-making. This practice ignores model ambiguity, exposes the decision…

Econometrics · Economics 2021-10-07 Maximilian Blesch , Philipp Eisenhauer