English
Related papers

Related papers: Consistency of Feature Markov Processes

200 papers

In a deterministic world, a planning agent can be certain of the consequences of its planned sequence of actions. Not so, however, in dynamic, stochastic domains where Markov decision processes are commonly used. Unfortunately these suffer…

Artificial Intelligence · Computer Science 2014-01-21 Jiri Baum , Ann E. Nicholson , Trevor I. Dix

Model reduction of Markov processes is a basic problem in modeling state-transition systems. Motivated by the state aggregation approach rooted in control theory, we study the statistical state compression of a discrete-state Markov chain…

Machine Learning · Statistics 2019-11-26 Anru Zhang , Mengdi Wang

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

The rapid advancement and widespread adoption of machine learning-driven technologies have underscored the practical and ethical need for creating interpretable artificial intelligence systems. Feature importance, a method that assigns…

Machine Learning · Computer Science 2023-12-07 Nimrod Harel , Uri Obolski , Ran Gilad-Bachrach

Reinforcement learning has solid foundations, but becomes inefficient in partially observed (non-Markovian) environments. Thus, a learning agent -born with a representation and a policy- might wish to investigate to what extent the Markov…

Artificial Intelligence · Computer Science 2011-03-02 Gabor Matuz , Andras Lorincz

Reformulating the history matching problem from a least-square mathematical optimization problem into a Markov Decision Process introduces a method in which reinforcement learning can be utilized to solve the problem. This method provides a…

Machine Learning · Computer Science 2022-12-26 Omar S. Alolayan , Abdullah O. Alomar , John R. Williams

We consider social learning in a changing world. Society can remain responsive to state changes only if agents regularly act upon fresh information, which limits the value of social learning. When the state is close to persistent, a…

Theoretical Economics · Economics 2022-01-07 Raphaël Lévy , Marcin Pęski , Nicolas Vieille

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

We consider dynamic programming problems with a large time horizon, and give sufficient conditions for the existence of the uniform value. As a consequence, we obtain an existence result when the state space is precompact, payoffs are…

Optimization and Control · Mathematics 2009-04-20 Jérôme Renault

We consider the problem of learning a policy for a Markov decision process consistent with data captured on the state-actions pairs followed by the policy. We assume that the policy belongs to a class of parameterized policies which are…

Optimization and Control · Mathematics 2017-01-24 Manjesh K. Hanawal , Hao Liu , Henghui Zhu , Ioannis Ch. Paschalidis

The recent framework of performative prediction is aimed at capturing settings where predictions influence the target/outcome they want to predict. In this paper, we introduce a natural multi-agent version of this framework, where multiple…

Machine Learning · Computer Science 2022-01-26 Georgios Piliouras , Fang-Yi Yu

When predictions support decisions they may influence the outcome they aim to predict. We call such predictions performative; the prediction influences the target. Performativity is a well-studied phenomenon in policy-making that has so far…

Machine Learning · Computer Science 2021-03-02 Juan C. Perdomo , Tijana Zrnic , Celestine Mendler-Dünner , Moritz Hardt

We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint…

Optimization and Control · Mathematics 2022-08-30 Pierre Carpentier , Jean-Philippe Chancelier , Michel de Lara

We introduce LAMP: the Linear Additive Markov Process. Transitions in LAMP may be influenced by states visited in the distant history of the process, but unlike higher-order Markov processes, LAMP retains an efficient parametrization. LAMP…

Machine Learning · Computer Science 2017-04-06 Ravi Kumar , Maithra Raghu , Tamas Sarlos , Andrew Tomkins

Constructing general knowledge by learning task-independent models of the world can help agents solve challenging problems. However, both constructing and evaluating such models remains an open challenge. The most common approaches to…

Artificial Intelligence · Computer Science 2021-04-15 Alex Kearney , Anna Koop , Patrick M. Pilarski

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

Optimization and Control · Mathematics 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

We present an empirical study on methods for span finding, the selection of consecutive tokens in text for some downstream tasks. We focus on approaches that can be employed in training end-to-end information extraction systems, and find…

Computation and Language · Computer Science 2022-10-17 Weiwei Gu , Boyuan Zheng , Yunmo Chen , Tongfei Chen , Benjamin Van Durme

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

Machine Learning · Computer Science 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

Future sequence represents the outcome after executing the action into the environment (i.e. the trajectory onwards). When driven by the information-theoretic concept of mutual information, it seeks maximally informative consequences.…

Machine Learning · Computer Science 2023-11-15 Jianfei Ma

We discuss the notorious problem of order selection in hidden Markov models, i.e. of selecting an adequate number of states, highlighting typical pitfalls and practical challenges arising when analyzing real data. Extensive simulations are…

Methodology · Statistics 2017-04-18 Jennifer Pohle , Roland Langrock , Floris van Beest , Niels Martin Schmidt