English
Related papers

Related papers: Analyzing dynamic decision-making models using Cha…

200 papers

Dynamical models of cognition play an increasingly important role in driving theoretical and experimental research in psychology. Therefore, parameter estimation, model analysis and comparison of dynamical models are of essential…

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…

Information Theory · Computer Science 2010-10-13 Maxim Raginsky

This paper deals with control of partially observable discrete-time stochastic systems. It introduces and studies Markov Decision Processes with Incomplete Information and with semi-uniform Feller transition probabilities. The important…

Optimization and Control · Mathematics 2022-08-30 Eugene A. Feinberg , Pavlo O. Kasyanov , Michael Z. Zgurovsky

Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the…

Machine Learning · Computer Science 2024-05-28 Yu-Jie Zhang , Zhen-Yu Zhang , Peng Zhao , Masashi Sugiyama

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

Social dynamics is concerned primarily with interactions among individuals and the resulting group behaviors, modeling the temporal evolution of social systems via the interactions of individuals within these systems. In particular, the…

Machine Learning · Statistics 2016-11-08 Zhen Xu , Wen Dong , Sargur Srihari

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

We propose a data-driven method to learn the time-dependent probability density of a multivariate stochastic process from sample paths, assuming that the initial probability density is known and can be evaluated. Our method uses a novel…

Machine Learning · Statistics 2025-06-19 Agnimitra Dasgupta , Javier Murgoitio-Esandi , Ali Fardisi , Assad A Oberai

We develop a prototypical stochastic model for local search around a given home. The stochastic dynamic model is motivated by experimental findings of the motion of a fruit fly around a given spot of food but shall generally describe local…

Statistical Mechanics · Physics 2018-09-12 J. Noetel , V. L. S. Freitas , E. E. N. Macau , L. Schimansky-Geier

We are interested in modeling the Darwinian evolution resulting from the interplay of phenotypic variation and natural selection through ecological interactions, in the specific scales of the biological framework of adaptive dynamics.…

Probability · Mathematics 2013-02-05 Nicolas Champagnat , Pierre-Emmanuel Jabin , Sylvie Méléard

The inherent complexity of biological agents often leads to motility behavior that appears to have random components. Robust stochastic inference methods are therefore required to understand and predict the motion patterns from time…

Soft Condensed Matter · Physics 2024-11-14 Jan Albrecht , Manfred Opper , Robert Großmann

The simulation of complex stochastic network dynamics arising, for instance, from models of coupled biomolecular processes remains computationally challenging. Often, the necessity to scan a models' dynamics over a large parameter space…

Quantitative Methods · Quantitative Biology 2013-03-14 Tiago Ramalho , Marco Selig , Ulrich Gerland , Torsten A. Enßlin

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

We develop a dynamic model of discrete choice that incorporates peer effects into random consideration sets. We characterize the equilibrium behavior and study the empirical content of the model. In our setup, changes in the choices of…

Econometrics · Economics 2021-05-19 Nail Kashaev , Natalia Lazzati

Populations are made up of an integer number of individuals and are subject to stochastic birth-death processes whose rates may vary in time. Useful quantities, like the chance of ultimate fixation, satisfy an appropriate difference…

Populations and Evolution · Quantitative Biology 2020-07-22 Jayant Pande , Nadav M. Shnerb

We use a decision-theoretic framework to study the problem of forecasting discrete outcomes when the forecaster is unable to discriminate among a set of plausible forecast distributions because of partial identification or concerns about…

Econometrics · Economics 2020-12-18 Timothy Christensen , Hyungsik Roger Moon , Frank Schorfheide

An ecosystem is a nonlinear dynamical system, its orbits giving rise to the observed complexity in the system. The diverse components of the ecosystem interact in discrete time to give rise to emergent features that determine the trajectory…

Dynamical Systems · Mathematics 2015-07-29 Sudeepto Bhattacharya , L. M. Saha

We consider the problem of imitation learning from expert demonstrations in partially observable Markov decision processes (POMDPs). Belief representations, which characterize the distribution over the latent states in a POMDP, have been…

Machine Learning · Computer Science 2019-06-25 Tanmay Gangwani , Joel Lehman , Qiang Liu , Jian Peng

In this work, we consider a binary hypothesis testing problem involving a group of human decision-makers. Due to the nature of human behavior, each human decision-maker observes the phenomenon of interest sequentially up to a random length…

Signal Processing · Electrical Eng. & Systems 2023-01-26 Nandan Sriranga , Baocheng Geng , Pramod K. Varshney