English
Related papers

Related papers: Beyond Rescorla-Wagner: the ups and downs of learn…

200 papers

This paper is dedicated to a robust ordinal method for learning the preferences of a decision maker between subsets. The decision model, derived from Fishburn and LaValle (1996) and whose parameters we learn, is general enough to be…

Artificial Intelligence · Computer Science 2023-08-08 Hugo Gilbert , Mohamed Ouaguenouni , Meltem Ozturk , Olivier Spanjaard

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under drifting non-stationarity, i.e., both the reward and state transition distributions are allowed to evolve over time, as long as their respective…

Machine Learning · Computer Science 2020-06-26 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

Machine Learning · Statistics 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under temporal drifts, ie, both the reward and state transition distributions are allowed to evolve over time, as long as their respective total…

Machine Learning · Computer Science 2020-05-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

This paper addresses variational data assimilation from a learning point of view. Data assimilation aims to reconstruct the time evolution of some state given a series of observations, possibly noisy and irregularly-sampled. Using automatic…

Computational Physics · Physics 2021-11-10 Ronan Fablet , Bertrand Chapron , Lucas. Drumetz , Etienne Memin , Olivier Pannekoucke , Francois Rousseau

In this work, we investigate a model of an adaptive networked dynamical system, where the coupling strengths among phase oscillators coevolve with the phase states. It is shown that in this model the oscillators can spontaneously…

Disordered Systems and Neural Networks · Physics 2010-11-02 Menghui Li , Shuguang Guan , C. -H. Lai

This paper presents a new theory, known as robust dynamic pro- gramming, for a class of continuous-time dynamical systems. Different from traditional dynamic programming (DP) methods, this new theory serves as a fundamental tool to analyze…

Optimization and Control · Mathematics 2018-09-18 Tao Bian , Zhong-Ping Jiang

Reinforcement learning is typically treated as a uniform, data-driven optimization process, where updates are guided by rewards and temporal-difference errors without explicitly exploiting global structure. In contrast, dynamic programming…

Machine Learning · Computer Science 2026-04-21 Ivo Nowak

Machine learning models often require large datasets and struggle to generalize beyond their training distribution. These limitations pose significant challenges in scientific and engineering contexts, where generating exhaustive datasets…

Chemical Physics · Physics 2025-06-12 Salman N. Salman , Sergey A. Shteingolts , Ron Levie , Dan Mendels

The prediction of stochastic dynamical systems and the capture of dynamical behaviors are profound problems. In this article, we propose a data-driven framework combining Reservoir Computing and Normalizing Flow to study this issue, which…

Dynamical Systems · Mathematics 2023-08-01 Cheng Fang , Yubin Lu , Ting Gao , Jinqiao Duan

The backpropagation method has enabled transformative uses of neural networks. Alternatively, for energy-based models, local learning methods involving only nearby neurons offer benefits in terms of decentralized training, and allow for the…

Disordered Systems and Neural Networks · Physics 2025-01-30 Martin J. Falk , Adam T. Strupp , Benjamin Scellier , Arvind Murugan

Traditional artificial neural networks consist of nodes with non-oscillatory dynamics. Biological neural networks, on the other hand, consist of oscillatory components embedded in an oscillatory environment. Motivated by this feature of…

Neurons and Cognition · Quantitative Biology 2026-03-17 Mark A. Kramer

We investigate the predictive power of recurrent neural networks for oscillatory systems not only on the attractor, but in its vicinity as well. For this we consider systems perturbed by an external force. This allows us to not merely…

Adaptation and Self-Organizing Systems · Physics 2019-07-02 Rok Cestnik , Markus Abel

In this paper, we study neural cognition in social network. A stochastic model is introduced and shown to incorporate two well-known models in Pavlovian conditioning and social networks as special case, namely Rescorla-Wagner model and…

Optimization and Control · Mathematics 2017-04-12 Jieqiang Wei , Junfeng Wu , Marco Molinari , Vladimir Cvetkovic , Karl H. Johansson

Artificial limbs are sophisticated devices to assist people with tasks of daily living. Despite advanced robotic prostheses demonstrating similar motion capabilities to biological limbs, users report them difficult and non-intuitive to use.…

Machine Learning · Computer Science 2023-05-25 Adam S. R. Parker , Michael R. Dawson , Patrick M. Pilarski

Teaching by direct models in science has been weakening the learning process of the students, because the real problems in engineering are not solved by direct models instead commonly they are solved by inverse models. On the other hand,…

Physics Education · Physics 2019-08-09 K. L. Cristiano , D. A. Triana , R. Ortiz , A. F. Estupiñán

We consider the problem of learning about and comparing the consequences of dynamic treatment strategies on the basis of observational data. We formulate this within a probabilistic decision-theoretic framework. Our approach is compared…

Statistics Theory · Mathematics 2010-11-16 A. Philip Dawid , Vanessa Didelez

As well known, Hebb's learning traces its origin in Pavlov's Classical Conditioning, however, while the former has been extensively modelled in the past decades (e.g., by Hopfield model and countless variations on theme), as for the latter…

Disordered Systems and Neural Networks · Physics 2022-07-05 Elena Agliari , Miriam Aquaro , Adriano Barra , Alberto Fachechi , Chiara Marullo

The purpose of order-of-addition (OofA) experiments is to identify the best order in a sequence of m components in a system or treatment. Such experiments may be analysed by various regression models, the most popular ones being based on…

Methodology · Statistics 2021-01-27 Hans-Peter Piepho , Emlyn R. Williams

Modeling complex dynamical systems under varying conditions is computationally intensive, often rendering high-fidelity simulations intractable. Although reduced-order models (ROMs) offer a promising solution, current methods often struggle…

Machine Learning · Computer Science 2026-01-16 Andrew F. Ilersich , Kevin Course , Prasanth B. Nair