English
Related papers

Related papers: Joint modeling for learning decision-making dynami…

200 papers

Recent studies have proposed that one can summarize brain activity into dynamics among a relatively small number of hidden states and that such an approach is a promising tool for revealing brain function. Hidden Markov models (HMMs) are a…

Neurons and Cognition · Quantitative Biology 2021-09-02 Takahiro Ezaki , Yu Himeno , Takamitsu Watanabe , Naoki Masuda

Active learning seeks to reduce the amount of data required to fit the parameters of a model, thus forming an important class of techniques in modern machine learning. However, past work on active learning has largely overlooked latent…

Machine Learning · Computer Science 2024-02-20 Aditi Jha , Zoe C. Ashwood , Jonathan W. Pillow

Reinforcement Learning (RL) serves as a versatile framework for sequential decision-making, finding applications across diverse domains such as robotics, autonomous driving, recommendation systems, supply chain optimization, biology,…

Machine Learning · Computer Science 2024-08-26 Vaneet Aggarwal , Washim Uddin Mondal , Qinbo Bai

Active learning is a machine learning paradigm that aims to improve the performance of a model by strategically selecting and querying unlabeled data. One effective selection strategy is to base it on the model's predictive uncertainty,…

Machine Learning · Computer Science 2024-05-17 Seong Jin Cho , Gwangsu Kim , Junghyun Lee , Jinwoo Shin , Chang D. Yoo

Depression has been the leading cause of mental-health illness worldwide. Major depressive disorder (MDD), is a common mental health disorder that affects both psychologically as well as physically which could lead to loss of lives. Due to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Anupama Ray , Siddharth Kumar , Rutvik Reddy , Prerana Mukherjee , Ritu Garg

This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to…

Machine Learning · Computer Science 2022-01-25 Mingyu Cai , Mohammadhosein Hasanbeig , Shaoping Xiao , Alessandro Abate , Zhen Kan

Background: Reliable prediction of clinical progression over time can improve the outcomes of depression. Little work has been done integrating various risk factors for depression, to determine the combinations of factors with the greatest…

Machine Learning · Statistics 2023-07-06 Runa Bhaumik , Jonathan Stange

Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic…

Machine Learning · Computer Science 2021-01-08 Kaige Yang

Recurrent neural networks (RNNs) provide a powerful approach in neuroscience to infer latent dynamics in neural populations and to generate hypotheses about the neural computations underlying behavior. However, past work has focused on…

Machine Learning · Computer Science 2025-10-30 Elia Torre , Michele Viscione , Lucas Pompe , Benjamin F Grewe , Valerio Mante

Reinforcement Learning (RL) has gained substantial attention across diverse application domains and theoretical investigations. Existing literature on RL theory largely focuses on risk-neutral settings where the decision-maker learns to…

Machine Learning · Computer Science 2024-12-24 Zhengqi Wu , Renyuan Xu

Data analysts are essential in organizations, transforming raw data into insights that drive decision-making and strategy. This study explores how analysts' productivity evolves on a collaborative platform, focusing on two key learning…

Social and Information Networks · Computer Science 2025-03-27 Yue Yin

Joint models initially dedicated to a single longitudinal marker and a single time-to-event need to be extended to account for the rich longitudinal data of cohort studies. Multiple causes of clinical progression are indeed usually…

Applications · Statistics 2016-01-26 Cécile Proust-Lima , Jean-François Dartigues , Hélène Jacqmin-Gadda

Emerging evidence showed that major depressive disorder (MDD) is associated with disruptions of brain structural and functional networks, rather than impairment of isolated brain region. Thus, connectome-based models capable of predicting…

Neurons and Cognition · Quantitative Biology 2021-10-18 Aya Kabbara , Gabriel Robert , Mohamad Khalil , Marc Verin , Pascal Benquet , Mahmoud Hassan

Forecasting multivariate hidden Markov processes is challenging due to nonlinear and nonstationary observations, latent state transitions, and cross-sequence dependencies. While deep learning methods achieve strong predictive accuracy, they…

Machine Learning · Computer Science 2026-05-15 Manrui Jiang , Jingru Huang , Yong Chen , Chen Zhang

One key challenge for multi-task Reinforcement learning (RL) in practice is the absence of task indicators. Robust RL has been applied to deal with task ambiguity, but may result in over-conservative policies. To balance the worst-case…

Machine Learning · Computer Science 2022-10-25 Mengdi Xu , Peide Huang , Yaru Niu , Visak Kumar , Jielin Qiu , Chao Fang , Kuan-Hui Lee , Xuewei Qi , Henry Lam , Bo Li , Ding Zhao

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

Machine Learning · Computer Science 2026-04-07 Yaoze Guo , Shana Moothedath

We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate…

Machine Learning · Statistics 2016-12-07 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

Measuring states in reinforcement learning (RL) can be costly in real-world settings and may negatively influence future outcomes. We introduce the Actively Observable Markov Decision Process (AOMDP), where an agent not only selects control…

Machine Learning · Computer Science 2025-10-17 Daiqi Gao , Ziping Xu , Aseel Rawashdeh , Predrag Klasnja , Susan A. Murphy

Multi-agent reinforcement learning (MARL) has achieved significant progress in large-scale traffic control, autonomous vehicles, and robotics. Drawing inspiration from biological systems where roles naturally emerge to enable coordination,…

Multiagent Systems · Computer Science 2026-05-01 Harsh Goel , Mohammad Omama , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Sandeep Chinchali

An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process…

Machine Learning · Computer Science 2021-06-29 Mónika Farsang , Luca Szegletes