English
Related papers

Related papers: Inducing Individual Students' Learning Strategies …

200 papers

Partially Observable Markov Decision Processes (POMDP) is a widely used model to represent the interaction of an environment and an agent, under state uncertainty. Since the agent does not observe the environment state, its uncertainty is…

Artificial Intelligence · Computer Science 2021-04-16 Divya Grover , Christos Dimitrakakis

Partially Observable Markov Decision Processes (POMDPs) are systems in which one agent interacts with a stochastic environment, and receives only partial information about the current state. In a multi-environment POMDP (MEPOMDP), the…

Artificial Intelligence · Computer Science 2026-05-11 Léonard Brice , Filip Cano , Krishnendu Chatterjee , Thomas A. Henzinger , Stefanie Muroya

Collaborative learning has successfully applied knowledge transfer to guide a pool of small student networks towards robust local minima. However, previous approaches typically struggle with drastically aggravated student homogenization…

Machine Learning · Computer Science 2021-02-23 Shaoxiong Feng , Hongshen Chen , Xuancheng Ren , Zhuoye Ding , Kan Li , Xu Sun

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu

Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the development of…

Computation and Language · Computer Science 2025-05-29 Zhengyuan Liu , Stella Xin Yin , Geyu Lin , Nancy F. Chen

Our goal is to enable robots to plan sequences of tabletop actions to push a block with unknown physical properties to a desired goal pose. We approach this problem by learning the constituent models of a Partially-Observable Markov…

Robotics · Computer Science 2025-07-02 Atharv Jain , Seiji Shaw , Nicholas Roy

Conventional approaches to enhancing movement coordination, such as providing instructions and visual feedback, are often inadequate in complex motor tasks with multiple degrees of freedom (DoFs). To effectively address coordination…

Systems and Control · Electrical Eng. & Systems 2026-04-30 Ankur Kamboj , Rajiv Ranganathan , Xiaobo Tan , Vaibhav Srivastava

The standard objective in machine learning is to train a single model for all users. However, in many learning scenarios, such as cloud computing and federated learning, it is possible to learn a personalized model per user. In this work,…

Machine Learning · Computer Science 2020-07-21 Yishay Mansour , Mehryar Mohri , Jae Ro , Ananda Theertha Suresh

As general purpose robots become more capable, pre-programming of all tasks at the factory will become less practical. We would like for non-technical human owners to be able to communicate, through interaction with their robot, the details…

Robotics · Computer Science 2012-04-03 Mark P. Woodward , Robert J. Wood

This study aims to determine a predictive model to learn students probability to pass their courses taken at the earliest stage of the semester. To successfully discover a good predictive model with high acceptability, accurate, and…

Machine Learning · Computer Science 2023-04-13 Anabella C. Doctor

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

Robotics · Computer Science 2021-07-19 Hanna Kurniawati

Many medical decision-making tasks can be framed as partially observed Markov decision processes (POMDPs). However, prevailing two-stage approaches that first learn a POMDP and then solve it often fail because the model that best fits the…

Machine Learning · Statistics 2020-04-01 Joseph Futoma , Michael C. Hughes , Finale Doshi-Velez

Personalization aims to characterize individual preferences and is widely applied across many fields. However, conventional personalized methods operate in a centralized manner, potentially exposing raw data when pooling individual…

Machine Learning · Computer Science 2025-08-06 Hao Di , Yi Yang , Haishan Ye , Xiangyu Chang

Humans can learn concepts or recognize items from just a handful of examples, while machines require many more samples to perform the same task. In this paper, we build a computational model to investigate the possibility of this kind of…

Artificial Intelligence · Computer Science 2016-11-09 Wen-Chieh Fang , Yi-ting Chiang

Navigating in environments alongside humans requires agents to reason under uncertainty and account for the beliefs and intentions of those around them. Under a sequential decision-making framework, egocentric navigation can naturally be…

Artificial Intelligence · Computer Science 2025-09-03 Kevin Alcedo , Pedro U. Lima , Rachid Alami

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Markov decision processes (POMDPs), optimal memoryless policies…

Optimization and Control · Mathematics 2016-02-16 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

We consider partially observable Markov decision processes (POMDPs) with a set of target states and positive integer costs associated with every transition. The traditional optimization objective (stochastic shortest path) asks to minimize…

Artificial Intelligence · Computer Science 2016-05-12 Tomáš Brázdil , Krishnendu Chatterjee , Martin Chmelík , Anchit Gupta , Petr Novotný

In this article, we present a novel multimodal feedback framework called MOSAIC-F, an acronym for a data-driven Framework that integrates Multimodal Learning Analytics (MMLA), Observations, Sensors, Artificial Intelligence (AI), and…

Human-Computer Interaction · Computer Science 2025-06-11 Alvaro Becerra , Daniel Andres , Pablo Villegas , Roberto Daza , Ruth Cobos