English
Related papers

Related papers: SAGE:State-Aware Guided End-to-End Policy for Mult…

200 papers

Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic…

Machine Learning · Computer Science 2021-01-08 Kaige Yang

Imitation learning frameworks for robotic manipulation have drawn attention in the recent development of language model grounded robotics. However, the success of the frameworks largely depends on the coverage of the demonstration cases:…

Robotics · Computer Science 2025-03-10 Tong Mu , Yihao Liu , Mehran Armand

Semi-supervised learning faces significant challenges in realistic scenarios where labeled data is scarce and unlabeled data follows unknown, arbitrary distributions. We formalize this critical yet under-explored paradigm as Universal…

Machine Learning · Computer Science 2026-05-18 Yaxin Hou , Jun Ma , Hanyang Li , Bo Han , Jie Yu , Yuheng Jia

The sense of touch, being the earliest sensory system to develop in a human body [1], plays a critical part of our daily interaction with the environment. In order to successfully complete a task, many manipulation interactions require…

Robotics · Computer Science 2017-05-18 Jaeyong Sung , J. Kenneth Salisbury , Ashutosh Saxena

The rapid proliferation of the Internet of Things (IoT) continues to expose critical security vulnerabilities, necessitating the development of efficient and robust intrusion detection systems (IDS). Machine learning-based intrusion…

Cryptography and Security · Computer Science 2025-09-11 Jing Chen , Onat Gungor , Zhengli Shang , Tajana Rosing

Software vulnerabilities are a primary threat to modern infrastructure. While static analysis and Graph Neural Networks have long served as the foundation for vulnerability detection, the emergence of Large Language Models (LLMs) has…

Cryptography and Security · Computer Science 2026-04-22 Zhengyang Shan , Xu Qian , Jiayun Xin , Minghui Xu , Yue Zhang , Zhen Yang , Hao Wu , Xiuzhen Cheng

This paper presents a novel state representation for reward-free Markov decision processes. The idea is to learn, in a self-supervised manner, an embedding space where distances between pairs of embedded states correspond to the minimum…

Machine Learning · Computer Science 2022-05-05 Lorenzo Steccanella , Anders Jonsson

Engineered image-based biomarkers offer a clinically interpretable alternative to black-box AI in computational pathology, yet their discovery remains largely intuition-driven, guided by fragmented literature rather than rigorous biological…

In partial multi-label learning (PML), the true labels are unobserved, which makes label disambiguation important but difficult. A key challenge is that ambiguous candidate labels can propagate errors into downstream tasks such as feature…

Machine Learning · Computer Science 2026-02-05 Hanlin Pan , Yuhao Tang , Wanfu Gao

Due to physiological variation, patients diagnosed with the same condition may exhibit divergent, but related, responses to the same treatments. Hidden Parameter Markov Decision Processes (HiP-MDPs) tackle this transfer-learning problem by…

Machine Learning · Statistics 2016-12-05 Taylor Killian , George Konidaris , Finale Doshi-Velez

We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms. We cast this problem as learning the parameters of a discrete Partially Observable Markov Decision Process…

Machine Learning · Computer Science 2026-02-04 Seiji Shaw , Travis Manderson , Chad Kessens , Nicholas Roy

A state space representation of an environment is a classic and yet powerful tool used by many autonomous robotic systems for efficient and often optimal solution planning. However, designing these representations with high performance is…

Machine Learning · Computer Science 2020-12-23 Andrew Wilhelm , Aaron Wilhelm , Garrett Fosdick

In this article, a \underline{S}tate-dependent \underline{M}ulti-\underline{A}gent \underline{D}eep \underline{D}eterministic \underline{P}olicy \underline{G}radient (\textbf{SMADDPG}) method is proposed in order to learn an optimal control…

Systems and Control · Electrical Eng. & Systems 2024-11-25 Mi Zhou , Jiazhi Li , Masood Mortazavi , Ning Yan , Chaouki Abdallah

POMDPs capture a broad class of decision making problems, but hardness results suggest that learning is intractable even in simple settings due to the inherent partial observability. However, in many realistic problems, more information is…

Machine Learning · Computer Science 2023-02-07 Jonathan N. Lee , Alekh Agarwal , Christoph Dann , Tong Zhang

Learning procedural-aware video representations is a key step towards building agents that can reason about and execute complex tasks. Existing methods typically address this problem by aligning visual content with textual descriptions at…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jinghan Zhao , Yifei Huang , Feng Lu

Vision-Language Models (VLMs) have demonstrated exceptional general reasoning capabilities. However, their performance in embodied navigation remains hindered by a scarcity of aligned open-world vision and robot control data. Despite…

Robotics · Computer Science 2026-05-12 Zhixuan Shen , Jiawei Du , Ziyu Guo , Han Luo , Lilan Peng , Joey Tianyi Zhou , Haonan Luo , Tianrui Li

Recent years have seen human robot collaboration (HRC) quickly emerged as a hot research area at the intersection of control, robotics, and psychology. While most of the existing work in HRC focused on either low-level human-aware motion…

Human-Computer Interaction · Computer Science 2018-04-02 Wei Zheng , Bo Wu , Hai Lin

This paper presents a state representation framework for Markov decision processes (MDPs) that can be learned solely from state trajectories, requiring neither reward signals nor the actions executed by the agent. We propose learning the…

Machine Learning · Computer Science 2026-03-25 Lorenzo Steccanella , Joshua B. Evans , Özgür Şimşek , Anders Jonsson

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

Large language model (LLM) based agents are increasingly used to tackle software engineering tasks that require multi-step reasoning and code modification, demonstrating promising yet limited performance. However, most existing LLM agents…

Artificial Intelligence · Computer Science 2025-11-11 Hiroaki Hayashi , Bo Pang , Wenting Zhao , Ye Liu , Akash Gokul , Srijan Bansal , Caiming Xiong , Semih Yavuz , Yingbo Zhou