English
Related papers

Related papers: SAGE:State-Aware Guided End-to-End Policy for Mult…

200 papers

Analysis of Markov Decision Processes (MDP) is often hindered by state space explosion. Abstraction is a well-established technique in model checking to mitigate this issue. This paper presents a novel lazy abstraction method for MDP…

Logic in Computer Science · Computer Science 2024-06-04 Dániel Szekeres , Kristóf Marussy , István Majzik

Instance segmentation with unseen objects is a challenging problem in unstructured environments. To solve this problem, we propose a robot learning approach to actively interact with novel objects and collect each object's training label…

Robotics · Computer Science 2022-07-22 Houjian Yu , Changhyun Choi

Deep learning is currently reaching outstanding performances on different tasks, including image classification, especially when using large neural networks. The success of these models is tributary to the availability of large collections…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mingyuan Jiu , Xuguang Song , Hichem Sahbi , Shupan Li , Yan Chen , Wei Guo , Lihua Guo , Mingliang Xu

We revisit the identification of an $\varepsilon$-optimal policy in average-reward Markov Decision Processes (MDP). In such MDPs, two measures of complexity have appeared in the literature: the diameter, $D$, and the optimal bias span, $H$,…

Machine Learning · Computer Science 2024-05-28 Adrienne Tuynman , Rémy Degenne , Emilie Kaufmann

We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass. In particular, it…

Logic in Computer Science · Computer Science 2011-02-22 Laurent Doyen , Thierry Massart , Mahsa Shirmohammadi

Recently, autoregressive recommendation models (ARMs), such as Meta's HSTU model, have emerged as a major breakthrough over traditional Deep Learning Recommendation Models (DLRMs), exhibiting the highly sought-after scaling law behaviour.…

This paper aims to develop a new human-machine interface to improve rehabilitation performance from the perspective of both the user (patient) and the machine (robot) by introducing the co-adaption techniques via model-based reinforcement…

Artificial Intelligence · Computer Science 2023-05-04 Kairui Guo , Adrian Cheng , Yaqi Li , Jun Li , Rob Duffield , Steven W. Su

Accurately modeling robot dynamics is crucial to safe and efficient motion control. In this paper, we develop and apply an iterative learning semi-parametric model, with a neural network, to the task of autonomous racing with a Model…

Robotics · Computer Science 2020-11-18 Ignat Georgiev , Christoforos Chatzikomis , Timo Völkl , Joshua Smith , Michael Mistry

This paper introduces EmbodiedAgent, a hierarchical framework for heterogeneous multi-robot control. EmbodiedAgent addresses critical limitations of hallucination in impractical tasks. Our approach integrates a next-action prediction…

Robotics · Computer Science 2025-08-18 Hanwen Wan , Yifei Chen , Yixuan Deng , Zeyu Wei , Dongrui Li , Zexin Lin , Donghao Wu , Jiu Cheng , Xiaoqiang Ji

This paper proposes Meta-SAGE, a novel approach for improving the scalability of deep reinforcement learning models for combinatorial optimization (CO) tasks. Our method adapts pre-trained models to larger-scale problems in test time by…

Machine Learning · Computer Science 2023-06-08 Jiwoo Son , Minsu Kim , Hyeonah Kim , Jinkyoo Park

The transition kernel of a continuous-state-action Markov decision process (MDP) admits a natural tensor structure. This paper proposes a tensor-inspired unsupervised learning method to identify meaningful low-dimensional state and action…

Machine Learning · Statistics 2023-02-21 Chengzhuo Ni , Yaqi Duan , Munther Dahleh , Anru Zhang , Mengdi Wang

Self-supervised learning (SSL), as a newly emerging unsupervised representation learning paradigm, generally follows a two-stage learning pipeline: 1) learning invariant and discriminative representations with auto-annotation pretext(s),…

Machine Learning · Computer Science 2022-08-23 Jiayu Yao , Qingyuan Wu , Quan Feng , Songcan Chen

Large language models (LLMs) have achieved remarkable performance across a wide range of NLP tasks. However, their substantial inference cost poses a major barrier to real-world deployment, especially in latency-sensitive scenarios. To…

Computation and Language · Computer Science 2025-05-26 Ning Yang , Fangxin Liu , Junjie Wang , Tao Yang , Kan Liu , Haibing Guan , Li Jiang

Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and…

Artificial Intelligence · Computer Science 2026-03-18 Yulin Peng , Xinxin Zhu , Chenxing Wei , Nianbo Zeng , Leilei Wang , Ying Tiffany He , F. Richard Yu

We present a method for solving implicit (factored) Markov decision processes (MDPs) with very large state spaces. We introduce a property of state space partitions which we call epsilon-homogeneity. Intuitively, an epsilon-homogeneous…

Artificial Intelligence · Computer Science 2013-02-08 Thomas L. Dean , Robert Givan , Sonia Leach

Semi supervised learning methods have gained importance in today's world because of large expenses and time involved in labeling the unlabeled data by human experts. The proposed hybrid approach uses SVM and Label Propagation to label the…

Machine Learning · Computer Science 2015-12-08 Aruna Govada , Pravin Joshi , Sahil Mittal , Sanjay K Sahay

The polling system with switch-over durations is a useful model with several practical applications. It is classified as a Discrete Event Dynamic System (DEDS) for which no one agreed upon modelling approach exists. Furthermore, DEDS are…

Optimization and Control · Mathematics 2021-12-14 Dylan Solms

In this paper we present a novel method for learning hierarchical representations of Markov decision processes. Our method works by partitioning the state space into subsets, and defines subtasks for performing transitions between the…

Machine Learning · Computer Science 2021-12-21 Lorenzo Steccanella , Simone Totaro , Anders Jonsson

Active classification, i.e., the sequential decision-making process aimed at data acquisition for classification purposes, arises naturally in many applications, including medical diagnosis, intrusion detection, and object tracking. In this…

Systems and Control · Computer Science 2018-10-02 Bo Wu , Mohamadreza Ahmadi , Suda Bharadwaj , Ufuk Topcu

We propose a novel paradigm of semi-supervised learning (SSL)--the semi-supervised multiple representation behavior learning (SSMRBL). SSMRBL aims to tackle the difficulty of learning a grammar for natural language parsing where the data…

Computation and Language · Computer Science 2019-10-22 Ruqian Lu , Shengluan Hou