中文
相关论文

相关论文: Non-Markov Policies to Reduce Sequential Failures …

200 篇论文

This paper presents the first ever approach for solving \emph{continuous-observation} Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) and their semi-Markovian counterparts, Dec-POSMDPs. This contribution is…

多智能体系统 · 计算机科学 2017-03-17 Shayegan Omidshafiei , Christopher Amato , Miao Liu , Michael Everett , Jonathan P. How , John Vian

In real-world applications of reinforcement learning, it is often challenging to obtain a state representation that is parsimonious and satisfies the Markov property without prior knowledge. Consequently, it is common practice to construct…

机器学习 · 统计学 2024-07-31 Tao Ma , Jin Zhu , Hengrui Cai , Zhengling Qi , Yunxiao Chen , Chengchun Shi , Eric B. Laber

In Bayesian optimization (BO) for expensive black-box optimization tasks, acquisition function (AF) guides sequential sampling and plays a pivotal role for efficient convergence to better optima. Prevailing AFs usually rely on artificial…

机器学习 · 计算机科学 2022-10-04 Zijing Liu , Xiyao Qu , Xuejun Liu , Hongqiang Lyu

Predicting personalized sequential behavior is a key task for recommender systems. In order to predict user actions such as the next product to purchase, movie to watch, or place to visit, it is essential to take into account both long-term…

信息检索 · 计算机科学 2016-09-30 Ruining He , Julian McAuley

Automating the segregation process is a need for every sector experiencing a high volume of materials handling, repetitive and exhaustive operations, in addition to risky exposures. Learning automated pick-and-place operations can be…

机器学习 · 计算机科学 2024-04-30 Hariharan Arunachalam , Marc Hanheide , Sariah Mghames

We study the sequential decision-making problem of allocating a limited resource to agents that reveal their stochastic demands on arrival over a finite horizon. Our goal is to design fair allocation algorithms that exhaust the available…

机器学习 · 计算机科学 2023-06-21 Parisa Hassanzadeh , Eleonora Kreacic , Sihan Zeng , Yuchen Xiao , Sumitra Ganesh

Sequential Recommender Systems (SRSs) are widely employed to model user behavior over time. However, their robustness in the face of perturbations in training data remains a largely understudied yet critical issue. A fundamental challenge…

信息检索 · 计算机科学 2024-05-03 Filippo Betello , Federico Siciliano , Pushkar Mishra , Fabrizio Silvestri

Reinforcement Learning (RL) algorithms have shown tremendous success in simulation environments, but their application to real-world problems faces significant challenges, with safety being a major concern. In particular, enforcing…

机器学习 · 计算机科学 2024-06-19 Weiye Zhao , Rui Chen , Yifan Sun , Tianhao Wei , Changliu Liu

Generative robot policies such as Flow Matching offer flexible, multi-modal policy learning but are sample-inefficient. Although object-centric policies improve sample efficiency, it does not resolve this limitation. In this work, we…

机器人学 · 计算机科学 2026-04-01 Jan Ole von Hartz , Lukas Schweizer , Joschka Boedecker , Abhinav Valada

In sequential recommender system applications, it is important to develop models that can capture users' evolving interest over time to successfully recommend future items that they are likely to interact with. For users with long…

信息检索 · 计算机科学 2021-12-15 Aritra Ghosh , Saayan Mitra , Andrew Lan

Warehouse automation plays a pivotal role in enhancing operational efficiency, minimizing costs, and improving resilience to workforce variability. While prior research has demonstrated the potential of machine learning (ML) models to…

机器人学 · 计算机科学 2025-06-12 Shuai Li , Azarakhsh Keipour , Sicong Zhao , Srinath Rajagopalan , Charles Swan , Kostas E. Bekris

To facilitate efficient learning, policy gradient approaches to deep reinforcement learning (RL) are typically paired with variance reduction measures and strategies for making large but safe policy changes based on a batch of experiences.…

机器学习 · 计算机科学 2023-11-13 Jared Markowitz , Edward W. Staley

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

机器学习 · 计算机科学 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

Sequentially grasping multiple objects with multi-fingered hands is common in daily life, where humans can fully leverage the dexterity of their hands to enclose multiple objects. However, the diversity of object geometries and the complex…

机器人学 · 计算机科学 2025-08-05 Sicheng He , Zeyu Shangguan , Kuanning Wang , Yongchong Gu , Yuqian Fu , Yanwei Fu , Daniel Seita

In adaptive systems, predictors are used to anticipate changes in the systems state or behavior that may require system adaption, e.g., changing its configuration or adjusting resource allocation. Therefore, the quality of predictors is…

计算机科学中的逻辑 · 计算机科学 2024-12-17 Christel Baier , Sascha Klüppelholz , Jakob Piribauer , Robin Ziemek

In this paper, we study planning in stochastic systems, modeled as Markov decision processes (MDPs), with preferences over temporally extended goals. Prior work on temporal planning with preferences assumes that the user preferences form a…

机器人学 · 计算机科学 2023-03-09 Hazhar Rahmani , Abhishek N. Kulkarni , Jie Fu

The constructive approach within Neural Combinatorial Optimization (NCO) treats a combinatorial optimization problem as a finite Markov decision process, where solutions are built incrementally through a sequence of decisions guided by a…

机器学习 · 计算机科学 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Automating warehouse operations can reduce logistics overhead costs, ultimately driving down the final price for consumers, increasing the speed of delivery, and enhancing the resiliency to market fluctuations. This extended abstract…

机器人学 · 计算机科学 2023-10-10 Shuai Li , Azarakhsh Keipour , Kevin Jamieson , Nicolas Hudson , Sicong Zhao , Charles Swan , Kostas Bekris

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

Due to the popularity of the Internet and smart mobile devices, more and more financial transactions and activities have been digitalized. Compared to traditional financial fraud detection strategies using credit-related features, customers…

机器学习 · 计算机科学 2018-08-17 Ruinan Zhang , Fanglan Zheng , Wei Min