English
Related papers

Related papers: Spatial-Temporal Interplay in Human Mobility: A Hi…

200 papers

Deep reinforcement learning (DRL) provides a promising way for intelligent agents (e.g., autonomous vehicles) to learn to navigate complex scenarios. However, DRL with neural networks as function approximators is typically considered a…

Robotics · Computer Science 2023-11-28 Jiachen Li , David Isele , Kanghoon Lee , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Skeleton-based action recognition relies on the extraction of spatial-temporal topological information. Hypergraphs can establish prior unnatural dependencies for the skeleton. However, the existing methods only focus on the construction of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shengqin Wang , Yongji Zhang , Hong Qi , Minghao Zhao , Yu Jiang

Network Slice placement with the problem of allocation of resources from a virtualized substrate network is an optimization problem which can be formulated as a multiobjective Integer Linear Programming (ILP) problem. However, to cope with…

Networking and Internet Architecture · Computer Science 2021-05-17 Jose Jurandir Alves Esteves , Amina Boubendir , Fabrice Guillemin , Pierre Sens

Representation learning over temporal networks has drawn considerable attention in recent years. Efforts are mainly focused on modeling structural dependencies and temporal evolving regularities in Euclidean space which, however,…

Social and Information Networks · Computer Science 2023-01-31 Menglin Yang , Min Zhou , Marcus Kalander , Zengfeng Huang , Irwin King

Temporal event representations are an essential aspect of learning among humans. They allow for succinct encoding of the experiences we have through a variety of sensory inputs. Also, they are believed to be arranged hierarchically,…

We present a two-step hybrid reinforcement learning (RL) policy that is designed to generate interpretable and robust hierarchical policies on the RL problem with graph-based input. Unlike prior deep reinforcement learning policies…

Machine Learning · Computer Science 2022-10-20 Tongzhou Mu , Kaixiang Lin , Feiyang Niu , Govind Thattai

Hierarchical reinforcement learning (RL) can accelerate long-horizon decision-making by temporally abstracting a policy into multiple levels. Promising results in sparse reward environments have been seen with skills, i.e. sequences of…

Machine Learning · Computer Science 2024-07-15 Ce Hao , Catherine Weaver , Chen Tang , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

Autonomous vehicles (AVs) are on the road. To safely and efficiently interact with other road participants, AVs have to accurately predict the behavior of surrounding vehicles and plan accordingly. Such prediction should be probabilistic,…

Machine Learning · Computer Science 2018-09-11 Liting Sun , Wei Zhan , Masayoshi Tomizuka

Hierarchical Reinforcement Learning (HRL) frameworks like Option-Critic (OC) and Multi-updates Option Critic (MOC) have introduced significant advancements in learning reusable options. However, these methods underperform in multi-goal…

Artificial Intelligence · Computer Science 2026-02-17 Gabriel Romio , Mateus Begnini Melchiades , Bruno Castro da Silva , Gabriel de Oliveira Ramos

Hierarchical reinforcement learning (HRL) leverages temporal abstraction to efficiently tackle complex long-horizon tasks. However, HRL often collapses because the continual updates of the low-level primitive make earlier sub-goals issued…

Machine Learning · Computer Science 2025-08-19 Utsav Singh , Vinay P. Namboodiri

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and agent policy. By…

Machine Learning · Computer Science 2025-01-14 Liyuan Hu

Taking advantage of both vehicle-to-everything (V2X) communication and automated driving technology, connected and automated vehicles are quickly becoming one of the transformative solutions to many transportation problems. However, in a…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Zhengwei Bai , Peng Hao , Wei Shangguan , Baigen Cai , Matthew J. Barth

Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the preferences of the…

Information Retrieval · Computer Science 2022-11-07 Xiong Junwu , Xiaoyun Feng , YunZhou Shi , James Zhang , Zhongzhou Zhao , Wei Zhou

3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge. Despite the fast-paced progress in robot perception, most…

Robotics · Computer Science 2023-05-15 Nathan Hughes , Yun Chang , Siyi Hu , Rajat Talak , Rumaisa Abdulhai , Jared Strader , Luca Carlone

Reinforcement Learning (RL) algorithms often struggle with low training efficiency. A common approach to address this challenge is integrating model-based planning algorithms, such as Monte Carlo Tree Search (MCTS) or Value Iteration (VI),…

Machine Learning · Computer Science 2025-01-08 Zidu Yin , Zhen Zhang , Dong Gong , Stefano V. Albrecht , Javen Q. Shi

Sequential Recommendation aims to recommend items that a target user will interact with in the near future based on the historically interacted items. While modeling temporal dynamics is crucial for sequential recommendation, most of the…

Information Retrieval · Computer Science 2021-09-27 Zeyuan Chen , Wei Zhang , Junchi Yan , Gang Wang , Jianyong Wang

Travel time estimation is one of the core tasks for the development of intelligent transportation systems. Most previous works model the road segments or intersections separately by learning their spatio-temporal characteristics to estimate…

Artificial Intelligence · Computer Science 2023-11-16 Guangyin Jin , Huan Yan , Fuxian Li , Jincai Huang , Yong Li

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions,…

Machine Learning · Computer Science 2020-12-29 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Joey Tianyi Zhou , Chengqi Zhang

Human-robot handovers are characterized by high uncertainty and poor structure of the problem that make them difficult tasks. While machine learning methods have shown promising results, their application to problems with large state…

Robotics · Computer Science 2016-10-18 Francesco Riccio , Roberto Capobianco , Daniele Nardi

In recent years, Hypergraph Neural Networks (HNNs) have demonstrated immense potential in handling complex systems with high-order interactions. However, acquiring large-scale, high-quality labeled data for these models is costly, making…

Machine Learning · Computer Science 2025-07-29 Yanheng Hou , Xunkai Li , Zhenjun Li , Bing Zhou , Ronghua Li , Guoren Wang