中文
相关论文

相关论文: Imitation from Observations with Trajectory-Level …

200 篇论文

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

机器学习 · 计算机科学 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

Decision Transformer (DT) can learn effective policy from offline datasets by converting the offline reinforcement learning (RL) into a supervised sequence modeling task, where the trajectory elements are generated auto-regressively…

机器学习 · 计算机科学 2024-11-19 Zhihong Liu , Long Qian , Zeyang Liu , Lipeng Wan , Xingyu Chen , Xuguang Lan

The evolutionary processes of complex systems contain critical information regarding their functional characteristics. The generation time of edges provides insights into the historical evolution of various networked complex systems, such…

人工智能 · 计算机科学 2025-01-14 En Xu , Can Rong , Jingtao Ding , Yong Li

Off-policy evaluation (OPE) estimates the performance of a target policy using offline data collected from a behavior policy, and is crucial in domains such as robotics or healthcare where direct interaction with the environment is costly…

Generative policies based on diffusion and flow matching achieve strong performance in robotic manipulation by modeling multi-modal human demonstrations. However, their reliance on iterative Ordinary Differential Equation (ODE) integration…

Model-based offline reinforcement Learning (RL) is a promising approach that leverages existing data effectively in many real-world applications, especially those involving high-dimensional inputs like images and videos. To alleviate the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Shenghua Wan , Ziyuan Chen , Le Gan , Shuai Feng , De-Chuan Zhan

Imitation learning from observation (LfO) is more preferable than imitation learning from demonstration (LfD) due to the nonnecessity of expert actions when reconstructing the expert policy from the expert data. However, previous studies…

机器人学 · 计算机科学 2020-10-19 Zhihao Cheng , Liu Liu , Aishan Liu , Hao Sun , Meng Fang , Dacheng Tao

Diffusion-based generative models have achieved promising results recently, but raise an array of open questions in terms of conceptual understanding, theoretical analysis, algorithm improvement and extensions to discrete, structured,…

机器学习 · 计算机科学 2022-09-01 Xingchao Liu , Lemeng Wu , Mao Ye , Qiang Liu

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

机器学习 · 计算机科学 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Offline imitation learning (IL) promises the ability to learn performant policies from pre-collected demonstrations without interactions with the environment. However, imitating behaviors fully offline typically requires numerous expert…

机器学习 · 计算机科学 2023-03-07 Lantao Yu , Tianhe Yu , Jiaming Song , Willie Neiswanger , Stefano Ermon

Trajectory inference seeks to recover the temporal dynamics of a population from snapshots of its (uncoupled) temporal marginals, i.e. where observed particles are not tracked over time. Prior works addressed this challenging problem under…

机器学习 · 计算机科学 2025-02-27 Anming Gu , Edward Chien , Kristjan Greenewald

Imitation from observation (IfO) is the problem of learning directly from state-only demonstrations without having access to the demonstrator's actions. The lack of action information both distinguishes IfO from most of the literature in…

机器学习 · 计算机科学 2019-06-19 Faraz Torabi , Garrett Warnell , Peter Stone

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

Modeling the evolution of system with time-series data is a challenging and critical task in a wide range of fields, especially when the time-series data is regularly sampled and partially observable. Some methods have been proposed to…

机器学习 · 计算机科学 2024-12-03 Mengbang Zou , Weisi Guo

Many real-world systems, such as moving planets, can be considered as multi-agent dynamic systems, where objects interact with each other and co-evolve along with the time. Such dynamics is usually difficult to capture, and understanding…

机器学习 · 计算机科学 2020-11-10 Zijie Huang , Yizhou Sun , Wei Wang

Federated Learning (FL) is an emerging domain in the broader context of artificial intelligence research. Methodologies pertaining to FL assume distributed model training, consisting of a collection of clients and a server, with the main…

机器学习 · 计算机科学 2023-05-09 Bhargav Ganguly , Vaneet Aggarwal

Recent advances in offline Reinforcement Learning (RL) have proven that effective policy learning can benefit from imposing conservative constraints on pre-collected datasets. However, such static datasets often exhibit distribution bias,…

机器学习 · 计算机科学 2026-05-15 Yunpeng Qing , Yixiao Chi , Shuo Chen , Shunyu Liu , Kexuan Zhou , Sixu Lin , Litao Liu , Changqing Zou

Learning from demonstration (LfD) has succeeded in tasks featuring a long time horizon. However, when the problem complexity also includes human-in-the-loop perturbations, state-of-the-art approaches do not guarantee the successful…

机器人学 · 计算机科学 2024-12-10 Yanwei Wang , Nadia Figueroa , Shen Li , Ankit Shah , Julie Shah

Real-world data deviating from the independent and identically distributed (i.i.d.) assumption of in-distribution training data poses security threats to deep networks, thus advancing out-of-distribution (OOD) detection algorithms.…

计算与语言 · 计算机科学 2024-10-31 Yiming Wang , Pei Zhang , Baosong Yang , Derek F. Wong , Zhuosheng Zhang , Rui Wang

In the last few years, there has been a surge of interest in learning representations of entitiesand relations in knowledge graph (KG). However, the recent availability of temporal knowledgegraphs (TKGs) that contain time information for…

计算与语言 · 计算机科学 2020-10-27 Chengjin Xu , Mojtaba Nayyeri , Fouad Alkhoury , Hamed Shariat Yazdi , Jens Lehmann