中文
相关论文

相关论文: Imitation from Observations with Trajectory-Level …

200 篇论文

Offline Goal-Conditioned Reinforcement Learning (Offline GCRL) is an important problem in RL that focuses on acquiring diverse goal-oriented skills solely from pre-collected behavior datasets. In this setting, the reward feedback is…

人工智能 · 计算机科学 2024-02-13 Sungyoon Kim , Yunseon Choi , Daiki E. Matsunaga , Kee-Eung Kim

We introduce a representation learning framework for spatial trajectories. We represent partial observations of trajectories as probability distributions in a learned latent space, which characterize the uncertainty about unobserved parts…

机器学习 · 计算机科学 2022-10-05 Dídac Surís , Carl Vondrick

Diffusion-based world models have demonstrated strong capabilities in synthesizing realistic long-horizon trajectories for offline reinforcement learning (RL). However, many existing methods do not directly generate actions alongside states…

机器学习 · 计算机科学 2026-05-14 Zongyue Li , Xiao Han , Yusong Li , Niklas Strauss , Matthias Schubert

Deep generative models such as flow matching and diffusion models have shown great potential in learning complex distributions and dynamical systems, but often act as black-boxes, neglecting underlying physics. In contrast, physics-based…

机器学习 · 计算机科学 2026-04-28 Gurjeet Sangra Singh , Frantzeska Lavda , Giangiacomo Mercatali , Alexandros Kalousis

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

机器学习 · 计算机科学 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

In 5G smart cities, edge computing is employed to provide nearby computing services for end devices, and the large-scale models (e.g., GPT and LLaMA) can be deployed at the network edge to boost the service quality. However, due to the…

分布式、并行与集群计算 · 计算机科学 2024-12-12 Zuan Xie , Yang Xu , Hongli Xu , Yunming Liao , Zhiyuan Yao

In online advertising, advertisers participate in ad auctions to acquire ad opportunities, often by utilizing auto-bidding tools provided by demand-side platforms (DSPs). The current auto-bidding algorithms typically employ reinforcement…

机器学习 · 计算机科学 2024-04-09 Haoming Li , Yusen Huo , Shuai Dou , Zhenzhe Zheng , Zhilin Zhang , Chuan Yu , Jian Xu , Fan Wu

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

机器学习 · 计算机科学 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

We address the problem of learning observation models end-to-end for estimation. Robots operating in partially observable environments must infer latent states from multiple sensory inputs using observation models that capture the joint…

机器人学 · 计算机科学 2022-04-12 Paloma Sodhi , Eric Dexheimer , Mustafa Mukadam , Stuart Anderson , Michael Kaess

We present a novel Neural Embedding Spatio-Temporal (NEST) point process model for spatio-temporal discrete event data and develop an efficient imitation learning (a type of reinforcement learning) based approach for model fitting. Despite…

机器学习 · 计算机科学 2021-01-25 Shixiang Zhu , Shuang Li , Zhigang Peng , Yao Xie

Traffic flow estimation (TFE) is crucial for intelligent transportation systems. Traditional TFE methods rely on extensive road sensor networks and typically incur significant costs. Sparse mobile crowdsensing enables a cost-effective…

人工智能 · 计算机科学 2024-07-12 Jianzhe Xue , Yunting Xu , Dongcheng Yuan , Caoyi Zha , Hongyang Du , Haibo Zhou , Dusit Niyato

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

机器人学 · 计算机科学 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Accurate Vehicle Trajectory Prediction is critical for automated vehicles and advanced driver assistance systems. Vehicle trajectory prediction consists of two essential tasks, i.e., longitudinal position prediction and lateral position…

机器学习 · 计算机科学 2023-12-04 Renteng Yuan , Mohamed Abdel-Aty , Qiaojun Xiang , Zijin Wang , Ou Zheng

Diffusion policies are competitive for offline reinforcement learning (RL) but are typically guided at sampling time by heuristics that lack a statistical notion of risk. We introduce LRT-Diffusion, a risk-aware sampling rule that treats…

机器学习 · 计算机科学 2026-02-20 Ximan Sun , Xiang Cheng

Time series generation (TSG) is widely used across domains, yet most existing methods assume regular sampling and fixed output resolutions. These assumptions are often violated in practice, where observations are irregular and sparse, while…

机器学习 · 计算机科学 2026-02-02 Xu Zhang , Junwei Deng , Chang Xu , Hao Li , Jiang Bian

Learning to act from observational data without active environmental interaction is a well-known challenge in Reinforcement Learning (RL). Recent approaches involve constraints on the learned policy or conservative updates, preventing…

机器学习 · 计算机科学 2021-10-28 Georg Ostrovski , Pablo Samuel Castro , Will Dabney

Recent years have seen a shift towards learning-based methods for trajectory prediction, with challenges remaining in addressing uncertainty and capturing multi-modal distributions. This paper introduces Temporal Ensembling with…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Kai-Yin Hong , Chieh-Chih Wang , Wen-Chieh Lin

Feature Transformation (FT) crafts new features from original ones via mathematical operations to enhance dataset expressiveness for downstream models. However, existing FT methods exhibit critical limitations: discrete search struggles…

机器学习 · 计算机科学 2025-05-22 Nanxu Gong , Zijun Li , Sixun Dong , Haoyue Bai , Wangyang Ying , Xinyuan Wang , Yanjie Fu

Trajectory generation has recently drawn growing interest in privacy-preserving urban mobility studies and location-based service applications. Although many studies have used deep learning or generative AI methods to model trajectories and…

机器学习 · 计算机科学 2026-03-25 Yuanbo Tang , Yan Tang , Zixuan Zhang , Zihui Zhao , Yang Li