English
Related papers

Related papers: Generating Individual Trajectories Using GPT-2 Tra…

200 papers

The generation of realistic spatio-temporal trajectories of human mobility is of fundamental importance in a wide range of applications, such as the developing of protocols for mobile ad-hoc networks or what-if analysis in urban ecosystems.…

Social and Information Networks · Computer Science 2017-12-12 Luca Pappalardo , Filippo Simini

Accurate and robust weather forecasting remains a fundamental challenge due to the inherent spatio-temporal complexity of atmospheric systems. In this paper, we propose a novel self-supervised learning framework that leverages…

Machine Learning · Computer Science 2025-11-04 Yao Liu

Language models are often trained to maximize the likelihood of the next token given past tokens in the training dataset. However, during inference time, they are utilized differently, generating text sequentially and auto-regressively by…

Machine Learning · Computer Science 2025-01-22 Zhepeng Cen , Yao Liu , Siliang Zeng , Pratik Chaudhari , Huzefa Rangwala , George Karypis , Rasool Fakoor

Pre-trained language models have shown remarkable success in improving various downstream NLP tasks due to their ability to capture dependencies in textual data and generate natural responses. In this paper, we leverage the power of…

Computation and Language · Computer Science 2020-06-30 Hung Le , Steven C. H. Hoi

We consider the problem of spatial path planning. In contrast to the classical solutions which optimize a new plan from scratch and assume access to the full map with ground truth obstacle locations, we learn a planner from the data in a…

Machine Learning · Computer Science 2021-12-03 Devendra Singh Chaplot , Deepak Pathak , Jitendra Malik

We propose a robust and efficient framework to generate global trajectories for ground robots in complex 3D environments. The proposed method takes point cloud as input and efficiently constructs a multi-level map using triangular patches…

Robotics · Computer Science 2024-11-14 Chengkun Tian , Xiaohui Gao , Yongguang Liu

Human auditory perception is shaped by moving sound sources in 3D space, yet prior work in generative sound modelling has largely been restricted to mono signals or static spatial audio. In this work, we introduce a framework for generating…

Sound · Computer Science 2025-09-29 Yunyi Liu , Shaofan Yang , Kai Li , Xu Li

Generative modelling with Transformer architectures can simulate complex sequential structures across various applications. We extend this line of work to the social sciences by introducing a Transformer-based generative model tailored to…

Econometrics · Economics 2026-01-23 Alberto Cabezas , Carlotta Montorsi

Learning from demonstration allows robots to acquire complex skills from human demonstrations, but conventional approaches often require large datasets and fail to generalize across coordinate transformations. In this paper, we propose…

Robotics · Computer Science 2025-09-18 Zewen Yang , Xiaobing Dai , Dongfa Zhang , Yu Li , Ziyang Meng , Bingkun Huang , Hamid Sadeghian , Sami Haddadin

In various fields of knowledge creation, including science, new ideas often build on pre-existing information. In this work, we explore this concept within the context of language models. Specifically, we explore the potential of…

Computation and Language · Computer Science 2024-04-04 David Herel , Tomas Mikolov

In autoregressive large language models (LLMs), temporal straightening offers an account of how the next-token prediction objective shapes representations. Models learn to progressively straighten the representational trajectory of input…

Artificial Intelligence · Computer Science 2026-04-28 Jack King , Evelina Fedorenko , Eghbal A. Hosseini

In this Working Paper we analyse computational strategies for using aggregated spatio-temporal population data acquired from telecommunications networks to infer travel and movement patterns between geographical regions. Specifically, we…

Novel concepts are essential for design innovation and can be generated with the aid of data stimuli and computers. However, current generative design algorithms focus on diagrammatic or spatial concepts that are either too abstract to…

Computation and Language · Computer Science 2021-11-17 Qihao Zhu , Jianxi Luo

We present a scalable self-supervised approach for segmenting feasible vehicle trajectories from monocular images for autonomous driving in complex urban environments. Leveraging large-scale dashcam videos, we treat recorded ego-vehicle…

Robotics · Computer Science 2026-03-25 Tomasz Frelek , Rohan Patil , Akshar Tumu , Henrik I. Christensen

We present a generative model of human mobility in which trajectories arise as realizations of a prescribed, time-dependent Markov dynamics defined on a spatial interaction network. The model constructs a hierarchical routing structure with…

Social and Information Networks · Computer Science 2026-01-12 David A. Meyer , Asif Shakeel

Variations of human body skeletons may be considered as dynamic graphs, which are generic data representation for numerous real-world applications. In this paper, we propose a spatio-temporal graph convolution (STGC) approach for assembling…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Chaolong Li , Zhen Cui , Wenming Zheng , Chunyan Xu , Jian Yang

In this work, we introduce an innovative autoregressive model leveraging Generative Pretrained Transformer (GPT) architectures, tailored for fraud detection in payment systems. Our approach innovatively confronts token explosion and…

Machine Learning · Computer Science 2023-12-25 Ze Yu Zhao , Zheng Zhu , Guilin Li , Wenhan Wang , Bo Wang

Imitation learning is an intuitive approach for teaching motion to robotic systems. Although previous studies have proposed various methods to model demonstrated movement primitives, one of the limitations of existing methods is that the…

Robotics · Computer Science 2020-09-24 Takayuki Osa , Shuhei Ikemoto

Data annotation is an essential step for constructing new datasets. However, the conventional approach of data annotation through crowdsourcing is both time-consuming and expensive. In addition, the complexity of this process increases when…

Computation and Language · Computer Science 2024-02-09 Juhwan Choi , Eunju Lee , Kyohoon Jin , YoungBin Kim

The importance of personal mobility data is widely recognized in various fields. However, the utilization of real personal mobility data raises privacy concerns. Therefore, it is crucial to generate pseudo personal mobility data that…

Computers and Society · Computer Science 2023-12-19 Peiran Li , Haoran Zhang , Wenjing Li , Dou Huang , Jinyu Chen , Junxiang Zhang , Xuan Song , Pengjun Zhao , Shibasaki Ryosuke