English
Related papers

Related papers: HiT-JEPA: A Hierarchical Self-supervised Trajector…

200 papers

The integration of GNSS data into portable devices has led to the generation of vast amounts of trajectory data, which is crucial for applications such as map-matching. To tackle the limitations of rule-based methods, recent works in deep…

Databases · Computer Science 2026-03-26 Anjun Gao , Zhenglin Wan , Pingfu Chao , Shunyu Yao

Pedestrian trajectory prediction is crucial for autonomous driving and robotics. While existing point-based and grid-based methods expose two main limitations: insufficiently modeling human motion dynamics, as they fail to balance local…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yanghong Liu , Xingping Dong , Ming Li , Weixing Zhang , Yidong Lou

In remote control systems, transmitting large data volumes (e.g., images, video frames) from wireless sensors to remote controllers is challenging when uplink capacity is limited (e.g., RedCap devices or massive wireless sensor networks).…

Information Theory · Computer Science 2025-07-03 Abanoub M. Girgis , Alvaro Valcarce , Mehdi Bennis

Ultrasound (US) imaging poses unique challenges for representation learning due to its inherently noisy acquisition process. The low signal-to-noise ratio and stochastic speckle patterns hinder standard self-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ashwath Radhachandran , Vedrana Ivezić , Shreeram Athreya , Ronit Anilkumar , Corey W. Arnold , William Speier

The link prediction task aims to predict missing entities or relations in the knowledge graph and is essential for the downstream application. Existing well-known models deal with this task by mainly focusing on representing knowledge graph…

Computation and Language · Computer Science 2023-03-29 Jin Liu , Jianye Chen , Chongfeng Fan , Fengyu Zhou

Source code representation with deep learning techniques is an important research field. There have been many studies that learn sequential or structural information for code representation. But sequence-based models and non-sequence-models…

Software Engineering · Computer Science 2023-03-15 Kechi Zhang , Zhuo Li , Zhi Jin , Ge Li

We introduce VL-JEPA, a vision-language model built on a Joint Embedding Predictive Architecture (JEPA). Instead of autoregressively generating tokens as in classical VLMs, VL-JEPA predicts continuous embeddings of the target texts. By…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Delong Chen , Mustafa Shukor , Theo Moutakanni , Willy Chung , Jade Yu , Tejaswi Kasarla , Yejin Bang , Allen Bolourchi , Yann LeCun , Pascale Fung

Autonomous highway driving involves high-speed safety risks due to limited reaction time, where rare but dangerous events may lead to severe consequences. This places stringent requirements on trajectory planning in terms of both…

Robotics · Computer Science 2026-04-14 Yujia Lu , Chong Wei , Lu Ma , Lounis Adouane

With the acceleration of urbanization, traffic forecasting has become an essential role in smart city construction. In the context of spatio-temporal prediction, the key lies in how to model the dependencies of sensors. However, existing…

Artificial Intelligence · Computer Science 2023-09-21 Qian Ma , Zijian Zhang , Xiangyu Zhao , Haoliang Li , Hongwei Zhao , Yiqi Wang , Zitao Liu , Wanyu Wang

This study focuses on the problem of path modeling in heterogeneous information networks and proposes a multi-hop path-aware recommendation framework. The method centers on multi-hop paths composed of various types of entities and…

Information Retrieval · Computer Science 2025-05-12 Hongye Zheng , Yue Xing , Lipeng Zhu , Xu Han , Junliang Du , Wanyu Cui

We present V-JEPA 2.1, a family of self-supervised models that learn dense, high-quality visual representations for both images and videos while retaining strong global scene understanding. The approach combines four key components. First,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Lorenzo Mur-Labadia , Matthew Muckley , Amir Bar , Mido Assran , Koustuv Sinha , Mike Rabbat , Yann LeCun , Nicolas Ballas , Adrien Bardes

Robust data association is critical for analysis of long-term motion trajectories in complex scenes. In its absence, trajectory precision suffers due to periods of kinematic ambiguity degrading the quality of follow-on analysis. Common…

Machine Learning · Computer Science 2020-11-17 David S. Hayden , Sue Zheng , John W. Fisher

World models compress rich sensory streams into compact latent codes that anticipate future observations. We let separate agents acquire such models from distinct viewpoints of the same environment without any parameter sharing or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haoran Zhang , Youjin Wang , Yi Duan , Rong Fu , Dianyu Zhao , Sicheng Fan , Shuaishuai Cao , Wentao Guo , Xiao Zhou

Electronic health records (EHR) contain narrative notes that provide extensive details on the medical condition and management of patients. Natural language processing (NLP) of clinical notes can use observed frequencies of clinical terms…

Computation and Language · Computer Science 2023-07-04 Bryan Cai , Sihang Zeng , Yucong Lin , Zheng Yuan , Doudou Zhou , Lu Tian

The wide spread use of positioning and photographing devices gives rise to a deluge of traffic trajectory data (e.g., vehicle passage records and taxi trajectory data), with each record having at least three attributes: object ID, location…

Machine Learning · Computer Science 2020-03-18 Meng Chen , Xiaohui Yu , Yang Liu

Large Language Model (LLM) pretraining, finetuning, and evaluation rely on input-space reconstruction and generative capabilities. Yet, it has been observed in vision that embedding-space training objectives, e.g., with Joint Embedding…

Computation and Language · Computer Science 2025-10-08 Hai Huang , Yann LeCun , Randall Balestriero

Predicting the trajectories of vehicles is crucial for the development of autonomous driving (AD) systems, particularly in complex and dynamic traffic environments. In this study, we introduce HiT (Human-like Trajectory Prediction), a novel…

Robotics · Computer Science 2025-05-29 Haicheng Liao , Zhenning Li , Guohui Zhang , Keqiang Li , Chengzhong Xu

Image-based Joint-Embedding Predictive Architecture (IJEPA) offers an attractive alternative to Masked Autoencoder (MAE) for representation learning using the Masked Image Modeling framework. IJEPA drives representations to capture useful…

Machine Learning · Computer Science 2024-10-15 Etai Littwin , Vimal Thilak , Anand Gopalakrishnan

The field of trajectory forecasting has grown significantly in recent years, partially owing to the release of numerous large-scale, real-world human trajectory datasets for autonomous vehicles (AVs) and pedestrian motion tracking. While…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Boris Ivanovic , Guanyu Song , Igor Gilitschenski , Marco Pavone

Future wireless systems increasingly require predictive and transferable representations that can support multiple physical-layer (PHY) tasks under dynamic environments. However, most existing supervised learning-based methods are designed…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Can Zheng , Jiguang He , Guofa Cai , Nannan Li , Mehdi Bennis , Henk Wymeersch , Merouane Debbah