English
Related papers

Related papers: OmniTraj: Pre-Training on Heterogeneous Data for A…

200 papers

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of universal forecasting,…

Machine Learning · Computer Science 2024-05-24 Gerald Woo , Chenghao Liu , Akshat Kumar , Caiming Xiong , Silvio Savarese , Doyen Sahoo

Deep learning for human sensing on edge systems presents significant potential for smart applications. However, its training and development are hindered by the limited availability of sensor data and resource constraints of edge systems.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yu Zhang , Xi Zhang , Hualin Zhou , Xinyuan Chen , Shang Gao , Hong Jia , Jianfei Yang , Yuankai Qi , Tao Gu

Panoramic imagery, with its 360{\deg} field of view, offers comprehensive information to support Multi-Object Tracking (MOT) in capturing spatial and temporal relationships of surrounding objects. However, most MOT algorithms are tailored…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Kai Luo , Hao Shi , Sheng Wu , Fei Teng , Mengfei Duan , Chang Huang , Yuhang Wang , Kaiwei Wang , Kailun Yang

The widespread adoption of mobile devices and data collection technologies has led to an exponential increase in trajectory data, presenting significant challenges in spatio-temporal data mining, particularly for efficient and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yuanshao Zhu , James Jianqiao Yu , Xiangyu Zhao , Xiao Han , Qidong Liu , Xuetao Wei , Yuxuan Liang

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Siyuan Yao , Rui Zhu , Ziqi Wang , Wenqi Ren , Yanyang Yan , Xiaochun Cao

A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on…

Web-crawled pretraining datasets underlie the impressive "zero-shot" evaluation performance of multimodal models, such as CLIP for classification/retrieval and Stable-Diffusion for image generation. However, it is unclear how meaningful the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Vishaal Udandarao , Ameya Prabhu , Adhiraj Ghosh , Yash Sharma , Philip H. S. Torr , Adel Bibi , Samuel Albanie , Matthias Bethge

This paper introduces a trajectory prediction model tailored for autonomous driving, focusing on capturing complex interactions in dynamic traffic scenarios without reliance on high-definition maps. The model, termed MFTraj, harnesses…

Robotics · Computer Science 2024-05-03 Haicheng Liao , Zhenning Li , Chengyue Wang , Huanming Shen , Bonan Wang , Dongping Liao , Guofa Li , Chengzhong Xu

Scaling real robot data is a key bottleneck in imitation learning, leading to the use of auxiliary data for policy training. While other aspects of robotic manipulation such as image or language understanding may be learned from…

Robotics · Computer Science 2025-09-23 Chengbo Yuan , Rui Zhou , Mengzhen Liu , Yingdong Hu , Shengjie Wang , Li Yi , Chuan Wen , Shanghang Zhang , Yang Gao

We propose a novel zero-shot multi-frame image restoration method for removing unwanted obstruction elements (such as rains, snow, and moire patterns) that vary in successive frames. It has three stages: transformer pre-training, zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Lin Liu , Shanxin Yuan , Jianzhuang Liu , Xin Guo , Youliang Yan , Qi Tian

We introduce a new model for conditional and continuous data morphing called TRansport Adversarial Network for Smooth InTerpolation (TRANSIT). We apply it to create a background data template for weakly-supervised searches at the LHC. The…

High Energy Physics - Phenomenology · Physics 2025-05-27 Ivan Oleksiyuk , Svyatoslav Voloshynovskiy , Tobias Golling

Accurate trajectory prediction is a cornerstone for the safe operation of autonomous driving systems, where understanding the dynamic behavior of surrounding agents is crucial. Transformer-based architectures have demonstrated significant…

Machine Learning · Computer Science 2025-05-07 JianLin Zhu , HongKuo Niu

Large Language Models (LLMs) have made significant strides in text generation and comprehension, with recent advancements extending into multimodal LLMs that integrate visual and audio inputs. However, these models continue to struggle with…

Computation and Language · Computer Science 2024-10-17 Arushi Goel , Karan Sapra , Matthieu Le , Rafael Valle , Andrew Tao , Bryan Catanzaro

Astronomical time-series analysis faces a critical limitation: the scarcity of labeled observational data. We present a pre-training approach that leverages simulations, significantly reducing the need for labeled examples from real…

Instrumentation and Methods for Astrophysics · Physics 2025-10-16 Rithwik Gupta , Daniel Muthukrishna , Jeroen Audenaert

Multi-object tracking (MOT) is a critical and challenging task in computer vision, particularly in situations involving objects with similar appearances but diverse movements, as seen in team sports. Current methods, largely reliant on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Atom Scott , Ikuma Uchida , Ning Ding , Rikuhei Umemoto , Rory Bunker , Ren Kobayashi , Takeshi Koyama , Masaki Onishi , Yoshinari Kameda , Keisuke Fujii

Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Accurately forecasting crowd trajectories is challenging due to the uncertain nature of human motions in different…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Yu Liu , Yuexin Zhang , Kunming Li , Yongliang Qiao , Stewart Worrall , You-Fu Li , He Kong

Accurate traffic forecasting is crucial for effective urban planning and transportation management, enabling efficient resource allocation and enhanced travel experiences. However, existing models often face limitations in generalization,…

Machine Learning · Computer Science 2025-11-11 Zhonghang Li , Long Xia , Lei Shi , Yong Xu , Dawei Yin , Chao Huang

To address panoramic distortion, large search space, and identity ambiguity under a 360{\deg} FoV, OmniTrack++ adopts a feedback-driven framework that progressively refines perception with trajectory cues. A DynamicSSM block first…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Kai Luo , Hao Shi , Kunyu Peng , Fei Teng , Sheng Wu , Kaiwei Wang , Kailun Yang

Whole-body humanoid motion represents a fundamental challenge in robotics, requiring balance, coordination, and adaptability to enable human-like behaviors. However, existing methods typically require multiple training samples per motion,…