English
Related papers

Related papers: Building a Foundation Model for Trajectory from Sc…

200 papers

Motion understanding is fundamental to physical reasoning, enabling models to infer dynamics and predict future states. However, state-of-the-art models still struggle on recent motion benchmarks, primarily due to the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yulu Gan , Ligeng Zhu , Dandan Shan , Baifeng Shi , Hongxu Yin , Boris Ivanovic , Song Han , Trevor Darrell , Jitendra Malik , Marco Pavone , Boyi Li

Despite tremendous advances in AI, it remains a significant challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans in various tasks. These systems need to have a sophisticated…

Artificial Intelligence · Computer Science 2023-11-03 Yuwei Bao , Keunwoo Peter Yu , Yichi Zhang , Shane Storks , Itamar Bar-Yossef , Alexander De La Iglesia , Megan Su , Xiao Lin Zheng , Joyce Chai

Foundation models have made rapid advances in many domains including Earth observation, where Geospatial Foundation Models (GFMs) can help address global challenges such as climate change, agriculture, and disaster response. Previous work…

Machine Learning · Computer Science 2025-01-23 Mirali Purohit , Gedeon Muhawenayo , Esther Rolf , Hannah Kerner

The birth of Foundation Models brought unprecedented results in a wide range of tasks, from language to vision, to robotic control. These models are able to process huge quantities of data, and can extract and develop rich representations,…

This work addresses a fundamental barrier in recommender systems: the inability to generalize across domains without extensive retraining. Traditional ID-based approaches fail entirely in cold-start and cross-domain scenarios where new…

Information Retrieval · Computer Science 2025-06-16 Yangqin Jiang , Xubin Ren , Lianghao Xia , Da Luo , Kangyi Lin , Chao Huang

The widespread use of GPS devices has driven advances in spatiotemporal data mining, enabling machine learning models to simulate human decision making and generate realistic trajectories, addressing both data collection costs and privacy…

Machine Learning · Computer Science 2025-10-09 Zhiyang Zhang , Ningcong Chen , Xin Zhang , Yanhua Li , Shen Su , Hui Lu , Jun Luo

Trajectory modeling refers to characterizing human movement behavior, serving as a pivotal step in understanding mobility patterns. Nevertheless, existing studies typically ignore the confounding effects of geospatial context, leading to…

Machine Learning · Computer Science 2024-04-23 Kang Luo , Yuanshao Zhu , Wei Chen , Kun Wang , Zhengyang Zhou , Sijie Ruan , Yuxuan Liang

Foundation models are pretrained on large-scale corpora to learn generalizable patterns across domains and tasks -- such as contours, textures, and edges in images, or tokens and sentences in text. In contrast, discovering such generalities…

Machine Learning · Computer Science 2025-05-27 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Foundation models, such as large language models (LLMs), have been widely recognised as transformative AI technologies due to their capabilities to understand and generate content, including plans with reasoning capabilities. Foundation…

Artificial Intelligence · Computer Science 2024-04-04 Qinghua Lu , Liming Zhu , Xiwei Xu , Zhenchang Xing , Stefan Harrer , Jon Whittle

Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other…

Artificial Intelligence · Computer Science 2023-03-08 Sherry Yang , Ofir Nachum , Yilun Du , Jason Wei , Pieter Abbeel , Dale Schuurmans

Recent Video-to-Audio (V2A) generation relies on extracting semantic and temporal features from video to condition generative models. Training these models from scratch is resource intensive. Consequently, leveraging foundation models (FMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Gehui Chen , Guan'an Wang , Xiaowen Huang , Jitao Sang

Artificial intelligence (AI)-driven electronic design automation (EDA) techniques have been extensively explored for VLSI circuit design applications. Most recently, foundation AI models for circuits have emerged as a new technology trend.…

Hardware Architecture · Computer Science 2025-04-08 Wenji Fang , Jing Wang , Yao Lu , Shang Liu , Yuchao Wu , Yuzhe Ma , Zhiyao Xie

Safe, reliable navigation in extreme, unfamiliar terrain is required for future robotic space exploration missions. Recent generative-AI methods learn semantically aware navigation policies from large, cross-embodiment datasets, but offer…

The rapid advancement of AI technology has led to widespread applications of agent systems across various domains. However, the need for detailed architecture design poses significant challenges in designing and operating these systems.…

Software Engineering · Computer Science 2024-08-07 Jingwen Zhou , Qinghua Lu , Jieshan Chen , Liming Zhu , Xiwei Xu , Zhenchang Xing , Stefan Harrer

While interpretability is crucial for machine learning applications in safety-critical domains and for regulatory compliance, existing tabular foundation models like TabPFN lack transparency. Generalized Additive Models (GAMs) provide the…

Machine Learning · Computer Science 2026-02-06 Andreas Mueller , Julien Siems , Harsha Nori , David Salinas , Arber Zela , Rich Caruana , Frank Hutter

Gait patterns play a critical role in human identification and healthcare analytics, yet current progress remains constrained by small, narrowly designed models that fail to scale or generalize. Building a unified gait foundation model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dingqiang Ye , Chao Fan , Kartik Narayan , Bingzhe Wu , Chengwen Luo , Jianqiang Li , Vishal M. Patel

Language is an interface to the outside world. In order for embodied agents to use it, language must be grounded in other, sensorimotor modalities. While there is an extended literature studying how machines can learn grounded language, the…

Artificial Intelligence · Computer Science 2021-10-12 Tristan Karch , Laetitia Teodorescu , Katja Hofmann , Clément Moulin-Frier , Pierre-Yves Oudeyer

Artificial intelligence (AI) is evolving towards artificial general intelligence, which refers to the ability of an AI system to perform a wide range of tasks and exhibit a level of intelligence similar to that of a human being. This is in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Chunhui Zhang , Li Liu , Yawen Cui , Guanjie Huang , Weilin Lin , Yiqian Yang , Yuehong Hu

Teaching robots new skills quickly and conveniently is crucial for the broader adoption of robotic systems. In this work, we address the problem of one-shot imitation from a single human demonstration, given by an RGB-D video recording. We…

Robotics · Computer Science 2025-01-30 Nick Heppert , Max Argus , Tim Welschehold , Thomas Brox , Abhinav Valada

Rapid advancements in foundation models, including Large Language Models, Vision-Language Models, Multimodal Large Language Models, and Vision-Language-Action Models, have opened new avenues for embodied AI in mobile service robotics. By…

Robotics · Computer Science 2026-03-11 Matthew Lisondra , Beno Benhabib , Goldie Nejat