English
Related papers

Related papers: FlexiFly: Interfacing the Physical World with Foun…

200 papers

Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications. The rapid advances in FMs serve as an important contextual backdrop for the vision of…

Networking and Internet Architecture · Computer Science 2024-05-08 Zihan Chen , Howard H. Yang , Y. C. Tay , Kai Fong Ernest Chong , Tony Q. S. Quek

Quantitative remote sensing inversion aims to estimate continuous surface variables-such as biomass, vegetation indices, and evapotranspiration-from satellite observations, supporting applications in ecosystem monitoring, carbon accounting,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zhenyu Yu , Mohd Yamani Idna Idris , Hua Wang , Pei Wang , Junyi Chen , Kun Wang

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

Machine Learning · Computer Science 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

Motion understanding is fundamental to physical reasoning, enabling models to infer dynamics and predict future states. However, state-of-the-art models still struggle on recent motion benchmarks, primarily due to the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yulu Gan , Ligeng Zhu , Dandan Shan , Baifeng Shi , Hongxu Yin , Boris Ivanovic , Song Han , Trevor Darrell , Jitendra Malik , Marco Pavone , Boyi Li

Foundation Models (FM) have increasingly drawn the attention of researchers due to their scalability and generalization across diverse tasks. Inspired by the success of FMs and the principles that have driven advancements in Large Language…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Mohammadreza Baharani , Ghazal Alinezhad Noghre , Armin Danesh Pazho , Gabriel Maldonado , Hamed Tabkhi

To support future intelligent multifunctional sixth-generation (6G) wireless communication networks, Synesthesia of Machines (SoM) is proposed as a novel paradigm for artificial intelligence (AI)-native intelligent multi-modal…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiang Cheng , Boxun Liu , Xuanyu Liu , Ensong Liu , Ziwei Huang

Foundation models (FMs) such as large language models have revolutionized the field of AI by showing remarkable performance in various tasks. However, they exhibit numerous limitations that prevent their broader adoption in many real-world…

Artificial Intelligence · Computer Science 2024-02-05 Debarun Bhattacharjya , Junkyu Lee , Don Joven Agravante , Balaji Ganesan , Radu Marinescu

Foundation models (FMs) have shown remarkable capabilities in generalized intelligence, multimodal understanding, and adaptive learning across a wide range of domains. However, their deployment in harsh or austere environments --…

Networking and Internet Architecture · Computer Science 2025-09-17 Evan Chen , Seyyedali Hosseinalipour , Christopher G. Brinton , David J. Love

The intersection of Foundation Model (FM) and Federated Learning (FL) presents a unique opportunity to unlock new possibilities for real-world applications. On the one hand, FL, as a collaborative learning paradigm, help address challenges…

Machine Learning · Computer Science 2025-05-06 Weiming Zhuang , Chen Chen , Jingtao Li , Chaochao Chen , Yaochu Jin , Lingjuan Lyu

Recent advancements in foundation models (FMs) have unlocked new prospects in autonomous driving, yet the experimental settings of these studies are preliminary, over-simplified, and fail to capture the complexity of real-world driving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yidong Huang , Jacob Sansom , Ziqiao Ma , Felix Gervits , Joyce Chai

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

Smart-home sensor data holds significant potential for several applications, including healthcare monitoring and assistive technologies. Existing approaches, however, face critical limitations. Supervised models require impractical amounts…

Artificial Intelligence · Computer Science 2026-02-03 Michele Fiori , Gabriele Civitarese , Flora D. Salim , Claudio Bettini

Sampling useful three-dimensional molecular structures along with their most favorable conformations is a key challenge in drug discovery. Current state-of-the-art 3D de-novo design flow matching or diffusion-based models are limited to…

Machine Learning · Computer Science 2025-11-24 Riccardo Tedoldi , Ola Engkvist , Patrick Bryant , Hossein Azizpour , Jon Paul Janet , Alessandro Tibo

Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sheng Luo , Wei Chen , Wanxin Tian , Rui Liu , Luanxuan Hou , Xiubao Zhang , Haifeng Shen , Ruiqi Wu , Shuyi Geng , Yi Zhou , Ling Shao , Yi Yang , Bojun Gao , Qun Li , Guobin Wu

AI-communication integration is widely regarded as a core enabling technology for 6G. Most existing AI-based physical-layer designs rely on task-specific models that are separately tailored to individual modules, resulting in poor…

Signal Processing · Electrical Eng. & Systems 2026-01-19 Xiang Cheng , Boxun Liu , Xuanyu Liu , Xuesong Cai

Realistic simulation of dynamic scenes requires accurately capturing diverse material properties and modeling complex object interactions grounded in physical principles. However, existing methods are constrained to basic material types…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Zhuoman Liu , Weicai Ye , Yan Luximon , Pengfei Wan , Di Zhang

As an effective approach to understanding the human-centric physical world, Wearable Artificial Intelligence (AI), which leverages multimodal wearable sensors to understand human physiology and behavior, has attracted increasing attention…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Yize Cai , Baoshen Guo , Guobin Shen , Zhiqing Hong

Foundation models are vital tools in various Computer Vision applications. They take as input a single RGB image and output a deep feature representation that is useful for various applications. However, in case we have multiple views of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Leo Segre , Or Hirschorn , Shai Avidan

Existing imitation learning methods enable robots to interact autonomously with the physical environment. However, contact-rich manipulation tasks remain a significant challenge due to complex contact dynamics that demand high-precision…

This perspective reframes human-robot interaction (HRI) through extended reality (XR), arguing that virtual robots powered by large foundation models (FMs) can serve as cognitively grounded, empathic agents. Unlike physical robots,…

Human-Computer Interaction · Computer Science 2026-03-30 Yuchong Zhang , Yong Ma , Danica Kragic