English
Related papers

Related papers: FOLIAGE: Towards Physical Intelligence World Model…

200 papers

Inferring full-body poses from Head Mounted Devices, which capture only 3-joint observations from the head and wrists, is a challenging task with wide AR/VR applications. Previous attempts focus on learning one-stage motion mapping and thus…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Fangyu Du , Yang Yang , Xuehao Gao , Hongye Hou

Objectives: Functional connectivity triggered by naturalistic stimulus (e.g., movies) and machine learning techniques provide a great insight in exploring the brain functions such as fluid intelligence. However, functional connectivity are…

Artificial Intelligence · Computer Science 2021-01-07 Xiaobo Liu , Su Yang

We introduce MIRAGE, a new benchmark for multimodal expert-level reasoning and decision-making in consultative interaction settings. Designed for the agriculture domain, MIRAGE captures the full complexity of expert consultations by…

Machine Learning · Computer Science 2026-01-07 Vardhan Dongre , Chi Gui , Shubham Garg , Hooshang Nayyeri , Gokhan Tur , Dilek Hakkani-Tür , Vikram S. Adve

In personalized Federated Learning (pFL), high data heterogeneity can cause significant gradient divergence across devices, adversely affecting the learning process. This divergence, especially when gradients from different users form an…

Machine Learning · Computer Science 2024-10-07 Minh Duong Nguyen , Khanh Le , Khoi Do , Nguyen H. Tran , Duc Nguyen , Chien Trinh , Zhaohui Yang

Recent motion-language models unify tasks like comprehension and generation but operate at a coarse granularity, lacking fine-grained understanding and nuanced control over body parts needed for animation or interaction. This stems from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Bizhu Wu , Jinheng Xie , Wenting Chen , Zhe Kong , Jianfeng Ren , Linlin Shen , Ruibin Bai , Rong Qu

Federated Learning (FL) provides a privacy-preserving mechanism for distributed training of machine learning models on networked devices (e.g., mobile devices, IoT edge nodes). It enables Artificial Intelligence (AI) at the edge by creating…

Machine Learning · Computer Science 2024-04-03 Paul Joe Maliakel , Shashikant Ilager , Ivona Brandic

This work proposes a new machine learning (ML)-based paradigm aiming to enhance the computational efficiency of non-equilibrium reacting flow simulations while ensuring compliance with the underlying physics. The framework combines…

Computational Physics · Physics 2023-09-25 Ivan Zanardi , Simone Venturi , Marco Panesi

We address the problem of form understanding: finding text entities and the relationships/links between them in form images. The proposed FUDGE model formulates this problem on a graph of text elements (the vertices) and uses a Graph…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Brian Davis , Bryan Morse , Brian Price , Chris Tensmeyer , Curtis Wiginton

Real-life deployment of federated Learning (FL) often faces non-IID data, which leads to poor accuracy and slow convergence. Personalized FL (pFL) tackles these issues by tailoring local models to individual data sources and using weighted…

Machine Learning · Computer Science 2025-04-30 Weihang Chen , Cheng Yang , Jie Ren , Zhiqiang Li , Zheng Wang

Investigating the impact of fatigue on human physiological function and motor behavior is crucial for developing biomechanics and medical applications aimed at mitigating fatigue, reducing injury risk, and creating sophisticated ergonomic…

Graphics · Computer Science 2026-04-14 Iliana Loi , Konstantinos Moustakas

Vertical AI Agents are revolutionizing industries by delivering domain-specific intelligence and tailored solutions. However, many sectors, such as manufacturing, healthcare, and logistics, demand AI systems capable of extending their…

Multiagent Systems · Computer Science 2025-01-16 Fouad Bousetouane

Physiological signals are often corrupted by motion artifacts, baseline drift, and other low-SNR disturbances, which pose significant challenges for analysis. Additionally, these signals exhibit strong non-stationarity, with sharp peaks and…

Machine Learning · Computer Science 2025-10-21 Yanlong Chen , Mattia Orlandi , Pierangelo Maria Rapa , Simone Benatti , Luca Benini , Yawei Li

Federated Learning (FL) has emerged as a crucial distributed training paradigm, enabling discrete devices to collaboratively train a shared model under the coordination of a central server, while leveraging their locally stored private…

Machine Learning · Computer Science 2024-09-02 Wenhao Yuan , Xuehe Wang

General physical scene understanding requires more than simply localizing and recognizing objects -- it requires knowledge that objects can have different latent properties (e.g., mass or elasticity), and that those properties affect the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hsiao-Yu Tung , Mingyu Ding , Zhenfang Chen , Daniel Bear , Chuang Gan , Joshua B. Tenenbaum , Daniel LK Yamins , Judith E Fan , Kevin A. Smith

Video foundation models generate visually realistic and temporally coherent content, but their reliability as world simulators depends on whether they capture physical, logical, and spatial constraints. Existing metrics such as Frechet…

Computation and Language · Computer Science 2025-12-18 Zefan Cai , Haoyi Qiu , Tianyi Ma , Haozhe Zhao , Gengze Zhou , Kung-Hsiang Huang , Parisa Kordjamshidi , Minjia Zhang , Wen Xiao , Jiuxiang Gu , Nanyun Peng , Junjie Hu

High-quality 3D world models are pivotal for embodied intelligence and Artificial General Intelligence (AGI), underpinning applications such as AR/VR content creation and robotic navigation. Despite the established strong imaginative…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yixiang Dai , Fan Jiang , Chiyu Wang , Mu Xu , Yonggang Qi

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken…

Artificial Intelligence · Computer Science 2026-01-23 Zhikang Chen , Tingting Zhu

We propose an arbitrary Lagrangian-Eulerian (ALE)-consistent machine learning framework for long-term fluid-structure interaction (FSI) prediction on deforming unstructured meshes. Specifically, the fluid dynamics are modeled by a surrogate…

Fluid Dynamics · Physics 2026-05-05 Shihang Zhao , Martín Saravia , Haokui Jiang , Zhiyang Xue , Shunxiang Cao

Synthesizing physics-grounded 3D assets is a critical bottleneck for interactive virtual worlds and embodied AI. Existing methods predominantly focus on static geometry, overlooking the functional properties essential for interaction. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yunhan Yang , Chunshi Wang , Junliang Ye , Yang Li , Zanxin Chen , Zehuan Huang , Yao Mu , Zhuo Chen , Chunchao Guo , Xihui Liu

Accurate cancer survival prediction requires integration of diverse data modalities that reflect the complex interplay between imaging, clinical parameters, and textual reports. However, existing multimodal approaches suffer from simplistic…

Machine Learning · Computer Science 2025-07-01 Aakash Tripathi , Asim Waqas , Matthew B. Schabath , Yasin Yilmaz , Ghulam Rasool