English
Related papers

Related papers: PersONAL: Towards a Comprehensive Benchmark for Pe…

200 papers

Person re identification is a challenging retrieval task that requires matching a person's acquired image across non overlapping camera views. In this paper we propose an effective approach that incorporates both the fine and coarse pose…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 M. Saquib Sarfraz , Arne Schumann , Andreas Eberle , Rainer Stiefelhagen

Embodied navigation is a fundamental capability of embodied intelligence, enabling robots to move and interact within physical environments. However, existing navigation tasks primarily focus on predefined object navigation or instruction…

Leveraging multimodal large language models (MLLMs) to develop embodied agents offers significant promise for addressing complex real-world tasks. However, current evaluation benchmarks remain predominantly language-centric or heavily…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Dwip Dalal , Utkarsh Mishra , Narendra Ahuja , Nebojsa Jojic

Embodied scene understanding serves as the cornerstone for autonomous agents to perceive, interpret, and respond to open driving scenarios. Such understanding is typically founded upon Vision-Language Models (VLMs). Nevertheless, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Yunsong Zhou , Linyan Huang , Qingwen Bu , Jia Zeng , Tianyu Li , Hang Qiu , Hongzi Zhu , Minyi Guo , Yu Qiao , Hongyang Li

Current embodied VLM evaluation relies on static, expert-defined, manually annotated benchmarks that exhibit severe redundancy and coverage imbalance. This labor intensive paradigm drains computational and annotation resources, inflates…

Computation and Language · Computer Science 2026-02-03 Shuai Zhang , Jiayu Hu , Zijie Chen , Zeyuan Ding , Yi Zhang , Yingji Zhang , Ziyi Zhou , Junwei Liao , Shengjie Zhou , Yong Dai , Zhenzhong Lan , Xiaozhu Ju

Aligning machine learning systems with human expectations is mostly attempted by training with manually vetted human behavioral samples, typically explicit feedback. This is done on a population level since the context that is capturing the…

Artificial Intelligence · Computer Science 2025-06-23 Simon Werner , Katharina Christ , Laura Bernardy , Marion G. Müller , Achim Rettinger

In this paper, we argue that the future of Artificial Intelligence research resides in two keywords: integration and embodiment. We support this claim by analyzing the recent advances of the field. Regarding integration, we note that the…

Artificial Intelligence · Computer Science 2017-09-19 Clément Moulin-Frier , Jordi-Ysard Puigbò , Xerxes D. Arsiwalla , Martì Sanchez-Fibla , Paul F. M. J. Verschure

Recent advances in remote patient monitoring (RPM) systems can recognize various human activities to measure vital signs, including subtle motions from superficial vessels. There is a growing interest in applying artificial intelligence…

Machine Learning · Computer Science 2022-09-29 Thanveer Shaik , Xiaohui Tao , Niall Higgins , Raj Gururajan , Yuefeng Li , Xujuan Zhou , U Rajendra Acharya

As Vision-Language Models (VLMs) are increasingly deployed as autonomous cognitive cores for embodied assistants, evaluating their privacy awareness in physical environments becomes critical. Unlike digital chatbots, these agents operate in…

Cryptography and Security · Computer Science 2026-05-11 Junran Wang , Xinjie Shen , Zehao Jin , Pan Li

Navigating dynamic urban environments presents significant challenges for embodied agents, requiring advanced spatial reasoning and adherence to common-sense norms. Despite progress, existing visual navigation methods struggle in map-free…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Xinhao Liu , Jintong Li , Yicheng Jiang , Niranjan Sujay , Zhicheng Yang , Juexiao Zhang , John Abanes , Jing Zhang , Chen Feng

In the context of visual navigation, the capacity to map a novel environment is necessary for an agent to exploit its observation history in the considered place and efficiently reach known goals. This ability can be associated with spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Large language models (LLMs) and agentic systems have shown promise for automated software development, but applying them to hardware-in-the-loop (HIL) embedded and Internet-of-Things (IoT) systems remains challenging due to the tight…

Software Engineering · Computer Science 2026-03-23 Yiming Li , Yuhan Cheng , Mingchen Ma , Yihang Zou , Ningyuan Yang , Wei Cheng , Hai "Helen" Li , Yiran Chen , Tingjun Chen

The rapidly developing field of large multimodal models (LMMs) has led to the emergence of diverse models with remarkable capabilities. However, existing benchmarks fail to comprehensively, objectively and accurately evaluate whether LMMs…

We introduce environment predictive coding, a self-supervised approach to learn environment-level representations for embodied agents. In contrast to prior work on self-supervised learning for images, we aim to jointly encode a series of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Santhosh K. Ramakrishnan , Tushar Nagarajan , Ziad Al-Halah , Kristen Grauman

Embodied Planning is dedicated to the goal of creating agents capable of executing long-horizon tasks in complex physical worlds. However, existing embodied planning benchmarks frequently feature short-horizon tasks and coarse-grained…

Robotics · Computer Science 2025-08-06 Muzhen Cai , Xiubo Chen , Yining An , Jiaxin Zhang , Xuesong Wang , Wang Xu , Weinan Zhang , Ting Liu

Progress in Embodied AI has made it possible for end-to-end-trained agents to navigate in photo-realistic environments with high-level reasoning and zero-shot or language-conditioned behavior, but benchmarks are still dominated by…

Embodied AI research is increasingly moving beyond single-task, single-environment policy learning toward multi-task, multi-scene, and multi-model settings. This shift substantially increases the engineering overhead and development time…

Robotics · Computer Science 2026-04-16 Xueyang Zhou , Yihan Sun , Xijie Gong , Guiyao Tie , Pan Zhou , Lichao Sun , Yongchao Chen

Current approaches to embodied AI tend to learn policies from expert demonstrations. However, without a mechanism to evaluate the quality of demonstrated actions, they are limited to learning from optimal behaviour, or they risk replicating…

Computation and Language · Computer Science 2025-10-14 Sabrina McCallum , Amit Parekh , Alessandro Suglia

In this work, we study Cooperative Spatial Intelligence, the ability of decentralized embodied agents to coordinate effectively under dynamic environmental constraints across city-scale outdoor domains. We introduce Sentinel Challenge, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiangye Lin , Hongxin Zhang , Ruxi Deng , Qinhong Zhou , Chuang Gan

Recent work has presented embodied agents that can navigate to point-goal targets in novel indoor environments with near-perfect accuracy. However, these agents are equipped with idealized sensors for localization and take deterministic…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Samyak Datta , Oleksandr Maksymets , Judy Hoffman , Stefan Lee , Dhruv Batra , Devi Parikh