English
Related papers

Related papers: Beyond Isolation: A Unified Benchmark for General-…

200 papers

Object navigation (ObjectNav) in real-world environments is a complex problem that requires simultaneously addressing multiple challenges, including complex spatial structure, long-horizon planning and semantic understanding. Recent…

Robotics · Computer Science 2026-03-10 Haokun Zhu , Zongtai Li , Zihan Liu , Kevin Guo , Zhengzhi Lin , Yuxin Cai , Guofei Chen , Chen Lv , Wenshan Wang , Jean Oh , Ji Zhang

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

Navigating complex indoor environments requires a deep understanding of the space the robotic agent is acting into to correctly inform the navigation process of the agent towards the goal location. In recent learning-based navigation…

Robotics · Computer Science 2023-10-05 Marco Rosano , Antonino Furnari , Luigi Gulino , Corrado Santoro , Giovanni Maria Farinella

Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it…

Artificial Intelligence · Computer Science 2025-01-16 Jason Yik , Korneel Van den Berghe , Douwe den Blanken , Younes Bouhadjar , Maxime Fabre , Paul Hueber , Weijie Ke , Mina A Khoei , Denis Kleyko , Noah Pacik-Nelson , Alessandro Pierro , Philipp Stratmann , Pao-Sheng Vincent Sun , Guangzhi Tang , Shenqi Wang , Biyan Zhou , Soikat Hasan Ahmed , George Vathakkattil Joseph , Benedetto Leto , Aurora Micheli , Anurag Kumar Mishra , Gregor Lenz , Tao Sun , Zergham Ahmed , Mahmoud Akl , Brian Anderson , Andreas G. Andreou , Chiara Bartolozzi , Arindam Basu , Petrut Bogdan , Sander Bohte , Sonia Buckley , Gert Cauwenberghs , Elisabetta Chicca , Federico Corradi , Guido de Croon , Andreea Danielescu , Anurag Daram , Mike Davies , Yigit Demirag , Jason Eshraghian , Tobias Fischer , Jeremy Forest , Vittorio Fra , Steve Furber , P. Michael Furlong , William Gilpin , Aditya Gilra , Hector A. Gonzalez , Giacomo Indiveri , Siddharth Joshi , Vedant Karia , Lyes Khacef , James C. Knight , Laura Kriener , Rajkumar Kubendran , Dhireesha Kudithipudi , Shih-Chii Liu , Yao-Hong Liu , Haoyuan Ma , Rajit Manohar , Josep Maria Margarit-Taulé , Christian Mayr , Konstantinos Michmizos , Dylan R. Muir , Emre Neftci , Thomas Nowotny , Fabrizio Ottati , Ayca Ozcelikkale , Priyadarshini Panda , Jongkil Park , Melika Payvand , Christian Pehle , Mihai A. Petrovici , Christoph Posch , Alpha Renner , Yulia Sandamirskaya , Clemens JS Schaefer , André van Schaik , Johannes Schemmel , Samuel Schmidgall , Catherine Schuman , Jae-sun Seo , Sadique Sheik , Sumit Bam Shrestha , Manolis Sifalakis , Amos Sironi , Kenneth Stewart , Matthew Stewart , Terrence C. Stewart , Jonathan Timcheck , Nergis Tömen , Gianvito Urgese , Marian Verhelst , Craig M. Vineyard , Bernhard Vogginger , Amirreza Yousefzadeh , Fatima Tuz Zohora , Charlotte Frenkel , Vijay Janapa Reddi

Unifying multiple multi-modal visual object tracking (MMVOT) tasks draws increasing attention due to the complementary nature of different modalities in building robust tracking systems. Existing practices mix all data sensor types in a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhangyong Tang , Tianyang Xu , Xuefeng Zhu , Chunyang Cheng , Tao Zhou , Xiaojun Wu , Josef Kittler

In recent years, the field of artificial intelligence has undergone a paradigm shift from task-specific small-scale models to general-purpose large language models (LLMs). With the rapid iteration of LLMs, objective, quantitative, and…

Generalist multimodal agents are expected to unify perception, language, and control - operating robustly across diverse real world domains. However, current evaluation practices remain fragmented across isolated benchmarks, making it…

Skillful mobile operation in three-dimensional environments is a primary topic of study in Artificial Intelligence. The past two years have seen a surge of creative work on navigation. This creative output has produced a plethora of…

Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined…

Robotics · Computer Science 2020-11-30 Danilo Perico , Paulo E. Santos , Reinaldo Bianchi

A practical navigation agent must be capable of handling a wide range of interaction demands, such as following instructions, searching objects, answering questions, tracking people, and more. Existing models for embodied navigation fall…

Humans can flexibly interpret and compose different goal specifications, such as language instructions, spatial coordinates, or visual references, when navigating to a destination. In contrast, most existing robotic navigation policies are…

Robotics · Computer Science 2025-09-25 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

Recent progress in embodied AI has produced a growing ecosystem of robot policies, foundation models, and modular runtimes. However, current evaluation remains dominated by task success metrics such as completion rate or manipulation…

Robotics · Computer Science 2026-04-14 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Motion simulation, prediction and planning are foundational tasks in autonomous driving, each essential for modeling and reasoning about dynamic traffic scenarios. While often addressed in isolation due to their differing objectives, such…

Robotics · Computer Science 2026-02-03 Nan Song , Junzhe Jiang , Jingyu Li , Xiatian Zhu , Li Zhang

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

Robotics · Computer Science 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

As robotic navigation techniques in perception and planning advance, mobile robots increasingly venture into off-road environments involving complex traversability. However, selecting suitable planning methods remains a challenge due to…

Robotics · Computer Science 2024-05-24 Masafumi Endo , Kohei Honda , Genya Ishigami

Embodied navigation holds significant promise for real-world applications such as last-mile delivery. However, most existing approaches are confined to either indoor or outdoor environments and rely heavily on strong assumptions, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yuxiang Zhao , Yirong Yang , Yanqing Zhu , Yanfen Shen , Chiyu Wang , Zhining Gu , Pei Shi , Wei Guo , Mu Xu

Multimodal Large Languages models have been progressing from uni-modal understanding toward unifying visual, audio and language modalities, collectively termed omni models. However, the correlation between uni-modal and omni-modal remains…

Computation and Language · Computer Science 2025-10-31 Chen Chen , ZeYang Hu , Fengjiao Chen , Liya Ma , Jiaxing Liu , Xiaoyu Li , Ziwen Wang , Xuezhi Cao , Xunliang Cai

Medical foundation models show promise to learn broadly generalizable features from large, diverse datasets. This could be the base for reliable cross-modality generalization and rapid adaptation to new, task-specific goals, with only a few…

Embodied navigation is a fundamental capability of embodied intelligence, enabling robots to move and interact within physical environments. However, existing navigation tasks primarily focus on predefined object navigation or instruction…

Metric ground navigation addresses the problem of autonomously moving a robot from one point to another in an obstacle-occupied planar environment in a collision-free manner. It is one of the most fundamental capabilities of intelligent…

Robotics · Computer Science 2020-11-04 Daniel Perille , Abigail Truong , Xuesu Xiao , Peter Stone