English
Related papers

Related papers: Benchmarking Interaction, Beyond Policy: a Reprodu…

200 papers

In the evolving field of robotics, the challenge of Object Navigation (ON) in household environments has attracted significant interest. Existing ON benchmarks typically place objects in locations guided by general scene priors, without…

Robotics · Computer Science 2026-02-09 Hongcheng Wang , Jinyu Zhu , Hao Dong

Commonsense AI has long been seen as a near impossible goal -- until recently. Now, research interest has sharply increased with an influx of new benchmarks and models. We propose two new ways to evaluate commonsense models, emphasizing…

Computation and Language · Computer Science 2021-03-25 Nicholas Lourie , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

Improving instance-specific image goal navigation (InstanceImageNav), which locates the identical object in a real-world environment from a query image, is essential for robotic systems to assist users in finding desired objects. The…

Perceiving potential ``action possibilities'' (\ie, affordance) regions of images and learning interactive functionalities of objects from human demonstration is a challenging task due to the diversity of human-object interactions.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Hongchen Luo , Wei Zhai , Jiao Wang , Yang Cao , Zheng-Jun Zha

Building meaningful interoperation with external software units requires performing the conceptual interoperability analysis that starts with identifying the conceptual interoperability constraints of each software unit, then it compares…

Software Engineering · Computer Science 2018-12-06 Hadil Abukwaik , Mohammed Abufouda , Thejashree Nair , Dieter Rombach

Map representations learned by expert demonstrations have shown promising research value. However, the field of visual navigation still faces challenges due to the lack of real-world human-navigation datasets that can support efficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Faith Johnson , Bryan Bo Cao , Kristin Dana , Shubham Jain , Ashwin Ashok

Camouflaged Object Detection (COD) stands as a significant challenge in computer vision, dedicated to identifying and segmenting objects visually highly integrated with their backgrounds. Current mainstream methods have made progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Kuan Wang , Yanjun Qin , Mengge Lu , Liejun Wang , Xiaoming Tao

Due to the proliferation of short-form content and the rapid adoption of AI, opportunities for deep, reflective thinking have significantly diminished, undermining users' critical thinking and reducing engagement with the reasoning behind…

Computation and Language · Computer Science 2025-04-28 Seunghyun Yoo

We introduce INQUIRE, a text-to-image retrieval benchmark designed to challenge multimodal vision-language models on expert-level queries. INQUIRE includes iNaturalist 2024 (iNat24), a new dataset of five million natural world images, along…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Edward Vendrow , Omiros Pantazis , Alexander Shepard , Gabriel Brostow , Kate E. Jones , Oisin Mac Aodha , Sara Beery , Grant Van Horn

In recent years, great efforts have been devoted to deep imitation learning for autonomous driving control, where raw sensory inputs are directly mapped to control actions. However, navigating through densely populated intersections remains…

Robotics · Computer Science 2022-02-22 Zeyu Zhu , Huijing Zhao

Visual Object Goal Navigation (ObjectNav) requires a robot to locate a target object in an unseen environment using egocentric observations. However, decision-making policies often struggle to transfer to unseen environments and novel…

Robotics · Computer Science 2025-04-15 Yuxin Cai , Xiangkun He , Maonan Wang , Hongliang Guo , Wei-Yun Yau , Chen Lv

Zero-Shot Object Navigation (ZSON) enables agents to navigate towards open-vocabulary objects in unknown environments. The existing works of ZSON mainly focus on following individual instructions to find generic object classes, neglecting…

Robotics · Computer Science 2024-05-31 Yinpei Dai , Run Peng , Sikai Li , Joyce Chai

Collaborative perception systems overcome single-vehicle limitations in long-range detection and occlusion scenarios by integrating multi-agent sensory data, improving accuracy and safety. However, frequent cooperative interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yunjiang Xu , Lingzhi Li , Jin Wang , Yupeng Ouyang , Benyuan Yang

As embodied intelligence emerges as a core frontier in artificial intelligence research, simulation platforms must evolve beyond low-level physical interactions to capture complex, human-centered social behaviors. We introduce FreeAskWorld,…

Artificial Intelligence · Computer Science 2025-12-23 Yuhang Peng , Yizhou Pan , Xinning He , Jihaoyu Yang , Xinyu Yin , Han Wang , Xiaoji Zheng , Chao Gao , Jiangtao Gong

Learning commonsense reasoning from visual contexts and scenes in real-world is a crucial step toward advanced artificial intelligence. However, existing video reasoning benchmarks are still inadequate since they were mainly designed for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Andong Wang , Bo Wu , Sunli Chen , Zhenfang Chen , Haotian Guan , Wei-Ning Lee , Li Erran Li , Chuang Gan

For robots to be generally useful, they must be able to find arbitrary objects described by people (i.e., be language-driven) even without expensive navigation training on in-domain data (i.e., perform zero-shot inference). We explore these…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Samir Yitzhak Gadre , Mitchell Wortsman , Gabriel Ilharco , Ludwig Schmidt , Shuran Song

While Visual Large Language Models (VLLMs) show great promise as embodied agents, they continue to face substantial challenges in spatial reasoning. Existing embodied benchmarks largely focus on passive, static household environments and…

Robotics · Computer Science 2025-11-24 Yifan Li , Lichi Li , Anh Dao , Xinyu Zhou , Yicheng Qiao , Zheda Mai , Daeun Lee , Zichen Chen , Zhen Tan , Mohit Bansal , Yu Kong

Visually impaired users face significant challenges in daily information access and real-time environmental perception, and there is an urgent need for intelligent assistive systems with accurate recognition capabilities. Although…

Vision-language navigation (VLN), in which an agent follows language instruction in a visual environment, has been studied under the premise that the input command is fully feasible in the environment. Yet in practice, a request may not be…

Computation and Language · Computer Science 2022-08-16 Andrea Burns , Deniz Arsan , Sanjna Agrawal , Ranjitha Kumar , Kate Saenko , Bryan A. Plummer

We present SigniFYI-CDN, an inspection method built from previously proposed methods combining Semiotic Engineering and the Cognitive Dimensions of Notations. Compared to its predecessors, SigniFYI-CDN simplifies procedural steps and…