English
Related papers

Related papers: EVGeoQA: Benchmarking LLMs on Dynamic, Multi-Objec…

200 papers

Embodied Question Answering (EQA) combines visual scene understanding, goal-directed exploration, spatial and temporal reasoning under partial observability. A central challenge is to confine physical search to question-relevant subspaces…

Robotics · Computer Science 2026-02-18 Haochen Zhang , Nirav Savaliya , Faizan Siddiqui , Enna Sachdeva

Despite their sophisticated capabilities, large language models (LLMs) encounter a major hurdle in effective assessment. This paper first revisits the prevalent evaluation method-multiple choice question answering (MCQA), which allows for…

Computation and Language · Computer Science 2024-03-13 Fangyun Wei , Xi Chen , Lin Luo

Geographic Question Answering (GeoQA) addresses natural language queries in geographic domains to fulfill complex user demands and improve information retrieval efficiency. Traditional QA systems, however, suffer from limited comprehension,…

Information Retrieval · Computer Science 2025-04-04 Jian Wang , Zhuo Zhao , Zeng Jie Wang , Bo Da Cheng , Lei Nie , Wen Luo , Zhao Yuan Yu , Ling Wang Yuan

Maintaining grid stability amid widespread electric vehicle (EV) adoption is vital for sustainable transportation. Traditional optimization methods and Reinforcement Learning (RL) approaches often struggle with the high dimensionality and…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Stavros Orfanoudakis , Peter Palensky , Pedro P. Vergara

Object search in large-scale, unstructured environments remains a fundamental challenge in robotics, particularly in dynamic or expansive settings such as outdoor autonomous exploration. This task requires robust spatial reasoning and the…

Robotics · Computer Science 2025-05-29 Lanxiang Zheng , Ruidong Mei , Mingxin Wei , Hao Ren , Hui Cheng

Vision Language Models (VLMs) demonstrate significant potential as embodied AI agents for various mobility applications. However, a standardized, closed-loop benchmark for evaluating their spatial reasoning and sequential decision-making…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Weizhen Wang , Chenda Duan , Zhenghao Peng , Yuxin Liu , Bolei Zhou

Geographic reasoning is a fundamental cognitive capability that requires models to infer plausible locations by synthesizing visual evidence with spatial world knowledge. Despite recent advances in large vision-language models (LVLMs),…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Pengyue Jia , Yingyi Zhang , Xiangyu Zhao , Sharon Li

The emergence of Multimodal Large Language Models (MLLMs) has propelled the development of autonomous agents that operate on Graphical User Interfaces (GUIs) using pure visual input. A fundamental challenge is robustly grounding natural…

The emergence of advanced multimodal large language models (MLLMs) has significantly enhanced AI assistants' ability to process complex information across modalities. Recently, egocentric videos, by directly capturing user focus, actions,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Taiying Peng , Jiacheng Hua , Miao Liu , Feng Lu

As power systems decarbonise and digitalise, high penetrations of distributed energy resources and flexible tariffs make electric power marketing (EPM) a key interface between regulation, system operation and sustainable-energy deployment.…

Computation and Language · Computer Science 2026-02-02 Jinzhi Wang , Qingke Peng , Haozhou Li , Zeyuan Zeng , Jiangbo Zhang , Kaixuan Yang , Ningyong Wu , Qinfeng Song , Ruimeng Li , Biyi Zhou

Multimodal large language models (MLLMs) have shown strong potential for autonomous driving, yet existing benchmarks remain largely ego-centric and therefore cannot systematically assess model performance in infrastructure-centric and…

Robotics · Computer Science 2026-04-06 Junwei You , Pei Li , Zhuoyu Jiang , Weizhe Tang , Zilin Huang , Rui Gan , Jiaxi Liu , Yan Zhao , Sikai Chen , Bin Ran

Large language models (LLMs) have shown promising results in learning and contextualizing information from different forms of data. Recent advancements in foundational models, particularly those employing self-attention mechanisms, have…

Computation and Language · Computer Science 2024-07-17 Devashish Vikas Gupta , Azeez Syed Ali Ishaqui , Divya Kiran Kadiyala

With advances in multimodal research and deep learning, Multimodal Large Language Models (MLLMs) have emerged as a powerful paradigm for a wide range of multimodal tasks. As a core problem in vision-language research, Visual Question…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Quanxing Xu , Ling Zhou , Xian Zhong , Xiaohua Huang , Rubing Huang , Chia-Wen Lin

Large language models (LLMs) have shown strong performance in natural language to SQL (NL2SQL) tasks within general databases. However, extending to GeoSQL introduces additional complexity from spatial data types, function invocation, and…

Databases · Computer Science 2025-10-03 Shuyang Hou , Haoyue Jiao , Ziqi Liu , Lutong Xie , Guanyu Chen , Shaowen Wu , Xuefeng Guan , Huayi Wu

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

In Embodied Question Answering (EQA), agents must explore and develop a semantic understanding of an unseen environment to answer a situated question with confidence. This problem remains challenging in robotics, due to the difficulties in…

Navigating complex environments requires robots to effectively store observations as memories and leverage them to answer human queries about spatial locations, which is a critical yet underexplored research challenge. While prior work has…

Artificial Intelligence · Computer Science 2025-09-26 Yufan Mao , Hanjing Ye , Wenlong Dong , Chengjie Zhang , Hong Zhang

Vision Language Models (VLMs) are increasingly adopted as central reasoning modules for embodied agents. Existing benchmarks evaluate their capabilities under ideal, well-lit conditions, yet robust 24/7 operation demands performance under a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yohan Park , Hyunwoo Ha , Wonjun Jo , Tae-Hyun Oh

Within the multimodal field, large vision-language models (LVLMs) have made significant progress due to their strong perception and reasoning capabilities in the visual and language systems. However, LVLMs are still plagued by the two…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Sirui Cheng , Siyu Zhang , Jiayi Wu , Muchen Lan

Large language models (LLMs) have shown promise in automating travel planning, yet they often fall short in addressing nuanced spatiotemporal rationality. While existing benchmarks focus on basic plan validity, they neglect critical aspects…

Computation and Language · Computer Science 2025-12-12 Hang Ni , Fan Liu , Xinyu Ma , Lixin Su , Shuaiqiang Wang , Dawei Yin , Hui Xiong , Hao Liu