English
Related papers

Related papers: Multi-LLM QA with Embodied Exploration

200 papers

In question answering (QA), different questions can be effectively addressed with different answering strategies. Some require a simple lookup, while others need complex, multi-step reasoning to be answered adequately. This observation…

Computation and Language · Computer Science 2024-09-24 Mohanna Hoveyda , Arjen P. de Vries , Maarten de Rijke , Harrie Oosterhuis , Faegheh Hasibi

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

Computation and Language · Computer Science 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Embodied intelligence empowers agents with a profound sense of perception, enabling them to respond in a manner closely aligned with real-world situations. Large Language Models (LLMs) delve into language instructions with depth, serving a…

Multimedia · Computer Science 2024-07-17 Shuyuan Liu , Jiawei Chen , Shouwei Ruan , Hang Su , Zhaoxia Yin

Recent studies have presented compelling evidence that large language models (LLMs) can equip embodied agents with the self-driven capability to interact with the world, which marks an initial step toward versatile robotics. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Sipeng Zheng , Jiazheng Liu , Yicheng Feng , Zongqing Lu

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu

Recently, directly using large language models (LLMs) has been shown to be the most reliable method to evaluate QA models. However, it suffers from limited interpretability, high cost, and environmental harm. To address these, we propose to…

Computation and Language · Computer Science 2024-12-13 Dongryeol Lee , Minwoo Lee , Kyungmin Min , Joonsuk Park , Kyomin Jung

Tool-augmented Large Language Models (LLMs) have shown impressive capabilities in remote sensing (RS) applications. However, existing benchmarks assume question-answering input templates over predefined image-text data pairs. These…

Computation and Language · Computer Science 2024-05-03 Simranjit Singh , Michael Fore , Dimitrios Stamoulis

Can world knowledge learned by large language models (LLMs) be used to act in interactive environments? In this paper, we investigate the possibility of grounding high-level tasks, expressed in natural language (e.g. "make breakfast"), to a…

Machine Learning · Computer Science 2022-03-09 Wenlong Huang , Pieter Abbeel , Deepak Pathak , Igor Mordatch

Extractive reading comprehension question answering (QA) datasets are typically evaluated using Exact Match (EM) and F1-score, but these metrics often fail to fully capture model performance. With the success of large language models…

Computation and Language · Computer Science 2025-04-23 Xanh Ho , Jiahao Huang , Florian Boudin , Akiko Aizawa

Reward Models (RMs), vital for large model alignment, are underexplored for complex embodied tasks like Embodied Question Answering (EQA) where nuanced evaluation of agents' spatial, temporal, and logical understanding is critical yet not…

Machine Learning · Computer Science 2025-06-13 Yuhang Chen , Zhen Tan , Tianlong Chen

Large Language Models (LLMs) have emerged as powerful tools for accelerating scientific discovery, yet their static knowledge and hallucination issues hinder autonomous research applications. Recent advances integrate LLMs into agentic…

Artificial Intelligence · Computer Science 2025-12-23 Zeyu Xia , Jinzhe Ma , Congjie Zheng , Shufei Zhang , Yuqiang Li , Hang Su , P. Hu , Changshui Zhang , Xingao Gong , Wanli Ouyang , Lei Bai , Dongzhan Zhou , Mao Su

Biomedical question-answering (QA) has gained increased attention for its capability to provide users with high-quality information from a vast scientific literature. Although an increasing number of biomedical QA datasets has been recently…

Computation and Language · Computer Science 2021-02-17 Gabriele Pergola , Elena Kochkina , Lin Gui , Maria Liakata , Yulan He

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. This study introduces the LLM-Coordination Benchmark,…

Computation and Language · Computer Science 2025-04-30 Saaket Agashe , Yue Fan , Anthony Reyna , Xin Eric Wang

Large Language Models (LLMs) have shown impressive potential to simulate human behavior. We identify a fundamental challenge in using them to simulate experiments: when LLM-simulated subjects are blind to the experimental design (as is…

Artificial Intelligence · Computer Science 2025-11-25 George Gui , Olivier Toubia

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Xingyu Wu , Sheng-hao Wu , Jibin Wu , Liang Feng , Kay Chen Tan

Designing autonomous driving systems requires efficient exploration of large hardware/software configuration spaces under diverse environmental conditions, e.g., with varying traffic, weather, and road layouts. Traditional design space…

Robotics · Computer Science 2025-12-10 Po-An Shih , Shao-Hua Wang , Yung-Che Li , Chia-Heng Tu , Chih-Han Chang

Recent advancements in Large Language Models (LLMs) have facilitated the development of Multimodal LLMs (MLLMs). Despite their impressive capabilities, MLLMs often suffer from over-reliance on unimodal biases (e.g., language bias and vision…

Computation and Language · Computer Science 2024-11-14 Meiqi Chen , Yixin Cao , Yan Zhang , Chaochao Lu

Large Language Models (LLMs) have proven immensely beneficial in education by capturing vast amounts of literature-based information, allowing them to generate context without relying on external sources. In this paper, we propose a…

Information Retrieval · Computer Science 2025-07-03 Umar Ali Khan , Ekram Khan , Fiza Khan , Athar Ali Moinuddin