English
Related papers

Related papers: Incentivizing Multimodal Reasoning in Large Models…

200 papers

Language models have recently advanced into the realm of reasoning, yet it is through multimodal reasoning that we can fully unlock the potential to achieve more comprehensive, human-like cognitive capabilities. This survey provides a…

Computation and Language · Computer Science 2025-03-25 Zhiyu Lin , Yifei Gao , Xian Zhao , Yunfan Yang , Jitao Sang

Classical robotic systems typically rely on custom planners designed for constrained environments. While effective in restricted settings, these systems lack generalization capabilities, limiting the scalability of embodied AI and…

Robotics · Computer Science 2026-02-25 Guangming Wang , Qizhen Ying , Yixiong Jing , Olaf Wysocki , Brian Sheil

To what extent can a neural network systematically reason over symbolic facts? Evidence suggests that large pre-trained language models (LMs) acquire some reasoning capacity, but this ability is difficult to control. Recently, it has been…

Computation and Language · Computer Science 2020-11-17 Alon Talmor , Oyvind Tafjord , Peter Clark , Yoav Goldberg , Jonathan Berant

Improving the reasoning capabilities of embodied agents is crucial for robots to complete complex human instructions in long-view manipulation tasks successfully. Despite the success of large language models and vision language models based…

Artificial Intelligence · Computer Science 2025-10-23 Jinrui Liu , Bingyan Nie , Boyu Li , Yaran Chen , Yuze Wang , Shunsen He , Haoran Li

Performing complex manipulation tasks in dynamic environments requires efficient Task and Motion Planning (TAMP) approaches that combine high-level symbolic plans with low-level motion control. Advances in Large Language Models (LLMs), such…

Robotics · Computer Science 2025-10-02 Muhayy Ud Din , Jan Rosell , Waseem Akram , Isiah Zaplana , Maximo A Roa , Irfan Hussain

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

Information Retrieval · Computer Science 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

Recent advancements in 2D multimodal large language models (MLLMs) have significantly improved performance in vision-language tasks. However, extending these capabilities to 3D environments remains a distinct challenge due to the complexity…

Artificial Intelligence · Computer Science 2026-01-29 Changyu Zeng , Yifan Wang , Zimu Wang , Wei Wang , Zhengni Yang , Muyi Bao , Jiming Xiao , Anh Nguyen , Yutao Yue

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

Mathematical reasoning serves as a cornerstone for assessing the fundamental cognitive capabilities of human intelligence. In recent times, there has been a notable surge in the development of Large Language Models (LLMs) geared towards the…

Computation and Language · Computer Science 2024-09-18 Janice Ahn , Rishu Verma , Renze Lou , Di Liu , Rui Zhang , Wenpeng Yin

Cognitive Reframing, a core element of Cognitive Behavioral Therapy (CBT), helps individuals reinterpret negative experiences by finding positive meaning. Recent advances in Large Language Models (LLMs) have demonstrated improved…

Computation and Language · Computer Science 2025-04-02 Yilin Qi , Dong Won Lee , Cynthia Breazeal , Hae Won Park

Large language models (LLMs) have revolutionized artificial intelligence by enabling complex reasoning capabilities. While recent advancements in reinforcement learning (RL) have primarily focused on domain-specific reasoning tasks (e.g.,…

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

The ability to process information from multiple modalities and to reason through it step-by-step remains a critical challenge in advancing artificial intelligence. However, existing reasoning benchmarks focus on text-only reasoning, or…

Artificial Intelligence · Computer Science 2025-07-01 Yulun Jiang , Yekun Chai , Maria Brbić , Michael Moor

The development of general robotic systems capable of manipulating in unstructured environments is a significant challenge. While Vision-Language Models(VLM) excel in high-level commonsense reasoning, they lack the fine-grained 3D spatial…

Robotics · Computer Science 2025-01-08 Mingjie Pan , Jiyao Zhang , Tianshu Wu , Yinghao Zhao , Wenlong Gao , Hao Dong

This survey paper outlines the key developments in the field of Large Language Models (LLMs), including enhancements to their reasoning skills, adaptability to various tasks, increased computational efficiency, and the ability to make…

Computation and Language · Computer Science 2026-02-12 Asifullah Khan , Muhammad Zaeem Khan , Aleesha Zainab , Saleha Jamshed , Sadia Ahmad , Kaynat Khatib , Faria Bibi , Abdul Rehman

Achieving human-level intelligence requires refining the transition from the fast, intuitive System 1 to the slower, more deliberate System 2 reasoning. While System 1 excels in quick, heuristic decisions, System 2 relies on logical…

Grounding the common-sense reasoning of Large Language Models (LLMs) in physical domains remains a pivotal yet unsolved problem for embodied AI. Whereas prior works have focused on leveraging LLMs directly for planning in symbolic spaces,…

Robotics · Computer Science 2024-12-10 Yanwei Wang , Tsun-Hsuan Wang , Jiayuan Mao , Michael Hagenow , Julie Shah

Large Multi-modal Models (LMMs) have made impressive progress in many vision-language tasks. Nevertheless, the performance of general LMMs in specific domains is still far from satisfactory. This paper proposes FoodLMM, a versatile food…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yuehao Yin , Huiyan Qi , Bin Zhu , Jingjing Chen , Yu-Gang Jiang , Chong-Wah Ngo

In recent years, the emergence of large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, has shown impressive capabilities in complex problems, e.g., mathematics and coding. Some pioneering studies attempt to bring the success of…

Computation and Language · Computer Science 2025-05-20 Jiaan Wang , Fandong Meng , Jie Zhou

Large Language Models (LLMs) have shown promising results across various tasks, yet their reasoning capabilities remain a fundamental challenge. Developing AI systems with strong reasoning capabilities is regarded as a crucial milestone in…

Artificial Intelligence · Computer Science 2025-08-20 Xiao-Wen Yang , Jie-Jing Shao , Lan-Zhe Guo , Bo-Wen Zhang , Zhi Zhou , Lin-Han Jia , Wang-Zhou Dai , Yu-Feng Li