中文
相关论文

相关论文: MindWatcher: Toward Smarter Multimodal Tool-Integr…

200 篇论文

Intelligent physical systems as embodied cognitive systems must perform high-level reasoning while concurrently managing an underlying control architecture. The link between cognition and control must manage the problem of converting…

The rapid evolution of large language models in natural language processing has substantially elevated their semantic understanding and logical reasoning capabilities. Such proficiencies have been leveraged in autonomous driving systems,…

机器人学 · 计算机科学 2025-05-27 Yixin Cui , Haotian Lin , Shuo Yang , Yixiao Wang , Yanjun Huang , Hong Chen

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

人工智能 · 计算机科学 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Large language models have achieved remarkable capabilities across domains, yet mechanisms underlying sophisticated reasoning remain elusive. Recent reasoning models outperform comparable instruction-tuned models on complex cognitive tasks,…

计算与语言 · 计算机科学 2026-01-19 Junsol Kim , Shiyang Lai , Nino Scherrer , Blaise Agüera y Arcas , James Evans

Iterative human engagement is a common and effective means of leveraging the advanced language processing power of large language models (LLMs). Using well-structured prompts in a conversational manner, human users can effectively influence…

计算与语言 · 计算机科学 2024-10-02 Santosh Kumar Radha , Yasamin Nouri Jelyani , Ara Ghukasyan , Oktay Goktas

Early artificial intelligence paradigms exhibited separated cognitive functions: Neural Networks focused on "perception-representation," Reinforcement Learning on "decision-making-behavior," and Symbolic AI on "knowledge-reasoning." With…

人工智能 · 计算机科学 2026-01-07 Zhi Liu , Guangzhi Wang

Human social interactions depend on the ability to infer others' unspoken intentions, emotions, and beliefs-a cognitive skill grounded in the psychological concept of Theory of Mind (ToM). While large language models (LLMs) excel in…

计算与语言 · 计算机科学 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

机器学习 · 计算机科学 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Human intelligence naturally intertwines omni-modal perception -- spanning vision, audio, and language -- with complex reasoning and tool usage to interact with the world. However, current multi-modal LLMs are primarily confined to bi-modal…

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

机器学习 · 计算机科学 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Current multimodal large language models (MLLMs) still face significant challenges in complex visual tasks (e.g., spatial understanding, fine-grained perception). Prior methods have tried to incorporate visual reasoning, however, they fail…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Zhangquan Chen , Ruihui Zhao , Chuwei Luo , Mingze Sun , Xinlei Yu , Yangyang Kang , Ruqi Huang

Reasoning is a hallmark of human intelligence, enabling adaptive decision-making in complex and unfamiliar scenarios. In contrast, machine intelligence remains bound to training data, lacking the ability to dynamically refine solutions at…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Shaheer U. Saeed , Yipei Wang , Veeru Kasivisvanathan , Brian R. Davidson , Matthew J. Clarkson , Yipeng Hu , Daniel C. Alexander

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of…

机器人学 · 计算机科学 2026-01-07 Biyuan Liu , Daigang Xu , Lei Jiang , Wenjun Guo , Ping Chen

Multimodal large language models excel across diverse domains but struggle with complex visual reasoning tasks. To enhance their reasoning capabilities, current approaches typically rely on explicit search or post-training techniques.…

计算与语言 · 计算机科学 2026-03-03 Jinyang Wu , Mingkuan Feng , Guocheng Zhai , Shuai Zhang , Zheng Lian , Fangrui Lv , Pengpeng Shao , Ruihan Jin , Zhengqi Wen , Jianhua Tao

Scaling inference-time computation has enabled Large Language Models (LLMs) to achieve strong reasoning performance, but inherently sequential decoding leads to substantial latency, especially on complex tasks. Recent work on adaptive…

Recent advancements in Multi-modal Large Language Models (MLLMs) have significantly improved their performance in tasks combining vision and language. However, challenges persist in detailed multi-modal understanding, comprehension of…

计算与语言 · 计算机科学 2024-05-29 Somnath Kumar , Yash Gadhia , Tanuja Ganu , Akshay Nambi

Autonomous artificial intelligence (AI) agents have emerged as promising protocols for automatically understanding the language-based environment, particularly with the exponential development of large language models (LLMs). However, a…

Tool-Integrated Reasoning (TIR) enables large language models (LLMs) to solve complex tasks by interacting with external tools, yet existing approaches depend on high-quality synthesized trajectories selected by scoring functions and sparse…

人工智能 · 计算机科学 2026-02-02 Siyu Gong , Linan Yue , Weibo Gao , Fangzhou Yao , Shimin Di , Lei Feng , Min-Ling Zhang

Chain-of-Thought (CoT) reasoning has been widely adopted to enhance Large Language Models (LLMs) by decomposing complex tasks into simpler, sequential subtasks. However, extending CoT to vision-language reasoning tasks remains challenging,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Luozheng Qin , Jia Gong , Yuqing Sun , Tianjiao Li , Mengping Yang , Xiaomeng Yang , Chao Qu , Zhiyu Tan , Hao Li

Chain-of-Thought (CoT) prompting has proven highly effective for enhancing complex reasoning in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs). Yet, it struggles in complex spatial reasoning tasks. Nonetheless,…

计算与语言 · 计算机科学 2025-01-14 Chengzu Li , Wenshan Wu , Huanyu Zhang , Yan Xia , Shaoguang Mao , Li Dong , Ivan Vulić , Furu Wei