中文
相关论文

相关论文: From Prompts to Pavement: LMMs-based Agentic Behav…

200 篇论文

Autonomous driving (AD) technology promises to revolutionize daily transportation by making it safer, more efficient, and more comfortable. Their role in reducing traffic accidents and improving mobility will be vital to the future of…

机器人学 · 计算机科学 2024-11-19 Sonda Fourati , Wael Jaafar , Noura Baccar

The evolution of agentic systems represents a significant milestone in artificial intelligence and modern software systems, driven by the demand for vertical intelligence tailored to diverse industries. These systems enhance business…

多智能体系统 · 计算机科学 2025-01-03 Fouad Bousetouane

Vision-and-Language Navigation (VLN) is a challenging task in which an agent needs to follow a language-specified path to reach a target destination. The goal gets even harder as the actions available to the agent get simpler and move…

计算机视觉与模式识别 · 计算机科学 2021-08-02 Federico Landi , Lorenzo Baraldi , Marcella Cornia , Massimiliano Corsini , Rita Cucchiara

Building generalist agents that can handle diverse tasks and evolve themselves across different environments is a long-term goal in the AI community. Large language models (LLMs) are considered a promising foundation to build such agents…

This paper introduces a multi-agent framework guided by Large Language Models (LLMs) to assist in the early stages of engineering design, a phase often characterized by vast parameter spaces and inherent uncertainty. Operating under a…

人工智能 · 计算机科学 2026-04-21 Varun Kumar , George Em Karniadakis

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

人工智能 · 计算机科学 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

人工智能 · 计算机科学 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

In dynamic open-world environments, autonomous agents often encounter novelties that hinder their ability to find plans to achieve their goals. Specifically, traditional symbolic planners fail to generate plans when the robot's planning…

机器人学 · 计算机科学 2026-03-13 Hong Lu , Pierrick Lorang , Timothy R. Duggan , Jivko Sinapov , Matthias Scheutz

Recent SOTA approaches for embodied learning via interaction directly employ large language models (LLMs) as agents to determine the next steps in an environment. Due to their world knowledge and reasoning capabilities, LLM agents achieve…

计算与语言 · 计算机科学 2024-07-15 Abhay Zala , Jaemin Cho , Han Lin , Jaehong Yoon , Mohit Bansal

Effective modeling of how human travelers learn and adjust their travel behavior from interacting with transportation systems is critical for system assessment and planning. However, this task is also difficult due to the complex cognition…

人工智能 · 计算机科学 2025-11-04 Tianming Liu , Jirong Yang , Yafeng Yin , Manzi Li , Linghao Wang , Zheng Zhu

Training Vision Language Models (VLMs) for video event reasoning requires high-quality structured annotations capturing not only what happened, but when, where, why, and with what consequence, at a scale manual labelling cannot support. We…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Han Zhang , Wanting Jiang , Tomasz Kornuta , Tian Zheng , Vidya Murali

Large Language Models demonstrate strong reasoning and generation abilities, yet their behavior in multi-turn tasks often lacks reliability and verifiability. We present a task completion framework that enables LLM-based agents to act under…

人工智能 · 计算机科学 2025-12-15 Gonca Gürsun

We present GLM-5V-Turbo, a step toward native foundation models for multimodal agents. As foundation models are increasingly deployed in real environments, agentic capability depends not only on language reasoning, but also on the ability…

We propose a hybrid architecture that integrates decision tree-based symbolic reasoning with the generative capabilities of large language models (LLMs) within a coordinated multi-agent framework. Unlike prior approaches that loosely couple…

人工智能 · 计算机科学 2025-08-08 Andrew Kiruluta

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

This work examines whether activating latent subspaces in language models (LLMs) can steer scientific code generation toward a specific programming language. Five causal LLMs were first evaluated on scientific coding prompts to quantify…

人工智能 · 计算机科学 2025-06-24 Vansh Sharma , Venkat Raman

Robots are increasingly expected to execute open ended natural language requests in human environments, which demands reliable long horizon execution under partial observability. This is especially challenging for humanoids because…

机器人学 · 计算机科学 2026-03-12 Peng Ren , Haoyang Ge , Chuan Qi , Cong Huang , Hong Li , Jiang Zhao , Pei Chi , Kai Chen

Recent advances in prompting techniques and multi-agent systems for Large Language Models (LLMs) have produced increasingly complex approaches. However, we lack a framework for characterizing and comparing prompting techniques or…

人工智能 · 计算机科学 2025-01-15 Dhruv Dhamani , Mary Lou Maher

Modern information systems require autonomous agents capable of navigating complex workflows, yet current methodologies often struggle with the transition from structured metadata parsing to general environmental perception. While the…

人工智能 · 计算机科学 2026-05-28 Susanna Cifani , Mario Luca Bernardi , Marta Cimitile

Developing general-purpose navigation policies for unknown environments remains a core challenge in robotics. Most existing systems rely on task-specific neural networks and fixed information flows, limiting their generalizability. Large…

机器人学 · 计算机科学 2025-10-20 Bernard Lange , Anil Yildiz , Mansur Arief , Shehryar Khattak , Mykel Kochenderfer , Georgios Georgakis