中文
相关论文

相关论文: Enabling Extensible Embodied Capabilities with Too…

200 篇论文

Robotic arms are increasingly being used in collaborative environments, requiring an accurate understanding of human intentions to ensure both effectiveness and safety. Electroencephalogram (EEG) signals, which measure brain activity,…

信号处理 · 电气工程与系统科学 2024-11-20 Byeong-Hoo Lee , Kang Yin

The ability of Large Language Models (LLMs) to use external tools unlocks powerful real-world interactions, making rigorous evaluation essential. However, current benchmarks primarily report final accuracy, revealing what models can do but…

计算与语言 · 计算机科学 2026-01-29 Qihao Wang , Yue Hu , Mingzhe Lu , Jiayue Wu , Yanbing Liu , Yuanmin Tang

Tool-Integrated Reasoning (TIR) extends LLM capabilities by leveraging external environments. However, existing methods lack the deliberation during sequential tool invocation required for strategic planning and self-correction. While RL…

人工智能 · 计算机科学 2026-05-29 Yang He , Xiao Ding , Bibo Cai , Yufei Zhang , Kai Xiong , Zhouhao Sun , Bing Qin , Ting Liu

Through the integration of external tools, large language models (LLMs) such as GPT-4o and Llama 3.1 significantly expand their functional capabilities, evolving from elementary conversational agents to general-purpose assistants. We argue…

计算与语言 · 计算机科学 2024-10-16 Zhenchao Jin , Mengchen Liu , Dongdong Chen , Lingting Zhu , Yunsheng Li , Lequan Yu

Spatial reasoning in 3D scenes requires precise geometric calculations that challenge vision-language models. Visual programming addresses this by decomposing problems into steps calling specialized tools, yet existing methods rely on…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Shengguang Wu , Xiaohan Wang , Yuhui Zhang , Hao Zhu , Serena Yeung-Levy

In embodied intelligence, datasets play a pivotal role, serving as both a knowledge repository and a conduit for information transfer. The two most critical attributes of a dataset are the amount of information it provides and how easily…

机器人学 · 计算机科学 2025-11-13 Jiahao Xiao , Bowen Yan , Jianbo Zhang , Jia Wang , Chunyi Li , Zhengxue Cheng , Guangtao Zhai

Embodied artificial intelligence emphasizes the role of an agent's body in generating human-like behaviors. The recent efforts on EmbodiedAI pay a lot of attention to building up machine learning models to possess perceiving, planning, and…

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

机器人学 · 计算机科学 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

人工智能 · 计算机科学 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji

Embodied Chain-of-Thought (ECoT) reasoning enhances vision-language-action (VLA) models by improving performance and interpretability through intermediate reasoning steps. However, its sequential autoregressive token generation introduces…

机器人学 · 计算机科学 2025-09-23 Zhekai Duan , Yuan Zhang , Shikai Geng , Gaowen Liu , Joschka Boedecker , Chris Xiaoxuan Lu

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

机器人学 · 计算机科学 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

As access to high-quality, domain-specific data grows increasingly scarce, multi-epoch training has become a practical strategy for adapting large language models (LLMs). However, autoregressive models often suffer from performance…

计算与语言 · 计算机科学 2025-12-30 Jiapeng Wang , Yiwen Hu , Yanzipeng Gao , Haoyu Wang , Shuo Wang , Hongyu Lu , Jiaxin Mao , Wayne Xin Zhao , Junyi Li , Xiao Zhang

Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or…

计算与语言 · 计算机科学 2026-04-16 Shouzheng Huang , Meishan Zhang , Baotian Hu , Min Zhang

Agentic systems powered by Large Language Models (LLMs) have demonstrated remarkable potential in tackling complex, long-horizon tasks. However, their efficacy is fundamentally constrained by static configurations governing agent behaviors,…

人工智能 · 计算机科学 2026-02-24 Jingqi Zhou , Sheng Wang , DeZhao Deng , Junwen Lu , Junwei Su , Qintong Li , Jiahui Gao , Hao Wu , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Emotional Support Conversation requires not only affective expression but also grounded instrumental support to provide trustworthy guidance. However, existing ESC systems and benchmarks largely focus on affective support in text-only…

人工智能 · 计算机科学 2026-05-11 Xingyu Sui , Yanyan Zhao , Yulin Hu , Jiahe Guo , Weixiang Zhao , Bing Qin

In-Network Collective (INC) acceleration holds immense potential for optimizing AI training and inference; however, its cross-layer nature has historically hindered investment and adoption within the open Ethernet ecosystem. To bridge this…

The increasing adoption of heterogeneous platforms that combine CPUs with accelerators such as GPUs in high-performance computing (HPC) introduces new challenges for performance analysis and optimization. Traditional efficiency metrics,…

分布式、并行与集群计算 · 计算机科学 2026-03-30 Ghazal Rahimi , Victor Lopez , Marc Clascà , Joan Vinyals Ylla Català , Jesus Labarta , Marta Garcia-Gasulla

Embodied cognition argues that intelligence arises from sensorimotor interaction rather than passive observation. It raises an intriguing question: do modern vision-language models (VLMs), trained largely in a disembodied manner, exhibit…

人工智能 · 计算机科学 2025-11-27 Qineng Wang , Wenlong Huang , Yu Zhou , Hang Yin , Tianwei Bao , Jianwen Lyu , Weiyu Liu , Ruohan Zhang , Jiajun Wu , Li Fei-Fei , Manling Li

Embodied AI systems, including robots and autonomous vehicles, are increasingly integrated into real-world applications, where they encounter a range of vulnerabilities stemming from both environmental and system-level factors. These…

密码学与安全 · 计算机科学 2025-02-26 Wenpeng Xing , Minghao Li , Mohan Li , Meng Han

Tool-augmented language models, equipped with retrieval, memory, or external APIs, are reshaping AI, yet their theoretical advantages remain underexplored. In this paper, we address this question by demonstrating the benefits of in-tool…

机器学习 · 计算机科学 2026-04-03 Sam Houliston , Ambroise Odonnat , Charles Arnal , Vivien Cabannes