中文
相关论文

相关论文: ArtiBench and ArtiBrain: Benchmarking Generalizabl…

200 篇论文

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a…

机器人学 · 计算机科学 2022-09-14 Hao Shen , Weikang Wan , He Wang

As multimodal language models play an increasingly important role in scientific research, materials science offers a critical testbed due to its interdisciplinary, multimodal, and application-driven nature. However, existing materials…

人工智能 · 计算机科学 2026-05-29 Wanhao Liu , Jiaqing Xie , Qian Tan , Weida Wang , Jue Wang , Ran Sun , Zhuo Yang , Wanli Ouyang , Lei Bai , Tianfan Fu , Lu Chen , Xin Chen , Yuqiang Li

Solving expert-level multimodal tasks is a key milestone towards general intelligence. As the capabilities of multimodal large language models (MLLMs) continue to improve, evaluation of such advanced multimodal intelligence becomes…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Yan Yang , Dongxu Li , Haoning Wu , Bei Chen , Liu Liu , Liyuan Pan , Junnan Li

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

Object manipulation from 3D visual inputs poses many challenges on building generalizable perception and policy models. However, 3D assets in existing benchmarks mostly lack the diversity of 3D shapes that align with real-world intra-class…

机器学习 · 计算机科学 2021-11-05 Tongzhou Mu , Zhan Ling , Fanbo Xiang , Derek Yang , Xuanlin Li , Stone Tao , Zhiao Huang , Zhiwei Jia , Hao Su

Large language models (LLMs) have shown strong performance on mathematical reasoning under well-defined conditions. However, real-world engineering problems involve uncertainty, context, and open-ended settings that extend beyond symbolic…

人工智能 · 计算机科学 2026-05-05 Xiyuan Zhou , Xinlei Wang , Yirui He , Yang Wu , Ruixi Zou , Yuheng Cheng , Yulu Xie , Wenxuan Liu , Huan Zhao , Yan Xu , Jinjin Gu , Junhua Zhao

While text-to-image generation has achieved unprecedented fidelity, the vast majority of existing models function fundamentally as static text-to-pixel decoders. Consequently, they often fail to grasp implicit user intentions. Although…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Jun He , Junyan Ye , Zilong Huang , Dongzhi Jiang , Chenjue Zhang , Leqi Zhu , Renrui Zhang , Xiang Zhang , Weijia Li

Building on recent advances in language-based reasoning models, we explore multimodal reasoning that integrates vision and text. Existing multimodal benchmarks primarily test visual extraction combined with text-based reasoning, lacking…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Mert Unsal , Aylin Akkus

As large language models (LLMs) evolve into autonomous agents capable of acting in open-ended environments, ensuring behavioral alignment with human values becomes a critical safety concern. Existing benchmarks, focused on static,…

计算与语言 · 计算机科学 2026-03-10 Weixiang Zhao , Haozhen Li , Yanyan Zhao , xuda zhi , Yongbo Huang , Hao He , Bing Qin , Ting Liu

The fusion of Large Language Models with vision models is pioneering new possibilities in user-interactive vision-language tasks. A notable application is reasoning segmentation, where models generate pixel-level segmentation masks by…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Donggon Jang , Yucheol Cho , Suin Lee , Taehyeon Kim , Dae-Shik Kim

While imitation learning has shown impressive results in single-task robot manipulation, scaling it to multi-task settings remains a fundamental challenge due to issues such as suboptimal demonstrations, trajectory noise, and behavioral…

机器人学 · 计算机科学 2025-12-23 Yihang Zhu , Weiqing Wang , Shijie Wu , Ye Shi , Jingya Wang

As Large Language Model (LLM) alignment evolves from simple completions to complex, highly sophisticated generation, Reward Models are increasingly shifting toward rubric-guided evaluation to mitigate surface-level biases. However, the…

人工智能 · 计算机科学 2026-03-04 Qiyuan Zhang , Junyi Zhou , Yufei Wang , Fuyuan Lyu , Yidong Ming , Can Xu , Qingfeng Sun , Kai Zheng , Peng Kang , Xue Liu , Chen Ma

Inferring the affordance of an object and grasping it in a task-oriented manner is crucial for robots to successfully complete manipulation tasks. Affordance indicates where and how to grasp an object by taking its functionality into…

机器人学 · 计算机科学 2025-03-04 Yingbo Tang , Shuaike Zhang , Xiaoshuai Hao , Pengwei Wang , Jianlong Wu , Zhongyuan Wang , Shanghang Zhang

Large language models (LLMs) like ChatGPT have revealed amazing intelligence. How to evaluate the question-solving abilities of LLMs and their degrees of intelligence is a hot-spot but challenging issue. First, the question-solving…

计算与语言 · 计算机科学 2023-09-14 Fei Tang , Wanling Gao , Luzhou Peng , Jianfeng Zhan

Building embodied agents capable of accomplishing arbitrary tasks is a core objective towards achieving embodied artificial general intelligence (E-AGI). While recent work has advanced such general robot policies, their training and…

机器人学 · 计算机科学 2025-07-30 Liu Dai , Haina Wang , Weikang Wan , Hao Su

We present INTEGRALBENCH, a focused benchmark designed to evaluate Large Language Model (LLM) performance on definite integral problems. INTEGRALBENCH provides both symbolic and numerical ground truth solutions with manual difficulty…

人工智能 · 计算机科学 2025-07-30 Bintao Tang , Xin Yang , Yuhao Wang , Zixuan Qiu , Zimo Ji , Wenyuan Jiang

Multimodal large language models (MLLMs) are proficient in perception and instruction-following, but they still struggle with spatial reasoning: the ability to mentally track and manipulate objects across multiple views and over time.…

人工智能 · 计算机科学 2025-12-30 Ryan Spencer , Roey Yaari , Ritvik Vemavarapu , Joyce Yang , Steven Ngo , Utkarsh Sharma

Generalization across Agentic tool-calling environments remains a key unsolved challenge in developing reliable agentic reasoning systems. While large language models (LLMs) demonstrate strong performance on isolated benchmarks, their…

人工智能 · 计算机科学 2025-10-28 Vishvesh Bhat , Omkar Ghugarkar , Julian McAuley

A kitchen assistant needs to operate human-scale objects, such as cabinets and ovens, in unmapped environments with dynamic obstacles. Autonomous interactions in such environments require integrating dexterous manipulation and fluid…

机器人学 · 计算机科学 2024-03-08 Mayank Mittal , David Hoeller , Farbod Farshidian , Marco Hutter , Animesh Garg

From dishwashers to cabinets, humans interact with articulated objects every day, and for a robot to assist in common manipulation tasks, it must learn a representation of articulation. Recent deep learning learning methods can provide…

机器人学 · 计算机科学 2023-09-29 Russell Buchanan , Adrian Röfer , João Moura , Abhinav Valada , Sethu Vijayakumar