中文
相关论文

相关论文: GAgent: An Adaptive Rigid-Soft Gripping Agent with…

200 篇论文

Proactive AR agents promise context-aware assistance, but their interactions often rely on explicit voice prompts or responses, which can be disruptive or socially awkward. We introduce Sensible Agent, a framework designed for unobtrusive…

We present STAgent, an agentic large language model tailored for spatio-temporal understanding, designed to solve complex tasks such as constrained point-of-interest discovery and itinerary planning. STAgent is a specialized model capable…

This paper proposes a simple, yet effective framework, called GiT, simultaneously applicable for various vision tasks only with a vanilla ViT. Motivated by the universality of the Multi-layer Transformer architecture (e.g, GPT) widely used…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Haiyang Wang , Hao Tang , Li Jiang , Shaoshuai Shi , Muhammad Ferjad Naeem , Hongsheng Li , Bernt Schiele , Liwei Wang

The ability to perform effective planning is crucial for building an instruction-following agent. When navigating through a new environment, an agent is challenged with (1) connecting the natural language instructions with its progressively…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Zhiwei Deng , Karthik Narasimhan , Olga Russakovsky

Designing agents, capable of learning autonomously a wide range of skills is critical in order to increase the scope of reinforcement learning. It will both increase the diversity of learned skills and reduce the burden of manually…

机器学习 · 计算机科学 2022-11-08 Grgur Kovač , Adrien Laversanne-Finot , Pierre-Yves Oudeyer

The next generation of active safety features in autonomous vehicles should be capable of safely executing evasive hazard-avoidance maneuvers akin to those performed by professional stunt drivers to achieve high-agility motion at the limits…

机器人学 · 计算机科学 2026-04-09 Shawn Azdam , Pranav Doma , Aliasghar Moj Arab

We propose a novel tri-fingered soft robotic gripper with decoupled stiffness and shape control capability for performing adaptive grasping with minimum system complexity. The proposed soft fingers adaptively conform to object shapes…

机器人学 · 计算机科学 2020-10-23 Dimuthu D. Arachchige , Yue Chen , Ian D. Walker , Isuru S. Godage

Large Language Model (LLM)-based autonomous agents are expected to play a vital role in the evolution of 6G networks, by empowering real-time decision-making related to management and service provisioning to end-users. This shift…

人工智能 · 计算机科学 2025-09-04 Ilias Chatzistefanidis , Navid Nikaein

Prompt engineering is crucial for fully leveraging large language models (LLMs), yet most existing optimization methods follow a single trajectory, resulting in limited adaptability, gradient conflicts, and high computational overhead. We…

人工智能 · 计算机科学 2026-02-04 Yichen Han , Yuhang Han , Siteng Huang , Guanyu Liu , Zhengpeng Zhou , Bojun Liu , Yujia Zhang , Isaac N Shi , Lewei He , Tianyu Shi

Autonomous web navigation requires agents to perceive complex visual environments and maintain long-term context, yet current Large Language Model (LLM) based agents often struggle with spatial disorientation and navigation loops. In this…

人工智能 · 计算机科学 2026-03-04 Xinjun Wang , Shengyao Wang , Aimin Zhou , Hao Hao

Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Open-Vocabulary Human-Object Interaction (OV-HOI) are limited by cross-modal hallucinations and…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Zhenlong Yuan , Yue Wang , Dapeng Zhang , Kejin Cui , Rui Chen , Jing Tang , Lei Sun , Hongwei Yu , Chengxuan Qian , Xiangxiang Chu , Shuo Li , Yuyin Zhou

Density functional theory (DFT) and machine learning potentials (MLPs) are essential for predicting and understanding materials properties, yet preparing, executing, and analyzing these simulations typically requires extensive scripting,…

计算物理 · 物理学 2026-01-08 Guanghen Liu , Songge Yang , Yu Zhong

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the environment: how dynamic agents behave, and how the actions of each of the agents affect the behavior of others.…

计算机视觉与模式识别 · 计算机科学 2020-05-26 Seung Wook Kim , Yuhao Zhou , Jonah Philion , Antonio Torralba , Sanja Fidler

Graphical User Interface (GUI) element grounding (precisely locating elements on screenshots based on natural language instructions) is fundamental for agents interacting with GUIs. Deploying this capability directly on resource-constrained…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Hongxin Li , Yuntao Chen , Zhaoxiang Zhang

Grasping a variety of objects remains a key challenge in the development of versatile robotic systems. The human hand is remarkably dexterous, capable of grasping and manipulating objects with diverse shapes, mechanical properties, and…

机器人学 · 计算机科学 2024-10-11 Ngoc-Duy Tran , Hoang-Hiep Ly , Xuan-Thuan Nguyen , Thi-Thoa Mac , Anh Nguyen , Tung D. Ta

The rapid progress of navigation, manipulation, and vision models has made mobile manipulators capable in many specialized tasks. However, the open-world mobile manipulation (OWMM) task remains a challenge due to the need for generalization…

机器人学 · 计算机科学 2025-06-24 Junting Chen , Haotian Liang , Lingxiao Du , Weiyun Wang , Mengkang Hu , Yao Mu , Wenhai Wang , Jifeng Dai , Ping Luo , Wenqi Shao , Lin Shao

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

计算机视觉与模式识别 · 计算机科学 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Graphical user interface (GUI) agents have shown promise in automating mobile tasks but still struggle with input redundancy and decision ambiguity. In this paper, we present \textbf{RecAgent}, an uncertainty-aware agent that addresses…

人工智能 · 计算机科学 2025-08-07 Chao Hao , Shuai Wang , Kaiwen Zhou

Training vision-language models on cognitively-plausible amounts of data requires rethinking how models integrate multimodal information. Within the constraints of the Vision track for the BabyLM Challenge 2025, we propose a lightweight…

人工智能 · 计算机科学 2025-10-10 Bianca-Mihaela Ganescu , Suchir Salhan , Andrew Caines , Paula Buttery

This paper addresses the problem of mobile grasping in dynamic, unknown environments where a robot must operate under a limited field-of-view. The fundamental challenge is the inherent trade-off between ``seeing'' around to reduce…

机器人学 · 计算机科学 2026-05-12 Tianrun Hu , Anxing Xiao , David Hsu , Hanbo Zhang