English
Related papers

Related papers: A4-Agent: An Agentic Framework for Zero-Shot Affor…

200 papers

Research and practice in Intelligent Design (ID) have significantly enhanced engineering innovation, efficiency, quality, and productivity over recent decades, fundamentally reshaping how engineering designers think, behave, and interact…

Computational Engineering, Finance, and Science · Computer Science 2025-11-25 Shuo Jiang , Min Xie , Frank Youhua Chen , Jian Ma , Jianxi Luo

The field of Artificial Intelligence is undergoing a transition from Generative AI -- probabilistic generation of text and images -- to Agentic AI, in which autonomous systems execute actions within external environments on behalf of users.…

Artificial Intelligence · Computer Science 2026-03-02 Sheng Cao , Zhao Chang , Chang Li , Hannan Li , Liyao Fu , Ji Tang

Robotic manipulation faces critical challenges in understanding spatial affordances--the "where" and "how" of object interactions--essential for complex manipulation tasks like wiping a board or stacking objects. Existing methods, including…

Executing open-ended natural language queries is a core problem in robotics. While recent advances in imitation learning and vision-language-actions models (VLAs) have enabled promising end-to-end policies, these models struggle when faced…

Tool use requires reasoning about the fit between an object's affordances and the demands of a task. Visual affordance learning can benefit from goal-directed interaction experience, but current techniques rely on human labels or expert…

Robotics · Computer Science 2021-06-30 Dylan Turpin , Liquan Wang , Stavros Tsogkas , Sven Dickinson , Animesh Garg

Interactions with articulated objects are a challenging but important task for mobile robots. To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates manipulation priors from affordance estimation with…

Robotics · Computer Science 2023-02-07 Giulio Schiavi , Paula Wulkop , Giuseppe Rizzi , Lionel Ott , Roland Siegwart , Jen Jen Chung

Robotic agents need to understand how to interact with objects in their environment, both autonomously and during human-robot interactions. Affordance detection on 3D point clouds, which identifies object regions that allow specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Maximilian Xiling Li , Korbinian Rudolf , Nils Blank , Rudolf Lioutikov

Amodal completion, generating invisible parts of occluded objects, is vital for applications like image editing and AR. Prior methods face challenges with data needs, generalization, or error accumulation in progressive pipelines. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hongxing Fan , Lipeng Wang , Haohua Chen , Zehuan Huang , Jiangtao Wu , Lu Sheng

In humans, perceptual awareness facilitates the fast recognition and extraction of information from sensory input. This awareness largely depends on how the human agent interacts with the environment. In this work, we propose active neural…

Machine Learning · Computer Science 2021-12-21 Alexander Ororbia , Ankur Mali

Affordance learning is a complex challenge in many applications, where existing approaches primarily focus on the geometric structures, visual knowledge, and affordance labels of objects to determine interactable regions. However, extending…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Nghia Vu , Tuong Do , Khang Nguyen , Baoru Huang , Nhat Le , Binh Xuan Nguyen , Erman Tjiputra , Quang D. Tran , Ravi Prakash , Te-Chuan Chiu , Anh Nguyen

Foundation models face growing compute and memory bottlenecks, hindering deployment on resource-limited platforms. While compression techniques such as pruning and quantization are widely used, most rely on uniform heuristics that ignore…

Machine Learning · Computer Science 2025-09-09 Sadegh Jafari , Aishwarya Sarkar , Mohiuddin Bilwal , Ali Jannesari

Agentic language models operate in a fundamentally different safety regime than chat models: they must plan, call tools, and execute long-horizon actions where a single misstep, such as accessing files or entering credentials, can cause…

Computation and Language · Computer Science 2026-03-04 Aradhye Agarwal , Gurdit Siyan , Yash Pandya , Joykirat Singh , Akshay Nambi , Ahmed Awadallah

Designing realistic multi-object scenes requires not only generating images, but also planning spatial layouts that respect semantic relations and physical plausibility. On one hand, while recent advances in diffusion models have enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zezhong Fan , Xiaohan Li , Luyi Ma , Kai Zhao , Liang Peng , Topojoy Biswas , Evren Korpeoglu , Kaushiki Nag , Kannan Achan

Proactive AR agents promise context-aware assistance, but their interactions often rely on explicit voice prompts or responses, which can be disruptive or socially awkward. We introduce Sensible Agent, a framework designed for unobtrusive…

Human-Computer Interaction · Computer Science 2025-11-03 Geonsun Lee , Min Xia , Nels Numan , Xun Qian , David Li , Yanhe Chen , Achin Kulshrestha , Ishan Chatterjee , Yinda Zhang , Dinesh Manocha , David Kim , Ruofei Du

The rapid evolution of AI-generated images poses growing challenges to information integrity and media authenticity. Existing detection approaches face limitations in robustness, interpretability, and generalization across diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Mengfei Liang , Yiting Qu , Yukun Jiang , Michael Backes , Yang Zhang

Current approaches rely on zero-shot evaluation due to the absence of training data; while proprietary models such as GPT-4 exhibit strong reasoning capabilities, smaller open-source models remain ineffective at complex tool use. To address…

Artificial Intelligence · Computer Science 2026-05-05 Hyunji Min , Sangwon Jung , Junyoung Sung , Dosung Lee , Leekyeung Han , Paul Hongsuck Seo

We propose a minimal agentic baseline that enables systematic comparison across different AI-based theorem prover architectures. This design implements the core features shared among state-of-the-art systems: iterative proof refinement,…

Artificial Intelligence · Computer Science 2026-05-15 Borja Requena , Austin Letson , Krystian Nowakowski , Izan Beltran-Ferreiro , Leopoldo Sarra

Functional affordance grounding requires more than recognizing an object: an agent must localize the specific region that supports an interaction, such as the handle to pull or the button to press. This is difficult for training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qirui Wang , Jingyi He , Yining Pan , Xulei Yang , Shijie Li

We introduce GenAgent, unifying visual understanding and generation through an agentic multimodal model. Unlike unified models that face expensive training costs and understanding-generation trade-offs, GenAgent decouples these capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kaixun Jiang , Yuzheng Wang , Junjie Zhou , Pandeng Li , Zhihang Liu , Chen-Wei Xie , Zhaoyu Chen , Yun Zheng , Wenqiang Zhang

In real-world environments, AI systems often face unfamiliar scenarios without labeled data, creating a major challenge for conventional scene understanding models. The inability to generalize across unseen contexts limits the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Manjunath Prasad Holenarasipura Rajiv , B. M. Vidyavathi