English
Related papers

Related papers: EZBlender: Efficient 3D Editing with Plan-and-ReAc…

200 papers

Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly''). Prior agent based methods decompose such tasks but rely on handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Anirudh Sundara Rajan , Krishna Kumar Singh , Yong Jae Lee

Current LLM agents operate under an implicit but universal assumption: execution is a transaction -- the user submits a request, the agent works in isolation, and only upon completion does the dialogue resume. This forces users into a…

Machine Learning · Computer Science 2026-04-28 Zhiyuan Zhai , Ming Li , Xin Wang

Instruction guided image editing has advanced substantially with recent generative models, yet it still fails to produce reliable results across many seemingly simple cases. We observe that a large portion of these failures stem not from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Bo Zhao , Kairui Guo , Runnan Du , Haiyang Sun , Pengshan Wang , Huan Yang , Kun Gai , Yixin Cao , Wei Ji

The ability to perform effective planning is crucial for building an instruction-following agent. When navigating through a new environment, an agent is challenged with (1) connecting the natural language instructions with its progressively…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zhiwei Deng , Karthik Narasimhan , Olga Russakovsky

Existing Graphical User Interface (GUI) agents operate through step-by-step calls to vision language models--taking a screenshot, reasoning about the next action, executing it, then repeating on the new page--resulting in high costs and…

Artificial Intelligence · Computer Science 2026-02-25 Hongbin Zhong , Fazle Faisal , Luis França , Tanakorn Leesatapornwongsa , Adriana Szekeres , Kexin Rong , Suman Nath

Effective human-agent collaboration in physical environments requires understanding not only what to act upon, but also where the actionable elements are and how to interact with them. Existing approaches often operate at the object level…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinyi Wang , Xun Yang , Yanlong Xu , Yuchen Wu , Zhen Li , Na Zhao

Despite the remarkable progress of Multimodal Large Language Models (MLLMs) in 2D vision-language tasks, their application to complex 3D scene manipulation remains underexplored. In this paper, we bridge this critical gap by tackling three…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zhengfei Kuang , Rui Lin , Long Zhao , Gordon Wetzstein , Saining Xie , Sanghyun Woo

In the past year, researchers have created agentic systems that can design real-world CAD-style objects in a training-free setting, a new variety of system that we call Agent-Aided Design. These systems place an agent in a feedback loop in…

Artificial Intelligence · Computer Science 2026-04-28 Mitch Adler , Matthew Russo , Michael Cafarella

Large language models (LLMs) have shown remarkable advancements in enabling language agents to tackle simple tasks. However, applying them for complex, multi-step, long-horizon tasks remains a challenge. Recent work have found success by…

Computation and Language · Computer Science 2025-08-05 Lutfi Eren Erdogan , Nicholas Lee , Sehoon Kim , Suhong Moon , Hiroki Furuta , Gopala Anumanchipalli , Kurt Keutzer , Amir Gholami

Existing multi-turn image editing paradigms are often confined to isolated single-step execution. Due to a lack of context-awareness and closed-loop feedback mechanisms, they are prone to error accumulation and semantic drift during…

Graphics · Computer Science 2026-04-01 Fei Shen , Chengyu Xie , Lihong Wang , Zhanyi Zhang , Xin Jiang , Xiaoyu Du , Jinhui Tang

Recent advances in Large Language Models (LLMs) demonstrate that chain-of-thought prompting and deep reasoning substantially enhance performance on complex tasks, and multi-agent systems can further improve accuracy by enabling model…

Artificial Intelligence · Computer Science 2025-10-16 Zehui Ling , Deshu Chen , Yichi Zhang , Yuchen Liu , Xigui Li , Xin Guo , Yuan Cheng

Agent-based modeling plays an essential role in gaining insights into biology, sociology, economics, and other fields. However, many existing agent-based simulation platforms are not suitable for large-scale studies due to the low…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Lukas Breitwieser , Ahmad Hesam , Fons Rademakers , Juan Gómez Luna , Onur Mutlu

Metasurface inverse design has become central to realizing complex optical functionality, yet translating target responses into executable, solver-compatible workflows still demands specialized expertise in computational electromagnetics…

Artificial Intelligence · Computer Science 2026-04-03 Yi Huang , Bowen Zheng , Yunxi Dong , Hong Tang , Huan Zhao , S. M. Rakibul Hasan Shawon , Hualiang Zhang

Balancing user agency and system automation is essential for effective human-AI interactions. Fully automated systems can deliver efficiency but risk undermining usability and user autonomy, while purely manual tools are often inefficient…

Human-Computer Interaction · Computer Science 2025-02-20 Thomas Langerak

The integration of Large Language Models (LLMs) into Geographic Information Systems (GIS) marks a paradigm shift toward autonomous spatial analysis. However, evaluating these LLM-based agents remains challenging due to the complex,…

Artificial Intelligence · Computer Science 2026-04-16 Bo Yu , Cheng Yang , Dongyang Hou , Chengfu Liu , Jiayao Liu , Chi Wang , Zhiming Zhang , Haifeng Li , Wentao Yang

Video creation has become increasingly popular, yet the expertise and effort required for editing often pose barriers to beginners. In this paper, we explore the integration of large language models (LLMs) into the video editing workflow to…

Human-Computer Interaction · Computer Science 2024-02-29 Bryan Wang , Yuliang Li , Zhaoyang Lv , Haijun Xia , Yan Xu , Raj Sodhi

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

This paper introduces Scene-LLM, a 3D-visual-language model that enhances embodied agents' abilities in interactive 3D indoor environments by integrating the reasoning strengths of Large Language Models (LLMs). Scene-LLM adopts a hybrid 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rao Fu , Jingyu Liu , Xilun Chen , Yixin Nie , Wenhan Xiong

The evolution of Large Language Models (LLMs) from passive text processors to autonomous agents has established planning as a core component of modern intelligence. However, achieving generalized planning remains elusive, not only by the…

Evaluating Large Language Models (LLMs) as general-purpose agents is essential for understanding their capabilities and facilitating their integration into practical applications. However, the evaluation process presents substantial…

Computation and Language · Computer Science 2024-12-25 Chang Ma , Junlei Zhang , Zhihao Zhu , Cheng Yang , Yujiu Yang , Yaohui Jin , Zhenzhong Lan , Lingpeng Kong , Junxian He