English
Related papers

Related papers: RAISECity: A Multimodal Agent Framework for Realit…

200 papers

The convergence of generative artificial intelligence and advanced computer vision technologies introduces a groundbreaking approach to transforming textual descriptions into three-dimensional representations. This research proposes a fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Venkat Kumar R , Deepak Saravanan

Simulated environments play an essential role in embodied AI, functionally analogous to test cases in software engineering. However, existing environment generation methods often emphasize visual realism (e.g., object diversity and layout…

Robotics · Computer Science 2026-01-21 Jianan Wang , Siyang Zhang , Bin Li , Juan Chen , Jingtao Qi , Zhuo Zhang , Chen Qian

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Metasurface inverse design has become central to realizing complex optical functionality, yet translating target responses into executable, solver-compatible workflows still demands specialized expertise in computational electromagnetics…

Artificial Intelligence · Computer Science 2026-04-03 Yi Huang , Bowen Zheng , Yunxi Dong , Hong Tang , Huan Zhao , S. M. Rakibul Hasan Shawon , Hualiang Zhang

Autoregressive (AR) models have garnered significant attention in image generation for their ability to effectively capture both local and global structures within visual data. However, prevalent AR models predominantly rely on the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Yuxin Mao , Zhen Qin , Jinxing Zhou , Hui Deng , Xuyang Shen , Bin Fan , Jing Zhang , Yiran Zhong , Yuchao Dai

Embodied multi-agent systems (EMAS) have attracted growing attention for their potential to address complex, real-world challenges in areas such as logistics and robotics. Recent advances in foundation models pave the way for generative…

Multiagent Systems · Computer Science 2025-02-18 Di Wu , Xian Wei , Guang Chen , Hao Shen , Xiangfeng Wang , Wenhao Li , Bo Jin

Recently, video-based world models that learn to simulate the dynamics have gained increasing attention in robot learning. However, current approaches primarily emphasize visual generative quality while overlooking physical fidelity,…

Robotics · Computer Science 2026-01-21 Baorui Peng , Wenyao Zhang , Liang Xu , Zekun Qi , Jiazhao Zhang , Hongsi Liu , Wenjun Zeng , Xin Jin

In recent years, significant progress has been made in both image generation and generated image detection. Despite their rapid, yet largely independent, development, these two fields have evolved distinct architectural paradigms: the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yanran Zhang , Wenzhao Zheng , Yifei Li , Bingyao Yu , Yu Zheng , Lei Chen , Jiwen Lu , Jie Zhou

Recent advances in text-conditioned generative models have provided us with neural networks capable of creating images of astonishing quality, be they realistic, abstract, or even creative. These models have in common that (more or less…

Human-Computer Interaction · Computer Science 2022-10-10 Francisco Ibarrola , Tomas Lawton , Kazjon Grace

Despite rapid advances in 3D content generation, quality assessment for the generated 3D assets remains challenging. Existing methods mainly rely on image-based metrics and operate solely at the object level, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yuhan Zhang , Long Zhuo , Ziyang Chu , Tong Wu , Zhibing Li , Liang Pan , Dahua Lin , Ziwei Liu

Creating machines capable of understanding the world in 3D is essential in assisting designers that build and edit 3D environments and robots navigating and interacting within a three-dimensional space. Inspired by advances in language and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Aadarsh Sahoo , Vansh Tibrewal , Georgia Gkioxari

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Despite the growing adoption of mixed reality and interactive AI agents, it remains challenging for these systems to generate high quality 2D/3D scenes in unseen environments. The common practice requires deploying an AI agent to collect…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Qiuyuan Huang , Jae Sung Park , Abhinav Gupta , Paul Bennett , Ran Gong , Subhojit Som , Baolin Peng , Owais Khan Mohammed , Chris Pal , Yejin Choi , Jianfeng Gao

Achieving physically accurate object manipulation in image editing is essential for its potential applications in interactive world models. However, existing visual generative models often fail at precise spatial manipulation, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Ruihang Xu , Dewei Zhou , Xiaolong Shen , Fan Ma , Yi Yang

The rapid advancement of Artificial Intelligence Generated Content (AIGC) techniques has unlocked opportunities in generating diverse and compelling advertising images based on referenced product images and textual scene descriptions. This…

Graphics · Computer Science 2025-08-19 Yiyun Chen , Weikai Yang

Human understanding and generation are critical for modeling digital humans and humanoid embodiments. Recently, Human-centric Foundation Models (HcFMs) inspired by the success of generalist models, such as large language and vision models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shixiang Tang , Yizhou Wang , Lu Chen , Yuan Wang , Sida Peng , Dan Xu , Wanli Ouyang

Multimodal foundation models have demonstrated impressive capabilities across diverse tasks. However, their potential as plug-and-play solutions for missing modality reconstruction remains underexplored. To bridge this gap, we identify and…

Multimedia · Computer Science 2026-05-25 Guanzhou Ke , Bo Wang , Guoqing Chao , Weiming Hu , Shengfeng He

The rapid development and adoption of Generative AI (GAI) technology in the form of chatbots such as ChatGPT and Claude has greatly increased interest in agentic machines. This paper introduces the Autonomous Cognitive Entity (ACE) model, a…

Human-Computer Interaction · Computer Science 2023-11-02 David Shapiro , Wangfan Li , Manuel Delaflor , Carlos Toxtli

In the past year, researchers have created agentic systems that can design real-world CAD-style objects in a training-free setting, a new variety of system that we call Agent-Aided Design. These systems place an agent in a feedback loop in…

Artificial Intelligence · Computer Science 2026-04-28 Mitch Adler , Matthew Russo , Michael Cafarella

Despite the availability of large-scale 3D datasets and advancements in 3D generative models, the complexity and uneven quality of 3D geometry and texture data continue to hinder the performance of 3D generation techniques. In most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Xin Yang , Jiantao Lin , Yingjie Xu , Haodong Li , Yingcong Chen