English
Related papers

Related papers: T$^3$Bench: Benchmarking Current Progress in Text-…

200 papers

Recent text-to-scene generation approaches largely reduced the manual efforts required to create 3D scenes. However, their focus is either to generate a scene layout or to generate objects, and few generate both. The generated scene layout…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhenggang Tang , Yuehao Wang , Yuchen Fan , Jun-Kun Chen , Yu-Ying Yeh , Kihyuk Sohn , Zhangyang Wang , Qixing Huang , Alexander Schwing , Rakesh Ranjan , Dilin Wang , Zhicheng Yan

We present M^3-Bench, the first benchmark for evaluating multimodal tool use under the Model Context Protocol. The benchmark targets realistic, multi-hop and multi-threaded workflows that require visual grounding and textual reasoning,…

Artificial Intelligence · Computer Science 2026-02-05 Yang Zhou , Mingyu Zhao , Zhenting Wang , Difei Gu , Bangwei Guo , Ruosong Ye , Ligong Han , Can Jin , Dimitris N. Metaxas

We propose M3Bench, a new benchmark for whole-body motion generation in mobile manipulation tasks. Given a 3D scene context, M3Bench requires an embodied agent to reason about its configuration, environmental constraints, and task…

Robotics · Computer Science 2025-05-30 Zeyu Zhang , Sixu Yan , Muzhi Han , Zaijin Wang , Xinggang Wang , Song-Chun Zhu , Hangxin Liu

While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle to generate consistent and legible text within images. This shortcoming is commonly…

Machine Learning · Computer Science 2025-09-16 Tianyu Zhang , Xinyu Wang , Lu Li , Zhenghan Tai , Jijun Chi , Jingrui Tian , Hailin He , Suyuchen Wang

Given a 3D mesh with a UV parameterization, we introduce a novel approach to generating textures from text prompts. While prior work uses optimization from Text-to-Image Diffusion models to generate textures and geometry, this is slow and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Julian Knodt , Xifeng Gao

Text-to-video (T2V) generation models have made rapid progress in producing visually high-quality and temporally coherent videos. However, existing benchmarks primarily focus on perceptual quality, text-video alignment, or physical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Xianjing Han , Bin Zhu , Shiqi Hu , Franklin Mingzhe Li , Patrick Carrington , Roger Zimmermann , Jingjing Chen

Despite recent progress on the short-video Text-Visual Question Answering (ViteVQA) task - largely driven by benchmarks such as M4-ViteVQA - existing datasets still suffer from limited video duration and narrow evaluation scopes, making it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yangyang Zhong , Ji Qi , Yuan Yao , Pengxin Luo , Yunfeng Yan , Donglian Qi , Zhiyuan Liu , Tat-Seng Chua

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Despite recent advances in text-to-3D generative methods, there is a notable absence of reliable evaluation metrics. Existing metrics usually focus on a single criterion each, such as how well the asset aligned with the input text. These…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Tong Wu , Guandao Yang , Zhibing Li , Kai Zhang , Ziwei Liu , Leonidas Guibas , Dahua Lin , Gordon Wetzstein

Text-to-3D generation, which synthesizes 3D assets according to an overall text description, has significantly progressed. However, a challenge arises when the specific appearances need customizing at designated viewpoints but referring…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Junkai Yan , Yipeng Gao , Qize Yang , Xihan Wei , Xuansong Xie , Ancong Wu , Wei-Shi Zheng

The rapid evolution of Large Language Models (LLMs) has fostered diverse paradigms for automated slide generation, ranging from code-driven layouts to image-centric synthesis. However, evaluating these heterogeneous systems remains…

Computation and Language · Computer Science 2026-01-15 Yunqiao Yang , Wenbo Li , Houxing Ren , Zimu Lu , Ke Wang , Zhiyuan Huang , Zhuofan Zong , Mingjie Zhan , Hongsheng Li

Text-to-Image (T2I) generative models are becoming increasingly crucial due to their ability to generate high-quality images, but also raise concerns about social biases, particularly in human image generation. Sociological research has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Hanjun Luo , Haoyu Huang , Ziye Deng , Xinfeng Li , Hewei Wang , Yingbin Jin , Yang Liu , Wenyuan Xu , Zuozhu Liu

Recent breakthroughs in text-to-image generation has shown encouraging results via large generative models. Due to the scarcity of 3D assets, it is hardly to transfer the success of text-to-image generation to that of text-to-3D generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yiming Chen , Zhiqi Li , Peidong Liu

Text-to-Image (T2I) models and Unified Multimodal Models (UMMs) have achieved remarkable progress in visual generation. However, their reliance on a single-pass generation paradigm limits their ability to handle complex prompts requiring…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junjie Wang , Xinghua Lou , Jason Li , Ye Tian , Keyu Chen , Yulin Li , Bin Kang , Jacky Mai , Yanwei Li , Zhuotao Tian , Liqiang Nie

Despite remarkable progress in Text-to-Image models, many real-world applications require generating coherent image sets with diverse consistency requirements. Existing consistent methods often focus on a specific domain with specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Chengyou Jia , Xin Shen , Zhuohang Dang , Zhuohang Dang , Changliang Xia , Weijia Wu , Xinyu Zhang , Hangwei Qian , Ivor W. Tsang , Minnan Luo

Generative models have demonstrated remarkable capability in synthesizing high-quality text, images, and videos. For video generation, contemporary text-to-video models exhibit impressive capabilities, crafting visually stunning videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jay Zhangjie Wu , Guian Fang , Haoning Wu , Xintao Wang , Yixiao Ge , Xiaodong Cun , David Junhao Zhang , Jia-Wei Liu , Yuchao Gu , Rui Zhao , Weisi Lin , Wynne Hsu , Ying Shan , Mike Zheng Shou

In recent years, significant advancements have been made in text-driven 3D content generation. However, several challenges remain. In practical applications, users often provide extremely simple text inputs while expecting high-quality 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Huiqi Wu , Jianbo Mei , Yingjie Huang , Yining Xu , Jingjiao You , Yilong Liu , Li Yao

Text-to-3D generative AI systems create navigable environments from natural language prompts, but unlike text-to-image generation, evaluation requires embodied exploration of spatial coherence, scale, and navigability. We present the first…

Human-Computer Interaction · Computer Science 2026-03-17 Aung Pyae

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Weiyu Li , Xuanyang Zhang , Zheng Sun , Di Qi , Hao Li , Wei Cheng , Weiwei Cai , Shihao Wu , Jiarui Liu , Zihao Wang , Xiao Chen , Feipeng Tian , Jianxiong Pan , Zeming Li , Gang Yu , Xiangyu Zhang , Daxin Jiang , Ping Tan

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang