English
Related papers

Related papers: Omni123: Exploring 3D Native Foundation Models wit…

200 papers

Recent advancements in 3D foundation models have enabled the generation of high-fidelity assets, yet precise 3D manipulation remains a significant challenge. Existing 3D editing frameworks often face a difficult trade-off between visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Inbar Gat , Dana Cohen-Bar , Guy Levy , Elad Richardson , Daniel Cohen-Or

Generating immersive 3D scenes from texts is a core task in computer vision, crucial for applications in virtual reality and game development. Despite the promise of leveraging 2D diffusion priors, existing methods suffer from spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jisheng Chu , Wenrui Li , Rui Zhao , Wangmeng Zuo , Shifeng Chen , Xiaopeng Fan

Multimodal multitask learning has attracted an increasing interest in recent years. Singlemodal models have been advancing rapidly and have achieved astonishing results on various tasks across multiple domains. Multimodal learning offers…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Ye Xue , Diego Klabjan , Jean Utke

Feed-forward 3D Gaussian splatting (3DGS) models have gained significant popularity due to their ability to generate scenes immediately without needing per-scene optimization. Although omnidirectional images are becoming more popular since…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Suyoung Lee , Jaeyoung Chung , Kihoon Kim , Jaeyoo Huh , Gunhee Lee , Minsoo Lee , Kyoung Mu Lee

Generative models have achieved impressive fidelity in text-to-image synthesis, yet struggle with complex compositional prompts involving multiple constraints. We introduce \textbf{M3 (Multi-Modal, Multi-Agent, Multi-Round)}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Bangji Yang , Ruihan Guo , Jiajun Fan , Chaoran Cheng , Ge Liu

While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Lijiang Li , Zuwei Long , Yunhang Shen , Heting Gao , Haoyu Cao , Xing Sun , Caifeng Shan , Ran He , Chaoyou Fu

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

Diffusion models have demonstrated remarkable performance in generating unimodal data across various tasks, including image, video, and text generation. On the contrary, the joint generation of multimodal data through diffusion models is…

Machine Learning · Computer Science 2025-06-16 Kevin Rojas , Yuchen Zhu , Sichen Zhu , Felix X. -F. Ye , Molei Tao

While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Shifang Zhao , Yiheng Lin , Lu Han , Yao Zhao , Yunchao Wei

Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to…

Machine Learning · Computer Science 2024-11-19 Yunuo Chen , Tianyi Xie , Zeshun Zong , Xuan Li , Feng Gao , Yin Yang , Ying Nian Wu , Chenfanfu Jiang

General Text-to-3D (GT23D) generation is crucial for creating diverse 3D content across objects and scenes, yet it faces two key challenges: 1) ensuring semantic consistency between input text and generated 3D models, and 2) maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xiao Cai , Pengpeng Zeng , Lianli Gao , Sitong Su , Heng Tao Shen , Jingkuan Song

Recent advances in text-driven 3D scene editing and stylization, which leverage the powerful capabilities of 2D generative models, have demonstrated promising outcomes. However, challenges remain in ensuring high-quality stylization and…

Graphics · Computer Science 2026-03-03 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

Recent 3D generative models have achieved remarkable performance in synthesizing high resolution photorealistic images with view consistency and detailed 3D shapes, but training them for diverse domains is challenging since it requires…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Gwanghyun Kim , Se Young Chun

Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hui Shan , Keyang Luo , Ming Li , Sizhe Zheng , Yanwei Fu , Zhen Chen , Xiangru Huang

Prior approaches injecting camera control into diffusion models have focused on specific subsets of 4D consistency tasks: novel view synthesis, text-to-video with camera control, image-to-video, amongst others. Therefore, these fragmented…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Xiang Fan , Sharath Girish , Vivek Ramanujan , Chaoyang Wang , Ashkan Mirzaei , Petr Sushko , Aliaksandr Siarohin , Sergey Tulyakov , Ranjay Krishna

Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underperforming monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weijia Zhang , Dongnan Liu , Chao Ma , Weidong Cai

Given a single image of a target object, image-to-3D generation aims to reconstruct its texture and geometric shape. Recent methods often utilize intermediate media, such as multi-view images or videos, to bridge the gap between input image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jiacheng Wang , Zhedong Zheng , Wei Xu , Ping Liu

Recent advancements in Generalizable Gaussian Splatting have enabled robust 3D reconstruction from sparse input views by utilizing feed-forward Gaussian Splatting models, achieving superior cross-scene generalization. However, while many…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Zhicong Wu , Hongbin Xu , Gang Xu , Ping Nie , Zhixin Yan , Jinkai Zheng , Liangqiong Qu , Ming Li , Liqiang Nie