中文
相关论文

相关论文: ForgeDreamer: Industrial Text-to-3D Generation wit…

200 篇论文

We address the problem of generating long-horizon videos for robotic manipulation tasks. Text-to-video diffusion models have made significant progress in photorealism, language understanding, and motion generation but struggle with…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Liudi Yang , Yang Bai , George Eskandar , Fengyi Shen , Mohammad Altillawi , Dong Chen , Soumajit Majumder , Ziyuan Liu , Gitta Kutyniok , Abhinav Valada

In this paper, we introduce LDGen, a novel method for integrating large language models (LLMs) into existing text-to-image diffusion models while minimizing computational demands. Traditional text encoders, such as CLIP and T5, exhibit…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Pengzhi Li , Pengfei Yu , Zide Liu , Wei He , Xuhao Pan , Xudong Rao , Tao Wei , Wei Chen

Low-Rank Adaptation (LoRA) has gained prominence as a computationally efficient method for fine-tuning generative models, enabling distinct visual concept synthesis with minimal overhead. However, current methods struggle to effectively…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Aniket Roy , Maitreya Suin , Ketul Shah , Rama Chellappa

The advancements in automatic text-to-3D generation have been remarkable. Most existing methods use pre-trained text-to-image diffusion models to optimize 3D representations like Neural Radiance Fields (NeRFs) via latent-space denoising…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Junzhe Zhu , Peiye Zhuang , Sanmi Koyejo

3D AI-generated content (AIGC) has made it increasingly accessible for anyone to become a 3D content creator. While recent methods leverage Score Distillation Sampling to distill 3D objects from pretrained image diffusion models, they often…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yuxiao Yang , Peihao Li , Yuhong Zhang , Junzhe Lu , Xianglong He , Minghan Qin , Weitao Wang , Haoqian Wang

Recent advances in video generation enable a new paradigm for 3D scene creation: generating camera-controlled videos that simulate scene walkthroughs, then lifting them to 3D via feed-forward reconstruction techniques. This generative…

Large Language Models (LLMs) have achieved impressive performance across a wide range of applications. However, they often suffer from hallucinations in knowledge-intensive domains due to their reliance on static pretraining corpora. To…

信息检索 · 计算机科学 2026-02-10 Lihui Liu , Jiayuan Ding , Subhabrata Mukherjee , Carl J. Yang

Visual document understanding typically requires separate retrieval and generation models, doubling memory and system complexity. We present Hydra, a dual-head approach that provides both ColBERT-style late-interaction retrieval and…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Athos Georgiou

Personalized image generation requires effectively balancing content fidelity with stylistic consistency when synthesizing images based on text and reference examples. Low-Rank Adaptation (LoRA) offers an efficient personalization approach,…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Yu Li , Yujun Cai , Chi Zhang

Recent breakthroughs in the field of language-guided image generation have yielded impressive achievements, enabling the creation of high-quality and diverse images based on user instructions.Although the synthesis performance is…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Jian Ma , Mingjun Zhao , Chen Chen , Ruichen Wang , Di Niu , Haonan Lu , Xiaodong Lin

Multimodal Large Language Models (MLLMs) have significantly advanced vision-language understanding. However, even state-of-the-art models struggle with geometric reasoning, revealing a critical bottleneck: the extreme scarcity of…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

The rapid evolution of Large Language Models (LLMs) has shifted focus from general-purpose capabilities to domain-specific expertise. However, adapting LLMs to specialized fields such as medicine presents two challenge: (1) the…

机器学习 · 计算机科学 2026-01-14 Yuxin Yang , Aoxiong Zeng , Xiangquan Yang

Federated Learning with Low-Rank Adaptation (LoRA) faces three critical challenges under client heterogeneity: (1) Initialization-Induced Instability due to random initialization misaligning client subspaces; (2) Rank Incompatibility and…

机器学习 · 计算机科学 2025-11-21 Junchao Zhou , Junkang Liu , Fanhua Shang

Text-to-3D generation has recently seen significant progress. To enhance its practicality in real-world applications, it is crucial to generate multiple independent objects with interactions, similar to layer-compositing in 2D image…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Zizheng Yan , Jiapeng Zhou , Fanpeng Meng , Yushuang Wu , Lingteng Qiu , Zisheng Ye , Shuguang Cui , Guanying Chen , Xiaoguang Han

The rapid advancement of generative technologies has made synthetic images nearly indistinguishable from real ones, thereby creating an urgent need for robust detectors to counter misinformation. However, existing methods mainly rely on…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Yutong Xiao , Ran Ran , Jiwei Wei , Shuchang Zhou , Ke Liu , Zheng Ziqiang , Caiyan Qin

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative models that train on 3D…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Junlin Hao , Peiheng Wang , Haoyang Wang , Xinggong Zhang , Zongming Guo

While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed…

Recently, text-to-3D generation has attracted significant attention, resulting in notable performance enhancements. Previous methods utilize end-to-end 3D generation models to initialize 3D Gaussians, multi-view diffusion models to enforce…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Shuo Huang , Shikun Sun , Zixuan Wang , Xiaoyu Qin , Yanmin Xiong , Yuan Zhang , Pengfei Wan , Di Zhang , Jia Jia

The advent of Large Language Models (LLMs) and Generative AI has revolutionized natural language applications across various domains. However, high-stakes decision-making tasks in fields such as medical, legal and finance require a level of…

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…