English
Related papers

Related papers: DisCo-Layout: Disentangling and Coordinating Seman…

200 papers

Character video synthesis aims to produce realistic videos of animatable characters within lifelike scenes. As a fundamental problem in the computer vision and graphics community, 3D works typically require multi-view captures for per-case…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yifang Men , Yuan Yao , Miaomiao Cui , Liefeng Bo

Fine-tuning Vision-Language Models (VLMs) is a common strategy to improve performance following an ad-hoc data collection and annotation of real-world scenes. However, this process is often prone to biases, errors, and distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Massimo Rizzoli , Simone Alghisi , Seyed Mahed Mousavi , Giuseppe Riccardi

Recent text-to-image diffusion models have reached an unprecedented level in generating high-quality images. However, their exclusive reliance on textual prompts often falls short in precise control of image compositions. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Peiang Zhao , Han Li , Ruiyang Jin , S. Kevin Zhou

With its significant performance improvements, the deep learning paradigm has become a standard tool for modern image denoisers. While promising performance has been shown on seen noise distributions, existing approaches often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hao Chen , Chenyuan Qu , Yu Zhang , Chen Chen , Jianbo Jiao

Existing Multimodal Large Language Models (MLLMs) suffer from increased inference costs due to the additional vision tokens introduced by image inputs. In this work, we propose Visual Consistency Learning (ViCO), a novel training algorithm…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Long Cui , Weiyun Wang , Jie Shao , Zichen Wen , Gen Luo , Linfeng Zhang , Yanting Zhang , Yu Qiao , Wenhai Wang

Our project page: https://scutyklin.github.io/SceneLCM/. Automated generation of complex, interactive indoor scenes tailored to user prompt remains a formidable challenge. While existing methods achieve indoor scene synthesis, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yangkai Lin , Jiabao Lei , Kui Jia

Existing 3D-aware image synthesis approaches mainly focus on generating a single canonical object and show limited capacity in composing a complex scene containing a variety of objects. This work presents DisCoScene: a 3Daware generative…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Yinghao Xu , Menglei Chai , Zifan Shi , Sida Peng , Ivan Skorokhodov , Aliaksandr Siarohin , Ceyuan Yang , Yujun Shen , Hsin-Ying Lee , Bolei Zhou , Sergey Tulyakov

Layout-to-image synthesis is an emerging technique in conditional image generation. It aims to generate complex scenes, where users require fine control over the layout of the objects in a scene. However, it remains challenging to control…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yibin Wang , Changhai Zhou , Honghui Xu

Dense 3D shape correspondence remains a central challenge in computer vision and graphics as many deep learning approaches still rely on intermediate geometric features or handcrafted descriptors, limiting their effectiveness under…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Maolin Gao , Shao Jie Hu-Chen , Congyue Deng , Riccardo Marin , Leonidas Guibas , Daniel Cremers

Recently, neural implicit surfaces have become popular for multi-view reconstruction. To facilitate practical applications like scene editing and manipulation, some works extend the framework with semantic masks input for the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Zizhang Li , Xiaoyang Lyu , Yuanyuan Ding , Mengmeng Wang , Yiyi Liao , Yong Liu

Recent DiT-based text-to-image models increasingly adopt LLMs as text encoders, yet text conditioning remains largely static and often utilizes only a single LLM layer, despite pronounced semantic hierarchy across LLM layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Bozhou Li , Yushuo Guan , Haolin Li , Bohan Zeng , Yiyan Ji , Yue Ding , Pengfei Wan , Kun Gai , Yuanxing Zhang , Wentao Zhang

Existing text-to-image models often rely on parameter fine-tuning techniques such as Low-Rank Adaptation (LoRA) to customize visual attributes. However, when combining multiple LoRA models for content-style fusion tasks, unstructured…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jiahui Yang , Yongjia Ma , Donglin Di , Hao Li , Wei Chen , Yan Xie , Jianxun Cui , Xun Yang , Wangmeng Zuo

We introduce a method to generate 3D scenes that are disentangled into their component objects. This disentanglement is unsupervised, relying only on the knowledge of a large pretrained text-to-image model. Our key insight is that objects…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Dave Epstein , Ben Poole , Ben Mildenhall , Alexei A. Efros , Aleksander Holynski

While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains challenging, particularly in maintaining multi-view consistency. Classical approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yufeng Chi , Huimin Ma , Kafeng Wang , Jianmin Li

Reasoning Segmentation (RS) is a multimodal vision-text task that requires segmenting objects based on implicit text queries, demanding both precise visual perception and vision-text reasoning capabilities. Current RS approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yizhen Li , Dell Zhang , Xuelong Li , Yiqing Shen

Neural operators (NOs) excel at learning mappings between function spaces, serving as efficient forward solution approximators for PDE-governed systems. However, as black-box solvers, they offer limited insight into the underlying physical…

Machine Learning · Computer Science 2026-02-10 Ning Liu , Lu Zhang , Tian Gao , Yue Yu

A major bottleneck in search-based program synthesis is the exponentially growing search space which makes learning large programs intractable. Humans mitigate this problem by leveraging the compositional nature of the real world: In…

Artificial Intelligence · Computer Science 2024-12-25 Jonas Witt , Sebastijan Dumančić , Tias Guns , Claus-Christian Carbon

Text-to-image person re-identification (TIReID) aims to retrieve person images from a large gallery given free-form textual descriptions. TIReID is challenging due to the substantial modality gap between visual appearances and textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Giyeol Kim , Chanho Eom

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Autonomous 3D indoor scene synthesis breaks down in non-convex rooms with tightly coupled spatial constraints. Data-driven generators lack topological priors for long-horizon planning, while iterative agents fragment semantics and become…

Robotics · Computer Science 2026-05-05 Meisheng Zhang , Shizhao Sun , Yang Zhao , Ziyuan Liu , Zhijun Gao , Jiang Bian