中文
相关论文

相关论文: Semantics Lead the Way: Harmonizing Semantic and T…

200 篇论文

The rapid evolution of the fashion industry increasingly intersects with technological advancements, particularly through the integration of generative AI. This study introduces a novel generative pipeline designed to transform the fashion…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Abhishek Kumar Singh , Ioannis Patras

Deep learning (DL)-based Semantic Communications (SemCom) is becoming critical to maximize overall efficiency of communication networks. Nevertheless, SemCom is sensitive to wireless channel uncertainties, source outliers, and suffer from…

机器学习 · 计算机科学 2025-02-18 Jianhua Pei , Cheng Feng , Ping Wang , Hina Tabassum , Dongyuan Shi

Diffusion models has emerged as a powerful framework for tasks like image controllable generation and dense prediction. However, existing models often struggle to capture underlying semantics (e.g., edges, textures, shapes) and effectively…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Zhong Ji , Weilong Cao , Yan Zhang , Yanwei Pang , Jungong Han , Xuelong Li

Current subject-driven image generation methods encounter significant challenges in person-centric image generation. The reason is that they learn the semantic scene and person generation by fine-tuning a common pre-trained diffusion, which…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Yibin Wang , Weizhong Zhang , Jianwei Zheng , Cheng Jin

The Diffusion Model has not only garnered noteworthy achievements in the realm of image generation but has also demonstrated its potential as an effective pretraining method utilizing unlabeled data. Drawing from the extensive potential…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Muzhi Zhu , Yang Liu , Zekai Luo , Chenchen Jing , Hao Chen , Guangkai Xu , Xinlong Wang , Chunhua Shen

Previous efforts have managed to generate production-ready 3D assets from text or images. However, these methods primarily employ NeRF or 3D Gaussian representations, which are not adept at producing smooth, high-quality geometries required…

图形学 · 计算机科学 2024-10-15 Rengan Xie , Wenting Zheng , Kai Huang , Yizheng Chen , Qi Wang , Qi Ye , Wei Chen , Yuchi Huo

Diffusion models face a fundamental trade-off between generation quality and computational efficiency. Latent Diffusion Models (LDMs) offer an efficient solution but suffer from potential information loss and non-end-to-end training. In…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Zhennan Chen , Junwei Zhu , Xu Chen , Jiangning Zhang , Xiaobin Hu , Hanzhen Zhao , Chengjie Wang , Jian Yang , Ying Tai

We introduce Lavender, a simple supervised fine-tuning (SFT) method that boosts the performance of advanced vision-language models (VLMs) by leveraging state-of-the-art image generation models such as Stable Diffusion. Specifically,…

机器学习 · 计算机科学 2025-05-27 Chen Jin , Ryutaro Tanno , Amrutha Saseendran , Tom Diethe , Philip Teare

Feature Transformation (FT) crafts new features from original ones via mathematical operations to enhance dataset expressiveness for downstream models. However, existing FT methods exhibit critical limitations: discrete search struggles…

机器学习 · 计算机科学 2025-05-22 Nanxu Gong , Zijun Li , Sixun Dong , Haoyue Bai , Wangyang Ying , Xinyuan Wang , Yanjie Fu

Textile pattern generation (TPG) aims to synthesize fine-grained textile pattern images based on given clothing images. Although previous studies have not explicitly investigated TPG, existing image-to-image models appear to be natural…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Chenggong Hu , Yi Wang , Mengqi Xue , Haofei Zhang , Jie Song , Li Sun

Diffusion language models intrinsically fail to capture correlations between decoded tokens, which leads to a harsh trade-off between sampling quality and throughput. To solve this issue, we propose DiLaDiff, a variant of masked diffusion…

机器学习 · 计算机科学 2026-05-25 Jean-Marie Lemercier , Tomas Geffner , Karsten Kreis , Morteza Mardani , Arash Vahdat , Ante Jukić

Semantic image synthesis (SIS) is a task to generate realistic images corresponding to semantic maps (labels). However, in real-world applications, SIS often encounters noisy user inputs. To address this, we propose Stochastic Conditional…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Juyeon Ko , Inho Kong , Dogyun Park , Hyunwoo J. Kim

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

Large Language Diffusion Models (LLDMs) benefit from a flexible decoding mechanism that enables parallelized inference and controllable generations over autoregressive models. Yet such flexibility introduces a critical challenge: inference…

机器学习 · 计算机科学 2025-12-05 Yichuan Mo , Quan Chen , Mingjie Li , Zeming Wei , Yisen Wang

We present SemLayoutDiff, a unified model for synthesizing diverse 3D indoor scenes across multiple room types. The model introduces a scene layout representation combining a top-down semantic map and attributes for each object. Unlike…

图形学 · 计算机科学 2025-09-09 Xiaohao Sun , Divyam Goel , Angel X. Chang

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…

Diffusion large language models (dLLMs) offer a promising paradigm for parallel text generation, but in practice they face an accuracy-parallelism trade-off, where increasing tokens per forward (TPF) often degrades generation quality.…

计算与语言 · 计算机科学 2026-05-12 Haoyang Zhou , Li Kong , Shijie Ren , Xiting Wang , Shuang Liang , Guowei Wang , Zhenxuan Pan

Recent advancements in text-to-video (T2V) generation have been driven by two competing paradigms: autoregressive language models and diffusion models. However, each paradigm has intrinsic limitations: language models struggle with visual…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Aoxiong Yin , Kai Shen , Yichong Leng , Xu Tan , Xinyu Zhou , Juncheng Li , Siliang Tang

Latent space is one of the key concepts in generative AI, offering powerful means for creative exploration through vector manipulation. However, diffusion models like Stable Diffusion lack the intuitive latent vector control found in GANs,…

机器学习 · 计算机科学 2025-09-29 Zhihua Zhong , Xuanyang Huang

Recent advancements in text-to-image diffusion models have yielded impressive results in generating realistic and diverse images. However, these models still struggle with complex prompts, such as those that involve numeracy and spatial…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Long Lian , Boyi Li , Adam Yala , Trevor Darrell