English
Related papers

Related papers: Diffusion-based Document Layout Generation

200 papers

Text-driven image and video diffusion models have recently achieved unprecedented generation realism. While diffusion models have been successfully applied for image editing, very few works have done so for video editing. We present the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Eyal Molad , Eliahu Horwitz , Dani Valevski , Alex Rav Acha , Yossi Matias , Yael Pritch , Yaniv Leviathan , Yedid Hoshen

Text-based motion generation models are drawing a surge of interest for their potential for automating the motion-making process in the game, animation, or robot industries. In this paper, we propose a diffusion-based motion synthesis and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Jihoon Kim , Jiseob Kim , Sungjoon Choi

Image stitching from different captures often results in non-rectangular boundaries, which is often considered unappealing. To solve non-rectangular boundaries, current solutions involve cropping, which discards image content, inpainting,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Tianhao Zhou , Haipeng Li , Ziyi Wang , Ao Luo , Chen-Lin Zhang , Jiajun Li , Bing Zeng , Shuaicheng Liu

Calculus and geometry are ubiquitous in the theoretical modelling of scientific phenomena, but have historically been very challenging to apply directly to real data as statistics. Diffusion geometry is a new theory that reformulates…

Differential Geometry · Mathematics 2026-02-09 Iolo Jones , David Lanners

Graph generation addresses the problem of generating new graphs that have a data distribution similar to real-world graphs. While previous diffusion-based graph generation methods have shown promising results, they often struggle to scale…

Machine Learning · Computer Science 2025-05-28 Tobias Bernecker , Ghalia Rehawi , Francesco Paolo Casale , Janine Knauer-Arloth , Annalisa Marsico

Generating high-quality labeled image datasets is crucial for training accurate and robust machine learning models in the field of computer vision. However, the process of manually labeling real images is often time-consuming and costly. To…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Michael Shenoda , Edward Kim

Diffusion models have emerged as a promising approach for text generation, with recent works falling into two main categories: discrete and continuous diffusion models. Discrete diffusion models apply token corruption independently using…

Computation and Language · Computer Science 2025-05-29 Bocheng Li , Zhujin Gao , Linli Xu

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

Text-driven human motion generation in computer vision is both significant and challenging. However, current methods are limited to producing either deterministic or imprecise motion sequences, failing to effectively control the temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Yin Wang , Zhiying Leng , Frederick W. B. Li , Shun-Cheng Wu , Xiaohui Liang

In-context segmentation has drawn increasing attention with the advent of vision foundation models. Its goal is to segment objects using given reference images. Most existing approaches adopt metric learning or masked image modeling to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chaoyang Wang , Xiangtai Li , Henghui Ding , Lu Qi , Jiangning Zhang , Yunhai Tong , Chen Change Loy , Shuicheng Yan

Diffusion models have demonstrated significant potential in achieving state-of-the-art performance across various text generation tasks. In this systematic study, we investigate their application to the table-to-text problem by adapting the…

Computation and Language · Computer Science 2024-09-24 Aleksei S. Krylov , Oleg D. Somov

Deep generative models learn the data distribution, which is concentrated on a low-dimensional manifold. The geometric analysis of distribution transformation provides a better understanding of data structure and enables a variety of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Junhao Chen , Manyi Li , Zherong Pan , Xifeng Gao , Changhe Tu

Diffusion models have marked a significant milestone in the enhancement of image and video generation technologies. However, generating videos that precisely retain the shape and location of moving objects such as robots remains a…

Robotics · Computer Science 2024-07-04 Peng Wang , Zhihao Guo , Abdul Latheef Sait , Minh Huy Pham

One of the most compelling features of global discrete diffusion language models is their global bidirectional contextual capability. However, existing block-based diffusion studies tend to introduce autoregressive priors, which, while…

Machine Learning · Computer Science 2026-01-22 Linrui Ma , Yufei Cui , Kai Han , Yunhe Wang

This paper introduces a diffusion-based planner for leader--follower formation control in cluttered environments. The diffusion policy is used to generate the trajectory of the midpoint of two leaders as a rigid bar in the plane, thereby…

Robotics · Computer Science 2026-01-19 Hieu Do Quang , Chien Truong-Quoc , Quoc Van Tran

We use hierarchical procedural rules for the generation of control maps within the stable diffusion framework to produce photo-realistic architectural facade images. Starting from a single input image and its segmentation, we apply an…

Graphics · Computer Science 2026-05-15 Aleksander Plocharski , Jan Swidzinski , Przemyslaw Musialski

Addressing decision-making problems using sequence modeling to predict future trajectories shows promising results in recent years. In this paper, we take a step further to leverage the sequence predictive method in wider areas such as…

Robotics · Computer Science 2023-12-07 Mineui Hong , Minjae Kang , Songhwai Oh

Recent diffusion-based generators can produce high-quality images from textual prompts. However, they often disregard textual instructions that specify the spatial layout of the composition. We propose a simple approach that achieves robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Minghao Chen , Iro Laina , Andrea Vedaldi

Conventional class-guided diffusion models generally succeed in generating images with correct semantic content, but often struggle with texture details. This limitation stems from the usage of class priors, which only provide coarse and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Xiaoyu Yue , Zidong Wang , Zeyu Lu , Shuyang Sun , Meng Wei , Wanli Ouyang , Lei Bai , Luping Zhou