English

Artistic Intelligence: A Diffusion-Based Framework for High-Fidelity Landscape Painting Synthesis

Computer Vision and Pattern Recognition 2024-10-14 v4

Abstract

Generating high-fidelity landscape paintings remains a challenging task that requires precise control over both structure and style. In this paper, we present LPGen, a novel diffusion-based model specifically designed for landscape painting generation. LPGen introduces a decoupled cross-attention mechanism that independently processes structural and stylistic features, effectively mimicking the layered approach of traditional painting techniques. Additionally, LPGen proposes a structural controller, a multi-scale encoder designed to control the layout of landscape paintings, striking a balance between aesthetics and composition. Besides, the model is pre-trained on a curated dataset of high-resolution landscape images, categorized by distinct artistic styles, and then fine-tuned to ensure detailed and consistent output. Through extensive evaluations, LPGen demonstrates superior performance in producing paintings that are not only structurally accurate but also stylistically coherent, surpassing current state-of-the-art models. This work advances AI-generated art and offers new avenues for exploring the intersection of technology and traditional artistic practices. Our code, dataset, and model weights will be publicly available.

Keywords

Cite

@article{arxiv.2407.17229,
  title  = {Artistic Intelligence: A Diffusion-Based Framework for High-Fidelity Landscape Painting Synthesis},
  author = {Wanggong Yang and Yifei Zhao},
  journal= {arXiv preprint arXiv:2407.17229},
  year   = {2024}
}
R2 v1 2026-06-28T17:52:17.539Z