English

GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification

Computer Vision and Pattern Recognition 2026-03-25 v2

Abstract

Video Motion Magnification (VMM) amplifies subtle macroscopic motions to a perceptible level. Recently, existing mainstream Eulerian approaches address amplification-induced noise via decoupling representation learning such as texture, shape and frequency schemes, but they still struggle to mitigate the interference of photon noise on true micro-motion when motion displacements are very small. We propose GeoDiffMM, a novel diffusion-based Lagrangian VMM framework conditioned on optical flow as a geometric cue, enabling structurally consistent motion magnification. Specifically, we design a Noise-Free Optical Flow Augmentation strategy that synthesizes diverse nonrigid motion fields without photon noise as supervision, helping the model learn more accurate geometry-aware optical flow and generalize better. Next, we develop a Diffusion Motion Magnifier that conditions the denoising process on (i) optical flow as a geometry prior and (ii) a learnable magnification factor controlling magnitude, thereby selectively amplifying motion components consistent with scene semantics and structure. Finally, we perform Flow-based Video Synthesis to map the amplified motion back to the image domain with high fidelity. Extensive experiments on real and synthetic datasets show that GeoDiffMM outperforms state-of-the-art methods and significantly improves motion magnification.

Keywords

Cite

@article{arxiv.2512.08325,
  title  = {GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification},
  author = {Xuedeng Liu and Jiabao Guo and Zheng Zhang and Fei Wang and Zhi Liu and Dan Guo},
  journal= {arXiv preprint arXiv:2512.08325},
  year   = {2026}
}
R2 v1 2026-07-01T08:16:21.800Z