English
Related papers

Related papers: Causally Steered Diffusion for Automated Video Cou…

200 papers

Recent methods in flow-based diffusion editing have enabled direct transformations between source and target image distribution without explicit inversion. However, the latent trajectories in these methods often exhibit accumulated velocity…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Zixiang Li , Yue Song , Jianing Peng , Ting Liu , Jun Huang , Xiaochao Qu , Luoqi Liu , Wei Wang , Yao Zhao , Yunchao Wei

Instructional video editing applies edits to an input video using only text prompts, enabling intuitive natural-language control. Despite rapid progress, most methods still require fixed-length inputs and substantial compute. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mohammadreza Salehi , Mehdi Noroozi , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Alberto Gil Ramos , Abhinav Mehrotra

Recent advances in motion diffusion models have substantially improved the realism of human motion synthesis. However, existing approaches either rely on full-sequence diffusion models with bidirectional generation, which limits temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Qing Yu , Akihisa Watanabe , Kent Fujiwara

Prompt learning has garnered attention for its efficiency over traditional model training and fine-tuning. However, existing methods, constrained by inadequate theoretical foundations, encounter difficulties in achieving causally invariant…

Artificial Intelligence · Computer Science 2025-07-29 Xinshu Li , Ruoyu Wang , Erdun Gao , Mingming Gong , Lina Yao

Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Chen Zhao , Feng Chen , Xintao Wu

Conditional image-to-video (cI2V) generation aims to synthesize a new plausible video starting from an image (e.g., a person's face) and a condition (e.g., an action class label like smile). The key challenge of the cI2V task lies in the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Haomiao Ni , Changhao Shi , Kai Li , Sharon X. Huang , Martin Renqiang Min

Counterfactual image generation presents significant challenges, including preserving identity, maintaining perceptual quality, and ensuring faithfulness to an underlying causal model. While existing auto-encoding frameworks admit semantic…

Machine Learning · Computer Science 2025-06-10 Rajat Rasal , Avinash Kori , Fabio De Sousa Ribeiro , Tian Xia , Ben Glocker

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

Predicting counterfactual outcomes in longitudinal data, where sequential treatment decisions heavily depend on evolving patient states, is critical yet notoriously challenging due to complex time-dependent confounding and inadequate…

Machine Learning · Statistics 2026-04-15 Farbod Alinezhad , Jianfei Cao , Gary J. Young , Brady Post

Text-conditioned diffusion models have emerged as a promising tool for neural video generation. However, current models still struggle with intricate spatiotemporal prompts and often generate restricted or incorrect motion. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Long Lian , Baifeng Shi , Adam Yala , Trevor Darrell , Boyi Li

Predicting counterfactual distributions in complex dynamical systems is essential for scientific modeling and decision-making in domains such as public health and medicine. However, existing methods often rely on point estimates or purely…

Machine Learning · Computer Science 2025-09-15 Wenhao Mu , Zhi Cao , Mehmed Uludag , Alexander Rodríguez

Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation process is an important goal moving forward and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhengfei Kuang , Shengqu Cai , Hao He , Yinghao Xu , Hongsheng Li , Leonidas Guibas , Gordon Wetzstein

Video-language models (VLMs) achieve strong multimodal understanding but remain prone to hallucinations, especially when reasoning about actions and temporal order. Existing mitigation strategies, such as textual filtering or random video…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Tobia Poppi , Burak Uzkent , Amanmeet Garg , Lucas Porto , Garin Kessler , Yezhou Yang , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara , Florian Schiffers

We consider the problem of answering observational, interventional, and counterfactual queries in a causally sufficient setting where only observational data and the causal graph are available. Utilizing the recent developments in diffusion…

Machine Learning · Statistics 2024-10-11 Patrick Chao , Patrick Blöbaum , Sapan Patel , Shiva Prasad Kasiviswanathan

We present Causal-Adapter, a modular framework that adapts frozen text-to-image diffusion backbones for counterfactual image generation. Our method supports causal interventions on target attributes and consistently propagates their effects…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Lei Tong , Zhihua Liu , Chaochao Lu , Dino Oglic , Tom Diethe , Philip Teare , Sotirios A. Tsaftaris , Chen Jin

Causal generative modeling is essential for developing reliable and transparent AI systems capable of counterfactual reasoning. While existing approaches focus on integrating causal constraints during the training of generative models, they…

Machine Learning · Computer Science 2026-05-25 Aneesh Komanduri , Xintao Wu

Conventional supervised learning methods, especially deep ones, are found to be sensitive to out-of-distribution (OOD) examples, largely because the learned representation mixes the semantic factor with the variation factor due to their…

Machine Learning · Statistics 2021-11-02 Chang Liu , Xinwei Sun , Jindong Wang , Haoyue Tang , Tao Li , Tao Qin , Wei Chen , Tie-Yan Liu

Diffusion models have emerged as a powerful paradigm in video synthesis tasks including prediction, generation, and interpolation. Due to the limitation of the computational budget, existing methods usually implement conditional diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Siyuan Yang , Lu Zhang , Yu Liu , Zhizhuo Jiang , You He

Causality -- referring to temporal, uni-directional cause-effect relationships between components -- underlies many complex generative processes, including videos, language, and robot trajectories. Current causal diffusion models entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Xingjian Bai , Guande He , Zhengqi Li , Eli Shechtman , Xun Huang , Zongze Wu

Video-based AI systems are increasingly adopted in safety-critical domains such as autonomous driving and healthcare. However, interpreting their decisions remains challenging due to the inherent spatiotemporal complexity of video data and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Payal Varshney , Adriano Lucieri , Christoph Balada , Sheraz Ahmed , Andreas Dengel
‹ Prev 1 2 3 10 Next ›