中文
相关论文

相关论文: Demystifying Video Reasoning

200 篇论文

Generating realistic motions for digital humans is a core but challenging part of computer animations and games, as human motions are both diverse in content and rich in styles. While the latest deep learning approaches have made…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Ziyi Chang , Edmund J. C. Findlay , Haozheng Zhang , Hubert P. H. Shum

Latent reasoning has emerged as a promising paradigm for sequential recommendation, enabling models to capture complex user intent through multi-step deliberation. Yet existing approaches often rely on deterministic latent chains that…

信息检索 · 计算机科学 2026-02-13 Jie Jiang , Yang Wu , Qian Li , Yuling Xiong , Yihang Su , Junbang Huo , Longfei Lu , Jun Zhang , Huan Yu

Video grounding aims to localize the target moment in an untrimmed video corresponding to a given sentence query. Existing methods typically select the best prediction from a set of predefined proposals or directly regress the target span…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Xiao Liang , Tao Shi , Yaoyuan Liang , Te Tao , Shao-Lun Huang

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Kangfu Mei , Vishal M. Patel

The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision, with the diffusion model playing a crucial role in this achievement. Due to their impressive generative capabilities, diffusion models are…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Zhen Xing , Qijun Feng , Haoran Chen , Qi Dai , Han Hu , Hang Xu , Zuxuan Wu , Yu-Gang Jiang

Diffusion models have recently revolutionized the field of image synthesis due to their ability to generate photorealistic images. However, one of the major drawbacks of diffusion models is that the image generation process is costly. A…

Recent video generation models can produce smooth and visually appealing clips, but they often struggle to synthesize complex dynamics with a coherent chain of consequences. Accurately modeling visual outcomes and state transitions over…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Ziqi Huang , Ning Yu , Gordon Chen , Haonan Qiu , Paul Debevec , Ziwei Liu

Self-conditioning has been central to the success of continuous diffusion language models, as it allows models to correct previous errors. Yet its ability degrades precisely in the regime where diffusion is most attractive for deployment:…

计算与语言 · 计算机科学 2026-04-08 Dat Nguyen-Cong , Tung Kieu , Hoang Thanh-Tung

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

机器学习 · 计算机科学 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

计算与语言 · 计算机科学 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Match-cuts are powerful cinematic tools that create seamless transitions between scenes, delivering strong visual and metaphorical connections. However, crafting match-cuts is a challenging, resource-intensive process requiring deliberate…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Alejandro Pardo , Fabio Pizzati , Tong Zhang , Alexander Pondaven , Philip Torr , Juan Camilo Perez , Bernard Ghanem

Discrete diffusion models have recently shown significant progress in modeling complex data, such as natural languages and DNA sequences. However, unlike diffusion models for continuous data, which can generate high-quality samples in just…

机器学习 · 计算机科学 2025-03-20 Anji Liu , Oliver Broadrick , Mathias Niepert , Guy Van den Broeck

Video generation models hold substantial potential in areas such as filmmaking. However, current video diffusion models need high computational costs and produce suboptimal results due to extreme complexity of video generation task. In this…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Wenhao Li , Yichao Cao , Xiu Su , Xi Lin , Shan You , Mingkai Zheng , Yi Chen , Chang Xu

Modern video codecs and learning-based approaches struggle for semantic reconstruction at extremely low bit-rates due to reliance on low-level spatiotemporal redundancies. Generative models, especially diffusion models, offer a new paradigm…

图像与视频处理 · 电气工程与系统科学 2026-02-06 Maojun Zhang , Haotian Wu , Richeng Jin , Deniz Gunduz , Krystian Mikolajczyk

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

机器学习 · 计算机科学 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

机器学习 · 计算机科学 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

计算与语言 · 计算机科学 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue,…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Jingze Wu , Quan Zhang , Hongfei Suo , Zeqiang Cai , Hongbo Chen

Camera-controllable video generation aims to synthesize videos with flexible and physically plausible camera movements. However, existing methods either provide imprecise camera control from text prompts or rely on labor-intensive manual…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Haoyu Zhao , Zihao Zhang , Jiaxi Gu , Haoran Chen , Qingping Zheng , Pin Tang , Yeyin Jin , Yuang Zhang , Junqi Cheng , Zenghui Lu , Peng Shu , Zuxuan Wu , Yu-Gang Jiang