中文
相关论文

相关论文: WISA: World Simulator Assistant for Physics-Aware …

200 篇论文

Recent breakthroughs in Vision-Language (V&L) joint research have achieved remarkable results in various text-driven tasks. High-quality Text-to-video (T2V), a task that has been long considered mission-impossible, was proven feasible with…

人工智能 · 计算机科学 2022-11-28 Yuxing Qiu , Feng Gao , Minchen Li , Govind Thattai , Yin Yang , Chenfanfu Jiang

Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evaluation standards predominantly focus on image realism and shallow text-image alignment, lacking a…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Yuwei Niu , Munan Ning , Mengren Zheng , Weiyang Jin , Bin Lin , Peng Jin , Jiaqi Liao , Chaoran Feng , Kunpeng Ning , Bin Zhu , Li Yuan

While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Mingxin Liu , Shuran Ma , Shibei Meng , Xiangyu Zhao , Zicheng Zhang , Shaofeng Zhang , Zhihang Zhong , Peixian Chen , Haoyu Cao , Xing Sun , Haodong Duan , Xue Yang

Recent advancements in text-to-video (T2V) diffusion models have enabled high-fidelity and realistic video synthesis. However, current T2V models often struggle to generate physically plausible content due to their limited inherent ability…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Xiangdong Zhang , Jiaqi Liao , Shaofeng Zhang , Fanqing Meng , Xiangpeng Wan , Junchi Yan , Yu Cheng

Driven by the growing capacity and training scale, Text-to-Video (T2V) generation models have recently achieved substantial progress in video quality, length, and instruction-following capability. However, whether these models can…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Zeqing Wang , Keze Wang , Lei Zhang

Generative AI models, particularly Text-to-Video (T2V) systems, offer a promising avenue for transforming science education by automating the creation of engaging and intuitive visual explanations. In this work, we take a first step toward…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Megha Mariam K. M , Aditya Arun , Zakaria Laskar , C. V. Jawahar

Video-based spatial cognition is vital for robotics and embodied AI but challenges current Vision-Language Models (VLMs). This paper makes two key contributions. First, we introduce ViCA (Visuospatial Cognitive Assistant)-322K, a diverse…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Qi Feng

Text-to-video (T2V) models like Sora have made significant strides in visualizing complex prompts, which is increasingly viewed as a promising path towards constructing the universal world simulator. Cognitive psychologists believe that the…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Fanqing Meng , Jiaqi Liao , Xinyu Tan , Wenqi Shao , Quanfeng Lu , Kaipeng Zhang , Yu Cheng , Dianqi Li , Yu Qiao , Ping Luo

Text-to-video generative models have made significant strides in recent years, producing high-quality videos that excel in both aesthetic appeal and accurate instruction following, and have become central to digital art creation and user…

机器学习 · 计算机科学 2025-05-02 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

Autonomous driving requires robust perception models trained on high-quality, large-scale multi-view driving videos for tasks like 3D object detection, segmentation and trajectory prediction. While world models provide a cost-effective…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Zhuoran Yang , Xi Guo , Chenjing Ding , Chiyu Wang , Wei Wu

Interactive world models that simulate object dynamics are crucial for robotics, VR, and AR. However, it remains a significant challenge to learn physics-consistent dynamics models from limited real-world video data, especially for…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Yu Yang , Zhilu Zhang , Xiang Zhang , Yihan Zeng , Hui Li , Wangmeng Zuo

Recent advances in Video-to-Audio (V2A) generation have achieved impressive perceptual quality and temporal synchronization, yet most models remain appearance-driven, capturing visual-acoustic correlations without considering the physical…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Oh Hyun-Bin , Yuhta Takida , Toshimitsu Uesaka , Tae-Hyun Oh , Yuki Mitsufuji

This is a short technical report describing the winning entry of the PhysicsIQ Challenge, presented at the Perception Test Workshop at ICCV 2025. State-of-the-art video generative models exhibit severely limited physical understanding, and…

We introduce [Cosmos-Predict2.5], the latest generation of the Cosmos World Foundation Models for Physical AI. Built on a flow-based architecture, [Cosmos-Predict2.5] unifies Text2World, Image2World, and Video2World generation in a single…

Text-to-video (T2V) models have shown remarkable performance in generating visually reasonable scenes, while their capability to leverage world knowledge for ensuring semantic consistency and factual accuracy remains largely understudied.…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Yubin Chen , Xuyang Guo , Zhenmei Shi , Zhao Song , Jiahao Zhang

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

Training AI agents to proactively assist humans in daily activities, from routine household tasks to urgent safety situations, requires large-scale visual data. However, capturing such scenarios in the real world is often difficult, costly,…

计算与语言 · 计算机科学 2026-05-12 Yu-Hsiang Liu , Yu-Chien Tang , An-Zi Yen

Despite thousands of researchers, engineers, and artists actively working on improving text-to-image generation models, systems often fail to produce images that accurately align with the text inputs. We introduce TIFA (Text-to-Image…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yushi Hu , Benlin Liu , Jungo Kasai , Yizhong Wang , Mari Ostendorf , Ranjay Krishna , Noah A Smith

Video generative models pre-trained on large-scale internet datasets have achieved remarkable success, excelling at producing realistic synthetic videos. However, they often generate clips based on static prompts (e.g., text or images),…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Haoran He , Yang Zhang , Liang Lin , Zhongwen Xu , Ling Pan

Video generation models have shown strong potential as world models for autonomous driving simulation. However, existing approaches are primarily trained on real-world driving datasets, which mostly contain natural and safe driving…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Jiawei Zhou , Zhenxin Zhu , Lingyi Du , Linye Lyu , Lijun Zhou , Zhanqian Wu , Hongcheng Luo , Zhuotao Tian , Bing Wang , Guang Chen , Hangjun Ye , Haiyang Sun , Yu Li
‹ 上一页 1 2 3 10 下一页 ›