English
Related papers

Related papers: MAVEN A Multi-Agent Framework for Multicultural Te…

200 papers

Text-to-image (T2I) generative models achieve impressive visual fidelity but inherit and amplify demographic imbalances and cultural biases embedded in training data. We introduce T2I-BiasBench, a unified evaluation framework of thirteen…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Nihal Jaiswal , Siddhartha Arjaria , Gyanendra Chaubey , Ankush Kumar , Aditya Singh , Anchal Chaurasiya

Video generation is an inherently challenging task, as it requires modeling realistic temporal dynamics as well as spatial content. Existing methods entangle the two intrinsically different tasks of motion and content creation in a single…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Ximeng Sun , Huijuan Xu , Kate Saenko

Humans often specify and create through visual artifacts: typography sheets, sketches, reference images, and annotated scenes. Yet modern visual generators still ask users to serialize this intent into text, a bottleneck that compresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaofang Liu , Kangning Cui , Meng Chu , Zhaoqing Li , Suiyun Zhang , Jean-Michel Morel , Xiaodong Cun , Haoxuan Che , Rui Liu , Raymond H. Chan

We propose a zero-shot approach for generating consistent videos of animated characters based on Text-to-Image (T2I) diffusion models. Existing Text-to-Video (T2V) methods are expensive to train and require large-scale video datasets to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Abdelrahman Eldesokey , Peter Wonka

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

Text to image generation methods (T2I) are widely popular in generating art and other creative artifacts. While visual hallucinations can be a positive factor in scenarios where creativity is appreciated, such artifacts are poorly suited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Rodrigo Valerio , Joao Bordalo , Michal Yarom , Yonatan Bitton , Idan Szpektor , Joao Magalhaes

Despite rapid advances in text-to-video synthesis, generated video quality remains critically dependent on precise user prompts. Existing test-time optimization methods, successful in other domains, struggle with the multi-faceted nature of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Do Xuan Long , Xingchen Wan , Hootan Nakhost , Chen-Yu Lee , Tomas Pfister , Sercan Ö. Arık

Text-to-video generation has been dominated by diffusion-based or autoregressive models. These novel models provide plausible versatility, but are criticized for improper physical motion, shading and illumination, camera motion, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liu He , Yizhi Song , Hejun Huang , Pinxin Liu , Yunlong Tang , Daniel Aliaga , Xin Zhou

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Text-to-Video (T2V) models are capable of synthesizing high-quality, temporally coherent dynamic video content, but the diverse generation also inherently introduces critical safety challenges. Existing safety evaluation methods,which focus…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jiaming He , Guanyu Hou , Hongwei Li , Zhicong Huang , Kangjie Chen , Yi Yu , Wenbo Jiang , Guowen Xu , Tianwei Zhang

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Creating recipe images is a key challenge in food computing, with applications in culinary education and multimodal recipe assistants. However, existing datasets lack fine-grained alignment between recipe goals, step-wise instructions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ruoxuan Zhang , Jidong Gao , Bin Wen , Hongxia Xie , Chenming Zhang , Hong-Han Shuai , Wen-Huang Cheng

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee

Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos remains limited. Existing approaches typically concatenate multiple videos into a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Zhang , Liqiang Jing , Jia Li , Yapeng Tian , Xinya Du , Yunhui Guo , Vibhav Gogate

Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content. However, many existing methods rely on feeding frame-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Noriyuki Kugo , Xiang Li , Zixin Li , Ashish Gupta , Arpandeep Khatua , Nidhish Jain , Chaitanya Patel , Yuta Kyuragi , Yasunori Ishii , Masamoto Tanabiki , Kazuki Kozuka , Ehsan Adeli

Text-to-video generation has significantly enriched content creation and holds the potential to evolve into powerful world simulators. However, modeling the vast spatiotemporal space remains computationally demanding, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Jiancheng Huang , Gengwei Zhang , Zequn Jie , Siyu Jiao , Yinlong Qian , Ling Chen , Yunchao Wei , Lin Ma

The unsupervised training of GANs and VAEs has enabled them to generate realistic images mimicking real-world distributions and perform image-based unsupervised clustering or semi-supervised classification. Combining the power of these two…

Machine Learning · Computer Science 2019-06-18 Abdullah-Al-Zubaer Imran , Demetri Terzopoulos

Recent advances in video generation have been remarkable, enabling models to produce visually compelling videos with synchronized audio. While existing video generation benchmarks provide comprehensive metrics for visual quality, they lack…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Daili Hua , Xizhi Wang , Bohan Zeng , Xinyi Huang , Hao Liang , Junbo Niu , Xinlong Chen , Quanqing Xu , Wentao Zhang

Text-to-multiview (T2MV) diffusion models have shown great promise in generating multiple views of a scene from a single text prompt. While few-step backbones enable real-time T2MV generation, they often compromise key aspects of generation…

Machine Learning · Computer Science 2026-03-18 Ziyi Zhang , Li Shen , Deheng Ye , Yong Luo , Huangxuan Zhao , Meng Liu , Wei Yu , Lefei Zhang

Text-Image-to-Video (TI2V) generation aims to generate a video from an image following a text description, which is also referred to as text-guided image animation. Most existing methods struggle to generate videos that align well with the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shijie Wang , Samaneh Azadi , Rohit Girdhar , Saketh Rambhatla , Chen Sun , Xi Yin