English
Related papers

Related papers: RecipeGen: A Step-Aligned Multimodal Benchmark for…

200 papers

People enjoy food photography because they appreciate food. Behind each meal there is a story described in a complex recipe and, unfortunately, by simply looking at a food image we do not have access to its preparation process. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Amaia Salvador , Michal Drozdzal , Xavier Giro-i-Nieto , Adriana Romero

Many high-level procedural tasks can be decomposed into sequences of instructions that vary in their order and choice of tools. In the cooking domain, the web offers many partially-overlapping text and video recipes (i.e. procedures) that…

Computation and Language · Computer Science 2020-05-20 Angela S. Lin , Sudha Rao , Asli Celikyilmaz , Elnaz Nouri , Chris Brockett , Debadeepta Dey , Bill Dolan

Food is significant to human daily life. In this paper, we are interested in learning structural representations for lengthy recipes, that can benefit the recipe generation and food cross-modal retrieval tasks. Different from the common…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

While text-to-video (T2V) generation has achieved remarkable progress in photorealism, generating intent-aligned videos that faithfully obey physics principles remains a core challenge. In this work, we systematically study Newtonian…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xiangyu Bai , He Liang , Bishoy Galoaa , Utsav Nandi , Shayda Moezzi , Yuhang He , Sarah Ostadabbas

Cooking is a sequential and visually grounded activity, where each step such as chopping, mixing, or frying carries both procedural logic and visual semantics. While recent diffusion models have shown strong capabilities in text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Ruoxuan Zhang , Bin Wen , Hongxia Xie , Yi Yao , Songhan Zuo , Jian-Yu Jiang-Lin , Hong-Han Shuai , Wen-Huang Cheng

Despite the significant advancements in text-to-image (T2I) generative models, users often face a trial-and-error challenge in practical scenarios. This challenge arises from the complexity and uncertainty of tedious steps such as crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Chengyou Jia , Changliang Xia , Zhuohang Dang , Weijia Wu , Hangwei Qian , Minnan Luo

Direct computer vision based-nutrient content estimation is a demanding task, due to deformation and occlusions of ingredients, as well as high intra-class and low inter-class variability between meal classes. In order to tackle these…

Information Retrieval · Computer Science 2019-11-06 Matthias Fontanellaz , Stergios Christodoulidis , Stavroula Mougiakakou

Exams are a fundamental test of expert-level intelligence and require integrated understanding, reasoning, and generation. Existing exam-style benchmarks mainly focus on understanding and reasoning tasks, and current generation benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhaokai Wang , Penghao Yin , Xiangyu Zhao , Changyao Tian , Yu Qiao , Wenhai Wang , Jifeng Dai , Gen Luo

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

Text-to-image (T2I) generation has made remarkable progress in producing high-quality images, but a fundamental challenge remains: creating backgrounds that naturally accommodate text placement without compromising image quality. This…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Tianyi Liang , Jiangqi Liu , Yifei Huang , Shiqi Jiang , Jianshen Shi , Changbo Wang , Chenhui Li

Text-to-video generative models have made significant strides in recent years, producing high-quality videos that excel in both aesthetic appeal and accurate instruction following, and have become central to digital art creation and user…

Machine Learning · Computer Science 2025-05-02 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

Image editing models are advancing rapidly, yet comprehensive evaluation remains a significant challenge. Existing image editing benchmarks generally suffer from limited task scopes, insufficient evaluation dimensions, and heavy reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Juntong Wang , Jiarui Wang , Huiyu Duan , Jiaxiang Kang , Guangtao Zhai , Xiongkuo Min

With the rapid advancement of image-to-video (I2V) generation models, their potential for misuse in creating malicious content has become a significant concern. For instance, a single image can be exploited to generate a fake video, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Xiaofeng Li , Leyi Sheng , Zhen Sun , Zongmin Zhang , Jiaheng Wei , Xinlei He

Text-to-video (T2V) generation has rapidly progressed in visual fidelity, yet its ability to faithfully represent multiple cultures within a single prompt remains underexplored. We introduce MAVEN, a multi-agent prompt refinement framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Shuowei Li , Yuming Zhao , Parth Bhalerao , Oana Ignat

Video generation models have significantly advanced embodied intelligence, unlocking new possibilities for generating diverse robot data that capture perception, reasoning, and action in the physical world. However, synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufan Deng , Zilin Pan , Hongyu Zhang , Xiaojie Li , Ruoqing Hu , Yufei Ding , Yiming Zou , Yan Zeng , Daquan Zhou

Text-to-image (T2I) models have garnered significant attention for generating high-quality images aligned with text prompts. However, rapid T2I model advancements reveal limitations in early benchmarks, lacking comprehensive evaluations,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jingjing Chang , Yixiao Fang , Peng Xing , Shuhan Wu , Wei Cheng , Rui Wang , Xianfang Zeng , Gang Yu , Hai-Bao Chen

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Online reviews in the form of user-generated content (UGC) significantly impact consumer decision-making. However, the pervasive issue of not only human fake content but also machine-generated content challenges UGC's reliability. Recent…

Machine Learning · Computer Science 2024-01-18 Alessandro Gambetti , Qiwei Han

The rapid advancements of Text-to-Image (T2I) models have ushered in a new phase of AI-generated content, marked by their growing ability to interpret and follow user instructions. However, existing T2I model evaluation benchmarks fall…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinyu Wei , Jinrui Zhang , Zeqing Wang , Hongyang Wei , Zhen Guo , Lei Zhang