English
Related papers

Related papers: RecipeGen: A Benchmark for Real-World Recipe Image…

200 papers

Research on text-to-image generation has witnessed significant progress in generating diverse and photo-realistic images, driven by diffusion and auto-regressive models trained on large-scale image-text data. Though state-of-the-art models…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Wenhu Chen , Hexiang Hu , Chitwan Saharia , William W. Cohen

We introduce a new dataset of 293,008 high definition (1360 x 1360 pixels) fashion images paired with item descriptions provided by professional stylists. Each item is photographed from a variety of angles. We provide baseline results on 1)…

Recipe personalization through ingredient substitution has the potential to help people meet their dietary needs and preferences, avoid potential allergens, and ease culinary exploration in everyone's kitchen. To address ingredient…

Machine Learning · Computer Science 2023-02-17 Bahare Fatemi , Quentin Duval , Rohit Girdhar , Michal Drozdzal , Adriana Romero-Soriano

Recognizing food images presents unique challenges due to the variable spatial layout and shape changes of ingredients with different cooking and cutting methods. This study introduces an advanced approach for recognizing ingredients…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Kun Fu , Ying Dai

Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe. This is a non-trivial task that involves…

Computation and Language · Computer Science 2020-08-24 Liangming Pan , Jingjing Chen , Jianlong Wu , Shaoteng Liu , Chong-Wah Ngo , Min-Yen Kan , Yu-Gang Jiang , Tat-Seng Chua

The AI community has embraced multi-sensory or multi-modal approaches to advance this generation of AI models to resemble expected intelligent understanding. Combining language and imagery represents a familiar method for specific tasks…

Computation and Language · Computer Science 2023-04-06 David Noever , Samantha Elizabeth Miller Noever

Visual designers naturally draw inspiration from multiple visual references, combining diverse elements and aesthetic principles to create artwork. However, current image generative frameworks predominantly rely on single-source inputs --…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Ruoxi Chen , Dongping Chen , Siyuan Wu , Sinan Wang , Shiyun Lang , Petr Sushko , Gaoyang Jiang , Yao Wan , Ranjay Krishna

Food classification is a challenging problem due to the large number of categories, high visual similarity between different foods, as well as the lack of datasets for training state-of-the-art deep models. Solving this problem will require…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Parneet Kaur , Karan Sikka , Weijun Wang , Serge Belongie , Ajay Divakaran

A rapidly growing amount of content posted online, such as food recipes, opens doors to new exciting applications at the intersection of vision and language. In this work, we aim to estimate the calorie amount of a meal directly from an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Robin Ruede , Verena Heusser , Lukas Frank , Alina Roitberg , Monica Haurilet , Rainer Stiefelhagen

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Yibin Wang , Chenglin Li , Zheming Liang , Dianyi Wang , Yang Jiao , Zhipeng Wei , Chao Gong , Cheng Jin , Jingjing Chen , Jiaqi Wang

Nowadays, driven by the increasing concern on diet and health, food computing has attracted enormous attention from both industry and research community. One of the most popular research topics in this domain is Food Retrieval, due to its…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Han Fu , Rui Wu , Chenghao Liu , Jianling Sun

Dish images play a crucial role in the digital era, with the demand for culturally distinctive dish images continuously increasing due to the digitization of the food industry and e-commerce. In general cases, existing text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Huijie Liu , Bingcan Wang , Jie Hu , Xiaoming Wei , Guoliang Kang

Cultures across the world are distinguished by the idiosyncratic patterns in their cuisines. These cuisines are characterized in terms of their substructures such as ingredients, cooking processes and utensils. A complex fusion of these…

Computation and Language · Computer Science 2020-04-30 Tript Sharma , Utkarsh Upadhyay , Ganesh Bagler

Due to availability of a large amount of cooking recipes online, there is a growing interest in using this as data to create novel recipes. Novel Recipe Generation is a problem in the field of Natural Language Processing in which our main…

Computation and Language · Computer Science 2024-02-29 Mansi Goel , Pallab Chakraborty , Vijay Ponnaganti , Minnet Khan , Sritanaya Tatipamala , Aakanksha Saini , Ganesh Bagler

The availability of an accurate nutrition profile of recipes is an important feature for food databases with several applications including nutritional assistance, recommendation systems, and dietary analytics. Often in online databases,…

Physics and Society · Physics 2020-04-28 Jushaan Kalra , Devansh Batra , Nirav Diwan , Ganesh Bagler

In this paper, we study the novel problem of not only predicting ingredients from a food image, but also predicting the relative amounts of the detected ingredients. We propose two prediction-based models using deep learning that output…

Machine Learning · Computer Science 2019-10-02 Jiatong Li , Ricardo Guerrero , Vladimir Pavlovic

We introduce the WorldScore benchmark, the first unified benchmark for world generation. We decompose world generation into a sequence of next-scene generation tasks with explicit camera trajectory-based layout specifications, enabling…

Graphics · Computer Science 2025-12-02 Haoyi Duan , Hong-Xing Yu , Sirui Chen , Li Fei-Fei , Jiajun Wu

Understanding the nutritional content of food from visual data is a challenging computer vision problem, with the potential to have a positive and widespread impact on public health. Studies in this area are limited to existing datasets in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Quin Thames , Arjun Karpur , Wade Norris , Fangting Xia , Liviu Panait , Tobias Weyand , Jack Sim

The enormous progress in the field of artificial intelligence (AI) enables retail companies to automate their processes and thus to save costs. Thereby, many AI-based automation approaches are based on machine learning and computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Christoph Brosch , Alexander Bouwens , Sebastian Bast , Swen Haab , Rolf Krieger

Given the potential applications of generating recipes from food images, this area has garnered significant attention from researchers in recent years. Existing works for recipe generation primarily utilize a two-stage training method,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Guoshan Liu , Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo , Yu-Gang Jiang