English
Related papers

Related papers: Learning to Substitute Ingredients in Recipes

200 papers

Fine-grained ingredient recognition presents a significant challenge due to the diverse appearances of ingredients, resulting from different cutting and cooking methods. While existing approaches have shown promising results, they still…

Multimedia · Computer Science 2025-04-16 Yinxuan Gui , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Learning recipe and food image representation in common embedding space is non-trivial but crucial for cross-modal recipe retrieval. In this paper, we propose a new perspective for this problem by utilizing foundation models for data…

Information Retrieval · Computer Science 2024-07-18 Fangzhou Song , Bin Zhu , Yanbin Hao , Shuo Wang

Accurate food intake monitoring is crucial for maintaining a healthy diet and preventing nutrition-related diseases. With the diverse range of foods consumed across various cultures, classic food classification models have limitations due…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hassan Kazemi Tehrani , Jun Cai , Abbas Yekanlou , Sylvia Santosa

Computational gastronomy increasingly relies on diverse, high-quality recipe datasets to capture regional culinary traditions. Although there are large-scale collections for major languages, Macedonian recipes remain under-represented in…

Computation and Language · Computer Science 2025-11-18 Darko Sasanski , Dimitar Peshevski , Riste Stojanov , Dimitar Trajanov

Nutrient-based meal recommendations have the potential to help individuals prevent or manage conditions such as diabetes and obesity. However, learning people's food preferences and making recommendations that simultaneously appeal to their…

Human-Computer Interaction · Computer Science 2017-05-02 Longqi Yang , Cheng-Kang Hsieh , Hongjian Yang , Nicola Dell , Serge Belongie , Curtis Cole , Deborah Estrin

Food image classification serves as the foundation of image-based dietary assessment to predict food categories. Since there are many different food classes in real life, conventional models cannot achieve sufficiently high accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Xinyue Pan , Jiangpeng He , Andrew Peng , Fengqing Zhu

Recent advances in Multimodal Large Language Models (MLMMs) have enabled recipe generation from food images, yet outputs often contain semantically incorrect actions or ingredients despite high lexical scores (e.g., BLEU, ROUGE). To address…

Computation and Language · Computer Science 2026-02-19 Guoshan Liu , Bin Zhu , Yian Li , Jingjing Chen , Chong-Wah Ngo , Yu-Gang Jiang

Most existing recommendation approaches implicitly treat user tastes as unimodal, resulting in an average-of-tastes representations when multiple distinct interests are present. We show that appropriately modelling the multi-faceted nature…

Information Retrieval · Computer Science 2018-01-30 Maciej Kula

Cooking recipes are complex procedures that require not only a fluent and factual text, but also accurate timing, temperature, and procedural coherence, as well as the correct composition of ingredients. Standard training procedures are…

Computation and Language · Computer Science 2026-04-20 Mattia Ottoborgo , Daniele Rege Cambrin , Paolo Garza

Textual documents need to be of good quality to ensure effective asynchronous communication in remote areas, especially during the COVID-19 pandemic. However, defining a preferred document structure (content and arrangement) for improving…

Digital Libraries · Computer Science 2023-05-03 Rina Kagawa , Masaki Matsubara , Rei Miyata , Takuya Matsuzaki , Yukino Baba , Yoko Yamakata

Recent strategies achieved ensembling "for free" by fitting concurrently diverse subnetworks inside a single base network. The main idea during training is that each subnetwork learns to classify only one of the multiple inputs…

Machine Learning · Computer Science 2021-08-25 Alexandre Rame , Remy Sun , Matthieu Cord

Despite the abundance of multi-modal data, such as image-text pairs, there has been little effort in understanding the individual entities and their different roles in the construction of these data instances. In this work, we endeavour to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Hai X. Pham , Ricardo Guerrero , Jiatong Li , Vladimir Pavlovic

Computational food analysis (CFA) naturally requires multi-modal evidence of a particular food, e.g., images, recipe text, etc. A key to making CFA possible is multi-modal shared representation learning, which aims to create a joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Ricardo Guerrero , Hai Xuan Pham , Vladimir Pavlovic

Recent advances in the machine learning community allowed different use cases to emerge, as its association to domains like cooking which created the computational cuisine. In this paper, we tackle the picture-recipe alignment problem,…

Artificial Intelligence · Computer Science 2018-05-03 Micael Carvalho , Rémi Cadène , David Picard , Laure Soulier , Matthieu Cord

Interests in the automatic generation of cooking recipes have been growing steadily over the past few years thanks to a large amount of online cooking recipes. We present RecipeGPT, a novel online recipe generation and evaluation system.…

Computation and Language · Computer Science 2020-10-28 Helena H. Lee , Ke Shu , Palakorn Achananuparp , Philips Kokoh Prasetyo , Yue Liu , Ee-Peng Lim , Lav R. Varshney

Creating recipe images is a key challenge in food computing, with applications in culinary education and multimodal recipe assistants. However, existing datasets lack fine-grained alignment between recipe goals, step-wise instructions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ruoxuan Zhang , Jidong Gao , Bin Wen , Hongxia Xie , Chenming Zhang , Hong-Han Shuai , Wen-Huang Cheng

Large Language Models (LLMs) are trained on a vast amount of procedural texts, but they do not directly observe real-world phenomena. In the context of cooking recipes, this poses a challenge, as intermediate states of ingredients are often…

Multimedia · Computer Science 2025-08-29 Mashiro Toyooka , Kiyoharu Aizawa , Yoko Yamakata

Designing powerful tools that support cooking activities has rapidly gained popularity due to the massive amounts of available data, as well as recent advances in machine learning that are capable of analyzing them. In this paper, we…

Computation and Language · Computer Science 2018-05-01 Micael Carvalho , Rémi Cadène , David Picard , Laure Soulier , Nicolas Thome , Matthieu Cord

Increased awareness of the impact of food consumption on health and lifestyle today has given rise to novel data-driven food analysis systems. Although these systems may recognize the ingredients, a detailed analysis of their amounts in the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Jiatong Li , Fangda Han , Ricardo Guerrero , Vladimir Pavlovic

Research on food image understanding using recipe data has been a long-standing focus due to the diversity and complexity of the data. Moreover, food is inextricably linked to people's lives, making it a vital research area for practical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yuki Imajuku , Yoko Yamakata , Kiyoharu Aizawa