English
Related papers

Related papers: RecipeGPT: Generative Pre-training Based Cooking R…

200 papers

Direct computer vision based-nutrient content estimation is a demanding task, due to deformation and occlusions of ingredients, as well as high intra-class and low inter-class variability between meal classes. In order to tackle these…

Information Retrieval · Computer Science 2019-11-06 Matthias Fontanellaz , Stergios Christodoulidis , Stavroula Mougiakakou

In this paper, we introduce Recipe1M+, a new large-scale, structured corpus of over one million cooking recipes and 13 million food images. As the largest publicly available collection of recipe data, Recipe1M+ affords the ability to train…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Javier Marin , Aritro Biswas , Ferda Ofli , Nicholas Hynes , Amaia Salvador , Yusuf Aytar , Ingmar Weber , Antonio Torralba

Food Computing is currently a fast-growing field of research. Natural language processing (NLP) is also increasingly essential in this field, especially for recognising food entities. However, there are still only a few well-defined tasks…

Computation and Language · Computer Science 2022-04-19 Ania Wróblewska , Agnieszka Kaliska , Maciej Pawłowski , Dawid Wiśniewski , Witold Sosnowski , Agnieszka Ławrynowicz

We present a new multimodal dataset called Visual Recipe Flow, which enables us to learn each cooking action result in a recipe text. The dataset consists of object state changes and the workflow of the recipe text. The state change is…

Computation and Language · Computer Science 2022-09-14 Keisuke Shirai , Atsushi Hashimoto , Taichi Nishimura , Hirotaka Kameko , Shuhei Kurita , Yoshitaka Ushiku , Shinsuke Mori

The paper presents the PCGPT framework, an innovative approach to procedural content generation (PCG) using offline reinforcement learning and transformer networks. PCGPT utilizes an autoregressive model based on transformers to generate…

Machine Learning · Computer Science 2023-10-05 Sajad Mohaghegh , Mohammad Amin Ramezan Dehnavi , Golnoosh Abdollahinejad , Matin Hashemi

Building effective text generation systems requires three critical components: content selection, text planning, and surface realization, and traditionally they are tackled as separate problems. Recent all-in-one style neural generation…

Computation and Language · Computer Science 2019-09-04 Xinyu Hua , Lu Wang

In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual descriptions of its ingredients. Previous works on synthesis of images from text…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Fangda Han , Ricardo Guerrero , Vladimir Pavlovic

Generate-then-rank is a widely used mechanism for text generation, where a generator produces multiple text candidates and a ranker chooses the best one among the text candidates. However, existing methods usually train the generator and…

Computation and Language · Computer Science 2023-05-30 Weizhou Shen , Yeyun Gong , Yelong Shen , Song Wang , Xiaojun Quan , Nan Duan , Weizhu Chen

In this paper, we study the task of instructional dialogue and focus on the cooking domain. Analyzing the generated output of the GPT-J model, we reveal that the primary challenge for a recipe-grounded dialog system is how to provide the…

Computation and Language · Computer Science 2023-05-30 Duong Minh Le , Ruohao Guo , Wei Xu , Alan Ritter

Text generation is the automated process of producing written or spoken language using computational methods. It involves generating coherent and contextually relevant text based on predefined rules or learned patterns. However, challenges…

Computation and Language · Computer Science 2025-01-30 Rahimanuddin Shaik , Katikela Sreeharsha Kishore

Research on food image understanding using recipe data has been a long-standing focus due to the diversity and complexity of the data. Moreover, food is inextricably linked to people's lives, making it a vital research area for practical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yuki Imajuku , Yoko Yamakata , Kiyoharu Aizawa

This research presents and compares multiple approaches to automate the generation of literature reviews using several Natural Language Processing (NLP) techniques and retrieval-augmented generation (RAG) with a Large Language Model (LLM).…

Computation and Language · Computer Science 2024-11-28 Nurshat Fateh Ali , Md. Mahdi Mohtasim , Shakil Mosharrof , T. Gopi Krishna

Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general…

Computation and Language · Computer Science 2023-04-04 Renqian Luo , Liai Sun , Yingce Xia , Tao Qin , Sheng Zhang , Hoifung Poon , Tie-Yan Liu

We study the problem of future step anticipation in procedural videos. Given a video of an ongoing procedural activity, we predict a plausible next procedure step described in rich natural language. While most previous work focus on the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Mohamed Ashraf Abdelsalam , Samrudhdhi B. Rangrej , Isma Hadji , Nikita Dvornik , Konstantinos G. Derpanis , Afsaneh Fazly

Building upon the considerable advances in Large Language Models (LLMs), we are now equipped to address more sophisticated tasks demanding a nuanced understanding of cross-cultural contexts. A key example is recipe adaptation, which goes…

Computation and Language · Computer Science 2023-10-27 Yong Cao , Yova Kementchedjhieva , Ruixiang Cui , Antonia Karamolegkou , Li Zhou , Megan Dare , Lucia Donatelli , Daniel Hershcovich

Recent neural approaches to data-to-text generation have mostly focused on improving content fidelity while lacking explicit control over writing styles (e.g., word choices, sentence structures). More traditional systems use templates to…

Computation and Language · Computer Science 2020-10-12 Shuai Lin , Wentao Wang , Zichao Yang , Xiaodan Liang , Frank F. Xu , Eric Xing , Zhiting Hu

In this paper we want to address the problem of automation for recognition of photographed cooking dishes and generating the corresponding food recipes. Current image-to-recipe models are computation expensive and require powerful GPUs for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Jianfa Chen , Yue Yin , Yifan Xu

Paraphrase generation is a fundamental and long-standing task in natural language processing. In this paper, we concentrate on two contributions to the task: (1) we propose Retrieval Augmented Prompt Tuning (RAPT) as a parameter-efficient…

Computation and Language · Computer Science 2022-03-15 Jishnu Ray Chowdhury , Yong Zhuang , Shuyi Wang

Recipe personalization through ingredient substitution has the potential to help people meet their dietary needs and preferences, avoid potential allergens, and ease culinary exploration in everyone's kitchen. To address ingredient…

Machine Learning · Computer Science 2023-02-17 Bahare Fatemi , Quentin Duval , Rohit Girdhar , Michal Drozdzal , Adriana Romero-Soriano

The widespread usage of computer-based assessments and individualized learning platforms has resulted in an increased demand for the rapid production of high-quality items. Automated item generation (AIG), the process of using item models…

Computation and Language · Computer Science 2023-04-11 Ummugul Bezirhan , Matthias von Davier