VireoFood-251 dataset

Images of the 251 food categories in Vireo-Food 251.

Introduction

Food and ingredient recognition are key technologies to automatic dietary assessment. Existing datasets for food recognition are either small or do not have ingredient level labels. In this project, we extended the original Vireo Food-172 Dataset to Vireo Food-251 Dataset, with the newly added 79 food categories. The new dataset contains 169,673 food images from 251 categories, and annotated manually according to 406 ingredients. We believe that the release of VireoFood-251 can stimulate innovative research on this challenging and important problem.

The food categories are pupular dishes which were compiled from "Go cooking" and "Meishijie" . We compile the categories from both websites by removing duplication. All the images in the dataset were crawled from Baidu and Google image search. For each category, the name was issued as keywords in Chinese to search engines. Categories with no more than 100 images returned were removed from the list. The 251 categories covers eight major groups of foods, including "Vegetables" (e.g., "Fried beans"), "Soup" (e.g., "Sour beef soup"), "Bean products" (e.g., "Braised tofu"), "Egg" (e.g., "Scambled egg with loofah"), "Meat" (e.g., "Braised pork"), "Seafood" (e.g., "Spicy clams"), "Fish" (e.g., "Grilled fish"), and "Staple" (e.g., "Yangzhou Fried rice").

The image are labeled with more than 400 ingredients based on the recipes of 251 food categories. The ingredients range from popular items such as "shredded pork" and "shredded pepper" to rare items such as "codonopsis pilosula" and "radix astragali". In addition, we create additional labels for ingredients with large visual appearance.


Download

The dataset, including images, labels, can be obtained by sending a request email to us. Specifically, the researchers interested in VireoFood-251 should download and fill up this Agreement Form and send it back to Jing-jing Chen (chenjingjing.tju AT gmail.com; Email title: VireoFood-251 data request). We will then send you the download instructions at our discretion.

Please cite the following papers if the dataset helps your research.

 @article{VireoFood251,
	  title={A Study of Multi-Task and Region-Wise Deep Learning for Food Ingredient Recognition},
	  author={Chen, Jingjing and Zhu, Bin and Ngo, Chong-Wah and Chua, Tat-Seng and Jiang, Yu-Gang},
	  journal={IEEE Transactions on Image Processing},
	  volume={30},
	  pages={1514--1526},
	  year={2020},
	  publisher={IEEE}}

 @inproceedings{VireoFood172,
   Author  =  {Chen, Jingjing and Ngo, Chong-Wah},
   Title   =  {Deep-based Ingredient Recognition for Cooking Recipe Retrival},
   booktitle =  {ACM Multimedia},
   pages={32--41},
   Year    =  {2016}}
	

Statistics

      Number of Images: 169,673

      Number of Categories: 251

      Total ingredients: 406