中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
首页 机构 成果 学者
  
  1. CAS IR Grid
  2. 计算技术研究所
  3. 中国科学院计算技术研究所
  4. 中国科学院计算技术研究所期刊论文
  5. 英文
Multimodal Food Learning

文献类型：期刊论文

作者Min, Weiqing1; Hong, Xingjian1; Liu, Yuxin1; Huang, Mingyu1; Jin, Ying1; Zhou, Pengfei1; Xu, Leyi1; Wang, Yilin1; Jiang, Shuqiang1; Rui, Yong2
刊名ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS
出版日期2025-07-01
卷号21期号:7页码:28
关键词Multimodal Food Learning Cross-modal Retrieval Cross-modal Generation Food Recognition
ISSN号1551-6857
DOI10.1145/3715143
英文摘要Food-centered study has received more attention in the multimedia community for its profound impact on our survival, nutrition and health, pleasure, and enjoyment. Our experience of food is typically multisensory: We see food objects, smell its odors, taste its flavors, feel its texture, and hear sounds when chewing. Therefore, multimodal food learning is vital in food-centered study, which aims to relate information from multiple food modalities to support various multimedia tasks, ranging from recognition, retrieval, generation, recommendation, and interaction, enabling applications in different fields like healthcare and agriculture. However, there is no surveys on this topic to our knowledge. To fill this gap, this article formalizes multimodal food learning and comprehensively surveys its typical tasks, technical achievements, existing datasets, and applications to provide the blueprint with researchers and practitioners. Based on the current state of the art, we identify both open research issues and promising research directions, such as multimodal food learning benchmark construction, multimodal food foundation model construction, and multimodality diet estimation. We also point out that closer cooperation from researchers between multimedia and food science can handle some existing challenges and meanwhile open up more new opportunities to advance the fast development of multimodal food learning. This is the first comprehensive survey in this topic and we anticipate about 170 reviewed research articles can benefit academia and industry in this community and beyond.
资助项目Beijing Natural Science Foundation[JQ24021] ; National Natural Science Foundation of China[62125207] ; National Natural Science Foundation of China[62472411]
WOS研究方向Computer Science
语种英语
WOS记录号WOS:001540879800003
出版者ASSOC COMPUTING MACHINERY
源URL[http://119.78.100.204/handle/2XEOYT63/42004]  
专题中国科学院计算技术研究所期刊论文_英文
通讯作者Jiang, Shuqiang
作者单位1.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
2.Lenovo Grp Ltd, Beijing, Peoples R China
推荐引用方式
GB/T 7714		 Min, Weiqing,Hong, Xingjian,Liu, Yuxin,et al. Multimodal Food Learning[J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS,2025,21(7):28.
APA Min, Weiqing.,Hong, Xingjian.,Liu, Yuxin.,Huang, Mingyu.,Jin, Ying.,...&Rui, Yong.(2025).Multimodal Food Learning.ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS,21(7),28.
MLA Min, Weiqing,et al."Multimodal Food Learning".ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 21.7(2025):28.

入库方式： OAI收割

来源：计算技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。