English

SalientFusion: Context-Aware Compositional Zero-Shot Food Recognition

Computer Vision and Pattern Recognition 2025-09-05 v1 Artificial Intelligence

Abstract

Food recognition has gained significant attention, but the rapid emergence of new dishes requires methods for recognizing unseen food categories, motivating Zero-Shot Food Learning (ZSFL). We propose the task of Compositional Zero-Shot Food Recognition (CZSFR), where cuisines and ingredients naturally align with attributes and objects in Compositional Zero-Shot learning (CZSL). However, CZSFR faces three challenges: (1) Redundant background information distracts models from learning meaningful food features, (2) Role confusion between staple and side dishes leads to misclassification, and (3) Semantic bias in a single attribute can lead to confusion of understanding. Therefore, we propose SalientFusion, a context-aware CZSFR method with two components: SalientFormer, which removes background redundancy and uses depth features to resolve role confusion; DebiasAT, which reduces the semantic bias by aligning prompts with visual features. Using our proposed benchmarks, CZSFood-90 and CZSFood-164, we show that SalientFusion achieves state-of-the-art results on these benchmarks and the most popular general datasets for the general CZSL. The code is avaliable at https://github.com/Jiajun-RUC/SalientFusion.

Keywords

Cite

@article{arxiv.2509.03873,
  title  = {SalientFusion: Context-Aware Compositional Zero-Shot Food Recognition},
  author = {Jiajun Song and Xiaoou Liu},
  journal= {arXiv preprint arXiv:2509.03873},
  year   = {2025}
}

Comments

34th International Conference on Artificial Neural Networks - ICANN 2025

R2 v1 2026-07-01T05:20:21.780Z