English

Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse

Computation and Language 2023-05-08 v1

Abstract

Interactive Task Learning (ITL) concerns learning about unforeseen domain concepts via natural interactions with human users. The learner faces a number of significant constraints: learning should be online, incremental and few-shot, as it is expected to perform tangible belief updates right after novel words denoting unforeseen concepts are introduced. In this work, we explore a challenging symbol grounding task--discriminating among object classes that look very similar--within the constraints imposed by ITL. We demonstrate empirically that more data-efficient grounding results from exploiting the truth-conditions of the teacher's generic statements (e.g., "Xs have attribute Z.") and their implicatures in context (e.g., as an answer to "How are Xs and Ys different?", one infers Y lacks attribute Z).

Keywords

Cite

@article{arxiv.2305.03461,
  title  = {Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse},
  author = {Jonghyuk Park and Alex Lascarides and Subramanian Ramamoorthy},
  journal= {arXiv preprint arXiv:2305.03461},
  year   = {2023}
}

Comments

Accepted to the 15th International Conference on Computational Semantics (IWCS 2023)