English

How well does CLIP understand texture?

Computer Vision and Pattern Recognition 2022-11-08 v2

Abstract

We investigate how well CLIP understands texture in natural images described by natural language. To this end, we analyze CLIP's ability to: (1) perform zero-shot learning on various texture and material classification datasets; (2) represent compositional properties of texture such as red dots or yellow stripes on the Describable Texture in Detail(DTDD) dataset; and (3) aid fine-grained categorization of birds in photographs described by color and texture of their body parts.

Cite

@article{arxiv.2203.11449,
  title  = {How well does CLIP understand texture?},
  author = {Chenyun Wu and Subhransu Maji},
  journal= {arXiv preprint arXiv:2203.11449},
  year   = {2022}
}

Comments

ECCV 2022 CVinW Workshop

R2 v1 2026-06-24T10:21:27.400Z