A Decomposable Causal View of Compositional Zero-Shot Learning

Abstract

Composing and recognizing novel concepts that are combinations of known concepts, <i>i.e.</i>, compositional generalization, is one of the greatest power of human intelligence. With the development of artificial intelligence, it becomes increasingly appealing to build a vision system that can generalize to unknown compositions based on restricted known knowledge, which has so far remained a great challenge to our community. In fact, machines can be easily misled by superficial correlations in the data, disregarding the causal patterns that are crucial to generalization. In this paper, we rethink compositional generalization with a causal perspective, upon the context of Compositional Zero-Shot Learning (CZSL). We develop a simple yet strong approach based on our novel <u>De</u>composable <u>Ca</u>usal view (dubbed &#x201C;<small>DeCa</small>&#x201D;), by approximating the causal effect with the combination of three easy-to-learn components. Our proposed <small>DeCa</small><xref ref-type="fn" rid="fn1">¹</xref><fn id="fn1"><label>¹</label> Code is available on <u><uri>https://github.com/muliyangm/DeCa</uri></u>. </fn> is evaluated on two challenging CZSL benchmarks by recognizing unknown compositions of known concepts. Despite being simple in the design, our approach achieves consistent improvements over state-of-the-art baselines, demonstrating its superiority towards the goal of compositional generalization.