Emergent Predication Structure in Hidden State Vectors of Neural Readers

Hai Wang, Takeshi Onishi, Kevin Gimpel, David McAllester

2017 · 11 citations · 19 references

DOIFull text

Open access

Concepts

Abstract

A significant number of neural architectures for reading comprehension have recently been developed and evaluated on large cloze-style datasets. We present experiments supporting the emergence of "predication structure" in the hidden state vectors of these readers. More specifically, we provide evidence that the hidden state vectors represent atomic formulas [c] where is a semantic property (predicate) and c is a constant symbol entity identifier.

References

19