The Centroid Cannot Hold: Comparing Sequential and Global Estimates of Coherence as Indicators of Formal Thought Disorder

Abstract

Thought disorder (TD) as reflected in incoherent speech is a cardinal symptom of schizophrenia and related disorders. Quantification of the degree ofTD can inform diagnosis, monitoring, and timely intervention. Consequently, there has been an interest in applying methods ofdistributional semantics to quantify incoherence ofspoken language. Prior studies have generally involved few participants and utilized speech data collected in on-site structured interviews. In this paper we conduct a comprehensive evaluation ofapproaches to quantify incoherence using distributional semantics, including a novel variant that measures the global coherence oftext. This evaluation is conducted in the context of "audio diaries" collected from participants experiencing auditory verbal hallucinations using a smartphone application. Results reveal our novel global coherence metric using the centroid (weighted vector average) outperforms established approaches in their agreement with human annotators, supporting their preferential use in the context of short recordings ofunstructured and largely spontaneous speech.