Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations

TLDR

Recent advances in text mining offer new methods to exploit large natural language data from organizations, but preprocessing decisions critically influence whether content or style is captured, statistical power, and validity, and prior methodological guidance has been inconsistent and varies across studies. The study conducts two complementary reviews of computational linguistics and organizational text mining to generate empirically grounded preprocessing recommendations tailored to the type of text mining, research question, and dataset characteristics. The authors also recommend reporting practices to enhance transparency and reproducibility of text mining studies.

Abstract

Recent advances in text mining have provided new methods for capitalizing on the voluminous natural language text data created by organizations, their employees, and their customers. Although often overlooked, decisions made during text preprocessing affect whether the content and/or style of language are captured, the statistical power of subsequent analyses, and the validity of insights derived from text mining. Past methodological articles have described the general process of obtaining and analyzing text data, but recommendations for preprocessing text data were inconsistent. Furthermore, primary studies use and report different preprocessing techniques. To address this, we conduct two complementary reviews of computational linguistics and organizational text mining research to provide empirically grounded text preprocessing decision-making recommendations that account for the type of text mining conducted (i.e., open or closed vocabulary), the research question under investigation, and the data set’s characteristics (i.e., corpus size and average document length). Notably, deviations from these recommendations will be appropriate and, at times, necessary due to the unique characteristics of one’s text data. We also provide recommendations for reporting text mining to promote transparency and reproducibility.