Managing Delphi Surveys Using Nonparametric Statistical Techniques*

TLDR

Information systems researchers frequently use Delphi surveys to study key issues, yet past studies lack a definitive method and statistical support. The paper proposes a concise, nonparametric statistical method for conducting, analyzing, and reporting ranking‑type Delphi surveys, and demonstrates its use. The method employs nonparametric techniques to rank responses, analyze data, and report results, and the author illustrates its application by analyzing a Delphi survey and comparing it to results obtained without the approach. The advocated approach streamlines and strengthens studies, improves result validity, and better serves the consumers of the research findings.

Abstract

ABSTRACT Information systems researchers have often turned to a variant of the Delphi survey technique to support their research of key issues in their field. Two particular weaknesses of past studies using this approach have been a lack of a definitive method for conducting the research and a lack of statistical support for the conclusions drawn by the researchers. In this paper, the author presents a method, based on nonparametric statistical techniques, to conduct ranking‐type Delphi surveys, perform analysis, and report results. The author takes this one step further by illustrating an actual analysis of a Delphi survey. The analysis is compared to results that were presented without the benefit of the author's approach. This paper shows that use of the advocated approach can streamline and strengthen studies, improve the validity of results, and thus better serve the consumers of the research findings. Since the ranking‐type Delphi is so popular among information systems researchers, a consistent method is needed to apply to their data collection, analysis, and reporting of results. This paper provides such a method in concise form and illustrates the use of the method in a manner affording comparison between it and previous practice.