Structuring and Documenting Interactions with Subject-Matter Experts

Abstract

We have developed interviewing techniques for knowledge elicitation based on (1) relevant research and techniques from the social sciences, (2) the nature of expertise, and (3) a desire to avoid reductive bias, one of the pitfalls associated with the acquisition of highly complex knowledge. Our approach consists of four interviewing phases, with guidelines for questions suited to each stage. Descriptive Elicitation reveals important domain concepts as reflected in terms and specialized language. Structured Expansion probes the relationships between these concepts and the organization of the expert's knowledge. Scripting relies on the declarative knowledge found in the two previous stages to uncover procedural knowledge. Validation is important throughout the process of knowledge elicitation to ensure that the knowledge being elicited is correct and adequate to solve the intended class of problems. A prototype “knowledge editor” has been developed to document the knowledge elicited from an expert.