Evaluating computer game concepts with children

TLDR

The study explores how to evaluate new computer game concepts using small samples of eight‑ and nine‑year‑old children. The methodology involved a two‑phase study: first validating the approach with existing games, then applying it to new game ideas. The study found that separating game ideas from art produced the most valid reactions, that rankings and discussion were more effective than ratings and open-ended questions, and that children can effectively evaluate game concepts with the right methodology.

Abstract

This paper describes exploratory research on how to evaluate concepts for new computer games with small samples of eight- and nine-year-old children. There were two phases to the research, one to validate the methodology with existing games and one to apply the methodology to new game ideas. The results found that separating game ideas (presented as brief written descriptions that were also read aloud to children) from game art (presented on computer screens) elicited the most valid reactions from the children. Rankings and discussion of rationale were more effective than ratings and open-ended questions. Conclusions are that children can effectively evaluate the appeal and potential of game concepts with appropriate methodology.