An Evaluation Model for Psychoeducational Interventions Using Interactive Multimedia

Abstract

A review of published evaluations of psychoeducational interventions using interactive digital multimedia shows that evaluations typically address only some of the areas that collectively would constitute a comprehensive evaluation. There appears to be a need for an accepted standard for these evaluations, based on a general evaluation model that encompasses all relevant aspects of development, efficacy and use of multimedia interventions. A comprehensive model is proposed which includes special features of multimedia interventions that lead to unique evaluation requirements. The model integrates relevant aspects of program evaluation and clinical trials models in order to provide a unique model that includes all the evaluation domains relevant to digital multimedia interventions. These include evaluation of intervention theory, intervention design strategies, the formative process, intervention efficacy (process and outcome) and contextual issues such as evaluability assessment, reporting and stakeholder issues. The application of individual components of the model is illustrated with reference to problems in the evaluation literature on a particular type of digital multimedia intervention, electroencephalographic biofeedback for Attention-Deficit/Hyperactivity Disorder. The model should be useful for researchers planning evaluations of digital multimedia interventions, especially in the psychoeducational domain. This paper provides a theoretical and evidential background for the evaluation model, and includes a checklist and flowchart for the planning and conduct of the evaluation.