With a lack of consensus of what evaluation is within the field of evaluation, there is a difficulty in communicating to nonevaluators what evaluation is and how evaluation differs from research. To understand how evaluation is defined, both evaluators and researchers were asked how they defined evaluation and, if at all, differentiated evaluation from research. Overall, evaluators believed research and evaluation intersect, whereas researchers believed evaluation is a subcomponent of research. Furthermore, evaluators perceived greater differences between evaluation and research than researchers did, particularly in characteristics relevant at the beginning (e.g., purpose, questions, audience) and end (e.g., rendering value judgments, disseminating results) of studies. This study suggests that greater consensus on a definition of evaluation is needed to be able to distinguish the field and discipline of evaluation from related fields and to be able to communicate this information to nonevaluators.
BarkerC.PistrangN.ElliottR. (2016). Research methods in clinical psychology: An introduction for students and practitioners (3rd ed.). John Wiley & Sons.
4.
CarterR. K. (1971). Clients’ resistance to negative findings and the latent conservative function of evaluation studies. The American Sociologist, 6(5), 118–124.
5.
CastroM. P.FragapaneS.RinaldiF. M. (2016). Professionalization and evaluation: A European analysis in the digital era. Evaluation, 22(4), 489–507.
ChenH. T. (2015). Practical program evaluation: Theory-driven evaluation and the integrated evaluation perspective (2nd ed.). Sage.
8.
ChristieC. A. (2013). Michael Scriven and the development of the evaluation lexicon. In DonaldsonS. I.ScrivenM. (Eds.), The future of evaluation in society: A tribute to Michael Scriven (pp. 93–105). Information Age Publishing.
9.
DavidsonE. J. (2014). How “beauty” can bring truth and justice to life. New Directions for Evaluation, 2014(142), 31–43. https://doi.org/10.1002/ev.20083
10.
DonaldsonS. I.ChristieC. A. (2006). Emerging career opportunities in the transdiscipline of evaluation science. In DonaldsonS. I.BergerD. E.PezdekK. (Eds.), Applied psychology: New frontiers and rewarding careers (pp. 243–259). Lawrence Erlbaum Associates.
GreeneJ. C. (2016). Advancing equity: Cultivating an evaluation habit. In DonaldsonS. I.PicciottoR. (Eds.), Evaluation for an equitable society (pp. 49–66). Information Age Publishing.
13.
GuentherJ.ArnottA. (2011). Legitimising evaluation for vocational learning: From bastard sibling to equal brother (p. 11). AVETRA 14th Annual Conference: Research in VET: Janus Reflecting back, projecting forward. Melbourne, Victoria. http://www.covaluator.net/docs/S2.3_legitimising_evaluation_VET.pdf
14.
HackbarthD.GallG. B. (2005). Evaluation of school-based health center programs and services: The whys and hows of demonstrating program effectiveness. The Nursing Clinics of North America, 40(4), 711–724, x.
15.
JonesN. D. (2019). What I say I do: An evaluator’s tale (Unpublished thesis). Claremont Graduate University.
LaVelleJ. M. (2011). Planning for evaluation’s future: Undergraduate students’ interest in program evaluation. American Journal of Evaluation, 32(3), 362–375. https://doi.org/10.1177/1098214011398953
18.
Levin-RozalisM. (2003). Evaluation and research: Differences and similarities. The Canadian Journal of Program Evaluation, 18(2), 1–31.
19.
MasonS.HuntA. (2018). So what do you do? Exploring evaluator descriptions of their work. American Journal of Evaluation, 109821401876704. https://doi.org/10.1177/1098214018767049
20.
MathisonS. (2008). What is the difference between evaluation and research and why do we care. In SmithN. L.BrandonP. R. (Eds)., Fundamental Issues in Evaluation (pp. 183–196).
21.
MertensD. M. (2014). Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods (4th ed.). Sage.
22.
MertensD. M.WilsonA. T. (2012). Program evaluation theory and practice: A comprehensive guide (1st ed.). The Guilford Press.
23.
Montrosse-MoorheadB.BellaraA. P.GambinoA. J. (2017). Communicating about evaluation: A conceptual model and case example. Journal of Multidisciplinary Evaluation, 13(29), 16–30.
24.
MorrisM. (2007). Ethics and evaluation. In MorrisM. (Ed.), Evaluation ethics for best practice: Cases and commentaries (1st ed.). The Guilford Press.
25.
MunafoM. R.NosekB. A.BishopD. V. M.ButtonK. S.ChambersC. D.du SertN. P.SimonsohnU.WagenmakersE.-J.WareJ. J.IoannidisJ. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 1–9. https://doi.org/10/bw28
26.
PattonM. Q. (1997). Utilization-focused evaluation: The new century text. Sage.
PothC.LamarcheM. K.YappA.SullaE.ChisamoreC. (2014). Towards a definition of evaluation within the Canadian context: Who knew this would be so difficult?Canadian Journal of Program Evaluation, 29(1), 87–103.
31.
PreskillH.Russ-EftD. F. (2005). Building evaluation capacity: 72 activities for teaching and training. Sage.
RallisS. F. (2014). When and how qualitative methods provide credible and actionable evidence: Reasoning with rigor, probity, and transparency. In ChristieC. A.MarkM. M.DonaldsonS. I. (Eds.), Credible and actionable evidence: The foundation for rigorous and influential evaluations (2nd ed., pp. 137–156). Sage. https://doi.org/10.4135/9781483385839
34.
RossiP. H.LipseyM. W.LipseyM. W.FreemanH. E. (2004). Evaluation: A systematic approach. Sage.
35.
Russ-EftD.PreskillH. (2009). Evaluation in organizations: A systematic approach to enhancing learning, performance, and change. Basic Books.
36.
SuchmanE. (1968). Action for what? A methodological critique of evaluation studies. Paper presented at the annual meeting of the American Sociological Association.
37.
SchultesM.-T.KollmayerM.MejehM.SpielC. (2018). Attitudes toward evaluation: An exploratory study of students’ and stakeholders’ social representations. Evaluation and Program Planning, 70, 44–50. https://doi.org/10.1016/j.evalprogplan.2018.06.002
38.
ScrivenM. (1980). The logic of evaluation. EdgePress.
39.
ScrivenM. (1991). Evaluation thesaurus. Sage.
40.
ScrivenM. (2003). Evaluation in the new millennium: The transdisciplinary vision. In DonaldsonS. I.ScrivenM. (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 19–41). Erlbaum.
41.
ScrivenM. (2008). The concept of a transdiscipline: And of evaluation as a transdiscipline. Journal of MultiDisciplinary Evaluation, 5(10), 65–66.
42.
ScrivenM. (2013). The foundation and future of evaluation. In DonaldsonS. I.ScrivenM. (Eds.), The future of evaluation in society: A tribute to Michael Scriven (pp. 11–44). Information Age Publishing.
SkousenD. (2017). Evaluation: The island of misfit toys (PhD thesis). Claremont Graduate University.
46.
StufflebeamD. L. (1973). Evaluation as enlightenment for decision-making. In WorthenB. R.SandersJ. R. (Eds.), Educational evaluation: Theory and practice (pp. 143–147). Charles A. Jones Publishing.
47.
SturgesK. M. (2014). External evaluation as contract work: The production of evaluator identity. American Journal of Evaluation, 35(3), 346–363. https://doi.org/10.1177/1098214013513829
48.
U.S. Department of Health & Human Services. (2016) Part 46 - Protection of Human Subjects, 45 CFR 46.102[d].
49.
VedungE. (1997). Public policy and program evaluation. Transaction Publishers.
50.
VedungE. (2004). Evaluation research and fundamental research. In StockmannR. (Ed.), Evaluationsforschung: Grundlagen und ausgewählte Forschungsfelder [Evaluation research: Basics and selected fields of research] (pp. 111–134). Leske + Budrich.
51.
WeissC. H. (1997). Evaluation: Methods for studying programs and policies (2nd ed.). Prentice Hall.
52.
YarbroughD. B.ShulaL. M.HopsonR. K.CaruthersF. A. (2010). The program evaluation standards : A guide for evaluators and evaluation users (3rd. ed). Corwin Press.
53.
YarbroughD. B.ShulhaL. M.HopsonR. K.CaruthersF. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Sage.
