The Powers of Evaluation: The Understanding and Practice of Evaluation in youth Ministry Communities of Practice in Illinois

Abstract

Evaluation is a powerful tool for improvement yet is often perceived as simply a rearview mirror into the past. A two-tier qualitative method was used to uncover the practice and understanding of evaluation among youth pastors in Illinois. Reliance on indicators, such as stories and observation, tended to reinforce assumptions in practice. Evaluation was pervasive, powerfully guided perception, and primarily implicit.

Keywords

youth ministry evaluation communities of practice networking assessment church work with youth

Get full access to this article

View all access options for this article.

References

AAHE Assessment Forum. (2005). 9 principles of good practice for assessing student learning. Stylus Publishing. Retrieved from http://www.iuk.edu/~koctla/assessment/9principles.shtml.

Argyris

, & Schön

D. A.

(1974). Theory in practice: Increasing professional effectiveness. San Francisco, CA: Jossey-Bass.

Bernard

(2002). Research methods in anthropology. Walnut Creek, CA: Altamira.

Brown

(1987). Metacognition, executive control, self control, and other mysterious mechanisms. In Weinert

, & Kluwe

(Eds.), Metacognition, motivation, and understanding (pp. 65–116). Hillsdale, NJ: Erlbaum.

Brueggemann

(1982). The creative word. Philadelphia, PA: Fortress.

Edmondson

, & Moingeon

(1999). Learning, trust and organizational change. In Easterby-Smith

, Araujo

, & Burgoyne

(Eds.), Learning, trust and organizational change (pp. 157–175). London, England: Sage.

Eisner

(1979). The educational imagination: On the design and evaluation of school programs. New York, NY: Macmillan.

Exemplary

Y.M.

(2002). Exemplary youth ministry proposal. Retrieved from http://www.firstthird.org/eym/

Fenwick

T. J.

(2003). Learning through experience: Troubling orthodoxies and intersecting questions. Malabar, FL: Krieger.

10.

Frankena

W. K.

(1965). Philosophy of education. Toronto, Canada: Macmillan.

11.

Gall

, Gall

, & Borg

(2007). Educational research: An introduction. Boston, MA: Pearson/Allyn & Bacon.

12.

Glesne

(1999). Becoming qualitative researchers. New York, NY: Longman.

13.

Harris

, & Sansom

(2001). Discerning is more than counting: Higher education and assessment. Washington, DC: American Academy for Liberal Education.

14.

Hiebert

(2008). Transforming worldviews. Grand Rapids, MI: Baker.

15.

Jurkowitz

(2003). What is the literature saying about learning and assessment in higher education? Theological Education, 39(1), 53–92.

16.

Kolb

D. A.

(1984). Experiential learning: Experience as the source of learning and development. Upper Saddle River, NJ: Prentice Hall.

17.

Krueger

(1994). Focus groups: A practical guide for applied research (2nd ed.). Thousand Oaks, CA: Sage.

18.

Krueger

, & Casey

(2000). Focus groups: A practical guide for applied research (3rd ed.). Thousand Oaks, CA: Sage.

19.

Lave

, & Wenger

(1991). Situated learning: Legitimate peripheral participation. Cambridge, UK: Cambridge University Press.

20.

Lee

M. R.

(2003). Korean evangelical parachurch leaders (Doctoral dissertation). Trinity International University.

21.

Linhart

T. D.

(2005). Planting seeds: The curricular hope of short-term mission experiences in youth ministry. Christian Education Journal, Series 3, 2(2), 256–272.

22.

Maines

(n.d.) Giving the gift of evaluation to your ministry. Fuller Youth Institute. Retrieved from http://fulleryouthinstitute.org/articles/evaluation-part-i?/2005/12/evaluation-part-i/.

23.

McDermott

(1999). Learning across teams: The role of communities of practice in team organizations. Knowledge Management Review, 7(3), 191–213.

24.

Merriam

(2002). Qualitative research in practice. San Francisco, CA: Jossey-Bass.

25.

Merriam

, Caffarella

R. S.

, & Baumgartner

(2007). Learning in adulthood: A comprehensive guide. San Francisco, CA: Jossey-Bass.

26.

Metcalfe

, & Shimamura

(1994). Metacognition: Knowing about knowing. Cambridge, MA: MIT Press.

27.

National Network of Youth Ministries. (2004). Covenant bonds and core values. San Diego: NNYM. Retrieved from http://youthworkers.net

28.

National Network of Youth Ministries. (2007, Winter). 2007 Annual Survey of NNYM Members. Network Magazine, 1(1), 30–31.

29.

National Network of Youth Ministries. (2008a). Local network Illinois. San Diego: NNYM.

30.

National Network of Youth Ministries. (2008b). Membership directory. San Diego: NNYM.

31.

Niemi

(2002). Active learning: A cultural change needed in teacher education and schools. Teaching and Teacher Education, 18, 763–780.

32.

Patton

(1997). Utilization-focused evaluation. Thousand Oakes, CA: Sage.

33.

Patton

(2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oakes, CA: Sage.

34.

Patty

(2007). A case for qualitative inquiry. Retrieved from http://www.diagroup.net/white_papers/QR%201%20A%20Case%20for%20QR.doc.

35.

Plueddemann

(1981). Curriculum improvement through evaluation. Christian Education Journal, 8(1), 55–60.

36.

Robbins

(1990). Youth ministry nuts and bolts: Mastering the ministry behind the scenes. Grand Rapids, MI: Zondervan.

37.

Roen

(1989). The inward ear: A sermon evaluation method for preachers and hearers of the Word. Washington DC: Alban.

38.

Schön

D. A.

(1983). The reflective practitioner: How professionals think in action. New York, NY: Basic Books.

39.

Schön

D. A.

(1987). Educating the reflective practitioner: Toward a new design for teaching and learning in the professions. San Francisco, CA: Jossey-Bass.

40.

Senge

P. M.

(2000). Schools that learn: A fifth discipline fieldbook for educators, parents, and everyone who cares about education. New York, NY: Doubleday

41.

Setran

, & Ramler

(2012). Re-imagining Frankena: Toward a holistic model for philosophy of ministry. Christian Education Journal, 9(1), 7–26.

42.

Severe

(2006). The Pac-man syndrome: The missing congruence of philosophy and practice in youth ministry. The Journal of Youth Ministry, 4(2), 75–104.

43.

Severe

(2010). Epistemological assumptions in evaluation: The intersection between philosophy and practice in youth ministry. Christian Education Journal, 7(1), 6–29.

44.

Shavelson

R. J.

, McDonnell

, & Oakes

(1991). What are educational indicators and indicator systems? Practical Assessment, Research and Evaluation, 2(11) Retrieved from http://PAREonline.net/getvn.asp?v=2&n=11.

45.

Shavelson

R. J.

, Ruiz-Primo

M. A.

, & Wiley

E. W.

(2005). Windows into the mind. Higher Education: The International Journal of Higher Education and Educational Planning, 49(4), 413–430.

46.

Shimamura

A. P.

(2000). Toward a cognitive neuroscience of metacognition. Consciousness and Cognition, 9(1) 313–323.

47.

Smith

(2001). Chris Argyris: Theories of action, double-loop learning and organizational learning. The Encyclopedia of Informal Education. Retrieved from www.infed.org/thinkers/argyris.htm.

48.

Strommen

(1968). Evaluation and Christian growth. Review and Expositor, 65(2), 195–207.

49.

Strommen

, Jones

, & Rahn

(2001). Youth ministry that transforms: A comprehensive analysis of the hopes, frustrations, and effectiveness of today's youth workers. Grand Rapids, MI: Youth Specialties/Zondervan.

50.

Wenger

(1998). Communities of practice. Cambridge, UK: Cambridge University Press.

51.

Wenger

, & Snyder

(1998). Are you ready for communities of practice? Harvard Business Review, 78(1), 139–145.

52.

Westing

(1984). Evaluate and grow. Wheaton, IL: Victor.

53.

Wiggins

, & McTighe

(1998). Understanding by design. Alexandria, VA: Association for Supervision and Curriculum Development.

54.

Zohar

(2006). The nature and development of teachers’ metastrategic knowledge in the context of teaching higher order thinking. Journal of the Learning Sciences, 15(3), 331–377.