Evaluations of new methods of teaching Organizational Behavior (OB) usually rely on course ratings collected at the end of the semester. This article discusses the need for more rigorous designs for assessing teaching innovations, and proposes evaluating OB courses on the basis of change in self-ratings of managerial competencies. Selfratings of managerial competencies and a more sophisticated evaluation design are used to compare the Practical Organizational Behavior Education (PROBE) method to the lecture/tutorial method of delivering of OB material. PROBE produces greater perceived managerial skill learning than lecture/tutorial delivery for females, younger students, students with little work experience, and students from Western cultures. The discussion points out how incorrect conclusions might have been reached about the relative effectiveness of the two methods had a less sophisticated evaluation design been used.
Get full access to this article
View all access options for this article.
References
1.
Alliger, G. M.
,& Janak, E. A. (1989). Kirkpatrick’s levels of training criteria: Thirty years later. Personnel Psychology, 42, 331-342.
2.
Barry, D.
(1989-1990). Twincorp: Extensions of the classroom-as-organization model. Organizational Behavior Teaching Review, 14(1), 1-15.
3.
Betton, J. H.
(1991). Simulating organizations: A student-documented history of emergent behavior. Journal of Management Education, 15, 193-205.
4.
Bigelow, J.
(1983). Teaching action skills: Areport from the classroom.Exchange, 8(2), 28-34.
5.
Boyatzis, R.
(1982). The competent manager. New York: Wiley.
6.
Brown, A. D.
,& Neilson, A. (1993). The pros and cons of experientially based projects. Journal of Management Education, 17, 498-504.
7.
Burgoyne, J.
,& Stuart, R. (1991). Teaching and learning methods in management development. Personnel Review, 20(3), 27-22.
Carli, L. L.
(1989). Gender differences in interaction style and influence. Journal of Personality and Social Psychology, 56, 565-576.
10.
Carter, C.
, Nicholson, J., & Barlow, M. (1995). The Australian manager of the twenty-first century. In Karpin Committee (Ed.), Enterprising nation: Renewing Australia’s managers to meet the challenges of the Asia-Pacific century (Vol. 2, pp. 1223-1288). Canberra: Australian Government Publishing Service.
11.
Daly, J. P.
,& Worrell, D. L. (1993). Structuring group projects as miniature organizations. Journal of Management Education, 17, 236-242.
12.
Dickenson, C. A.
, Fisher, C. D., Shaw, J. B.,& Southey, G. N. (1995). Teaching HRM and managerial skills with the “living case.”Asia Pacific Journal of Human Resources, 33, 22-39.
13.
Elmes, M. B.
(1994). Paradox and pedagogy in the charismatic organizational behavior classroom. Journal of Management Education, 18, 7-20.
14.
Ford, J. D.
(1994). Management education: Shifting our assumptions. Journal of Management Education, 18, 212-226.
15.
Golembiewski, R. T.
, Billingsley, K.,& Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133-157.
16.
Goltz, S. M.
(1992). Practicing management in the classroom. Journal of Management Education, 16, 444-460.
17.
Harrison, J. K.
(1994). Experiencing quality undertakings in practice (EQUIP): Integrating total quality management theory and practice into the organizational behavior curriculum. Journal of Management Education, 18, 356-358.
18.
Hayes, J.
(1996). The Cognitive Style index: A measure of intuition analysis for organizational research. Journal of Management Studies, 33, 119-135.
19.
Hayes, J.
,& Allinson, C. W. (1996). The implications of learning styles for training and development: A discussion of the matching hypothesis. British Journal of Management, 7, 63-73.
20.
Hofstede, G.
(1984). Culture’s consequences. Beverly Hills, CA: Sage.
21.
Howard, G. S.
, & Dailey, P. R. (1979). Response-shift bias: A source of contamination of selfreport measures. Journal of Applied Psychology, 64, 144-150.
22.
Hunt, G.
(1991). Design for a group project. Journal of Management Education, 15(2), 497-501.
23.
Karpin Committee
. (1995, April). Enterprising nation: Renewing Australia’s managers to meet the challenges of the Asia-Pacific century (Report of the Industry Task Force on Leadership and Management Skills). Canberra: Australian Government Publishing Service.
24.
Kimber, D.
(1996). Collaborative learning in management education: Issues, benefits, problems, and solutions: A literature review [Online]. Available: http://ultibase.rmit.edu.au
25.
Kirkbride, P. S.
, & Tang, S.F.Y. (1992). Management development in the Nanyang Chinese societies of South East Asia. Journal of Management Development, 11, 51-63.
26.
Kirkpatrick, D. L.
(1983, November). Four steps to measuring training effectiveness. Personnel Administrator, 19-25.
27.
Knowles, M.
(1990). The adult learner: A neglected species (4th ed.). Houston, TX: Gulf.
28.
Liow, S.
, Betts, M., & Lit, K.L.J. (1991, September). Selecting teaching methods for differing educational objectives in higher education. Paper presented at the Fifth Annual Conference of the Educational Research Association, Singapore.
29.
McKeachie, W. J.
(1997). Student ratings: The validity of use. American Psychologist, 52, 1218-1225.
30.
Miller, J. A.
(1991). Experiencing management: A comprehensive, “hands-on” model for the introductory undergraduate management course. Journal of Management Education, 15, 151-169.
31.
Miner, R.
(1992). Reflections of teaching a large class. Journal of Management Education, 16, 290-302.
32.
Naumes, M. J.
(1993). A comparison of two teaching designs using the Organization Game as a measure of outcome performance. Journal of Management Education, 17, 360-373.
33.
Nirenberg, J.
(1994). An introduction to PROBE: Practical organizational behavior education. Journal of Management Education, 18, 324-321.
34.
Pollard, H. G.
, & Giacalone, R. A. (1985-1986). Linking organizational behavior simulations. Organizational Behavior Teaching Review, 10 (2), 19-27.
35.
Russo, E. J.
, & Schoemaker, P.J.H. (1992). Managing overconfidence. Sloan Management Review, 33(2), 7-17.
36.
Shaw, J. B.
, & Fisher, C. D. (1999). Practical Organizational Behavior Education (PROBE): Modifications and innovations. Journal of Management Education, 23(1), 13-30.
37.
Tannenbaum, S. I.
,& Woods, S. R. (1992). Determining a strategy for evaluating training: Operating within organizational constraints. Human Resource Planning, 15(2), 63-81.
38.
Terborg, J. R.
, Howard, G. S., & Maxwell, S. E. (1980). Evaluating planned organizational change: A method for assessing alpha, beta, and gamma change. Academy of Management Review, 5, 109-121.
39.
Walck, C. L.
, & Jordan, A. T. (1993). Using ethnographic techniques in the organizational behavior classroom. Journal of Management Education, 17, 197-217.
40.
Wallace, J.
, & Hunt, J. (1996). An analysis of managerial competencies across hierarchical levels and industry sectors: A contemporary Australian perspective. Journal of the Australian and New Zealand Academy of Management, 2, 36-47.
41.
Wexley, K. N.
, & Latham, G. P. (1991). Developing and training human resources in organizations. New York: Harper Collins.
42.
Whetton, D. A.
, & Cameron, K. S. (1991). Developing management skills (2nd ed.). Glenview, IL: Scott, Foresman.
