Recently, text-based causal maps (TBCMs) have generated enthusiasm as a methodological tool because they provide a way of accessing large, untapped sources of data generated by organizations. Although TBCMs have been used extensively in organizational behavior and strategic management research, studies assessing the psychometric properties of TBCM measures are virtually nonexistent. With the intention of facilitating large-sample substantive research using TBCMs, the authors examine the construct validity of two most frequently employed structural properties of TBCMs: complexity and centrality. In assessing construct validity, they examine the internal consistency, dimensionality, and predictive validity of the structural properties. The results suggest that complexity is not a general cognitive attribute. Rather, it is indicative of domain knowledge. On the other hand, centrality, which reflects the degree of hierarchy characterizing the TBCM, is related to cognitive ability and may reflect general information processing. Moreover, complexity and centrality, but not cognitive ability, predicted student performance.
Adams, R. S. (1970). Perceived teaching styles. Comparative Education Review, 50, 39-40.
2.
Adams-Webber, J. R. (1979). Personal construct theory. London: John Wiley & Sons.
3.
Amernic, J. H., & Beechy, T. H. (1979). Accounting students’performance and cognitive complexity: Some empirical evidence. Accounting Review, 50, 300-314.
4.
Anderson, J. C., & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732-740.
5.
Axelrod, R. (1976). The structure of decision. Princeton, NJ: Princeton University Press.
6.
Barr, P. S., Stimpert, J. L., & Huff, A. S. (1992). Cognitive change, strategic action, and organizational renewal. Strategic Management Journal, 13, 15-36.
7.
Bieri, J. (1961). Complexity and simplicity as a personality variable in cognitive and preferential behavior. In D. W. Fiske & S. R. Maddi (Eds.), Functions of varied experiences (pp. 355-366). Homewood, IL: Dorsey.
8.
Bieri, J., & Blacker, E. (1956). The generality of cognitive complexity in the perception of people and inkblots. Journal of Abnormal and Social Psychology, 53, 112-117.
9.
Bonham, G. M. (1993). Cognitive mapping as a technique to support international negotiation. Theory, 34, 255-273.
10.
Borg, W. (1979). Teacher coverage of academic content and pupil achievement. Journal of Educational Psychology, 71, 435-445.
11.
Bougon, M., Wieck, K., & Binkhorst, D. (1977). Cognition in organizations: An analysis of Utrecht Jazz Orchestra. Administrative Science Quarterly, 22, 606-639.
12.
Brown, S. (1992). Cognitive mapping and repertory grids for qualitative survey research: Some comparative observations. Journal of Management Studies, 29, 287-305.
13.
Calori, R., Johnson, G., & Sarnin, P. (1994). CEOs’cognitive maps and the scope of the organization. Strategic Management Journal, 15, 437-457.
14.
Carley, K. (1997). Extracting team mental models through textual analysis. Journal of Organizational Behavior, 18, 183-213.
15.
Carley, K., & Palmquist, M. (1992). Extracting, representing and analyzing mental models. Social Forces, 70, 601-636.
16.
Chen, K. H., & Olson, S. K. (1989). Measuring cognitive complexity in the accounting domain. Behavioral Research in Accounting, 1, 160-182.
17.
Chi, M. T., & Glaser, R. (1985). Problem solving abilities. In R. Sternberg (Ed.), Human abilities: An information processing approach (pp. 227-257). San Francisco: Freeman.
18.
Christensen, C. R. (1987). Teaching with cases at the Harvard Business School. In C. R. Christensen (Ed.), Teaching and the case method (pp. 184-186). Boston: Harvard Business School Press.
19.
Cossette, P., & Audet, M. (1992). Mapping of an idiosyncratic schema. Journal of Management Studies, 29, 325-347.
20.
Daniels, K., & De Chernatony, L. (1995). Validating a method for mapping managers’ mental models of competitive industry structures. Human Relations, 48, 975-991.
21.
Dehler, G. E. (1996). Management education as intentional learning: A knowledge-transforming approach to written composition. Journal of Management Education, 20, 221-235.
22.
Dodrill, C. B. (1983). Long term reliability of the Wonderlic personnel test. Journal of Consulting and Clinical Psychology, 51, 316-317.
23.
Eccles, J. C. (1994). How the self controls its brain. Berlin: Springer.
24.
Eden, C.(1992). On the nature of cognitive maps. Journal of Management Studies, 29, 261-265.
25.
Eden, C., Ackermann, F., & Cropper, S. (1992). The analysis of cause maps. Journal of Management Studies, 29, 309-324.
26.
Eden, C., Jones, S., & Sims, D. (1979). Thinking in organizations. London: Macmillan.
27.
Eden, C., Jones, S., & Sims, D. (1983). Messing about in problems. Oxford, UK: Pergamon.
28.
Eden, C., Jones, S., Sims, D., & Smithin, T. (1981). The intersubjectivity of issues and issues of intersubjectivity. Journal of Management Studies, 18, 37-47.
29.
E. F.Wonderlic & Associates. (1983). Wonderlic personnel test manual.Northfield, IL: Author.
30.
Eleanor, T. L., Diesner, J.,& Carley, K. (2001, July). Using automated text analysis to study self-presentation strategies. Paper presented at the Computational Analysis of Social and Organizational Systems (CASOS) conference, Pittsburgh, PA.
31.
Fahey, L., & Narayanan, V. K. (1989). Linking changes in revealed causal maps and environmental change: An empirical study. Journal of Management Studies, 26, 361-378.
32.
Fiol, M.,& Huff, A. (1992). Maps for managers. Journal of Management Studies, 29,267-285.
33.
Fisk, S. T., & Taylor, S. E. (1991). Social cognition (2nd ed.). New York: McGraw-Hill.
34.
Ford, J., & Hegarty, H. (1984). Decision makers’ beliefs about the causes and effects of structure: An exploratory study. Academy of Management Journal, 27, 271-291.
35.
Gatewood, R. D., & Field, H. S. (1994). Human resource selection (3rd ed.). Fort Worth, TX: Dryden Press.
36.
Gentner, D., & Stevens, A. L. (1983). Mental models. Hillsdale, NJ: Lawrence Erlbaum.
37.
Glover, J. D., & Hower, R. M. (1952). The administrator: Cases on human relations in business. Homewood, IL: Richard D. Irwin, Inc.
38.
Goldberg, L. R. (1990). An alternative “description of personality”: The Big Five factor structure. Journal of Personality and Social Psychology, 59, 1216-1229.
39.
Hackner, Y. E. R. (1991, August). Integrated complexity and profitability. Paper presented at Academy of Management Conference, Miami, FL.
40.
Hodgson, A. M., & Dill, W. R. (1970, January/February). Programmed case: The misfired missive. Harvard Business Review, p. 148-148.
41.
Hong, E., & O’Neil, F. (1992). Instructional strategies to help learners build relevant mental models in inferential statistics. Journal of Educational Psychology, 84, 150-159.
42.
Huff, A. S., & Fletcher, A. E. (1990). Conclusion: Key mapping decisions. In A. S. Huff (Ed.), Mapping strategic thought (pp. 403-421). New York: John Wiley.
43.
Hunter, J. E. (1989). The Wonderlic Personnel Test as a predictor of training success and job performance. Northfield, IL: E. F. Wonderlic, Inc.
44.
Johnson-Laird, P. N., & Nicholas, P. (1983). Mental models: Toward a cognitive science of language, inference and consciousness. Cambridge, MA: Harvard University Press.
45.
Kirk, B. A., Cummings, R. W., & Golstein, L. D. (1962). Predicting success in graduate business courses. California Management Review, 5, 63-67.
46.
Kleitman, N. (1963). Sleep and wakefulness. Chicago: University of Chicago Press.
47.
Knoke, K., & Kuklinski, J. H. (1982). Network analysis: Quantitative applications in the social sciences (Sage University Paper Series 07-028). Beverly Hills, CA: Sage.
48.
Langfield-Smith, K., & Lewis, G. (1989). Mapping cognitive structures: A pilot study to develop a research method (Working Paper 14). University of Melbourne, Graduate School of Management, Melbourne, Australia.
49.
Laukkanen, M. (1994). Comparative causal mapping of organizational cognition. Organization Science, 51, 322-343.
50.
Levi, A., & Tetlock, P. E. (1980). A cognitive analysis of Japan’s 1941 decision for war. Journal of Conflict Resolution, 24, 195-211.
51.
Mann, I. T. (1979). Free response causal attribution and information requests regarding interpersonal events: An examination of Kelley’s attribution model. Unpublished doctoral dissertation, Michigan State University.
52.
Marek, P., Griggs, R. A., & Koenig, C. S. (2000). Reducing cognitive complexity in a hypothetico-deductive reasoning task. Thinking and Reasoning, 6, 253-265.
53.
Miner, F. C., Jr., Das, H., & Gale, J. (1984). An investigation of the relative effectiveness of three diverse teaching methodologies. Organizational Behavior Teaching Review, 9, 49-59.
54.
Mintzberg, H., & Quinn, R. (1998). Readings in strategy process (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
55.
Mohammed, S., Klimoski, R., & Rentsch, J. (2000). The measurement of team mental models: We have no shared schema. Organizational Research Methods, 3, 123-165.
56.
Mount, M., & Barrick, M. (1994). Validity of observer ratings of the big five personality factors. Journal of Applied Psychology, 79, 272-281.
57.
Myers, A. (1982). Introduction to types. Palo Alto, CA: Consulting Psychologists Press.
58.
Narayanan, V., & Fahey, L. (1990). The evolution of revealed causal maps during decline: A case study of Admiral. In A. Huff (Ed.), Mapping strategic thought (pp. 109-134). New York: John Wiley.
59.
Newstead, S. E., & Griggs, R. A. (1992). Thinking about THOG: Sources of error in deductive reasoning problem, Psychological Research, 54, 299-305.
60.
Nozicka, G., Bonha, G., & Shapiro, M. (1976). Simulation techniques. In R. Axelrod (Ed.), Structure of decision: The cognitive maps of political elites (pp. 349-359). Princeton, NJ: Princeton University Press.
61.
Perrow, C. (1970). Organizational analysis: A sociological view. Belmont, CA: Wadsworth.
62.
Piaget, J. (1972). The psychology of the child. New York: Basic Books.
63.
Reger, R. K. (1990). The repertory grid technique for eliciting the content and structure of cognitive constructive systems. In A. S. Huff (Ed.), Mapping strategic thought (pp. 225-241). New York: John Wiley.
64.
Rentsch, J. R., Heffner, T. S., & Duffy, L. T. (1994). What you know is what you get from experience: Team experience related to teamwork schemas. Group and Organization Management, 19, 450-474.
65.
Ryan, A. M., & Sackett, P. R. (1987). A survey of individual assessment practices by I/O psychologists. Personnel Psychology, 40, 455-489.
66.
Schmidt, F. (2002). The role of general cognitive ability and job performance: Why there cannot be a debate. Human Performance, 15, 187-210.
Schneider, S. C., & Angelmar, R. (1993). Cognition in organizational analysis: Who’s minding the store?Organization Studies, 14, 347-374.
69.
Schwab, D. P. (1980). Construct validity in organizational behavior. Research in Organizational Behavior, 2, 3-44.
70.
Skinner, N. F. (1985). University grades and time of day of instruction. Bulletin of the Psychonomic Society, 23, 67-67.
71.
Sorenson, R., Savage, G., & Hartman, L. (1993). Motivating students to improve business writing: A comparison between goal-based and punishment-based grading systems. Journal of Business Communication, 30, 113-133.
72.
Stone, E. (1978). Research methods in organizational behavior.Glenview, IL: Scott, Foresman.
73.
Streitz, N. A. (1988). Mental models and metaphors: Implications for the design of adaptive user-system interfaces. In H. Mandl & A. Lesgold (Eds.), Learning issues for intelligent tutoring systems (pp. 164-186). New York: Springer-Verlag.
74.
Stubbart, C. I., & Ramaprasad, A. (1988). Probing two executives’schematic knowledge of the U.S. steel industry using cognitive maps. In R. Lamb & P. Shrivastava (Eds.), Advances in strategic management (pp. 139-164). Greenwich, CT: JAI.
75.
Tobias, S. (1994). Interest, prior knowledge, and learning. Review of Educational Research, 64, 37-54.
76.
Varma, P., & Krishnan, L. (1986). The effect of cognitive complexity and nature of the outcome on causal attribution. Journal of Social Psychology, 126, 639-647.
77.
Walsh, J. P. (1995). Managerial and organizational cognition: Notes from a trip down memory lane. Organization Science, 6, 280-321.
78.
Whetten, D. A., & Clark, S. C. (1996). An integrated model for teaching management skills. Journal of Management Education, 20, 152-181.
79.
White, B. Y., & Frederiksen, J. R. (1986). Progressions of qualitative models as a foundation for intelligent learning environments (Report No. 6277). Cambridge, MA: Bolt, Beranek, & Newman Laboratories.
80.
Wilson, J. R., & Rutherford, A. (1989). Mental models: Theory and application in human factors. Human Factors, 31, 617-634.
81.
Winston, P. H. (1984). Artificial intelligence (2nd ed.). Cambridge, MA: Addison Wesley.
