This article illustrates that any bivariate or multiple regression provides inadequate information about the levels of analysis in a data set collected in an organizational setting. As a result, individual-level effects may be incorrectly attributed to the group level, and group-level effects may be incorrectly viewed as being solely individual-level effects. Both of these situations are examples of the “fallacy of the wrong level.” Within and between analysis (WABA) allows levels of analysis to be tested in data. These WABA tests are useful in numerous analytical approaches, including structural equation modeling, hierarchical linear modeling, and various approaches to aggregation. This article provides a decision tree for use in performing tests for multiple alternative levels of analysis in a data set collected in organizations.
Ashkanasy, N. M. (2003). Emotions in organizations: A multi-level perspective. In F. Dansereau & F. J. Yammarino (Eds.), Multi-level issues in organizational behavior and strategy (Vol. 2, pp. 9-54). Amsterdam: JAI/Elsevier.
2.
Bandura, A. (1985). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
3.
Berson, Y., Avolio, B. J., & Kahai, S. (2003). Level specification: Using triangulation in a grounded theory approach to construct validation. In F. Dansereau & F. J. Yammarino (Eds.), Multi-level issues in organizational behavior and strategy (Vol. 2, pp. 85-112). Amsterdam: JAI/Elsevier.
4.
Bliese, P. D. (1998). Group size, ICC values and group-level correlations: A simulation. Organizational Research Methods, 1, 355-373.
5.
Bryk, R. J., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
6.
Cortina, K. S., Pant, H. A., & Smith-Darden, J. (2005). Multivariate latent growth models: Reading the covariance matrix for multi-level interpretations. In F. Dansereau & F. J. Yammarino (Eds.),Multi-level issues in strategy and methods (Vol. 4, pp. 277-318). Amsterdam: JAI/Elsevier.
7.
Dansereau, F., Alutto, J., & Yammarino, F. J. (1984). Theory testing in organizational behavior: The varient approach. Englewood Cliffs, NJ: Prentice Hall.
8.
Dansereau, F., Graen, G., & Haga, W. (1975). A vertical dyadic linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process. Organizational Behavior and Human Performance, 13, 46-70.
9.
Dansereau, F., & McConnell, J. (2000). Multivariate DETECT manual. The Institute for Theory Testing. Available at http://www.levelsofanalysis.com
10.
Dansereau, F., & Yammarino, F. (2000). Within and between analysis: The varient paradigm as an underlying approach to theory building and testing. In K. Klein & S. Kozlowski (Eds.),Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 425-466). San Francisco: Jossey-Bass.
11.
Dansereau, F., & Yammarino, F. J. (2004). Introduction to multi-level issues in organizational behavior and processes. In F. J. Yammarino & F. Dansereau (Eds.),Multi-level issues in organizational behavior and processes (Vol. 3, pp. xiii-xxxiii). Amsterdam: JAI/Elsevier.
12.
Dansereau, F., Yammarino, F. J., Markham, S. E., Newman, J., Dumas, M., Nachman, S., et al. (1995). Individualized leadership: A new multiple level approach. Leadership Quarterly, 6, 413-450.
13.
Dionne, S. D., Randel, A. E., Jaussi, K. S., & Chun, J. U. (2004). Diversity and demography in organizations: A levels of analysis review of the literature. In F. J. Yammarino & F. Dansereau (Eds.),Multi-level issues in organizational behavior and processes (Vol. 3, pp. 181-229). Amsterdam: JAI/Elsevier.
14.
Earley, C. P., & Mosakowski, E. (2002). Linking culture and behavior in organizations: Suggestions for theory development and research methodology. In F. J. Yammarino & F. Dansereau (Eds.),The many faces of multi-level issues (Vol. 1, pp. 297-319). Amsterdam: JAI/Elsevier.
15.
Ferris, G. R., Adams, G., Kolodinsky, R. W., Hochwarter, W. A., & Ammeter, A. P. (2002). Perceptions of organizational politics: Theory and research directions. In F. J. Yammarino & F. Dansereau (Eds.),The many faces of multi-level issues (Vol. 1, pp. 179-254). Amsterdam: JAI/Elsevier.
16.
George, J. M., & James, L. R. (1993). Personality, affect, and behavior in groups revisited: Comment on aggregation, levels of analysis, and a recent application of within and between analysis. Journal of Applied Psychology, 78, 798-804.
17.
Jelinek, M. (2003). Enacting the future: A time and levels-based view of strategic change. In F. Dansereau & F. Yammarino (Eds.),Multi-level issues in organizational behavior and strategy (Vol. 2, pp. 303-349). Amsterdam: JAI/Elsevier.
18.
Jung, D. I., & Sosik, J. J. (2003). Group potency and collective efficacy: Examining their predictive validity, level of analysis, and effects of performance feedback on future group performance. Group & Organization Management, 28, 366-391.
19.
Klein, K., Bliese, P. D., Kozlowski, S., Dansereau, F., Gavin, M. B., Griffin, M. A., et al. (2000). Multilevel analytical techniques: Commonalities, differences, and continuing questions. In K. Klein & S. Kozlowski (Eds.),Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 512-556). San Francisco: Jossey-Bass.
20.
Klein, K. J., Dansereau, F., & Hall, R. J. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195-229.
21.
Mackenzie, K. D. (2004). The process approach to multi-level organizational behavior. In F. J. Yammarino & F. Dansereau (Eds.),Multi-level issues in organizational behavior and processes (Vol. 3, pp. 347-417). Amsterdam: JAI/Elsevier.
22.
McComb, S. A., Woodard-Barringer, M., & Bourne, K. A. (2004). Understanding part-time work arrangements: A multi-level perspective. In F. J. Yammarino & F. Dansereau (Eds.), Multi-level issues in organizational behavior and processes (Vol. 3, pp. 3-55). Amsterdam: JAI/Elsevier.
23.
Moldoveanu, M. C., Baum, J. A. C., & Rowley, T. J. (2003). Information regimes, information strategies, and the evolution of interfirm network topologies. In F. Dansereau & F. J. Yammarino (Eds.),Multi-level issues in organizational behavior and strategy (Vol. 2, pp. 221-264). Amsterdam: JAI/Elsevier.
24.
Mumford, M. D., Schultz, R. A., & Osburn, H. K. (2002). Planning in organizations: Performance as a multi-level phenomenon. In F. J. Yammarino & F. Dansereau (Eds.),The many faces of multi-level issues (Vol. 1, pp. 3-65). Amsterdam: JAI/Elsevier.
25.
Ployhart, R. E., & Schneider, B. (2002). A multi-level perspective on personnel selection research and practice: Implications for selection system design, assessment, and construct validation. In F. J. Yammarino & F. Dansereau (Eds.),The many faces of multi-level issues(Vol. 1, pp. 95-140). Amsterdam: JAI/Elsevier.
26.
Reeves-Ellington, R. (2004). Trustscapes and distrustscapes: A multi-level approach for understanding stability and change. In F. J. Yammarino & F. Dansereau (Eds.),Multi-level issues in organizational behavior and processes (Vol. 3, pp. 91-148). Amsterdam: JAI/Elsevier.
27.
Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351-357.
28.
Schriesheim, C. (1995). Multivariate and moderated within and between-entity analysis (WABA) using hierarchical linear multiple regression. Leadership Quarterly, 6, 1-18.
29.
Schriesheim, C., Cogliser, C., & Neider, L. (1995). Is it “trustworthy?” A multiple levels of analysis reexamination of an Ohio State leadership study. Leadership Quarterly, 6, 111-145.
30.
Schriesheim, C., Neider, L., & Scandura, T. (1998). Delegation and leader–member exchange. Academy of Management Journal, 41, 298-318.
31.
Seitz, S. T., & Hulin, C. (2002). Multi-level simulation analysis: The dynamics of HIV/AIDS. In F. J. Yammarino & F. Dansereau (Eds.),The many faces of multi-level issues (Vol. 1, pp. 353-380). Amsterdam: JAI/Elsevier.
32.
Short, J. C., Palmer, T. B., & Ketchen, D. J. (2003). Multi-level influences on firm performance: Insights from the resource-based view and strategic groups research. In F. Dansereau & F. Yammarino (Eds.),Multi-level issues in organizational behavior and strategy (Vol. 2, pp. 155-187). Amsterdam: JAI/Elsevier.
33.
Wood, R., & Bandura, A. (1989). Social cognitive theory of organizational management. Academy of Management Review, 14, 361-384.
34.
Yammarino, F. J., & Dubinsky, A. J. (1992). Superior–subordinate relationships: A multiple-levels-of-analysis approach. Human Relations, 45, 575-600.
