The aim of this paper was to propose and test the factor structure of a new self-report questionnaire on leadership. A sample of 373 school principals in the Province of Quebec, Canada completed the initial 46-item version of the questionnaire. In order to obtain a questionnaire of minimal length, a four-step procedure was retained. First, items analysis was performed using Classical Test Theory. Second, Rasch analysis was used to identify non-fitting or overlapping items. Third, a confirmatory factor analysis (CFA) using structural equation modelling was performed on the 21 remaining items to verify the factor structure of the scale. Results show that the model with a single third-order dimension (leadership), two second-order dimensions (transactional and transformational leadership), and one first-order dimension (laissez-faire leadership) provides a good fit to the data. Finally, invariance of factor structure was assessed with a second sample of 222 vice-principals in the Province of Quebec, Canada. This model is in agreement with the theoretical model developed by Bass (1985), upon which the questionnaire is based.
Get full access to this article
View all access options for this article.
References
1.
Alimo-MetcalfeB.Alban-MetcalfeR. J. (2001) The development of a new Transformational Leadership Questionnaire. Journal of Occupational and Organizational Psychology, 74, 1–27.
2.
AndrichD. (1978) A rating formulation for ordered response categories. Psychometrika, 43, 561–573.
3.
AntonakisJ.AvolioB. J.SivasubramaniamN. (2003) Context and leadership: an examination of the nine-factor full-range leadership theory using the Multifactor Leadership Questionnaire. The Leadership Quarterly, 14, 261–295.
4.
AtwaterL. E.YammarinoF. J. (1992) Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?Personnel Psychology, 45, 141–164.
5.
AvolioB. J.BassB. M.JungD. I. (1999) Re-examining the components of transformational and transactional leadership using the Multifactor Leadership Questionnaire. Journal of Occupational and Organizational Psychology, 72, 441–462.
6.
BassB. M. (1985) Leadership and performance beyond expectations. New York: Free Press.
7.
BassB. M. (1997) Does the transactional-transformational leadership paradigm transcend organizational and national boundaries?American Psychologist, 52, 130–139.
8.
BassB. M.AvolioB. J. (1997) Full range of leadership: manual for the Multi-factor Leadership Questionnaire. Palo Alto, CA: Mind Garden.
9.
BassB. M.AvolioB. J.AtwaterL. (1996) The transformational and transactional leadership of men and women. Applied Psychology: An International Review, 45, 5–34.
10.
BentlerP. M. (1990) Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.
11.
BentlerP. M. (1995) EQS structural equations program manual. Encino, CA: Multivariate Software, Inc.
12.
BurnsJ. M. (1978) Leadership. New York: Harper and Row.
13.
BycioP.HackettR. D.AllenJ. S. (1995) Further assessments of Bass's (1985) conceptualization of transactional and transformational leadership. Journal of Applied Psychology, 80(4), 468–478.
14.
ByrneB. M. (1995) One application of structural equation modeling from two perspectives: exploring the EQS and LISTEL strategies. In HoyleR. H. (Ed.), Structural equation modeling: concepts, issues, and applications. Sage Publications: Los Angeles, CA. Pp. 138–157.
15.
ColeJ. C.RabinA. S.SmithT. M.KaufmanA. S. (2004) Development and validation of a Rasch-derived CES-D short form. Psychological Assessment, 16(4), 360–372.
16.
CongerJ. A.KanungoR. N. (2006) Charismatic leadership in organizations: perceived behavioral attributes and their measurement. Journal of Organizational Behavior, 15, 439–452.
17.
CrockerL.AlginaJ. (1986) Introduction to classical and modern test theory. New York: Harcourt Brace Jovanovich College Publishers.
18.
CronbachL. J. (1951) Coefficient alpha and the internal structure of tests. Psychometrika, 6, 297–334.
19.
DaughtryL. H. (1995) Vocational administrator leadership effectiveness as a function of gender and leadership style. Dissertation Abstracts International. (University Microfilms No. 9611275).
DussaultM.ValoisP.FrenetteÉ. (2007) Validation de l'échelle de Leadership Transformatif du directeur d'école [School principals' transformational leadership: validation of a scale]. Psychologie du Travail et des Organisations, 13(2), 37–52. [in French]
FoxC. M.JonesJ. A. (1998) Uses of Rasch modeling in counseling psychology research. Journal of Consulting Psychology, 45, 39–45.
24.
GuntherM.EvansG.MeffordL.CoeT. R. (2007) The relationship between leadership styles and empathy among student nurses. Nursing Outlook, 55, 196–201.
25.
HeinitzK.LiepmannD.FelfeJ. (2005) Examining the factor structure of the MLQ: recommendation for a reduced set of factors. European Journal of Psychological Assessment, 21(3), 182–190.
26.
HorwitzI. B.HorwitzS. K.DaramP.BrandtM. L.BrunicardiF. C.AwadS. S. (2008) Transformational, transactional, and passive-avoidant leadership characteristics of a surgical resident cohort: analysis using the multifactor leadership questionnaire and implications for improving surgical education curriculums. Journal of Surgical Research, 148, 49–59.
27.
HowellJ. M.AvolioB. J. (1993) Transformational leadership, transactional leadership, locus of control, and support for innovation: key predictors of consolidated-business-unit performance. Journal of Applied Psychology, 78(6), 891–902.
28.
HuL-T.BentlerP. M. (1999) Cutoff criteria for fix indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6(10), 1–55.
29.
KaneT. D.TrembleT. R. (2000) Transformational leadership effects at different levels of the Army. Military Psychology, 12(2), 137–160.
30.
KansteO.MiettunenJ.KyngaH. (2007) Psychometric properties of the Multifactor Leadership Questionnaire among nurses. Journal of Advanced Nursing, 57(2), 201–212.
31.
KellowayE. K.MullenJ.FrancisL. (2006) Divergent effects of transformational and passive leadership on employee safety. Journal of Occupational Health Psychology, 11(1), 76–86.
32.
KlineP. (1999) The handbook of psychological testing. (2nd ed.) London, UK: Routledge.
33.
KohW. L.SteersR. M.TerborgJ. R. (1995) The effects of transformational leadership on teacher attitudes and student performance in Singapore. Journal of Organizational Behavior, 16, 319–333.
34.
LaveaultD.GrégoireJ. (1997) Introduction aux théories des tests en sciences humaines [Introduction to testing theories in human sciences].Paris, Bruxelles: DeBoeck université. [in French]
35.
LeithwoodK.SteinbachR.JantziD. (2002) School leadership and teachers' motivation to implement accountability policies. Educational Administration Quarterly, 38(1), 94–119.
36.
LinacreJ. M. (2002) What do infit and outfit, mean-square and standardized mean?Rasch Measurement Transactions, 16(2), 878.
37.
LinacreJ. M.WrightB. D. (1999) WINSTEPS Rasch-model computer program, Version 2.88. Chicago: MESA Press, [computer software].
38.
MarshH. W.BallaJ. R.McDonaldR. P. (1988) Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychological Bulletin, 103, 391–411.
39.
MarshH. W.EllisL.ParadaL.RichardsG.HeubeckB. G. (2005) A short version of the Self Description Questionnaire II: operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. Psychological Assessment, 17, 81–102.
40.
McDonaldR. P. (1999) Test theory: a unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
41.
NunallyJ. C. (Ed.) (1978) Psychometric theory. (2nd ed.) New York, NY: McGraw-Hill.
42.
O'SheaP. G.FotiR. J.HauensteinN. M. A.BycioP. (2009) Are the best leaders both transformational and transactional? A patern-oriented analysis. Leadership, 5(2), 237–259.
43.
RaschG. (1960) Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press.
44.
RowoldJ. (2006) Transformational and transactional leadership in martial arts. Journal of Applied Sport Psychology, 18(4), 312–325.
45.
RowoldJ.HeinitzK. (2007) Transformational and charismatic leadership: assessing the convergent, divergent and criterion validity of the MLQ and the CKS. The Leadership Quarterly, 18, 121–133.
46.
SantorD. A.CoyneJ. C. (1997) Shortening the CES-D to improve its ability to detect cases of depression. Psychological Assessment, 9, 233–243.
47.
SashkinM. (1988) The visionary principal: school leadership for the next century. Education and Urban Society, 20, 239–249.
48.
SchumackerR. E.LomaxR. G. (1996) A beginner's guide to structural equation modeling. Mahwah, NJ: Lawrence Erlbaum Associates.
49.
SilinsH. C. (1992) Effective leadership for school reform. The Alberta Journal of Educational Research, 38, 317–334.
50.
SmithA. B.WrightE. P.RushR.StarkD. P.VelikovaG.ShelbyP. J. (2006) Rasch analysis of the dimensional structure of the Hospital Anxiety and Depression Scale. Psychooncology, 15, 817–827.
51.
SteigerJ. H. (1990) Structural model evaluation and modification: an interval estimation approach. Multivariate Behavioral Research, 25, 173–180.
52.
SteppP. L.ChoH.ChungS. (no date available) Perceived differences in leadership styles of people of color: transformational or transactional? Unpublished manuscript, Cornell University, Ithaca, New York.
53.
TejedaM. J.ScanduraT. A.PillaiR. (2001) The MLQ revisited: psychometric properties and recommendations. The Leadership Quarterly, 12, 31–52.
54.
TepperB. J.PercyP. M. (1994) Structural validity of the multifactor leadership questionnaire. Educational and Psychological Measurement, 54(3), 734–744.
55.
ThiteM. (2000) Leadership styles in information technology projects. International Journal of Project Management, 18, 235–241.
56.
TuckerL. R.LewisC. (1973) A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.
57.
VandenbergC.StordeurS.D'hooreW. (2002) Transactional and transformational leadership in nursing: structural validity and substantive relationships. European Journal of Psychological Assessment, 18(1), 16–29.
58.
van de SchootR.LugtigP.HoxJ. (2012) Developmetrics: a checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492.
59.
WaldmanD. A.BassB. M.EinsteinW. (1987) Leadership and outcomes of performance appraisal processes. Journal of Occupational Psychology, 60, 177–186.
60.
WalumbwaF. O.AvolioB. J.GardnerW. L.WernsingT. S.PetersonS. J. (2008) Authentic leadership: development and validation of a theory-based measure. Journal of Management, 34(1), 89–126.
WrightB. D.StoneM. H. (1979) Best test design. Chicago, IL: MESA Press.
63.
ZagorsekH.StroughS. J.JaklicM. (2006) Analysis of the reliability of the leadership practices inventory in the item response theory framework. International Journal of Selection and Assessment, 14(2), 180–191.
