The Performance Assessment for Leaders (PAL) was developed by a team of nationally recognized experts in response to a Massachusetts requirement to determine and evaluate the leadership abilities of candidates seeking initial school principal licensure. This article describes and evaluates research conducted on all aspects of a 2014-2015 statewide field trial of PAL. Findings suggest that this assessment is a valid and reliable measure of individual candidate competence for granting initial school leader licensure, and is a positive, educative experience for candidates. It concludes with implications for use elsewhere.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for Educational and Psychological Testing. Washington DC: American Educational Research Association.
2.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for Educational and Psychological Testing. Washington, DC:American Educational Research Association.
3.
BlackA. M.EarnestG. W. (2009). Measuring the outcomes of leadership development programs. Journal of Leadership & Organizational Studies, 16, 184-196.
4.
BriggsK.CheneyG. R.DavisJ.MollK. (2013). Operating in the dark: What outdated state policies and data gaps mean for effective school leadership. Dallas, TX: George W. Bush Institute.
5.
BrykA. S.SebringP. B.AllensworthE.LuppescuS.EastonJ. Q. (2010). Organizing schools for improvement: Lessons from Chicago. Chicago, IL: University of Chicago Press.
6.
CondonC.CliffordM. (2010). Measuring principal performance: How rigorous are commonly used principal performance assessment instruments?Naperville, Il: American Institutes for Research.
DavisS.EricksonD. E.KinseyG. W.Moore-StewardT.PadoverW.ThomasC.. . . WiseD. (2011). Reforming the California Public School Administrator licensure system through the alignment of research, policy, and practice: Policy perspectives and recommendations from the California Association of Professors of Educational Administration (CAPEA). CAPEA Education Leadership and Administration, 22, 66-82.
9.
Educational Leadership Constituent Council. (2011). Program report for the preparation of educational leaders. Washington, DC: National Policy Board for Educational Administration.
10.
EpsteinR. M. (2007). Assessment in medical education. New England Journal of Medicine, 356, 287-396.
11.
FeldtL. S.BrennanR. (1989). Reliability. In LinnR. L. (Ed.), Educational measurement (pp. 105-146). New York, NY: Palgrave Macmillan.
12.
Gadbury-AmyotC. C.McCrackenM. S.WoldtJ. L.BrennanR. L. (2014). Validity and reliability of portfolio assessment of student competence in two dental school populations: A four-year study. Journal of Dental Education, 78, 657-666.
13.
Gerhard-SzepS.GuntschA.PospiechP.SohnelA.ScheutzelP.WassmannT.ZahnT. (2016). Assessment formats in dental medicine: An overview. GMS Journal for Medical Education, 33(4), Doc65.
14.
GitomerD. H. (1993). Performance assessment and educational measurement. In WardW. C.BennettR. E. (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing and portfolio assessment (pp. 241-264). Hillsdale, NJ: Lawrence Erlbaum.
15.
GitomerD. H. (Ed.). (2012). Performance assessment and educational assessment. New York, NY: Routledge.
16.
GrissomJ. A.MitaniH.BlissettR. S. (2017). Principal licensure exams and future job performance: Evidence from the School Leaders Licensure Assessment. Educational Evaluation and Policy Analysis, 20(10), 1-33.
17.
HavyerR. D.WingoM. T.ComfereN.NelsonD. R.HalvorsenA. J.McDonaldF. S.ReedD. A. (2014). Teamwork assessment in internal medicine: A systematic review of validity evidence and outcomes. Journal of General Internal Medicine, 29, 894-910.
18.
HayesD.ChristieP.MillsM.LingardB. (2004). Productive leaders and productive leadership: Schools as learning organisations. Journal of Educational Administration, 42, 520-538.
19.
HooleE.MartineauJ. (2014). Evaluation methods. In DayD. (Ed.), The Oxford handbook of leadership and organizations (pp. 167-196). Oxford, UK: Oxford University Press.
20.
KennedyM. (Ed.). (2010). Teacher assessment and the quest for teacher quality. San Francisco, CA: Jossey-Bass.
21.
KiesewetterJ.Schmidt-HuberM.NetzelJ.KrohnA. C.AngstwurmM.FischerM. R. (2013). Training in leadership skills in medical education. GMS Zeitschrift für medizinische Ausbildung, 30(4), Doc49.
22.
KochanF. K.LockeD. L. (2009). Student assessment in educational leadership preparation programs. In YoungM. D.CrowG.MurphyJ.OgawaR. T. (Eds.), Handbook on the education of school leaders (pp. 417-456). New York, NY: Routledge.
23.
LalleyJ. (2017). Reliability and validity of edTPA. In CarterJ. H.LochteH. A. (Eds.), Teacher performance assessment and accountability reforms (pp. 47-78). New York, NY: Palgrave Macmillan.
24.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
25.
LeithwoodK.JantziD. (2008). Linking leadership to student learning: The contributions of leader efficacy. Educational Administration Quarterly, 44, 496-528.
26.
LinnR. L.BakerE. L.DunbarS. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15-21.
27.
LinquistE. F. (1951). Preliminary considerations in objective test construction. In LinquistE. F. (Ed.), Educational measurement (pp. 119-184). Washington, DC: American Council on Education.
28.
LouisK. S.LeithwoodK.WahlstromK. L.AndersonS. E. (2010). Investigating the links to improved student learning (Final report of research findings). Minneapolis, MN: University of Minnesota.
29.
MayH.SupovitzJ. A. (2011). The scope of principal efforts to improve instruction. Educational Administration Quarterly, 47, 332-352.
30.
MilesM.HubermanM. (1994). Qualitative data analysis: A sourcebook of new methods. Thousand Oaks, CA: Sage.
31.
MurphyJ.ElliotS. N.GoldringE.PorterA. C. (2007). Leadership for learning: A research-based model and taxonomy of behaviors. School Leadership & Management, 27, 179-201.
32.
OrphanosS.OrrM. T. (2014). Learning leadership matters: The influence of innovative school leadership preparation on teachers’ experiences and outcomes. Educational Management, Administration & Leadership, 42, 680-700.
33.
OrrM. T.OrphanosS. (2011). How preparation impacts school leaders and their school improvement: Comparing exemplary and conventionally prepared principals. Educational Administration Quarterly, 47, 18-70.
34.
OrrM. T.PecheoneR. L.ShearB.HollingworthL.BeaudinB. (2016). Massachusetts Performance Assessment for Leaders (PAL) technical report: Summary of validity and reliability studies for 2014-15 field trial of PAL. New York: Bank Street College of Education.
35.
OrrM. T.PecheoneR. L.SnyderJ.MurphyJ.PalankiA.BeaudinB. Q.. . . ButtramJ. (2017, in press). Performance Assessment for Principal Licensure: Evidence from content and face validation and bias review. Journal of Research on Leadership Education.
36.
OzgenS.Sanchez-GalofreO.AlabartJ. R.MedirM.GiraltF. (2013). Assessment of engineering students’ leadership competencies. Leadership and Management in Engineering, 13(2), 65-75.
37.
PecheoneR. L.ChungR. R. (2006). Evidence in teacher education. The Performance Assessment for California Teachers. Journal of Teacher Education, 57, 22-36.
38.
PecheoneR. L.PiggM. J.ChungR. R.SouvineyR. J. (2005). Performance assessment and electronic portfolios: Their effect on teacher learning and education. The Clearing House, 78, 164-176.
39.
PecheoneR. L.ShearB.WhittakerA.Darling HammondL. (2013). 2013 edTPA field test: Summary report. Palo Alto, CA: The Stanford Center for Assessment, Learning and Equity.
40.
PecheoneR. L.WeiR. C. (2007). Technical report of the Performance Assessment for California Teachers (PACT). Summary of validity and reliability studies for the 2003-2004 pilot year. Palo Alto, CA: The Stanford Center for Assessment, Learning and Equity.
41.
PorterA. C.PolikoffM.GoldringE.MurphyJ.ElliottS. N.MayH. (2010). Developing a psychometrically sound assessment of school leadership: The VAL-ED as a case study. Educational Administration Quarterly, 46, 135-173.
42.
RobinsonV. M. J.LloydC. A.RoweK. J. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44, 635-674.
43.
SandholtzJ. H.SheaL. M. (2012). Predicting performance: A comparison of university supervisors’ predictions and teacher candidates’ scores on a teacher performance assessment. Journal of Teacher Education, 63, 39-50.
44.
SebringP. B.AllensworthE.BrykA. S.EastonJ. Q.LuppescuS. (2006). The essential supports for school improvement. Chicago, IL: University of Chicago Consortium of School Research.
45.
ShavelsonR. J.WebbN. M. (2005). Generalizability theory. In Kempf-LeonardK. (Ed.), Encyclopedia of social measurement (pp. 99-105). Cambridge, MA: Elsevier.
46.
SheltonS. V. (2011). Strong leaders, strong schools: 2010 school leadership laws. Denver, CO: National Conference of State Legislatures.
47.
SheltonS. V. (2012). Preparing a pipeline of effective principals: A legislative approach. Denver, CO: National Conference of State Legislatures.
48.
SolanskyS. T. (2010). The evaluation of two key leadership development program components: Leadership skills assessment and leadership mentoring. The Leadership Quarterly, 21, 675-681.
49.
SupovitzJ. A.ChristmanJ. B. (2005). Small learning communities that actually learn: Lessons for school leaders. Phi Delta Kappan, 86, 649-651.
50.
TombariM. L.BorichG. D. (1999). Authentic assessment in the classroom: Applications and practice. Upper Saddle River, NJ: Prentice Hall.
51.
U.S. Department of Education. (2009, November). Race to the top program executive summary. Washington, DC: Author.
52.
WeissH. B.StephenN. (2009). From periphery to center: A new vision for family, school, and community partnerships. In ChristensonS.ReschleyA. (Eds.), Handbook of school-family partnerships (pp. 448-472). New York, NY: Routledge.
53.
WigginsG. P. (1993). Assessing student performance: Exploring the purpose and limits of testing. San Francisco, CA: Jossey-Bass.
