This article presents pilot study results of two leadership performance assessments, designed for a California principal preparation program and embedded in preparation using two learning approaches. The pilot study had two purposes: to evaluate the assessments‘ content validity and to evaluate the candidates’ leadership skills as demonstrated through their assessment products and an independent self-assessment tool. The evidence showed the tasks to be valid and useful tools for formative leadership development for different candidates and school settings. Participant feedback on the assessments‘ benefits and independent self-assessment ratings provided construct validation. We concluded that these are promising assessment tools for programs’ use in candidate assessment.
DaveyT., FerraraS., HollandP. W., WebbN. M., & WiseL. L. (2015). Psychometric considerations for the next generation of performance assessment.Princeton, NJ: Educational Testing Service.
4.
DavisS., EricksonD. E., KinseyG. W., Moore-StewardT., PadoverW., ThomasC., … WiseD. (2011). Reforming the California Public School Administrator Licensure System Through the Alignment of Research, Policy, and Practice: Policy Perspectives and Recommendations from the California Association of Professors of Educational Administration (CAPEA). CAPEA Education Leadershuip and Administration, 22, 66–82.
5.
GitomerD. H. (Ed.) (2012). Performance assessment and educational assessment.New York, NY: Routledge.
6.
GrissomJ. A., MitaniH., & BlissettR. S. (2017). Principal licensure exams and future job performance: Evidence from the School Leaders Licensure Assessment. Educational evaluation and policy analysis, 20(10), 1–33.
7.
HauerK. E., SoniK., CornettP., KohlwesJ. & and others. (2013). Developing entrustable professional activities as a basis for assessment of competence in an internal medicine residency: a feasibility study. Journal of general internal medicine, 28(8), 1110–1114.
8.
KellyM. D., & KoonceG. L. (2012). The relationship between student grade point average, principal internship mentor's assessment scores and school leaders licensure assessment scores. The journal of human resource and adult learning, 8(2).
9.
MessickS. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13–23.
10.
OrrM. T., HollingworthL., & BeaudinB. Q. (2016). Massachusetts Performance Assessment for Leaders (PAL) Technical Report Follow-Up: Summary of Feedback and Performance Studies for 2015–6 Program Year of PAL.New York, NY: Bank Street College.
11.
OrrM. T., PecheoneR. L., HollingworthL., BeaudinB. Q., SnyderJ., & MurphyJ. (2017). The Performance Assessment for Leaders: Construct Validity and Reliability Evidence. Journal of research on leadership education.https://doi.org/10.1177/1942775117742646.
12.
OrrM. T., PecheoneR. L., ShearB., HollingworthL., & BeaudinB. (2016). Massachusetts Performance Assessment for Leaders (PAL) Technical Report: Summary of Validity and Reliability Studies for 2014–15 Field Trial of PAL.New York: Bank Street College of Education.
13.
OrrM. T., PecheoneR. L., SnyderJ., MurphyJ., PalankiA., BeaudinB. Q., … ButtramJ. (2017). Performance Assessment for Principal Licensure: Evidence from content and face validation and bias review. Journal of research on leadership education.https://doi.org/10.1177/1942775117701179.
14.
PalmT. (2008). Performance assessment and authentic assessment: A conceptual analysis of the literature. Practical assessment, research & evaluation, 13(4), 1–11.
15.
PecheoneR. L., ShearB. W. A., & Darling HammondL. (2013). 2013 edTPA Field Test: Summary Report.Palo Alto, CA: Stanford Center for Assessment, Learning and Equity.
16.
PecheoneR. L., & WeiR. C. (2007). Technical report of the Performance Assessment for California Teachers (PACT). Summary of validity and reliability studies for the 2003–2004 pilot year.Palo Alto, CA: Stanford Center for Assessment, Learning and Equity.
17.
SheltonS. V. (2012). Preparing a Pipeline of Effective Principals: A Legislative Approach.Denver, CO: National Conference of State Legislatures.
18.
WilsonM., HallamP. J., PecheoneR. L., & MossP. A. (2014). Evaluating the validity of portfolio assessments for licensure decisions. Education Policy Analysis Archives, 22(6), 1–22.
