Abstract
Objective: Assess the face and construct validity of 2 assessment tools: a Checklist Assessment for Microlaryngeal Surgery (CAMS) and a Global Rating Assessment for Microlaryngeal Surgery (GRAMS) on a new theater-based immersive microlaryngscopy simulator.
Method: Fifteen candidates were divided into the novice or experienced group depending on their previous microlaryngoscopy experience. Each candidate undertook a 10-minute simulation of a microlaryngoscopy and excision biopsy, and 2 blinded experts rated their performance live. Candidates subsequently completed a questionnaire on their opinion of the simulator.
Results: The model demonstrated good face validity across all levels of experience. The GRAMS demonstrated excellent interrater reliability (0.9) compared with the CAMS (0.7). The CAMS assessment was able to differentiate experienced and novice candidates and, therefore, demonstrated construct validity. The GRAMS tool, however, was unable to differentiate candidates. There was a significant correlation between the 2 assessment tools (correlation coefficient = 0.624).
Conclusion: This study is the first reported trial of a high fidelity microlaryngoscopy simulator with task-specific rating tools. Use of these tools is recommended within otolaryngology training programs, with GRAMS for use as a frequently used feedback tool and CAMS as a confirmatory evaluation of competency at transitions of professional training.
Get full access to this article
View all access options for this article.