Abstract
Objective
In a context of increasingly limited surgical exposition, enhanced by the coronavirus disease 2019 (COVID-19) pandemic context, the objective of this article is to explain the development of a novel low-cost and simple replication animal-based septoplasty training model for otolaryngology residents, to assess its face and construct validity, and to validate a specific rating scale for each task.
Study Design
Experimental study.
Setting
Surgical simulation laboratory.
Methods
Septoplasty experts divided the procedure into key tasks. A simulator model to perform tasks was developed using pig ears to imitate human nasal septum cartilage, and a Specific Rating Scale was constructed. Trainees and faculty performed all tasks in the model. The participants were videotaped, and operative time, hand movements, and path length were recorded using a motion sensor device. Two blinded experts evaluated the videos with Global and Specific Rating Scales. All participants answered a satisfaction survey.
Results
Fifteen subjects were recruited (7 trainees and 8 faculty). Significantly higher Global Rating Scale score, shorter operative time and path length, and fewer hand movements were observed in the faculty group. The satisfaction survey showed high applicability to a real scenario (mean score of 4.6 out of 5). Specific Rating Scale showed construct and concurrent validity and high reliability.
Conclusion
This simulation model and its specific rating scale can be accurately used as a validated surgical assessment tool for endonasal septoplasty skills. Its low cost and simple replicability make it a potentially useful tool in any otolaryngology surgical training program.
Deviation or deformity of the nasal septum is a frequent cause of nasal obstruction and one of the most common complaints in the average rhinology practice.1,2 Septoplasty is a surgical intervention to correct a septal deformity, often indicated when medical management fails. It is a core procedure in otolaryngology and one of the first learned by residents during their training, for it provides an entry to more complex procedures and endoscopic approaches. 3
Regardless of the technique, septoplasty comprises mucosal preservation, flap elevation, and preservation of a cartilage frame to ensure nose stability. 2 There are 3 surgical approaches to septoplasty described in the literature: traditional endonasal, open rhinoseptoplasty, and endoscopic.
The traditional endonasal approach, most commonly used in our experience, involves direct visualization using a headlight and a nasal speculum, looking down into the nasal cavity from above, allowing little space for an assistant to observe. 4 Therefore, this procedure can be challenging to teach in the operating room, encouraging trainers and trainees to find alternative ways to understand anatomy and surgical steps. It has been proposed that junior residents require at least 20 septoplasties to approximate a more experienced surgeon. 5 However, a UK study reported that only 73.3% of senior residents consider themselves prepared to perform a septoplasty independently. 3 According to a study performed in our institution, residents were exposed to a mean of 18 endonasal septoplasties during their training in otolaryngology. 6 Other Chilean institutions report a median of only 12 septoplasties per trainee. 7 This situation has significantly worsened during the past year due to the coronavirus disease 2019 (COVID-19) pandemic, which has led to a restriction in elective procedures, reducing residents’ exposure to this procedure.
In this scenario, surgical simulation has been demonstrated to be an efficient and effective tool in surgical skills acquisition. 8 It offers a safe and realistic environment in which trainees can practice surgical skills, reducing patient risk and improving training residents’ confidence and performance.9-11 Simulation models allow for deliberate practice, an objective structured form of training, with real-time feedback and unbiased evaluation.11,12
Septoplasty training models described in the literature are scarce. A 3-dimensional printing model for endoscopic septoplasty training was created and validated in 2016 in Canada. 13 Likewise, simulation models for training rhinoseptoplasty have been developed using sheep, 14 chicken, 15 rabbit, 16 porcine, 17 silicone, 18 and human cadaver. 19 However, to our knowledge, there are no simulation training models for endonasal septoplasty described to date.
The objectives of this study are to explain the development of a novel and low-cost animal-based endonasal septoplasty training model for otolaryngology trainees, to assess its face and construct validity, and to validate a specific rating scale for each task.
Materials and Methods
Simulator Fabrication
The first step in constructing the simulation model was to separate endonasal septoplasty surgery into key tasks that trainees should be competent in before facing the entire procedure. Two experts in septoplasty from the Department of Otolaryngology at the Pontifical Catholic University of Chile identified the main steps in septoplasty. After 3 meetings, 4 key tasks were chosen: superior tunnel, inferior tunnel, septum deviation resection, and suturing.
The first task (superior tunnel) in septoplasty consists of dissecting within the subperichondrial plane and elevating the perichondrium and mucosa from the cartilage intact using a Killian nasal speculum, a dissector, and a headlight. 2 Second (inferior tunnel), the caudal end of the inferior border of the cartilaginous septum is separated from the premaxilla, which requires tunnel-view skill using the headlight. 5 Third (deviation resection), after both side flaps are elevated, a No. 15 blade is used to gently incise the septal deviation, preserving an adequate L-strut for nasal support, while elevating a contralateral mucosa flap to prevent septal perforation. Then, the deformity is separated from its cephalic attachment, using a rotational movement, and removed. 2 In the fourth and final task (suturing), once the septal deformity is resected, flaps are reapproximated using an absorbable suture, and the initial mucosal incision is closed.2,5
Constructing the Simulation Model
Once these 4 key tasks were identified, a low-cost septoplasty model was designed with experts’ guidance. To simulate human nasal septum, diverse materials derived from silicone and ex vivo animal tissues were tested, with the porcine ear found to be the most successful due to its similarity to the human septum. A wooden frame with a nasal septum shape was constructed to support a partially dissected porcine ear ( Figure 1A ). A wooden base to support the frame was then developed ( Figure 1B ). This base could be placed on another 45° base ( Figure 1C ), which supported a synthetic human head consisting of a mask stuffed with a sponge ( Figure 1D ). Pig ears were purchased at a slaughterhouse in Santiago, Chile. Ears were preserved under refrigeration for no more than 2 days. Half an hour before the participant’s training, ears were predissected, separating the skin from cartilage excepting the frame zone. Then, the skin of the ear was fixed to the wooden frame on both sides with square brackets to support it ( Figure 1C ).

(A) Wooden frame support, (B) wooden base supporting frame, and (C) 45° wooden base. The skin was bracketed to frame. Nondissected cartilage inside the frame and (D) human mask in position.
Simulation Assessment
A Specific Rating Scale (SRS) was constructed considering a list of fundamental objectives for each 1 of the 4 key tasks. Ratings were collected for 3 variables within each of the 4 key tasks and overall technique. A Likert scale from 1 to 5 was used for each rating, with a maximum possible score of 75 points ( Table 1 ). Instructive videos explaining each task, based on the SRS, were recorded and shown to the participants before the training. Participants received the simulator model prepared for each task. Also, they had available a headlight, a Killian nasal speculum, a No. 15 scalpel blade, a Cottle dissector, surgical forceps, a Mayo-Hegar, and a 3-0 Vicryl suture.
Specific Rating Scale.
Simulator Validation
Before training, informed consent was obtained, and an initial demographic survey was completed by all participants. Two groups were identified based on their training experience: trainees and faculty. Each participant was recorded performing all 4 tasks. During every procedure, certain parameters were registered: the operative time, the number of hand movements, and path length traveled by each hand. The last 2 were measured using the Imperial College Surgical Assessment Device (ICSAD), a motion-tracking device that involves tracking sensors on the dorsum of each hand. 20 Once all tasks were completed, the final surgical product on the pig ear was photographed. Subsequently, 2 blinded experts then assessed the videos and the final product photographs using the validated Global Rating Scale (GRS) from the Objective Structured Assessment of Technical Skills (OSATS), which is widely used and applied for objectifying skills acquisition ( Table 2 ), 21 and the SRS created by experts in this study. Once training was finished, a satisfaction survey (4 areas, each with a score of 1 to 5) was completed by participants ( Table 3 ). All groups’ performances were compared to assess the construct validity of the simulation model. The satisfaction survey data were collected to assess face validity. Correlation between the construct obtained with SRS and OSATS was assessed to validate the newly developed rating scale.
Global Rating Scale (Objective Structured Assessment of Technical Skills).
Satisfaction Survey Administered to Participants.
Statistical Analysis
Data were analyzed with STATA version 13.0 (StataCorp). Descriptive statistics are shown, including the median and range. Given the small sample size, construct validity was assessed using the Mann-Whitney-Wilcoxon test (nonparametric), searching for statistically significant differences among groups’ performances for each parameter. Face validity was measured with mean and standard deviation for each item of the satisfaction survey. Correlation between SRS and OSATS was assessed with Spearman correlation. Internal consistency was assessed using Cronbach’s α for SRS and GRS.
Ethical Concerns
This project was formally reviewed and approved by the Scientific Ethics Committee at the Faculty of Medicine of the Pontifical Catholic University of Chile, Santiago, Chile (ID 181129010).
Results
Fifteen subjects were recruited (7 trainees and 8 faculty). Participants’ baseline characteristics are shown in Table 4 .
Participant Characteristics.
Construct Validity
The quality of performance analysis showed a significantly better score for faculty in the GRS using OSATS, with a median score of 23.25 out of 30 (range, 17.5-30) compared to 17.5 points obtained by trainees (range, 13-22.5) (mean score difference, 6.68 points; 95% CI, 1.75-11.61;

Boxplot showing Objective Structured Assessment of Technical Skills (A, points), operative time (B, minutes), hand movements (C, number), and path length (D, meters). Significant differences among groups were found (Mann-Whitney-Wilcoxon test). Brackets: Participants per group.
In terms of operative time, considering total time to complete all tasks, the analysis showed shorter median operative time for faculty (11.7 minutes; range, 6.68-26.61) compared to trainees (25.1 minutes; range, 16.43-29.52) (mean time difference, 9.84 minutes; 95% CI, 2.44-17.24;
To register the participants’ hand movements and path length assessment, ICSAD was available for only 12 participants, excluding 1 trainee and 2 faculty. The analysis was made considering participants who completed all tasks. Therefore, the same 2 participants excluded from the operative time analysis for incomplete tasks were also excluded from this analysis. Significantly fewer hand movements were observed in the faculty group with a median number of 247 (range, 212-408) throughout the 4 tasks, compared to 465 (range, 205-465) in the trainee group (mean difference, 169.6; 95% CI, 60.58-278.61;
Specific Rating Scale Validation
The SRS created for the assessment of the simulation model tasks also showed significantly better scores according to a higher level of expertise, with a median of 56.5 (range, 50-66) and 64.75 (range, 56.5-68) points, for trainees and faculty, respectively (mean score difference, 5.66 points; 95% CI, 0.56-10.78;

(A) Boxplot showing Specific Rating Scale (SRS) median scores. Significant differences among groups were found (Mann-Whitney-Wilcoxon test). Brackets: Participants. (B) A significant Spearman correlation between Global Rating Scale (GRS) and SRS was found.
Face Validity
In the satisfaction survey, 100% of participants found the simulation model to be useful in learning septoplasty skills. In terms of applicability to a real scenario, participants valued the model with a mean (SD) score of 4.6 (0.51) out of 5. When participants were asked if they would recommend using the model to a peer, the mean (SD) score was 4.9 (0.26) out of 5. Finally, all participants would have liked to use the model during their otolaryngology training.
Discussion
In this study, we created a low-cost and straightforward replication of an endonasal septoplasty simulation model as a tool for training and objectively assessing otolaryngology trainees. The model was achieved using pig ears to simulate the human nasal septum, wood planks, and a human latex mask, with a total estimated cost of USD 30. Only the pig ears need to be replaced after the procedure (USD 2). The model assembly requires a previous subperichondrial ear dissection that can be performed by any trainee in a short time (30 minutes). These features make this model accessible to all otolaryngology training programs.
In a context of increasingly limited surgical exposition, enhanced by the COVID-19 pandemic context where elective procedures and the number of people remaining in the operation room should be restricted, 23 our low-cost model may be especially useful for junior residents who may achieve basic competence faster and thus take more advantage of surgical opportunities. Furthermore, it has been described that resident involvement in septoplasty correlates with increased time and cost, especially in junior resident–involved cases.24,25 In our context, the median of septoplasties performed by trainees is below the expected learning curve described in the literature (20 procedures) 5 and the Accreditation Council for Graduate Medical Education (ACGME) case log data (mean 52.9 procedures; range, 6-20). 26 Hence, the development of this simulation training model can potentially facilitate the practice of essential steps of this complex procedure for novice learners and thus shorten the learning curve. 27 To our knowledge, there is no other endonasal septoplasty simulation tool available.
The results of this study demonstrate that simulation training with this model has construct validity since it differentiates between levels of surgical expertise. 28 OSATS, operative time, hand movements, and path length analysis showed statistically significant differences between the 2 groups. These results make this model a useful tool for objective assessment of endonasal septoplasty skills.
Face validity, which reflects reality, was assessed with a 4-question satisfaction survey, in which all the participants were asked about the model’s usefulness in learning septoplasty skills, the applicability to a real scenario, if they would recommend using the model to a partner, and if it should be included in a surgical training program. All questions obtained a mean score of over 4.6 out of 5. In addition, septoplasty experts actively participated in the model design, giving feedback through formal meetings during the development process.
Likewise, an SRS was developed following experts’ fundamental concerns about each of the tasks to finally identify 4 key tasks and 5 areas of marking, with a total score of 75 points ( Table 1 ). Concurrent validity was demonstrated by a positive correlation between the assessments’ results when using this scale and OSATS. For construct validity, significant difference between the 2 expertise level groups was found. Internal consistency measures whether different items of a composite score show significance to the total score. In this study, SRS and GRS obtained high reliabilities, indicating that all items should be considered for final scoring. A similar septoplasty SRS to assess trainees in an operating room setting was published in the literature by Obeid et al, 29 matching the majority of the key tasks assessed in our specific assessment tool and simulation model.
A possible concern about the model is pig ear management. They were purchased at a slaughterhouse and maintained in refrigeration for no more than 2 days and predissected 30 minutes before model assembly. Initially, during the model development, ears were frozen to preserve them for a longer time, but after defrosting, the subperichondrial plane adhesion was higher than those kept in the refrigerator. On the other hand, ears kept for more than 2 days in refrigeration were too soft for the flap elevation.
A potential weakness of this study is variability of the pig ears during the validation process, since it could cause differences in the complexity of the model among participants and an imbalance between groups. This effect was intended to be neutralized by a matching, in which each of the 2 ears of a batch was used in different groups. However, the lack of standardization is present in the real world, where surgical cases are variable.
Another issue that could affect the fidelity/authenticity of the model in regards to the real procedure was the inferior tunnel. In this model, the cartilage is naturally attached to the mucosa in a specific region that simulates the cartilaginous septum (superior tunnel). In the case of the inferior tunnel, where the mucosa adheres to the bone in a real human septum, the skin is separated from the wooden frame. Nevertheless, the development of this task, in this model, does not allow for the dissection of the inferior tunnel, and the main objective of the exercise is to visualize the tunnel. Thus, after separating the pigskin adhered to the floor of the nostril, participants were requested to identify different colors located in the wooden frame, simulating the nasal spine and the perpendicular lamina of the ethmoid. In addition, in the premaxilla region—with caudo-cephalic orientation—a sequence of 6 symbols of the Spanish alphabet had to be identified by participants in order ( Table 1 and Figure 4 ).

Inferior tunnel task. (A) Nasal spine color identification (green arrow); nostril floor sequence identification (blue arrow); perpendicular lamina color identification (red arrow). (B) Skin in situ before tunnel making (yellow).
Two of 15 participants could not complete the last task, consisting of suturing both flaps after deviated cartilage is removed by performing 4 stitches from 1 septum side to the other ( Table 1 ) due to breaking of the suture’s needle. This result led to the exclusion of these participants from the analysis of operative time, hand movements, and path length, given that the values of these parameters would be infinite. Also, ICSAD was not available for all participants’ assessments, causing another 3 participants—1 in the trainee group and 2 in the faculty group—to be excluded from hand movements and path length analysis. Further stages of this or other similar studies should include more participants.
Conclusions
The simulation model and the SRS assessed in this study can be accurately used as a validated surgical assessment tool for skills that are required for endonasal septoplasty. This low-cost and simple replication simulation model is accessible and can potentially be used in any otolaryngology surgical training program for trainees. New studies will need to address learning curves and predictive validity, to better understand skill acquisition and transfer to the operating room setting.
