Sage Journals: Discover world-class research

Abstract

Background:

The orthopaedic in-training examination (OITE) is a 275-question test for orthopaedic residents administered annually. As the field of orthopaedics changes, the OITE evolves its content. The incidence of hip preservation–related procedures has increased substantially over the past decade; nonetheless, an analysis of the trends of hip preservation questions on the OITE has not yet been performed.

Purpose/Hypothesis:

The purpose of the study was to evaluate the number and type of questions on the OITE related to hip preservation to determine whether trends over time paralleled the increases in hip-related care in clinical practice. It was hypothesized that the frequency of hip preservation questions on the OITE would increase with time.

Study Design:

Cross-sectional study.

Methods:

Each OITE between 2002 and 2021 was reviewed for questions related to hip preservation. The types of questions included under “hip preservation” were those related to femoroacetabular impingement (FAI), athletic soft tissue injuries of the hip, acetabular labral tears, hip arthroscopy, and surgical management of adult hip dysplasia—excluding arthroplasty. Questions were quantified and categorized by topic, taxonomy level, associated imaging, and cited sources.

Results:

There were 30 hip preservation–related questions between 2002 and 2021. Of these, 77% occurred within the past 10 years. Also, 14 questions (47%) had associated images in the question stem—the most common being radiographs (n = 8 questions). The most commonly tested subcategories were FAI (n = 11 questions [37%]), athletic injuries (n = 7 questions [23%]), and anatomy (n = 7 questions [23%]). Over the last 10 years, 97.9% of citations were from journal articles—the most common being the Journal of the American Academy of Orthopaedic Surgeons, Clinical Orthopedics and Related Research, and the American Journal of Sports Medicine.

Conclusion:

The frequency of hip preservation–related questions on the OITE has increased with time, reflecting trends in clinical practice.

Keywords

education femoroacetabular impingement hip hip arthroscopy hip/pelvis/thigh

The orthopaedic in-training examination (OITE) is a 275-question test for orthopaedic residents administered annually. Developed by the American Academy of Orthopaedic Surgeons (AAOS), the OITE is designed to assess an orthopaedic surgery trainee’s knowledge each year in 11 primary content areas—including trauma, sports, spine, basic sciences, hip and knee, and pediatrics. Test performance outcomes are used by residency programs to guide orthopaedic resident education at both an individual and program-wide level. Test items are created by skilled orthopaedic surgeons and further reviewed by expert physician committees for relevancy and accuracy.¹⁴ The OITE is considered vitally important in orthopaedic resident training, and research has shown a correlation between OITE performance and success on the American Board of Orthopaedic Surgery parts I and II.⁵ Multiple previous studies have examined which topics are tested most frequently, the taxonomy of these questions, and the commonly used references for certain topic subgroups.^{1,6,15,18,19,22} A primary goal of these studies is to assist residents and residency programs with effective and efficient preparation for the examination. A secondary goal is to gauge whether this important annual examination reflects current and changing clinical practices within orthopaedic surgery.

As the field of orthopaedic surgery continues to change, the OITE has also evolved in the number of questions and content focus to reflect current trends in surgical practice. For example, the percentage of hip- and knee-related questions on the OITE increased significantly between 2005 and 2019, which parallels the increase in demand for primary total hip and knee arthroplasties.^7,15 The past several years have seen a steady rise in the utilization of hip arthroscopy and related hip preservation procedures to treat common sources of hip pain—such as labral tears, articular cartilage lesions, and femoroacetabular impingement (FAI).^4,23 Hip arthroscopy rates increased from 3.6 per 100,000 to 16.7 per 100,000 between 2005 and 2013, and the overall incidence of hip arthroscopy increased 600% between^4,11 2006 and 2010. With the rise of these procedures, OITE questions related to hip arthroscopy and hip preservation will probably increase in the coming years to reflect clinical practice patterns.

In this study, we evaluated the number and type of hip preservation–related questions on the OITE over time to track trends in question volume and determine whether there had been increases on the OITE that paralleled the increases in hip-related care in clinical practice. This information is helpful for residents preparing for the examination and for orthopaedic residency program directors when establishing an educational curriculum that prepares residents for the examination.

Methods

Each OITE between 2002 and 2021 was reviewed for questions related to hip preservation. For the years 2002 to 2012, the OITE was accessed from an online archive of old examinations, answers, and references at a single academic residency institution. For the years 2013 to 2016, published AAOS OITE study guides were used to access test content; for the years 2017 to 2021, the AAOS education platform (ResStudy) was used to access test content from the previous year. The complete examination (N = 275 questions) was accessible and analyzed for the 2002-2016 OITE, while <275 questions were accessible and analyzed for the 2017-2021 examinations—a mean of 245.8 questions each year. This discrepancy is due to the retrospective removal of some OITE questions for various reasons, likely because of poor wording or based on scoring distributions after the test administration. In addition, starting in 2020, the American Board of Orthopaedic Surgery has been contributing a portion of questions to the OITE that are inaccessible to residents or residency programs.

Each available examination question was analyzed by 2 observers (E.L. and L.O.), and we quantified those as “hip preservation” if the question was related to FAI, athletic soft tissue injuries of the hip (anterior superior iliac spine avulsions, snapping hip, or core muscle injuries), labral tears, hip arthroscopy, and surgical management of adult hip dysplasia—excluding arthroplasty. The number of hip preservation questions was quantified for each year of the OITE.

An R² value was calculated to measure the proportion of variation between the year and the number of hip preservation–related questions. Each question was further classified into 1 of several topic categories: dysplasia, FAI, anatomy, sports-related injuries, and miscellaneous. Anatomy questions specifically asked about the anatomic structures affected by the outlined hip preservation–related problems. We also categorized the questions based on their taxonomy level as described by Buckwalter et al,¹ in which taxonomy level 1 refers to questions involving direct recognition and recall of information, taxonomy level 2 involves questions requiring interpretation and comprehension of information or images, and taxonomy level 3 involves questions required problem solving, such as determining a treatment plan based on history or imaging findings.

We then analyzed the citations for each hip preservation question based on the citation type (journal, book) and source for the last 10 years of the OITE. The most commonly cited sources were reported.

Results

Over the course of 20 years of the OITE (2002-2021), there were 30 hip preservation–related questions. Each year, a mean of 1.5 questions were dedicated to hip preservation. On average, this represented 0.6% of all OITE questions during the study period. There was a positive correlation between time and the total number and percentage of hip preservation questions during the study period (R² = 0.438 for both) (Figure 1).

Figure 1.

(A) The absolute number of hip preservation questions on the OITE each year from 2002 to 2021. (B) The percentage of all hip preservation–related questions on the OITE each year from 2002 to 2021. OITE, orthopaedic in-training examination.

We found that 23 (77%) of the 30 hip preservation–related questions during the 20-year period occurred during the past 10 years (2012-2021) (Table 1). Also, 14 (47%) questions assessed direct recall (taxonomy level 1), 12 (40%) questions required interpretative skills (taxonomy level 2), and 4 (13%) questions required problem-solving skills (taxonomy level 3) (Table 2). Fourteen of the 30 questions (47%) had associated images in the question stem—the most common being radiographs (n = 8 questions), followed by arthroscopic images (n = 4 questions) (Table 3). The most commonly tested subcategories were FAI syndrome (n = 11 questions [37%]), athletic injuries (n = 7 questions [23%]), and anatomy (n = 7 questions [23%]) (Table 4).

Table 1

Number of Hip-Preservation Questions by Year of OITE^a

Year	Total OITE Questions Reviewed, n	Hip Preservation Questions, n (% of Total Reviewed)
2002	275	1 (0.36)
2003	275	1 (0.36)
2004	275	0 (0)
2005	275	0 (0)
2006	275	2 (0.73)
2007	275	1 (0.36)
2008	275	0 (0)
2009	275	0 (0)
2010	275	0 (0)
2011	275	2 (0.73)
2012	275	1 (0.36)
2013	275	0 (0)
2014	275	1 (0.36)
2015	275	2 (0.73)
2016	275	2 (0.73)
2017	271	3 (1.11)
2018	270	4 (1.48)
2019	260	1 (0.38)
2020	215	3 (1.40)
2021	213	6 (2.82)
20-year total	5354	30 (0.56)

OITE, orthopaedic in-training examination.

Table 2

Hip Preservation Questions According to Taxonomy Classification^a

Year^b	Taxonomy Level 1 Questions	Taxonomy Level 2 Questions	Taxonomy Level 3 Questions
2002	1	—	—
2003	1	—	—
2006	2	—	—
2007	1	—	—
2011	1	1	—
2012	—	1	—
2014	—	1	—
2015	—	1	1
2016	2	—	—
2017	1	2	—
2018	2	1	1
2019	—	1	—
2020	2	1	—
2021	1	3	2
20-year total	14	12	4

Taxonomy level 1: questions involving recall of information; taxonomy level 2: questions involving interpretation of information or imaging; taxonomy level 3: questions requiring problem-solving—such as determining a treatment plan based on a patient’s medical history or imaging findings. Dashes indicate zero questions.

There were no taxonomy classification questions in 2004, 2005, 2008, 2009, 2010, or 2013.

Table 3

Hip-Preservation Questions Related to Types of Imaging^a

Year^b	Radiographs	MRI	CT	Clinical Photographs	Arthroscopic Images
2011	—	—	—	—	1
2012	1	—	—	—	—
2014	—	—	—	—	1
2015	1	1	—	—	—
2017	1	—	—	—	1
2018	1	—	—	—	1
2019	1	—	—	—	—
2021	3	1	—	—	—
20-year total	8	2	0	0	4

Dashes indicate zero questions. CT, computed tomography; MRI, magnetic resonance imaging.

There were no hip preservation questions related to imaging in 2002-2010, 2013, 2016, or 2020.

Table 4

Hip-Preservation Questions by Subclassification^a

Year^b	Athletic Injury	FAI	Dysplasia	Anatomy
2002	—	—	1	—
2003	—	—	1	—
2006	—	—	—	2
2007	—	—	—	1
2011	—	—	1	1
2012	1	—	—	—
2014	1	—	—	—
2015	1	—	1	—
2016	—	2	—	—
2017	—	2	—	1
2018	1	2	—	1
2019	—	1	—	—
2020	2	1	—	—
2021	1	3	1	1
20-year total	7	11	5	7

Dashes indicate zero questions. FAI, femoroacetabular impingement.

There were no hip preservation questions with these subcategories in 2004, 2005, 2008, 2009, 2010, or 2013.

Regarding hip preservation–related questions during the past 10 years of the OITE (n = 23 questions), there were 48 total citations: 1 citation (2.1%) was from a textbook, and 47 (97.9%) were from journal articles. The most commonly cited journals were as follows: Journal of the American Academy of Orthopaedic Surgeons (n = 10 citations [21% of all journal citations]); Clinical Orthopedics and Related Research (n = 9 citations [19% of all journal citations]); American Journal of Sports Medicine (n = 7 citations [15% of all journal citations]); and Arthroscopy (4 citations [8% of all journal citations]) (Table 5).

Table 5

Division of Citations for the 23 Hip Preservation Questions by Source and Year^{a

b}

Source	2012	2013	2014	2015	2016	2017	2018	2019	2020	2021	Total Citations, n (% of Total)
Journals (n = 47; 97.9% overall)
Journal of the American Academy of Orthopaedic Surgeons	1	—	—	—	—	—	3	—	5	1	10 (19.2)
Clinical Orthopaedics and Related Research	—	—	—	2	1	1	2	—	—	3	9 (17.3)
American Journal of Sports Medicine	—	—	—	—	3	2	—	—	—	2	7 (13.5)
Arthroscopy	—	—	2	—	—	—	2	—	—	—	4 (7.7)
Clinical Journal of Sports Medicine	—	—	—	1	—	1	—	—	—	1	3 (5.8)
Journal of Bone and Joint Surgery– American Volume	—	—	—	—	—	1	—	1	—	1	3 (5.8)
Other^c	1	0	0	2	0	1	1	1	4	1	11 (21.1)
Books (n = 1; 2.1% overall)
Lovell and Winter’s Pediatric Orthopaedics (6th ed)²⁴	—	—	1	—	—	—	—	—	—	—	1 (1.9)
Total	2	0	3	5	4	6	8	2	9	9	48 (100)

Dashes indicate zero questions.

We selected 10 years of references to review in order to include a time period with the most recent applicable journals/books.

Less frequently cited journals, not listed above.

Discussion

Hip preservation makes up a small portion of the total content tested on the OITE at a mean of 1.5 questions per year or 0.6% of all test questions over the last 20 years. However, the overall amount of hip preservation questions has increased with time. The study findings indicated that 77% of all hip preservation questions during the study period occurred within the past 11 years (Table 1), at a mean of 2.3 questions per year. This reflects a similar trend in the rise of hip preservation surgeries performed in clinical practice over the past 2 decades.^4,11,23 There have been between 1 and 6 hip preservation questions in each OITE since 2014 (range, 0.4%-2.8% of all test questions), suggesting that residents and residency programs may expect at least ≥1 questions testing hip preservation knowledge on the OITE in future years. While previous studies have analyzed OITE questions on the content related to pathology, foot and ankle, sports, shoulder and elbow, trauma, oncology, and hand,^{2,6,8,9,19-21} none have previously studied OITE questions related to hip preservation topics.

Most hip preservation questions on the OITE were taxonomy level 1 (47%), followed by level 2 (40%) and level 3 (13%). The percentage of level 3 questions on hip preservation was low compared with more frequently tested domains such as foot and ankle (41.9%), pathology (32.3%), sports (25.5%), or trauma (19.1%).^2,8,20,21 However, there was a higher percentage of level 3 hip preservation questions than level 3 shoulder and elbow questions (13% vs 4.4%)—despite hip preservation questions comprising a smaller amount of all OITE questions compared with shoulder and elbow (0.6% vs 5.5%).¹⁹ The taxonomy classification of the hip preservation questions has also changed with time. The first 9 years of the study period only contained level 1 questions, while all level 3 questions occurred within the past 6 years (Table 4). This trend was also seen when analyzing hip preservation questions related to imaging. All questions containing images occurred within the final 10 years of the 20-year period (Table 3). This suggests that as the frequency of OITE hip preservation questions increases, the number of questions that focus on problem-solving knowledge and image interpretation will also increase.

FAI was the most commonly tested subcategory related to hip preservation (Table 4). While the true prevalence of FAI is difficult to determine based on the literature, the prevalence is estimated to be 10% to 15% in asymptomatic patients.¹⁰ One study determined that 40% of all hip joint pathology was related to FAI, while another study found FAI in 87% of young, active patients with hip pain.^13,17 Furthermore, both diagnosis and surgical treatment of FAI consistently increased between 2000 and 2016, with 1 study reporting a 7-fold increase in FAI surgery rate^3,11 between 2006 and 2010. Given the clinical relevance of FAI and increasing rates of both diagnosis and surgical treatment, the focus on hip preservation questions related to FAI (33% of all questions) is appropriate. This contrasts the questions on adult hip dysplasia, which constituted only 17% of all hip preservation questions. This discrepancy may be due to the lower incidence of adult hip dysplasia in the general population (ranging from 3% to 5%). However, hip dysplasia is still clinically significant as the leading cause of early-onset hip osteoarthritis.¹⁶ Questions about athletic injuries and anatomy equally comprised the remaining hip preservation questions. Our analysis of commonly tested hip preservation content may assist residents and residency programs with targeted preparation for the OITE.

Over the last 1 years, 48 citations were used for 23 hip preservation questions, for a mean of 2.1 citations per question. The most commonly cited sources were the Journal of the American Academy of Orthopaedic Surgeons, Clinical Orthopedics and Related Research, and the American Journal of Sports Medicine (Table 5). This is consistent with other domains tested on the OITE, such as shoulder and elbow, oncology, hand, trauma, and sports, which also obtain a significant number of citations from the Journal of the American Academy of Orthopaedic Surgeons and Clinical Orthopedics and Related Research.^6,8,9,19,21 Most citations came from journals (97.9%) as opposed to textbooks (2.1%), suggesting that residents may focus on reviewing relevant and high-yield journals to streamline their OITE studying for hip preservation questions. Miyamoto et al¹² found that success on the OITE was correlated with frequent review of orthopaedic journals, particularly the Journal of the American Academy of Orthopaedic Surgeons and the Journal of Bone and Joint Surgery–American Volume, although the authors noted that there was likely great benefit in frequently reviewing other orthopaedic journals as well. The use of textbooks as study material, however, was not correlated with improved OITE performance.¹²

As the indications and number of procedures for hip preservation–related procedures have grown, the OITE has paralleled an increase in hip preservation–related questions. This increase in the number of questions has not matched the exponential increase in the number of hip arthroscopy cases being performed but does perhaps reflect the growth of evidence-based literature on hip preservation. The OITE may not always reflect the percentage of material tested on the database of the American Board of Orthopaedic Surgery (ABOS) Part 1 examination.

Limitations

Limitations of this study include its retrospective review of previous examination materials. While materials reviewed for test years 2002 to 2012 were from a single institution’s records of the OITE, a complete set of 275 questions were available for review each year. This is in contrast to examinations from years 2017 to 2021, when <275 questions were available for review. In discussion with the AAOS, this discrepancy is due to questions that were poorly worded or did not have acceptable correct answer distributions after analysis. In addition, the past 2 years included 50 or so questions directly from the ABOS, which were not available for further review. It is difficult to predict the number of questions relating to hip preservation within the missing items.

Conclusion

Study findings indicated a positive correlation between time and percentage of hip preservation– related questions on the OITE over the past 20 years. In addition, 77% of hip preservation–related questions over the 20-year study period occurred in the last 10 years, with the highest total number of hip preservation related questions (n = 6) occurring on the 2021 examination. This information may help guide residency program education platforms moving forward and reflect national trends in the number of hip preservation–related surgeries being performed.

Footnotes

Final revision submitted July 31, 2023; accepted August 17, 2023.

One or more of the authors has declared the following potential conflict of interest or source of funding: A.M.S. has received consulting fees from Stryker. AOSSM checks author disclosures against the Open Payments Database (OPD). AOSSM has not conducted an independent investigation on the OPD and disclaims any liability or responsibility relating thereto.

Ethical approval was not sought for the present study.

References

Buckwalter

Schumacher

Albright

Cooper

RR.

Use of an educational taxonomy for evaluation of cognitive performance. J Med Educ. 1981;56(2):115-121. doi:10.1097/00001888-198102000-00006

Frassica

Papp

McCarthy

Weber

Analysis of the pathology section of the OITE will aid in trainee preparation. Clin Orthop Relat Res. 2008;466(6):1323-1328. doi:10.1007/s11999-008-0235-2

Hale

Melugin

Zhou

, et al. Incidence of femoroacetabular impingement and surgical management trends over time. Am J Sports Med. 2021;49(1):35-41. doi:10.1177/0363546520970914

Haynes

Pascual-Garrido

Nepple

, ANCHOR Group, Clohisy

JC.

Trends of hip arthroscopy in the setting of acetabular dysplasia. J Hip Preserv Surg. 2018;5(3):267-273. doi:10.1093/jhps/hny026

Herndon

Allan

Dyer

Jawa

Zurakowski

Predictors of success on the American Board of Orthopaedic Surgery Examination. Clin Orthop Relat Res. 2009;467(9):2436-2445. doi:10.1007/s11999-009-0939-y

Hoskins

Goyette

Patel

, et al. Updated analysis of the oncology section of the OITE from 2007 to 2019. J Cancer Educ. 2021;36(1):10-15. doi:10.1007/s13187-020-01840-z

Kurtz

Ong

Lau

Mowat

Halpern

Projections of primary and revision hip and knee arthroplasty in the United States from 2005 to 2030. J Bone Joint Surg Am. 2007;89(4):780-785. doi:10.2106/JBJS.F.00222

Lackey

Jeray

Tanner

Analysis of the musculoskeletal trauma section of the orthopaedic in-training examination (OITE). J Orthop Trauma. 2011;25(4):238-242. doi:10.1097/BOT.0b013e3181e59da9

LeBrun

Premkumar

Ellsworth

Shen

Cross

Fufa

DT.

Analysis of hand surgery questions on orthopaedic in-training examination from 2014 to 2019. Hand (N Y). Published online October 26, 2020:1558944720964960. doi:10.1177/1558944720964960

10.

Leunig

Beck

Dora

Ganz

Femoroacetabular impingement: trigger for the development of coxarthrosis [in German]. Orthopade. 2006;35(1):77-84. doi:10.1007/s00132-005-0896-4

11.

Maradit Kremers

Schilz

Van Houten

, et al. Trends in utilization and outcomes of hip arthroscopy in the United States between 2005 and 2013. J Arthroplasty. 2017;32(3):750-755. doi:10.1016/j.arth.2016.09.004

12.

Miyamoto

Jr Klein

Walsh

Zuckerman

JD.

Orthopaedic surgery residents’ study habits and performance on the orthopaedic in-training examination. Am J Orthop (Belle Mead NJ). 2007;36(12):E185-E188.

13.

Ochoa

Dawson

Patzkowski

Hsu

. Radiographic prevalence of femoroacetabular impingement in a young population with hip complaints is high. Clin Orthop Relat Res. 2010;468(10):2710-2714. doi:10.1007/s11999-010-1233-8

14.

Orthopaedic in-training examination (OITE). American Academy of Orthopaedic Surgeons. Accessed June 27, 2021. https://www.aaos.org/education/about-aaos-products/orthopaedic-in-training-examination-oite/

15.

Premkumar

Lebrun

Shen

Ellsworth

Bostrom

MPG

Cross

MB.

Analysis of hip and knee reconstruction questions on the orthopaedic in-training examination. J Arthroplasty. 2021;36(3):1156-1159. doi:10.1016/j.arth.2020.09.018

16.

Pun

Hip dysplasia in the young adult caused by residual childhood and adolescent-onset dysplasia. Curr Rev Musculoskelet Med. 2016;9(4):427-434. doi:10.1007/s12178-016-9369-0

17.

Rankin

Bleakley

Cullen

Hip joint pathology as a leading cause of groin pain in the sporting population: a 6-year review of 894 cases. Am J Sports Med. 2015;43(7):1698-1703. doi:10.1177/0363546515582031

18.

Sheibani-Rad

Arnoczky

Walter

NE.

Analysis of the basic science section of the orthopaedic in-training examination. Orthopedics. 2012;35(8):e1251-e1255. doi:10.3928/01477447-20120725-28

19.

Srikumaran

Freehill

Spiker

McFarland

Petersen

SA.

Evaluation of shoulder and elbow questions on the orthopaedic in-training examination as an instrument for enhancing examination preparation. J Bone Joint Surg Am. 2011;93(11):e63. doi:10.2106/JBJS.J.01531

20.

Srinivasan

Seybold

Kadakia

AR.

Analysis of the foot and ankle section of the orthopaedic in-training examination (OITE). Foot Ankle Int. 2009;30(11):1060-1064. doi:10.3113/FAI.2009.1060

21.

Srinivasan

Seybold

Salata

Miller

BS.

An analysis of the orthopaedic in-training examination sports section: the importance of reviewing the current orthopaedic subspecialty literature. J Bone Joint Surg Am. 2010;92(3):778-782. doi:10.2106/JBJS.I.00466

22.

Stone

Kang

Eisemon

Choueka

The most-cited sources on the orthopaedic in-training examination: question yield, reading efficiency, and time lag from publication. Bull Hosp Jt Dis (2013). 2013;71(4):245-252.

23.

Truntzer

Shapiro

Hoppe

Abrams

Safran

MR.

Hip arthroscopy in the United States: an update following coding changes in 2011. J Hip Preserv Surg. 2017;4(3):250-257. doi:10.1093/jhps/hnx004

24.

Weinstein

. Developmental hip dysplasia and dislocation. In: Morrissy