Acuity scoring systems quantitate the severity of clinical conditions and stratify patients according to presenting patient condition. In the pediatric intensive care unit, the complexity and number of clinical scoring systems are increasing as their applications for clinicians, health services researches, and quality improvement broaden. This article is a review of acuity scoring systems for the pediatric intensive care unit, including examples of scoring systems available, the methods used in assessing these tools, the ways in which these systems are used, and the utility of acuity scoring systems in accurate benchmarking. It is anticipated that with increasing health care costs and competition and increased focus on medical error reduction and quality improvement, the demands for risk-adjusted outcomes and institutional benchmarking will increase; therefore, as clinicians, academicians, and administrators, it is imperative that we be knowledgeable of the methods and applications of these acuity scoring systems to ensure their quality and appropriate use.
Institute of Medicine : Committee on Quality of Health Care in America. To Err Is Human: Building a Safer Health System . Washington, DC: National Academy Press ; 2000.
2.
Institute of Medicine : Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press ; 2001.
3.
AHRQ Quality Indicators.Prevention Quality Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/pqi_overview.htm. Accessed November 2005.
4.
AHRQ Quality Indicators.Patient Safety Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/psi_overview.htm. Accessed November 2005.
5.
AHRQ Quality Indicators.Inpatient Quality Indicators Overview. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrq.gov/iqi_overview.htm. Accessed November 2005.
6.
Institute of Medicine : Committee on Identifying Priority Areas for Quality Improvement. Priority Areas for National Action: Transforming Health Care Quality. Washington, DC: National Academies Press ; 2003.
7.
Berwick DMA primer on leading the improvement of systems . BMJ.1996;312: 619-622 .
8.
Institute for Healthcare Improvement.Critical Care. Available at: http://www.ihi.org/IHI/Topics/CriticalCare . Accessed November 2004.
9.
Vincent JL , de Mendonca A. , Cantraine F. , et al. Use of the SOFA score to assess the incidence of organ dysfunction/ failure in intensive care units: results of a multicenter, prospective study: working group on “sepsis-related problems” of the European Society of Intensive Care Medicine . Crit Care Med.1998;26: 1793-1800 .
10.
Leteurtre S. , Martinot A. , Duhamel A. , et al. Validation of the Paediatric Logistic Organ Dysfunction (PELOD) score: prospective, observational, multicentre study . Lancet. 2003; 362: 192-197 .
11.
Leclerc F. , Leteurtre S. , Duhamel A. , et al. Cumulative influence of organ dysfunctions and septic state on mortality of critically ill children . Am J Respir Crit Care Med.2005;171: 348-353 .
12.
Leteurtre S. , Martinot A. , Duhamel A. , et al. Development of a pediatric multiple organ dysfunction score: use of two strategies . Med Decis Making. 1999;19: 399-410 .
13.
Le Gall JR , Klar J. , Lemeshow S. , et al. The logistic organ dysfunction system: a new way to assess organ dysfunction in the intensive care unit: ICU Scoring Group . JAMA.1996; 276: 802-810 .
14.
Laupacis A. , Sekar N. , Stiell IGClinical prediction rules: a review and suggested modifications of methodological standards . JAMA.1997;277: 488-494 .
15.
Randolph AG , Guyatt GH , Calvin JE , Doig G. , Richardson WSUnderstanding articles describing clinical prediction tools: evidence based medicine in critical care group . Crit Care Med.1998;26: 1603-1612 .
16.
Marcin JP , Pollack MMReview of the methodologies and applications of scoring systems in neonatal and pediatric intensive care . Pediatr Crit Care Med.2000;1: 20-27 .
17.
Soeken KL , Prescott PAIssues in the use of kappa to estimate reliability . Med Care.1986;24: 733-741 .
18.
Fleiss J.Statistical Methods for Rates and Proportions. 2nd ed. New York: John Wiley & Sons ; 1981.
19.
Roberts C. , McNamee R.A matrix of kappa-type coefficients to assess the reliability of nominal scales . Stat Med.1998;17: 471-488 .
20.
Fleiss J.The Design and Analysis of Clinical Experiments. New York : John Wiley & Sons ; 1986.
21.
Landis J. , Gg K.The measurement of observer agreement for categorical data . Biometrics.1977;33: 159-174 .
22.
Jennett B. , Bond M.Assessment of outcome after severe brain damage . Lancet. 1975;1: 480-484 .
23.
Apgar V.A proposal for a new method of evaluation of the newborn infant . Curr Res Anesth Analg.1953;32: 260-267 .
24.
Hand DJStatistical methods in diagnosis . Stat Methods Med Res.1992;1: 49-67 .
25.
Tu JVAdvantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes . J Clin Epidemiol.1996;49: 1225-1231 .
26.
Breiman L.Classification and Regression Trees. Belmont, Calif : Wadsworth International Group ; 1984.
27.
Cleveland WSLOWESS: a program for smoothing scatter-plots by robust locally weighted regression . Am Stat. 1981; 35: 54 .
28.
Lemeshow S. , Le Gall JRModeling the severity of illness of ICU patients: a systems update . JAMA.1994;272: 1049-1055 .
29.
Swets JAMeasuring the accuracy of diagnostic systems . Science . 1988;240: 1285-1293 .
30.
Hanley JA , McNeil BJA method of comparing the areas under receiver operating characteristic curves derived from the same cases . Radiology. 1983 ;148: 839-843 .
31.
Hanley JA , McNeil BJThe meaning and use of the area under a receiver operating characteristic (ROC) curve . Radiology. 1982;143: 29-36 .
Hosmer DW , Hosmer T. , Le Cessie S , Lemeshow S.A comparison of goodness-of-fit tests for the logistic regression model . Stat Med.1997;16: 965-980 .
34.
Bertolini G. , D'Amico R. , Nardi D. , Tinazzi A. , Apolone G.One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model . J Epidemiol Biostat.2000 ;5: 251-253 .
35.
Pollack MM , Ruttimann UE , Getson PRPediatric risk of mortality (PRISM) score . Crit Care Med.1988;16: 1110-1116 .
36.
Pollack MM , Patel KM , Ruttimann UEPRISM III: an updated pediatric risk of mortality score . Crit Care Med.1996;24: 743-752 .
37.
Shann F. , Pearson G. , Slater A. , Wilkinson K.Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care . Intensive Care Med.1997 ;23: 201-207 .
38.
Slater A. , Shann F. , Pearson G.PIM2: a revised version of the Paediatric Index of Mortality . Intensive Care Med.2003;29: 278-285 .
39.
Pediatric Intensive Care Unit Evaluations : Assessing Quality and Efficiency: Scientific Background and Research. Available at: http://www.childrensnationalmedicalcenter.com/picues/scientific_quality.aspx. Accessed November 2005.
40.
Randolph AG , Gonzales CA , Cortellini L. , Yeh TSGrowth of pediatric intensive care units in the United States from 1995 to 2001 . J Pediatr.2004;144: 792-798 .
41.
Pollack MM , Patel KM , Ruttimann UEThe Pediatric Risk of Mortality III—Acute Physiology Score (PRISM III- APS): a method of assessing physiologic instability for pediatric intensive care unit patients . J Pediatr. 1997;131: 575-581 .
42.
van Keulen JG , Gemke RJ , Polderman KHEffect of training and strict guidelines on the reliability of risk adjustment systems in paediatric intensive care . Intensive Care Med.2005;31: 1229-1234 .
43.
van Keulen JG , Polderman KH , Gemke RJReliability of PRISM and PIM scores in paediatric intensive care . Arch Dis Child.2005;90: 211-214 .
44.
Gemke RJ , van Vught J.Scoring systems in pediatric intensive care: PRISM III versus PIM . Intensive Care Med.2002;28: 204-207 .
45.
Slater A. , Shann F.The suitability of the Pediatric Index of Mortality (PIM), PIM2, the Pediatric Risk of Mortality (PRISM), and PRISM III for monitoring the quality of pediatric intensive care in Australia and New Zealand . Pediatr Crit Care Med.2004;5: 447-454 .
46.
Brady AR , Harrison D. , Black S. , et al. Assessment and optimization of mortality prediction tools for admissions to pediatric intensive care in the United kingdom . Pediatrics. 2006;117: e733-e742 .
47.
Pediatric Intensive Care Unit Evaluations. Available at: http://www.dcchildrens.com/picues/. Accessed November 2005.
48.
Sibbald WJ , Bion J. EvaluatingCritical Care: Using Health Services Research to Improve Quality. New York: Springer ; 2001.
49.
Fiser DHOutcome evaluations as measures of quality in pediatric intensive care . Pediatr Clin North Am.1994;41: 1423-1438 .
50.
Fiser DH , Long N. , Roberson PK , Hefley G. , Zolten K. , Brodie-Fowler M.Relationship of pediatric overall performance category and pediatric cerebral performance category scores at pediatric intensive care unit discharge with outcome measures collected at hospital discharge and 1- and 6-month follow-up assessments . Crit Care Med.2000;28: 2616-2620 .
51.
Fiser DH , Tilford JM , Roberson PKRelationship of illness severity and length of stay to functional outcomes in the pediatric intensive care unit: a multi-institutional study . Crit Care Med.2000;28: 1173-1179 .
52.
Lacroix J. , Cotting J.Severity of illness and organ dysfunction scoring in children . Pediatr Crit Care Med.2005;6(3 suppl): S126-S134 .
53.
Graciano AL , Balko JA , Rahn DS , Ahmad N. , Giroir BPThe Pediatric Multiple Organ Dysfunction Score (P-MODS): development and validation of an objective scale to measure the severity of multiple organ dysfunction in critically ill children . Crit Care Med.2005;33: 1484-1491 .
54.
Knaus WA , Wagner DP , Draper EA , et al. The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized adults . Chest. 1991;100: 1619-1636 .
55.
Zimmerman JE , Wagner DP , Draper EA , Wright L. , Alzola C. , Knaus WAEvaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database . Crit Care Med.1998;26: 1317-1326 .
56.
Zimmerman JE , Kramer AA , McNair DS , Malila FMAcute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients . Crit Care Med.2006;34: 1297-1310 .
57.
Lemeshow S. , Teres D. , Klar J. , Avrunin JS , Gehlbach SH , Rapoport J.Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients . JAMA.1993;270: 2478-2486 .
58.
Champion HR , Sacco WJ , Copes WS , Gann DS , Gennarelli TA , Flanagan MEA revision of the trauma score . J Trauma. 1989;29: 623-629 .
59.
Eichelberger MR , Bowman LM , Sacco WJ , Mangubat EA , Lowenstein AD , Gotschall CSTrauma score versus revised trauma score in TRISS to predict outcome in children with blunt trauma . Ann Emerg Med.1989;18: 939-942 .
Baker SP , O'Neill B. , Haddon W. Jr, Long WBThe injury severity score: a method for describing patients with multiple injuries and evaluating emergency care . J Trauma. 1974;14: 187-196 .
63.
Boyd CR , Tolson MA , Copes WSEvaluating trauma care: the TRISS method: Trauma Score and the Injury Severity Score . J Trauma.1987;27: 370-378 .
64.
Champion HR , Copes WS , Sacco WJ , et al. The Major Trauma Outcome Study: establishing national norms for trauma care . J Trauma. 1990;30: 1356-1365 .
65.
Champion HR , Copes WS , Sacco WJ , et al. A new characterization of injury severity . J Trauma. 1990;30: 539-545 .
66.
Osler T. , Rutledge R. , Deis J. , Bedrick E.ICISS: an international classification of disease-9 based injury severity score . J Trauma. 1996;41: 380-386 .
Kaufmann CR , Maier RV , Rivara FP , Carrico CJEvaluation of the Pediatric Trauma Score . JAMA.1990;263: 69-72 .
69.
Tepas JJ3rd, Ramenofsky ML, Mollitt DL, Gans BM, DiScala C. The Pediatric Trauma Score as a predictor of injury severity: an objective assessment . J Trauma. 1988;28: 425-429 .
70.
Tepas JJ3rd, Mollitt DL, Talbert JL, Bryant M. The pediatric trauma score as a predictor of injury severity in the injured child . J Pediatr Surg.1987;22: 14-18 .
71.
Westley CR , Cotton EK , Brooks JGNebulized racemic epinephrine by IPPB for the treatment of croup: a double-blind study . Am J Dis Child.1978 ;132: 484-487 .
72.
Leipzig B. , Oski FA , Cummings CW , Stockman JA , Swender P.A prospective randomized study to determine the efficacy of steroids in treatment of croup . J Pediatr.1979;94: 194-196 .
73.
Carroll CL , Sekaran AK , Lerer TJ , Schramm CMA modified pulmonary index score with predictive value for pediatric asthma exacerbations . Ann Allergy Asthma Immunol.2005; 94: 355-359 .
74.
Gorelick MH , Stevens MW , Schultz TR , Scribano PVPerformance of a novel clinical score, the Pediatric Asthma Severity Score (PASS), in the evaluation of acute asthma . Acad Emerg Med.2004;11: 10-18 .
75.
Smith SR , Baty JD , Hodge D. III. Validation of the pulmonary score: an asthma severity score for children . Acad Emerg Med.2002;9: 99-104 .
76.
Wood DW , Downes JJ , Lecks HIA clinical scoring system for the diagnosis of respiratory failure: preliminary report on childhood status asthmaticus . Am J Dis Child.1972;123: 227-228 .
77.
Timmons OD , Havens PL , Fackler JCPredicting death in pediatric patients with acute respiratory failure: Pediatric Critical Care Study Group: Extracorporeal Life Support Organization . Chest. 1995;108: 789-797 .
Kahn A. , Blum D.Factors for poor prognosis in fulminating meningococcemia: conclusions from observations of 67 childhood cases . Clin Pediatr.1978;17: 680-682 , 687 .
80.
Stiehm ER , Damrosch DSFactors in the prognosis of meningococcal infection: review of 63 cases with emphasis on recognition and management of the severely ill patient . J Pediatr.1966;68: 457-467 .
81.
Flaegstad T. , Kaaresen PI , Stokland T. , Gutteberg T.Factors associated with fatal outcome in childhood meningococcal disease . Acta Paediatr.1995 ;84: 1137-1142 .
82.
Tuysuz B. , Ozlu I. , Aji DY , Erginel A.Prognostic factors in meningococcal disease and a new scoring system . Acta Paediatr.1993;82: 1053-1056 .
83.
Slonim AD , Pollack MMIntegrating the Institute of Medicine's six quality aims into pediatric critical care: relevance and applications . Pediatr Crit Care Med. May 2005;6: 264-269 .
84.
Nipshagen MD , Polderman KH , DeVictor D. , Gemke RJPediatric intensive care: result of a European survey . Intensive Care Med.2002;28: 1797-1803 .
85.
Pearson G. , Shann F. , Barry P. , et al. Should paediatric intensive care be centralised? Trent versus Victoria . Lancet. 1997; 349: 1213-1217 .
86.
Pollack MM , Cuerdon TT , Patel KM , Ruttimann UE , Getson PR , Levetown M.Impact of quality-of-care factors on pediatric intensive care unit mortality . JAMA.1994;272: 941-946 .
87.
Tenner PA , Dibrell H. , Taylor RPImproved survival with hospitalists in a pediatric intensive care unit . Crit Care Med.2003; 31: 847-852 .
88.
Cimino MA , Kirschbaum MS , Brodsky L. , Shaha SHAssessing medication prescribing errors in pediatric intensive care units . Pediatr Crit Care Med.2004;5: 124-132 .
89.
Kaushal R. , Bates DW , Landrigan C. , et al. Medication errors and adverse drug events in pediatric inpatients . JAMA.2001;285: 2114-2120 .
90.
Singh-Naz N. , Sprague BM , Patel KM , Pollack MMRisk factors for nosocomial infection in critically ill children: a prospective cohort study . Crit Care Med.1996;24: 875-878 .
91.
Marcin JP , Rutan E. , Rapetti PM , Brown JP , Rahnamayi R. , Pretzlaff RKNurse staffing and unplanned extubation in the pediatric intensive care unit . Pediatr Crit Care Med.2005;6: 254-257 .
92.
Pollack MM , Ruttimann UE , Getson PRAccurate prediction of the outcome of pediatric intensive care: a new quantitative method . N Engl J Med.1987 ;316: 134-139 .
93.
Marcin JP , Song J. , Leigh JPThe impact of pediatric intensive care unit volume on mortality: a hierarchical instrumental variable analysis . Pediatr Crit Care Med.2005;6: 136-141 .
94.
Pollack MM , Getson PR , Ruttimann UE , et al. Efficiency of intensive care: a comparative analysis of eight pediatric intensive care units . JAMA.1987 ;258: 1481-1486 .
95.
Marcin JP , Slonim AD , Pollack MM , Ruttimann UELong-stay patients in the pediatric intensive care unit . Crit Care Med.2001;29: 652-657 .
96.
Tilford JM , Simpson PM , Yeh TS , et al. Variation in therapy and outcome for pediatric head trauma patients . Crit Care Med.2001;29: 1056-1061 .
97.
Pollack MM , Alexander SR , Clarke N. , Ruttimann UE , Tesselaar HM , Bachulis ACImproved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities . Crit Care Med.1991;19: 150-159 .
98.
Pollack MM , Patel KM , Ruttimann E.Pediatric critical care training programs have a positive effect on pediatric intensive care mortality . Crit Care Med.1997 ;25: 1637-1642 .
99.
Marcin JP , Pollack MM , Patel KM , Ruttimann UEDecision support issues using a physiology based score . Intensive Care Med.1998; 24: 1299-1304 .
100.
Field MJ , Behrman RE , Institute of Medicine (US). Committee on Palliative and End-of-Life Care for Children and Their Families. When Children Die: Improving Palliative and End-of-Life Care for Children and Their Families. Washington, DC: National Academy Press ; 2003.
101.
Pon S. , Notterman DA , Martin K.Pediatric critical care and hospital costs under reimbursement by diagnosis-related group: effect of clinical and demographic characteristics . J Pediatr.1993;123: 355-364 .
102.
Slonim AD , Pollack MMAn approach to costs in critical care: macro- versus microeconomics . Crit Care Med.1999;27: 2286-2287 .
103.
Ruttimann UE , Patel KM , Pollack MMLength of stay and efficiency in pediatric intensive care units . J Pediatr.1998;133: 79-85 .
104.
Naclerio AL , Gardner JW , Pollack MMSocioeconomic factors and emergency pediatric ICU admissions . Ann N Y Acad Sci.1999;896: 379-382 .
105.
Marcin JP , Schembri MS , He J. , Romano PSA population-based analysis of socioeconomic status and insurance status and their relationship with pediatric trauma hospitalization and mortality rates . Am J Public Health.2003;93: 461-466 .
106.
Howard I. , Joseph JG , Natale JEPediatric traumatic brain injury: do racial/ethnic disparities exist in brain injury severity, mortality, or medical disposition ? Ethn Dis.2005; 15(4 suppl 5): S5 - 51—56 .
107.
Lopez AM , Tilford JM , Anand KJ , et al. Variation in pediatric intensive care therapies and outcomes by race, gender, and insurance status . Pediatr Crit Care Med.2006;7: 2-6 .
