ICISS: Dr. Rutledge's Contribution to Trauma Care
Dr Rutledge: Inventor of ICISS (ICD based Injury Severity Score)
In 1993 Dr Rutledge published the first article describing the use of ICD-9 codes as a means of predicting injury severity. (1) At the time the standard means of injury severity scoring was the consensus derived ISS. Dr Rutledge’s invention was a data derived system based upon analysis of actual injury outcomes that were quantitated from actual trauma outcomes.
Although controversial at the time, (criticized by Champion, MacKenzie and others) now 17 years later the ICISS stands as simple, well validated and relatively inexpensive means of injury severity scoring, confirming Dr Rutledge’s initial findings.(2-51)
Over 10 years ago Dr. Rutledge wrote:
The Journal of Trauma: Injury, Infection, and Critical Care:
January 1998 - Volume 44 - Issue 1 - pp 41-49
Article
The End of the Injury Severity Score (ISS) and the Trauma and Injury Severity Score (TRISS): ICISS, an International Classification of Diseases, Ninth Revision-Based Prediction Tool, Outperforms Both ISS and TRISS as Predictors of Trauma Patient Survival, Hospital Charges, and Hospital Length of Stay
Rutledge, Robert MD; Osler, Turner MD; Emery, Sherry PhD; Kromhout-Schiro, Sharon PhD
Collapse Box
Abstract
Introduction: Since their inception, the Injury Severity Score (ISS) and the Trauma and Injury Severity Score (TRISS) have been suggested as measures of the quality of trauma care. In concept, they are designed to accurately assess injury severity and predict expected outcomes. ICISS, an injury severity methodology based on International Classification of Diseases, Ninth Revision, codes, has been demonstrated to be superior to ISS and TRISS. The purpose of the present study was to compare the ability of TRISS to ICISS as predictors of survival and other outcomes of injury (hospital length of stay and hospital charges). It was our hypothesis that ICISS would outperform ISS and TRISS in each of these outcome predictions.
Methods: "Training" data for creation of ICISS predictions were obtained from a state hospital discharge data base. "Test" data were obtained from a state trauma registry. ISS, TRISS, and ICISS were compared as predictors of patient survival. They were also compared as indicators of resource utilization by assessing their ability to predict patient hospital length of stay and hospital charges. Finally, a neural network was trained on the ICISS values and applied to the test data set in an effort to further improve predictive power. The techniques were compared by comparing each patient's outcome as predicted by the model to the actual outcome.
Results: Seven thousand seven hundred five patients had complete data available for analysis. The ICISS was far more likely than ISS or TRISS to accurately predict every measure of outcome of injured patients tested, and the neural network further improved predictive power.
Conclusion: In addition to predicting mortality, quality tools that can accurately predict resource utilization are necessary for effective trauma center quality-improvement programs. ICISS-derived predictions of survival, hospital charges, and hospital length of stay consistently outperformed those of ISS and TRISS. The neural network-augmented ICISS was even better. This and previous studies demonstrate that TRISS is a limited technique in predicting survival resource utilization. Because of the limitations of TRISS, it should be superseded by ICISS.
References
1. Rutledge R, Fakhry S, Baker C, Oller D. Injury severity grading in trauma patients: a simplified technique based upon ICD-9 coding. J Trauma 1993;35(4):497-506; discussion 506.
2. Rutledge R. Injury severity and probability of survival assessment in trauma patients using a predictive hierarchical network model derived from ICD-9 codes. J Trauma 1995;38(4):590-7; discussion 597.
3. Osler T, Rutledge R, Deis J, Bedrick E. ICISS: an international classification of disease-9 based injury severity score. J Trauma 1996;41(3):380-6; discussion 386.
4. Rutledge R, Hoyt DB, Eastman AB, Sise MJ, Velky T, Canty T, et al. Comparison of the Injury Severity Score and ICD-9 diagnosis codes as predictors of outcome in injury: analysis of 44,032 patients. J Trauma 1997;42(3):477-87; discussion 487.
5. Osler TM, Cohen M, Rogers FB, Camp L, Rutledge R, Shackford SR, et al. Trauma registry injury coding is superfluous: a comparison of outcome prediction based on trauma registry International Classification of Diseases-Ninth Revision (ICD-9) and hospital information system ICD-9 codes. J Trauma 1997;43(2):253-6; discussion 256.
6. Rutledge R, Osler T. The ICD-9-based illness severity score: a new model that outperforms both DRG and APR-DRG as predictors of survival and resource utilization. J Trauma 1998;45(4):791-799.
7. Osler TM, Rogers FB, Glance LG, Cohen M, Rutledge R, Shackford SR, et al. Predicting survival, length of stay, and cost in the surgical intensive care unit: APACHE II versus ICISS. J Trauma 1998;45(2):234-7; discussion 237.
8. Rutledge R, Osler T, Kromhout-Schiro S. Illness severity adjustment for outcomes analysis: validation of the ICISS methodology in all 821,455 patients hospitalized in North Carolina in 1996. Surgery 1998;124(2):187-94; discussion 194.
9. Rutledge R, Osler T, Emery S, Kromhout-Schiro S. The end of the Injury Severity Score (ISS) and the Trauma and Injury Severity Score (TRISS): ICISS, an International Classification of Diseases, ninth revision-based prediction tool, outperforms both ISS and TRISS as predictors of trauma patient survival, hospital charges, and hospital length of stay. J Trauma 1998;44(1):41-49.
10. Hannan EL, Farrell LS, Gorthy SF, Bessey PQ, Cayten CG, Cooper A, et al. Predictors of mortality in adult patients with blunt injuries in New York State: a comparison of the Trauma and Injury Severity Score (TRISS) and the International Classification of Disease, Ninth Revision-based Injury Severity Score (ICISS). J Trauma 1999;47(1):8-14.
11. West TA, Rivara FP, Cummings P, Jurkovich GJ, Maier RV. Harborview assessment for risk of mortality: an improved measure of injury severity on the basis of ICD-9-CM. J Trauma 2000;49(3):530-40; discussion 540.
12. Hannan EL, Farrell LS, Meaker PS, Cooper A. Predicting inpatient mortality for pediatric trauma patients with blunt injuries: a better alternative. J Pediatr Surg 2000;35(2):155-159.
13. Kim Y, Jung KY, Kim CY, Kim YI, Shin Y. Validation of the International Classification of Diseases 10th Edition-based Injury Severity Score (ICISS). J Trauma 2000;48(2):280-285.
14. Rogers FB, Osler TM, Shackford SR, Martin F, Healey M, Pilcher D, et al. Population-based study of hospital trauma care in a rural state without a formal trauma system. J Trauma 2001;50(3):409-13; discussion 414.
15. Osler TM, Rogers FB, Badger GJ, Healey M, Vane DW, Shackford SR, et al. A simple mathematical modification of TRISS markedly improves calibration. J Trauma 2002;53(4):630-634.
16. Meredith JW, Evans G, Kilgo PD, MacKenzie E, Osler T, McGwin G, et al. A comparison of the abilities of nine scoring algorithms in predicting mortality. J Trauma 2002;53(4):621-8; discussion 628.
17. Stephenson SCR, Langley JD, Civil ID. Comparing measures of injury severity for use with large databases. J Trauma 2002;53(2):326-332.
18. Kuhls DA, Malone DL, McCarter RJ, Napolitano LM. Predictors of mortality in adult trauma patients: the physiologic trauma score is equivalent to the Trauma and Injury Severity Score. J Am Coll Surg 2002;194(6):695-704.
19. Meredith JW, Kilgo PD, Osler TM. Independently derived survival risk ratios yield better estimates of survival than traditional survival risk ratios when using the ICISS. J Trauma 2003;55(5):933-938.
20. Meredith JW, Kilgo PD, Osler T. A fresh set of survival risk ratios derived from incidents in the National Trauma Data Bank from which the ICISS may be calculated. J Trauma 2003;55(5):924-932.
21. Kilgo PD, Osler TM, Meredith W. The worst injury predicts mortality outcome the best: rethinking the role of multiple injuries in trauma outcome scoring. J Trauma 2003;55(4):599-606; discussion 606.
22. Kim Y, Jung KY. Utility of the international classification of diseases injury severity score: detecting preventable deaths and comparing the performance of emergency medical centers. J Trauma 2003;54(4):775-780.
23. Stephenson S, Henley G, Harrison JE, Langley JD. Diagnosis based injury severity scaling: investigation of a method using Australian and New Zealand hospitalisations. Inj Prev 2004;10(6):379-383.
24. Kilgo PD, Meredith JW, Hensberry R, Osler TM. A note on the disjointed nature of the injury severity score. J Trauma 2004;57(3):479-85; discussion 486.
25. Kulla M, Fischer S, Helm M, Lampl L. [How to assess the severity of the multi-system trauma in the emergency-room -- a critical review]. Anasthesiol Intensivmed Notfallmed Schmerzther 2005;40(12):726-736.
26. Clarke JR, Ragone AV, Greenwald L. Comparisons of survival predictions using survival risk ratios based on International Classification of Diseases, Ninth Revision and Abbreviated Injury Scale trauma diagnosis codes. J Trauma 2005;59(3):563-7; discussion 567.
27. Hannan EL, Waller CH, Farrell LS, Cayten CG. A comparison among the abilities of various injury severity measures to predict mortality with and without accompanying physiologic information. J Trauma 2005;58(2):244-251.
28. Deutscher M. The responsibility to protect. Med Confl Surviv 2005;21(1):28-34.
29. Markogiannakis H, Sanidas E, Messaris E, Michalakis I, Kasotakis G, Melissas J, et al. Management of blunt hepatic and splenic trauma in a Greek level I trauma centre. Acta Chir Belg 2006;106(5):566-571.
30. Durham R, Pracht E, Orban B, Lottenburg L, Tepas J, Flint L, et al. Evaluation of a mature trauma system. Ann Surg 2006;243(6):775-83; discussion 783.
31. Clark DE, Ahmad S. Estimating injury severity using the Barell matrix. Inj Prev 2006;12(2):111-116.
32. Pressley JC, Trieu L, Kendig T, Barlow B. National injury-related hospitalizations in children: public versus private expenditures across preventable injury mechanisms. J Trauma 2007;63(3 Suppl):S10-S19.
33. Moore L, Lavoie A, Bergeron E, Emond M. Modeling probability-based injury severity scores in logistic regression models: the logit transformation should be used. J Trauma 2007;62(3):601-605.
34. Bergeron E, Simons R, Linton C, Yang F, Tallon JM, Stewart TC, et al. Canadian benchmarks in trauma. J Trauma 2007;62(2):491-497.
35. Tepas JJ, Leaphart CL, Celso BG, Tuten JD, Pieper P, Ramenofsky ML, et al. Risk stratification simplified: the worst injury predicts mortality for the injured children. J Trauma 2008;65(6):1258-61; discussion 1261.
36. Davie G, Cryer C, Langley J. Improving the predictive ability of the ICD-based Injury Severity Score. Inj Prev 2008;14(4):250-255.
37. Markogiannakis H, Sanidas E, Michalakis I, Manouras A, Melissas J, Tsiftsis D, et al. Predictive factors of operative or nonoperative management of blunt hepatic trauma. Minerva Chir 2008;63(3):223-228.
38. Burd RS, Ouyang M, Madigan D. Bayesian logistic injury severity score: a method for predicting mortality using international classification of disease-9 codes. Acad Emerg Med 2008;15(5):466-475.
39. Diggs BS, Mullins RJ, Hedges JR, Arthur M, Newgard CD. Proportion of seriously injured patients admitted to hospitals in the US with a high annual injured patient volume: a metric of regionalized trauma care. J Am Coll Surg 2008;206(2):212-219.
40. Moore L, Lavoie A, Le Sage N, Bergeron E, Emond M, Abdous B, et al. Consensus or data-derived anatomic injury severity scoring? J Trauma 2008;64(2):420-426.
41. Boufous S, Finch C, Hayen A, Williamson A. The impact of environmental, vehicle and driver characteristics on injury severity in older drivers hospitalized as a result of a traffic crash. J Safety Res 2008;39(1):65-72.
42. Wong SSN, Leung GKK. Injury Severity Score (ISS) vs. ICD-derived Injury Severity Score (ICISS) in a patient population treated in a designated Hong Kong trauma centre. McGill journal of medicine : MJM : an international forum for the advancement of medical sciences by students 2008;11(1):9-13.
43. Tepas JJ, Celso BG, Leaphart CL, Graham D. Application of International Classification Injury Severity Score to National Surgical Quality Improvement Program defines pediatric trauma performance standards and drives performance improvement. J Trauma 2009;67(1):185-8; discussion 188.
44. Glance LG, Osler TM, Mukamel DB, Meredith W, Wagner J, Dick AW, et al. TMPM-ICD9: a trauma mortality prediction model based on ICD-9-CM codes. Ann Surg 2009;249(6):1032-1039.
45. Smartt P, Chalmers D. Searching for ski-lift injury: An uphill struggle? J Sci Med Sport 2009;
46. Cinelli SM, Brady P, Rennie CP, Tuluca C, Hall TS. Comparative results of trauma scoring systems in fatal outcomes. Conn Med 2009;73(5):261-265.
47. Kim J, Shin SD, Im TH, Lee KJ, Ko SB, Park JO, et al. Development and Validation of the Excess Mortality Ratio-adjusted Injury Severity Score Using the International Classification of Diseases 10th Edition. Acad Emerg Med 2009;
48. McDonald G, Davie G, Langley J. Validity of police-reported information on injury severity for those hospitalized from motor vehicle traffic crashes. Traffic Inj Prev 2009;10(2):184-190.
49. Smartt P, Chalmers D. Obstructing the goal? Hospitalisation for netball injury in New Zealand 2000-2005. N Z Med J 2009;122(1288):62-75.
50. Leaphart CL, Graham D, Pieper P, Celso BG, Tepas JJ. Surgical quality improvement: a simplified method to apply national standards to pediatric trauma care. J Pediatr Surg 2009;44(1):156-159.
51. Millham F, Jain NB. Are there racial disparities in trauma care? World J Surg 2009;33(1):23-33.
posted by DrR @ 1:02 PM
0 Comments:
Post a Comment
<< Home