- Open Access
Impact of order set use on outcome of patients with sepsis
Applied Informatics volume 4, Article number: 2 (2017)
In an effort to improve outcome of patients with sepsis, we developed and implemented a disease-specific alert and order set for our computerized physician order entry system. This alert and order set were implemented in 2015. We have produced a progressive decrease in mortality for patients at our hospital with diagnosis of sepsis. We see a significant decrease in mortality for patients who had the sepsis order set used compared to those who did not have the order set used. We recommend use of an order set for patients with sepsis.
We evaluate the care of patients in our hospital in an effort to continuously improve. Sepsis is a major focus for patient care improvement. There are established standards of care (Novosad et al. 2016; http://www.sccm.org/Documents/SSC-Guidelines.pdf 2012). These standards include several acute care activities including clinical and laboratory evaluation, rapid implementation of treatment, and follow-up evaluations. These multiple and multiphase steps are an excellent opportunity for a checklist to remind physicians of required tests and treatments to provide safe, timely, and effective care (Gawande 2009). A computerized physician order entry (CPOE) system is an ideal system to present physicians in real-time evidence-based efficient checklists of orders to provide care for specific patients. (Winterbottom et al. 2011; Hanzelka et al. 2013).
With our CPOE implementation our clinicians developed order sets to allow physicians to provide ideal care in the most efficient manner. One order set (Fig. 1) is for patients with signs and symptoms of sepsis. We also developed a best practice alert (BPA) (Fig. 2) for nurses and physicians that is activated in the computerized medical record when a patient has vital signs and white blood count suggestive of systemic inflammatory response syndrome (SIRS) or sepsis. The alert would be seen when nurse or physician open the chart. Specific parameters of vital signs, white blood cells, and serum lactate levels are shown in Table 1. The alert has a link to the sepsis order set. Physicians can select to use the order set from the link to best practice alert (BPA) or not. The order set can also be selected without the BPA.
During the time period of our data collection, there were no other new evaluations, medications or therapies implemented for our physicians and nurses. A specialized nurse who is our sepsis coordinator would see each time a BPA was initiated and follow-up with the nurse and physician about patient assessment and treatment.
We report patients with sepsis as a principal or secondary diagnosis. Our patient mortality has decreased from 25% in 2013 to 19.4% in 2015 and in the first quarter of 2016 to 15.05% (P = 0.005) (Table 2). In 2016 from May 1 2016 to August 16, 2016, we evaluated the use of the sepsis order set after the best practice alert was presented. In those patients with the BPA our sepsis order set was used in 111 of 183 (60.6%) patients in the emergency department and 233 of 592 inpatients (39.4%) (P < 0.0001). Overall sepsis order set utilization was 344 of 775 patients (44%) (Table 3). For our patients during the measured period of May 1, 2015 through April 30, 2016 where the order set was used (n = 218) our mortality was 11.57% (95% CI 7.32–15.82). During the same period, patients in whom the order set was not used (n = 905) the mortality was 18.19% (95% CI 16.3–20.1) (P = 0.015) (Table 4). Length of stay was 11.68 days (95% CI 10.03–13.33) in patients who had the order set used and 13.31 days (95% CI 12.2–14.41) in those who did not (P = 0.18). Readmissions were 11.7% (95% CI 7.45–15.95) for those who had order set and 16.69% (95% CI 14.2–29.1) (P = 0.097) in those who did not.
We evaluate the care of patients in our hospital in an effort to continuously improve. We measure, analyze, plan, implement, and then re-measure as processes for continuous improvement. Sepsis is a major focus for patient care improvement. There is a national focus to improve diagnosis, treatment, and outcomes. The assessment of patient’s signs and lab tests can now reliably be done by computerized health record systems. Alerts can be generated to nurses and clinicians. The next phase for improvement is being sure that every patient receives complete and timely care. This should be done in the most efficient manner for nurses and physicians.
We report an improvement in mortality with use of an order set designed to be complete, timely, and easy to use. Length of stay and readmissions were improved in patients who had order set used but did not reach statistical significant difference. We believe we will see ongoing improvements in patient outcomes with clinician education, specific case reviews, nurse implemented protocols, and perhaps computer requiring use of the order set for all patients with sepsis. We recommend order sets be evaluated and used for sepsis and other diseases.
We use our electronic health record (EHR) to measure incidence and mortality. Patients who were coded as a principal or secondary diagnosis of sepsis were included. Coding is done by professionally trained, evaluated, coders who review every patient chart. Problem lists and physician notes are used to assign diagnostic codes. We analyzed the results for patients with sepsis coded for overall mortality, use of order set, and mortality based on use or non-use of the order set. We also analyzed major quality metrics including length of stay (LOS) and readmissions within thirty days. We compared outcome in those patients in whom the order set was used to those in whom it was not. Results were expressed as number of cases and as mean percentages (rates) ±95% confidence intervals (CI) of the mean. Statistical significance for mortality, readmission, and use of sepsis order sets in Emergency Department vs. inpatients was analyzed with the Fisher Exact test. The Student T test was used to analyze differences in LOS. Chi-Square Statistic was employed to estimate reduction in mortality from 2013 to 2016. P ≤ 0.05 was accepted as significant. No data was collected from humans or animals, only chart review was performed. This is a retrospective chart review of patients in an urgent clinical condition requiring rapid evaluation and management. We did not apply randomization as we believe the alert and order set should be applied to all patients.
computerized physician order entry
best practice alert
systemic inflammatory response syndrome
- E H R:
electronic health record
length of stay
Gawande A (2009) The checklist manifesto: how to get things right. Metropolitan Books, New York
Hanzelka K, Yeung S, Chisolm G, Merriman K, Gaeta S, Malik I, Rice T (2013) Implementation of modified early-goal directed therapy for sepsis in the emergency center of a comprehensive cancer center. Support Care Cancer 21:727–734
Novosad S, Sapiano M, Grigg C, et al (2016) Vital signs: epidemiology of sepsis: prevalence of health care factors and opportunities for prevention. CDC. www.cdc.gov&citation. id = 10783602
Winterbottom F, Seoane L, Sundell E, Niazi J, Nash T (2011) Improving sepsis outcomes for acutely ill adults using interdisciplinary order sets. Clin Nurse Spec 2011:180–185
RCG: Executive Sponsor for the team that implemented the order set and wrote initial draft and edits to the manuscript. KR: Mount Sinai Medical Center epidemiologist and head of Division of Infectious Disease. Provided information for establishing the metrics for Best Practice Alert. MC: Chief of Division of Critical Care. MC oversees care of the patients in our intensive care units. Participated in implementing the order set and data and manuscript review. NN: Head of Infection Prevention. Co-lead team to evaluate and implement sepsis best practice alert and order set. NN evaluated and provided input on the manuscript. CL: Sepsis Coordinator. Co-lead efforts to implement the order set. Reviewed manuscript and provided suggestions. LC is the Mount Sinai Medical Center education program statistician. LC does the statistical analysis of our data and wrote the section on statistical methods. Evaluated the project and provided suggestion on the manuscript. DF: Chairman of the Emergency Department. He provided input into best practice alert, sepsis order set, and reviewed and provided suggestions on the manuscript. AS: Director of our Project Management Office. AS provided the data from our electronic health record for analysis and reviewed the manuscript. TG: Chief Information Officer. TG and team developed the best practice alert and order set as well as producing the data from our electronic health record. All authors read and approved the final manuscript.
We acknowledge the help of our Center for Clinical Excellence, all our infection prevention team, and the physicians and nurses of Mount Sinai Medical Center who care for our patients and use our patient safety programs such as best practice alerts and order sets.
All authors work together to improve quality of care of patients at Mount Sinai Medical Center. The authors declare that they have no competing interests.
Availability of data and materials
Data and materials are available in the office of principle author. Data is accumulated from our Mount Sinai Medical Center electronic health record.
There was no funding for this study. This work was part of our primary work for all authors involved in this work.