Impact of order set use on outcome of patients with sepsis
© The Author(s) 2017
Received: 26 September 2016
Accepted: 28 December 2016
Published: 5 January 2017
In an effort to improve outcome of patients with sepsis, we developed and implemented a disease-specific alert and order set for our computerized physician order entry system. This alert and order set were implemented in 2015. We have produced a progressive decrease in mortality for patients at our hospital with diagnosis of sepsis. We see a significant decrease in mortality for patients who had the sepsis order set used compared to those who did not have the order set used. We recommend use of an order set for patients with sepsis.
KeywordsSepsis Computerized order entry Order sets Decreasing mortality
We evaluate the care of patients in our hospital in an effort to continuously improve. Sepsis is a major focus for patient care improvement. There are established standards of care (Novosad et al. 2016; http://www.sccm.org/Documents/SSC-Guidelines.pdf 2012). These standards include several acute care activities including clinical and laboratory evaluation, rapid implementation of treatment, and follow-up evaluations. These multiple and multiphase steps are an excellent opportunity for a checklist to remind physicians of required tests and treatments to provide safe, timely, and effective care (Gawande 2009). A computerized physician order entry (CPOE) system is an ideal system to present physicians in real-time evidence-based efficient checklists of orders to provide care for specific patients. (Winterbottom et al. 2011; Hanzelka et al. 2013).
Criteria for alerting physicians and nurses
1. Patient must have at least 1 true value from each category (A, B and C)
2. Once it has fired it will not fire again for 12 h, per nursing and per physicians
3. It fires even if the patient has sepsis on problem list
A). Must have temperature greater than 100.9 F or less than 95.8 F
(Considers T max last 12 h lookback)
B). White blood cell count (WBC) greater than 12,000 or WBC less than 4000 and Bands >10%, or lactic acid greater than 2
Considers last WBC look-back up to 24 h, and last lactic acid look-back up to 12 h
C). Heart rate greater than 90 or respiratory rate greater than 25 or systolic blood pressure less than 90
Considers heart rate max & respiratory rate max & systolic blood pressure minimum with in past 6 h
During the time period of our data collection, there were no other new evaluations, medications or therapies implemented for our physicians and nurses. A specialized nurse who is our sepsis coordinator would see each time a BPA was initiated and follow-up with the nurse and physician about patient assessment and treatment.
Patient mortality for all patients with sepsis diagnosis
2016 (quarter 1)
Use of sepsis order set after best practice alert May 1, 2016—August 16, 2016
OS not used
Emergency department BPA
Sepsis order set utilization and patient outcome May 1, 2015- April 30, 2016
Number of cases
Observed mortality %
Observed LOS (days)
Observed readmissions %
Order set used
Order set not used
We evaluate the care of patients in our hospital in an effort to continuously improve. We measure, analyze, plan, implement, and then re-measure as processes for continuous improvement. Sepsis is a major focus for patient care improvement. There is a national focus to improve diagnosis, treatment, and outcomes. The assessment of patient’s signs and lab tests can now reliably be done by computerized health record systems. Alerts can be generated to nurses and clinicians. The next phase for improvement is being sure that every patient receives complete and timely care. This should be done in the most efficient manner for nurses and physicians.
We report an improvement in mortality with use of an order set designed to be complete, timely, and easy to use. Length of stay and readmissions were improved in patients who had order set used but did not reach statistical significant difference. We believe we will see ongoing improvements in patient outcomes with clinician education, specific case reviews, nurse implemented protocols, and perhaps computer requiring use of the order set for all patients with sepsis. We recommend order sets be evaluated and used for sepsis and other diseases.
We use our electronic health record (EHR) to measure incidence and mortality. Patients who were coded as a principal or secondary diagnosis of sepsis were included. Coding is done by professionally trained, evaluated, coders who review every patient chart. Problem lists and physician notes are used to assign diagnostic codes. We analyzed the results for patients with sepsis coded for overall mortality, use of order set, and mortality based on use or non-use of the order set. We also analyzed major quality metrics including length of stay (LOS) and readmissions within thirty days. We compared outcome in those patients in whom the order set was used to those in whom it was not. Results were expressed as number of cases and as mean percentages (rates) ±95% confidence intervals (CI) of the mean. Statistical significance for mortality, readmission, and use of sepsis order sets in Emergency Department vs. inpatients was analyzed with the Fisher Exact test. The Student T test was used to analyze differences in LOS. Chi-Square Statistic was employed to estimate reduction in mortality from 2013 to 2016. P ≤ 0.05 was accepted as significant. No data was collected from humans or animals, only chart review was performed. This is a retrospective chart review of patients in an urgent clinical condition requiring rapid evaluation and management. We did not apply randomization as we believe the alert and order set should be applied to all patients.
computerized physician order entry
best practice alert
systemic inflammatory response syndrome
- E H R:
electronic health record
length of stay
RCG: Executive Sponsor for the team that implemented the order set and wrote initial draft and edits to the manuscript. KR: Mount Sinai Medical Center epidemiologist and head of Division of Infectious Disease. Provided information for establishing the metrics for Best Practice Alert. MC: Chief of Division of Critical Care. MC oversees care of the patients in our intensive care units. Participated in implementing the order set and data and manuscript review. NN: Head of Infection Prevention. Co-lead team to evaluate and implement sepsis best practice alert and order set. NN evaluated and provided input on the manuscript. CL: Sepsis Coordinator. Co-lead efforts to implement the order set. Reviewed manuscript and provided suggestions. LC is the Mount Sinai Medical Center education program statistician. LC does the statistical analysis of our data and wrote the section on statistical methods. Evaluated the project and provided suggestion on the manuscript. DF: Chairman of the Emergency Department. He provided input into best practice alert, sepsis order set, and reviewed and provided suggestions on the manuscript. AS: Director of our Project Management Office. AS provided the data from our electronic health record for analysis and reviewed the manuscript. TG: Chief Information Officer. TG and team developed the best practice alert and order set as well as producing the data from our electronic health record. All authors read and approved the final manuscript.
We acknowledge the help of our Center for Clinical Excellence, all our infection prevention team, and the physicians and nurses of Mount Sinai Medical Center who care for our patients and use our patient safety programs such as best practice alerts and order sets.
All authors work together to improve quality of care of patients at Mount Sinai Medical Center. The authors declare that they have no competing interests.
Availability of data and materials
Data and materials are available in the office of principle author. Data is accumulated from our Mount Sinai Medical Center electronic health record.
There was no funding for this study. This work was part of our primary work for all authors involved in this work.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Gawande A (2009) The checklist manifesto: how to get things right. Metropolitan Books, New YorkGoogle Scholar
- Hanzelka K, Yeung S, Chisolm G, Merriman K, Gaeta S, Malik I, Rice T (2013) Implementation of modified early-goal directed therapy for sepsis in the emergency center of a comprehensive cancer center. Support Care Cancer 21:727–734View ArticleGoogle Scholar
- http://www.sccm.org/Documents/SSC-Guidelines.pdf. 2012
- Novosad S, Sapiano M, Grigg C, et al (2016) Vital signs: epidemiology of sepsis: prevalence of health care factors and opportunities for prevention. CDC. www.cdc.gov&citation. id = 10783602
- Winterbottom F, Seoane L, Sundell E, Niazi J, Nash T (2011) Improving sepsis outcomes for acutely ill adults using interdisciplinary order sets. Clin Nurse Spec 2011:180–185View ArticleGoogle Scholar