A next-day, brief e-survey overcomes the excessive variability seen in CAHPS-style emergency department surveys so that individual physician performance can be assessed on a regular basis

Tom Scaletta, Edward Elmhurst HealthFollow
Eva Hare, Kellstadt Graduate College of Business of DePaul UniversityFollow
Christopher Sung Lee, Kellstadt Graduate College of Business of DePaul UniversityFollow

Abstract

Traditional CAHPS-style emergency department (ED) surveys result in excessive variability when assessing individual physician performance. The objective of this study is to measure the variability of a brief, electronic survey (e-survey). The study team also measured the association of individual physicians to demographic data, physician and patient factors, and a physician burnout assessment tool. Data from SmartContact (SmartER, La Grange, IL) is a next-day, e-survey that takes about 30-seconds to complete. This tool was used by a hospital-employed emergency department (ED) group during calendar year 2017 across 2 EDs and 37 physicians.^1,2 Variability was estimated regarding raw patient experience (PX) scores and top box scores by using intraclass correlation coefficients (ICCs). Pearson correlations were used to measure the interaction between PX scores, physician factors, and patient factors. Analysis of the 2017 calendar year showed statistically significant differences between physician PX performance on a bimonthly and quarterly basis. As well, there was lower PX in patients presenting at night. No correlation was found with a burnout assessment tool. This study demonstrates statistically valid performance differences among physicians using a next-day e-survey, which conforms to the recommendations of ED professional organizations for use in driving provider PX improvement, enhancing patient trust, and improving patient outcomes.

Experience Framework

This article is associated with the Innovation & Technology lens of The Beryl Institute Experience Framework. (http://bit.ly/ExperienceFramework)

Access other PXJ articles related to this lens.
Access other resources related to this lens

Recommended Citation

Scaletta T, Hare E, Lee CS. A next-day, brief e-survey overcomes the excessive variability seen in CAHPS-style emergency department surveys so that individual physician performance can be assessed on a regular basis. Patient Experience Journal. 2019; 6(2):59-65. doi: 10.35680/2372-0247.1376.