I-PASS Cuna
I-PASS Cuna
Abstract
Introduction: communication errors between medical personnel are known to be a leading source of adverse events
(AEs). The implementation of teamwork training together with the use of a standardized handoff bundle has previously
shown to reduce the number of AEs. However, the applicability of this program in spanish-speaker countries remains unclear.
Objective: to assess whether the exploratory implementation of I-PASS bundle in an Argentine pediatric hospital is
associated with a reduction in the rate of AEs.
Methods: Design: an exploratory, uncontrolled, pre-post study.
Population and sample: medical records (MR), medical prescriptions, and physician reports were reviewed in two clinical
wards of the "Hospital General de Ni~nos Pedro de Elizalde".
Intervention: I-PASS Spanish version, an standardized handoff bundle consists in: a mnemonics, an introductory work-
shop, a written handoff tool, simulation sessions, and structured observations with feedback.
Results: we reviewed 264 MR. Preventable AEs decreased by 62.8% between pre-intervention and post-intervention
period (12.1 vs 4.5 AEs/100 admissions; IC95: 0.010; 0.142; [p ¼ 0.025]). Adherence to the use of quality handoff key
elements increased significantly, from 25% to 61% in post-intervention period (p ¼ 0.0001). Handoff duration did not
change significantly (5.5 0.2 vs 5.3 0.3 minutes per patient [p ¼ 0.59]).
Conclusion: Implementation of an I-PASS Spanish version was associated with a significant reduction in the rate of AEs
and with improvements in handoff quality; without changes in duration.
Keywords
Handoff, patient safety, communication, hospital, children
The researchers completed a form to evaluate the analysis considering adherence to quality elements
adherence to key handoff elements (Supplement 1) described as: almost always, always; and
every day of the week excluding weekends; Sheets non-adherence: sometimes, almost never, never. We
were completed previous and after the intervention compared the pre versus post intervention dichoto-
for assessing changes with the application of I-PASS mous covariate using the Fisher’s exact test. To com-
bundle. pare time–motion data pre and post-intervention we
used the t-Student test. We compared AEs before and
• Medical errors and adverse events after the intervention by Wilcoxon rank sum test for
proportions. We considered p values less than 0.05 to
Different tools were used for the measurement of indicate statistical significance.
medical errors and AEs: All analyses were completed with STATA/IC for
Mac (2013 StataCorp LPVR ).
• GAPPS (global assessment of pediatric patient
safety): the methodology of the “trigger tool” has Ethics
been used for the detection of AEs through retro-
In accordance with the provisions from regulations
spective analysis.19,20 GAPPS proved to be reliable
applicable to medical research in institutions over-
in identifying and measuring triggers in medical
sighted by the Government of the City of Buenos
records (MR) leading to AEs.21 Discharged patients’ Aires, approval by the Research Ethics Committee
MR were randomly selected and reviewed. from the General Children Pedro Elizalde Hospital
• Inclusion criteria: hospitalized patients’ MR
was obtained (IF-2017–16583833-HGNPE).
between 07/01/2017 to 09/30/2017 (pre-interven- The participants signed an informed consent where
tion), and between 11/01/2017 to 01/31/2018 (post- they freely decided to participate in the study.
intervention).
• Exclusion criteria: incomplete MR, hospitalization
shorter than 24 hours, MR of patients hospitalized Results
for psychiatric reasons or social reasons. We measured pre-intervention outcomes of interest
• Error reporting Mailbox: a mailbox was placed in during a three-month period on 14 pediatric residents,
each ward for reporting AEs detected in anony- from July to September 2017. The intervention was
mously way. implemented during October 2017 (one month). After
• Medical prescription errors (MPE) data collection that, data was collected from November 2017 to
worksheet: all inpatient medical’s prescriptions January 2018 (three months). All selected residents
were reviewed on tuesday, wednesday and thursday used the I-PASS handoff bundle during the interven-
during the first and third week of each month along tion. Based on direct and standardized observations,
the study. The incidence, type of MPE, and severity handoff feedback was provided to residents in the post-
according to the classification of the Ruiz-Jarabo intervention period.
group were determined.22
• Survey to evaluate physician’s satisfaction & percep- Handoff quality
tion: the residents of each ward answered a survey
the last month of each period between 4 to 8 hours We evaluated the adherence to key handoff elements
after receiving a patient’s handoff.10 based on the observation tool. A total of 115 observa-
tions were reviewed (56 observations in the pre-
intervention period and 59 in the post-intervention
Sample size and statistical analysis
period). We observed an overall key handoff elements
The sample size was calculated as AEs per 100 admis- compliance of 25% pre-intervention versus 61% post-
sions. We used as a reference the AEs measured in the intervention (p < 0.0001). The global adherence to the
study carried out in 2016 at HGNPE, that showed an ten handoff items evaluated was 56.6% pre-
incidence of 30 AEs per 100 admissions.20 intervention versus 76% post-intervention (p ¼ 0.023).
We estimated a 20% decrease in AEs, based on pre- In the pre-intervention period, the most used key ele-
vious studies.15 We calculated 132 MR to be reviewed ment was the patient’s summary (66%), while the key
per period;23 to obtain a power of 80%, with an alpha element least utilized was the illness severity (9%). In
error <0.05. The variables were expressed as a percent- the post-intervention period, the key element that
age according to their distribution, mean and standard increased its application the most was the action list
deviation or median and interquartile range. (18% pre-intervention versus 80% post-intervention)
The results collected from the observation forms followed by illness severity (9% pre-intervention
were grouped into a dichotomous scale for statistical versus 57.5% post-intervention) (Table 1).
4 Journal of Patient Safety and Risk Management 0(0)
Preintervention Postintervention p
Observations (number) 56 59
llness Severity 9% 57.5% 0.0000
Summary of the patient 66% 77% 0.191
Action List 18% 80% 0.0000
Situation Awareness & Contingency Planning 12.5% 34.5% 0.005
Synthesis By Receiver 21.5% 54% 0.0003
All 5 key elements 25% 61% 0.0001
Global (10 items*) 56% 76% 0.023
*Global: Handoff duration, Accuracy of Illness Severity Assessments, Quality of Patient Summaries, Omissions of important information,
Irrelevant information, plus 5 key elements.
Table 2. Preventable and non-preventable adverse events with the use of GAPPS tool.
Preintervention Postintervention p
No difference was observed in the time used period (6 preventable AEs and 0 non-preventable
for the handoff in both periods (pre-intervention AEs), indicating 12.9 and 4.5 AEs per 100 admissions
5.5 0.2 and post-intervention 5.3 0.3 minutes per respectively (IC95: 0.010; 0.142; [p ¼ 0.025]). This result
patient [p ¼ 0.59]). represents a 65% decrease of AEs post-intervention
(Figure 1). Considering only preventable AEs in both
Medical errors and adverse events periods, we verified an incidence of 12.1 in the pre-
We reviewed a total of 264 medical records (132 in each intervention period and 4.5 in the post-intervention
period) using GAPPS. We observed 17 possible AEs in period per 100 admissions (IC95: 0.0101; 0.142; [p ¼
the pre-intervention period (16 preventable AEs and 1 0.025]), representing a decrease of 62.8%. Types of
non-preventable AEs) and 6 in the post-intervention detected AEs are shown in Table 2.
Jorro Baron et al. 5
We reviewed a total of 5715 prescriptions (pre-interven- of the items related to patient care were improved in
tion period, 3590; post-intervention, 2125 prescriptions). the post-intervention period. We did not observe
There was no significant change in the rate of MPE (11.5 changes in communication of the patient, family care
pre-intervention versus 9.9 post-intervention errors per plan and patient family dissatisfaction. Residents
100 prescriptions [p ¼ 0.06]). We found more severe reported a higher percentage of handoff AEs, more
MPE in the pre-intervention period, class B (pre-interven- negative events, and more handoff interruptions in
tion 49, post-intervention 83 errors per 100 prescriptions the preintervention period. They also reported a
[p ¼ 0.0001]) and class C (pre-intervention 0.9, post- higher common understanding of the patient status at
intervention 1.9 errors per 100 prescriptions [p ¼ 0.003]). the end of the study (Table 3).
We observed a higher number of class A MPE (less
severe) in the post-intervention period (50 post- Discussion
intervention class A errors vs 15 pre-intervention errors
per 100 prescriptions [p ¼ 0.0001]). Medical errors and adverse events
We collected a total of 12 AEs pre-intervention and 4
We found that implementation of a spanish version of
AEs post-intervention in the assigned error mailboxes.
the I-PASS Handoff Bundle in two argentine pediatric
inpatient units, was associated with a 65% relative
End of shift surveys reduction in the rate of preventable AEs. We also
We took a convenience sample of 39 end of shift sur- found non statistically significant decrease in MPE
veys (20 pre-intervention, 19 post-intervention). Most rate, with a favorable change in the severity according
Table 3. Results of the end of shift survey according to the intervention period.
Did you observe any of the following events during your Preintervention Postintervention
patient’s care today in the morning? (N ¼ 20) % (N ¼ 19) %
to the proposed classification. This AEs reduction we think applies to our study.28 According to their
occurred without an increase in the time required to study describing resident experiences with implementa-
complete handoffs. tion of the I-PASS bundle, other important active com-
In concordance with our results, the initial study I- ponents were identified in this complex intervention
PASS implementation by Starmer et al., as a single such as auto-importing of patient data into the elec-
center experience, showed a decrease in AEs from tronic handoff document, improvements in the handoff
33.8 per 100 admissions (95% CI, 27.3–40.3) to 18.3 environment, and improvements in the teamwork and
per 100 admissions (95% CI: 14.7–21.9, P < 0.001).14 communication skills. Moreover, they observed that
Furthermore, in a study done in 9 pediatric residency strict adherence to the I-PASS bundle may not neces-
programs belonging to hospitals in the United States sarily lead to the achievement of the desired outcomes.
and Canada it was observed a relative reduction of In our study, the synthesis and feedback component
23% in medical errors and a 30% reduction in prevent- were the most challenging features of handoffs. The
able adverse events after I-PASS implementation.15 A mentioned features were also shown to be the most
decrease in diagnostic, clinical history and physical
challenging in previous reports.15,29
examination related AEs was reported. However, Lastly, duration of handoff was not significantly
there was no change in errors related to medication,
increased using I-PASS. Thus, the hand-off time
procedures or nosocomial infections. Both publications
remained almost constant while achieving overall
reported that there were no changes in physicians’
higher rates of inclusion of essential patient informa-
workload or time spent in handoffs when using I-
tion confirming observations from previous studies.30
PASS bundle. Sheth et al. demonstrated that an I-
PASS–supported handoff process was associated with
improved transfer efficiency and safety culture when End of shift survey
executing I-PASS in handoffs between the cardiovas- In surveys answered by handoff receiver physicians, we
cular intensive care unit to an acute care unit.24 Bigham verified improvements in most points related to the
et al. also showed a significant decrease in errors relat- perception of AEs. Nevertheless, these results could
ed to handoff after the use of a standardized tool in 23 not be compared due to the small sample size. No var-
pediatric hospitals.10 iation was identified in percentages related to commu-
After our intervention, we observed a decrease in the nication with the patient’s family. This was not an
AEs reported via the error mailbox system which was expected outcome since this topic was not addressed
very similar to the decrease detected with the use of by our intervention. Surprisingly, we observed high
GAPPS. In contrast, the AEs identified via different baseline levels of receiver understanding of patients
methods that we employed were not the same. care problems after handoffs. We speculate that this
Nevertheless, the decrease in self-reported AEs high baseline level resulted from a lack of awareness
cannot be exclusively attributed to the intervention
of the ineffectiveness of the handoff process.
implemented.
Fortunately, common understanding of patients was
Although AEs occurred frequently, our rates include
maintained throughout the study. Other studies have
very small and some serious errors and are consistent,
shown similar results regarding the handoff process
or even lower, with the rates found in numerous other
satisfaction and handoff intervention.10
studies using the same intensive surveillance meth-
ods.20,25,26 At the beginning of the implementation of
the I-PASS bundle, the average adherence to items in Limitations
the procedure was similar to the adherence observed in Among the limitations of our study we can mention its
different centers. After our quality improvement imple- design and representativeness since this is an explorato-
mentation, a significant difference was observed.14,15,27 ry study that took place in two hospital wards of a
single institution. That precludes us from establishing
Handoff quality a definite causal link between the I-PASS Handoff
In the post-intervention period, we observed an adher- Bundle implementation and any improvement in
ence of approximately 60% to the five key handoffs patient safety. In addition, the external validity of the
elements which was similar to the adherence detected survey regarding error perception was not evaluated in
in the previous studies and significantly better than the this study. Furthermore, physician’s behavior and their
pre-intervention period.15 In addition, as observed by use of I-PASS format may have been influenced by the
Coffey et al., an improvement in patient safety can be observer’s presence. Additionally, the severity of
observed regardless of inconsistent adherence to the patients’ affections in both periods could not be
mnemonic during verbal handoff, explanation which assessed to ensure their similarity. Finally, patients
Jorro Baron et al. 7
11. Berkenstadt H, Haviv Y, Tuval A, et al. Improving hand- 22. Otero L opez MJ, Codina Jane C, Tames Alonso MJ,
off communications in critical care: utilizing simulation- et al. Medication errors: standarizing the terminology
based training toward process improvement in managing and taxomany. Ruiz Jarabo 2000 grand results. Farm
patient risk. Chest 2008; 134: 158–162. Hosp 2018; 27: 137–149.
12. Dewar ZE, Yurkonis T and Attia M. Hand-off bundle 23. Taffarel P, Meregalli C, Jorro Bar on F, et al. Evaluaci
on
implementation associated with decreased medical errors de una estrategia de mejora sobre la incidencia de errores
and preventable adverse events on an academic family en la prescripcion de medicamentos en una unidad de
medicine in-patient unit: a pre-post study. Medicine cuidados intensivos pediátricos. Arch Argent Pediatr
(Baltimore) 2019; 98: e17459. 2015; 113: 229–236.
13. Arora V and Johnson J. A model for building a standard- 24. Sheth S, Mccarthy E, Kipps AK, et al. Changes in effi-
ized hand-off protocol. Jt Comm J Qual Patient Saf 2006; ciency and safety culture after integration of an I-PASS –
32: 646–655. supported handoff process. PED 2016; 137(2).
14. Starmer AJ, Sectish TC, Simon DW, et al. Rates of med- 25. Landrigan CP, Parry GJ, Bones CB, et al. Temporal
ical errors and preventable adverse events among hospi- trends in rates of patient harm resulting from medical
talized children following implementation of a resident care. N Engl J Med 2010; 363: 2124–2134.
handoff bundle. JAMA 2013; 310: 2262–2270. 26. Landrigan CP, Rothschild JM, Cronin JW, et al. Effect
15. Starmer AJ, Spector ND, Srivastava R, et al. Changes in of reducing interns’ work hours on serious medical errors
medical errors after implementation of a handoff pro- in intensive care units. N Engl J Med 2004; 351:
gram. N Engl J Med 2014; 371: 1803–1812. 1838–1848.
16. Starmer AJ, Spector ND, Srivastava R, et al. I-pass, a 27. Studeny S, Burley L, Cowen K, et al. Quality improve-
mnemonic to standardize verbal handoffs. Ped. 2012 ; ment project. SAGE Open Med 2017; 5: 1–6.
129: 201–204. 28. Coffey M, Thomson K, Li S-A, et al. Resident experien-
17. Starmer AJ, Spector ND, West DC, et al. Integrating ces with implementation of the I-PASS handoff bundle,
research, quality improvement, and medical education www.jgme.org/doi/pdf/10.4300/JGME-D-16-00616.1
for better handoffs and safer care: disseminating, adapt- (accessed 4 May 2018).
ing, and implementing the I-PASS program. Jt Comm J 29. Shahian DM, McEachern K, Rossi L, et al. Large-scale
Qual Patient Saf 2017; 47: 319–329. implementation of the I-PASS handover system at an
18. King HB, Battles J, Baker DP, et al. TeamSTEPPSTM: academic medical Centre. BMJ Qual Saf 2017; 26:
team strategies and tools to enhance performance and 760–770.
patient safety. In: Advances in patient safety: new direc- 30. Huth K, Hart F, Moreau K, et al. Real-world implemen-
tions and alternative approaches. Performance and tools. tation of a standardized handover program (I-PASS) on
Vol. 3. USA: Agency for Healthcare Research and a pediatric clinical teaching unit. Acad Pediatr 2016; 16:
Quality, 2008, https://www.ncbi.nlm.nih.gov/books/ 532–539.
NBK43686/ 31. Taffarel P, Meregalli C, Jorro Bar on F, et al. Evaluation
19. Kirkendall ES, Kloppenborg E, Papp J, et al. Measuring of an improvement strategy on the incidence of medica-
adverse events and levels of harm in pediatric inpatients tion prescribing errors in a pediatric intensive care unit.
with the global trigger tool. Pediatrics 2012; 130: Arch Argent Pediatr 2015; 113: 229–236.
e1206–e1214. 32. Aprea V, Bar on FJ, Meregalli C, et al. Impact of a health
20. Davenport MC, Domınguez PA, Ferreira JP, et al. care quality improvement intervention to prevent pres-
Deteccion de eventos adversos en pacientes pediátricos sure ulcers in a pediatric intensive care unit. Arch
hospitalizados mediante la herramienta de disparadores Argent Pediatr 2018; 116: (4): e529- e541.
globales global trigger tool. Arch Argent Pediatr 2017; 33. Pronovost P, Needham D, Berenholtz S, et al. An inter-
115: 357–363. vention to decrease catheter-related bloodstream infec-
21. Landrigan CP, Stockwell D, Toomey SL, et al. tions in the ICU. N Engl J Med 2006; 355: 2725–2732.
Performance of the global assessment of pediatric patient
safety (GAPPS) tool. PED 2016; 137(6).