0% found this document useful (0 votes)
75 views8 pages

Developing An Entrustable Professional Activity Fo

Uploaded by

rafaeliluis79
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
75 views8 pages

Developing An Entrustable Professional Activity Fo

Uploaded by

rafaeliluis79
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Fu et al.

BMC Medical Education (2024) 24:705 BMC Medical Education


[Link]

RESEARCH Open Access

Developing an entrustable professional


activity for providing health education
and consultation in occupational therapy
and examining its validity
Chung‑Pei Fu1, Ching‑Kai Huang2, Yi‑Chiun Yang3, Wei‑Sheng Liao4, Shih‑Min Huang5, Wei‑Di Chang6,
Yi‑Ju Chen7, Ming‑Wei Li5, Yi‑Ju Lin8, Chin‑Lung Wu8, Hsin‑Yu Chi5, Chia‑Yi Lee9, Fu‑Mei Chiang10,
Yu‑Lan Chen11, Ching‑Fen Tsou9, Tzu‑Hung Liu12,13, Chia‑Ting Su1, Ai‑Lun Yang14, Nung‑Chen Kuo15* and
Wan‑Ying Chang16*

Abstract
Background Entrustable Professional Activities (EPA)-based assessment is easily and intuitively used in evaluat‑
ing the learning outcomes of competency-based medical education (CBME). This study aimed to develop an EPA
for occupational therapy focused on providing health education and consultation (TP-EPA3) and examine its validity.
Methods Nineteen occupational therapists who had completed online training on the EQual rubric evaluation
participated in this study. An expert committee identified six core EPAs for pediatric occupational therapy. TP-EPA3
was developed following the EPA template and refined through consensus meetings. The EQual rubric, a 14-item,
five-point criterion-based anchor system, encompassing discrete units of work (DU), entrustable, essential, and impor‑
tant tasks of the profession (EEIT), and curricular role (CR), was used to evaluate the quality of TP-EPA3. Overall
scores below 4.07, or scores for DU, EEIT, and CR domains below 4.17. 4.00, and 4.00, respectively, indicate the need
for modifications.
Results The TP-EPA3 demonstrated good validity, surpassing the required cut-off score with an average overall EQual
score of 4.21 (SD = 0.41). Specific domain scores for DU, EEIT, and CR were 3.90 (SD = 0.69), 4.46 (SD = 0.44), and 4.42
(SD = 0.45), respectively. Subsequent revisions clarified observation contexts, enhancing specificity and focus. Further
validation of the revised TP-EPA3 and a thorough examination of its reliability and validity are needed.
Conclusion The successful validation of TP-EPA3 suggests its potential as a valid assessment tool in occupational
therapy education, offering a structured approach for developing competency in providing health education
and consultation. This process model for EPA development and validation can guide occupational therapists in creat‑
ing tailored EPAs for diverse specialties and settings.
Keywords Entrustable Professional Activity, Occupational therapy education, Competency-based medical education

*Correspondence:
Nung‑Chen Kuo
yves7116@[Link]
Wan‑Ying Chang
wanying0928@[Link]
Full list of author information is available at the end of the article

© The Author(s) 2024. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the
original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or
other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line
to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory
regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this
licence, visit [Link] The Creative Commons Public Domain Dedication waiver ([Link]
[Link]/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 2 of 7

Introduction Methods
Competency-based medical education (CBME) repre- This study was approved by the institutional review
sents a strategic evolution in the methodology of medi- boards of Fu Jen Catholic University (C110093) and
cal training, emphasizing the development of specific Taipei Hospital, Ministry of Health and Welfare
competencies essential for effective clinical practice (TH-IRB-0022–0027).
[1, 2]. Although competency frameworks have been
developed by the Accreditation Council for Graduate Participants
Medical Education (ACGME) and Canadian Medical Nineteen occupational therapists (11 females, 8 males),
Education Directives for Specialists (CanMEDS), their who had completed online training on the EQual rubric
implementation in clinical practice has been limited. evaluation, rated the 6 core EPAs in pediatric occupa-
Entrustable professional activities (EPAs) and mile- tional therapy on the EQual rubric. Their age distribu-
stones have emerged to bridge the gap between com- tion was as follows: 21.1% were aged 31–40 years; 63.2%,
petency frameworks and assessment and training in 41–50 years; and 15.8%, 51–60 years. Their workplaces
clinical practices [3–5]. were medical centers (42.1%), regional teaching hospitals
EPAs are discrete clinical activities that require the (47.4%), and district teaching hospitals (5.3%). Their posi-
integration of various competencies and represent an tions were chiefs of occupational therapy (26.3%), chiefs
activity associated with a specific clinical event [6, 7], of pediatric occupational therapy (15.8%), teaching direc-
whereas milestones refer to observable markers along a tors of occupational therapy (26.3%), clinical teachers
continuum of progress [8]. However, the application of (57.9%), and university teachers. The average duration of
milestones as evaluative tools for trainees’ competency their work experience was 20.2 years (SD = 6.7), whereas
faces challenges due to their sheer number, the exten- that as clinical teachers was 15.6 years (SD = 7.8).
sive and complex training required, and the necessity
for full participation in the learning process [9]. There- Procedure
fore, EPA-based assessment is easier and more intui- This study comprised two stages: the development of TP-
tive to use in evaluating the learning outcomes of the EPA3, and an examination of the structure and quality of
CBME [10, 11]. TP-EPA3.
EPAs have been well developed in many medical pro- In the first stage, six topics for the core EPAs were
fessions, such as medicine of various specialties [12–18], identified by expert committee using the nominal group
dentistry [19], nursing [20], pharmacy [21, 22], radiology technique and survey questionnaires distributed to 131
[23–25], physical therapy [26], and occupational therapy teaching hospitals in Taiwan [29]. The expert commit-
[27, 28]. While EPAs tailored to occupational therapy tee included two university teachers from departments
have been established in Singapore, they primarily focus of occupational therapy, 24 clinical teachers of pediat-
on undergraduate education during the earlier years ric occupational therapy in teaching hospitals, and one
of study, emphasizing fundamental professional activi- external expert developing EPAs in family medicine in
ties crucial for early-stage clinical education. However, Taiwan. The nominal group technique and survey ques-
it is crucial to develop EPAs specific to the final year of tionnaires were chosen to ensure a comprehensive and
undergraduate clinical training and post-graduate clini- systematic collection of expert opinions and have been
cal training. During this phase, occupational therapy detailed in previous studies [30, 31]. The survey was dis-
students are exposed to four major domains: physical, tributed to 131 teaching hospitals in Taiwan, providing a
mental, pediatric, and community. Each domain encom- broad basis for the identification of core EPAs [29].
passes unique core competencies and professional activi- The Taiwan Occupational Therapy Association made
ties. Thus, developing EPAs tailored to each domain of only minor textual refinements to the titles of the six
occupational therapy is essential. Accordingly, the pur- core EPAs: EPA1, “Providing evaluations in occupational
pose of this study was to delineate the process of devel- therapy”; EPA2, “Providing interventions in occupational
oping an EPA in pediatric occupational therapy, using the therapy”; EPA3, “Providing health education and consul-
EPA3 Providing Health Education and Consultation in tation” (TP-EPA3); EPA4, “Writing occupational therapy
occupational therapy (TP-EPA3) serving as an example, medical records”; EPA5, “Providing transdisciplinary col-
and to examine its validity. While we developed six EPAs laboration healthcare”; and EPA6, “Providing services
in pediatric occupational therapy, this study focuses of splints or assistive devices”, without altering the core
exclusively on TP-EPA3 as a representative example due competencies or the content of the EPAs themselves.
to its broad applicability across the four major domains The draft of TP-EPA3 was written by two pediatric occu-
of occupational therapy: physical, mental, pediatric, and pational therapy clinical teachers (corresponding and
community. co-corresponding authors) from two teaching hospitals

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 3 of 7

within the expert committee, based on the EPA template trainee’s level of entrustment using the following ques-
[11]. Following three rounds of consensus meetings, the tion: "If you were to supervise this trainee again in a
expert committee finalized the description of TP-EPA3, similar professional task and situation, which of the fol-
as shown in Appendix 1. lowing statements aligns with how you would assign the
In the second stage, 16 committee members from the task?" This question was used to guide the clinical teach-
stage one expert committee, along with 3 non-committee ers’ entrustment decisions. The entrustment and super-
occupational therapy experts with EPA experience, rated vision scale comprised 5 levels, with level 1 and level 2
TP-EPA3. All raters had completed the online training being further divided into two sublevels, and level 3
of the EQual rubric evaluation and assessed TP-EPA3 being divided into three sublevels (Appendix 2). The defi-
according to the EQual rubric. nition of level 1a was “Not allowed to observe practicing
the EPA”. Level 1b was “Not allowed to practice the EPA;
Measure allowed to observe”. Level 2a was "Allowed to practice the
The EQual rubric is a 14-item evaluation utilized to EPA only under proactive, full supervision as co-activity
assess the quality of EPAs [32]. This rubric measures with supervisor”. Level 2b was “Allowed to practice the
the constructs of EPAs across 3 domains, including dis- EPA only under proactive, full supervision with super-
crete units of work (DU) (items 1–6), entrustable, essen- vision in room ready to step in as needed”. Level 3a was
tial, and important tasks of the profession (EEIT)(items “Allowed to practice the EPA only under reactive/on-
7–10), and curricular role (CR) (items 11–14) [32]. Each demand supervision with supervisor immediately avail-
item is scored using a five-point criterion-based anchor able, all findings double-checked”. Level 3b was “Allowed
system [32], and an online training video is available for to practice the EPA only under reactive/on-demand
scoring [33]. A cut-off score of 4.07 determines whether supervision with supervision immediately available, key
a given EPA requires modification, with an average over- findings double-checked”. Level 3c was “Allowed to prac-
all EQual score below 4.07 indicating that it does [32]. tice the EPA only under reactive/on-demand supervision
Moreover, the cutoff scores for the DU, EEIT, and CR with supervisor distantly available, findings reviewed”.
domains are 4.17, 4.00, and 4.00, respectively [34]. The Level 4 was “Allowed to practice the EPA unsupervised”.
EQual rubric evaluation has been found to be reliable, Level 5 was “Allowed to supervise others in practice of
valid and useful in EPA development [32, 34, 35]. the EPA”.

Data analysis Results of the EQual rubric


Data analyses were performed in Microsoft Excel 16.75 Eighteen occupational therapists rated the TP-EPA3
for Mac. We calculated mean and standard deviation for according to the EQual rubric. The response rate was
the EQual rubric score and three domain scores to deter- 94.7%. The EQual item, domain, and overall scores for
mine whether the EPA needs modification. The EQual the TP-EPA3 are listed in Table 1. The average scores
rubric score represented the average of all 14 items, and of the individual items on the Equal rubric ranged from
domain scores for DU, EEIT, and CR were calculated 3.17 to 4.83. The average overall EQual score was 4.21
from items 1–6, 7–10, and 11–14, respectively [32, 34, (SD = 0.41), which was higher than the cut-off score,
35]. Additionally, the scatter plot was used to examine 4.07. The domain scores for DU, EEIT, and CR were 3.90
the dispersion of scores across the three domains. (SD = 0.69), 4.46 (SD = 0.44), and 4.42 (SD = 0.45), respec-
tively. Only the domain score for DU (3.90) was lower
Results than the domain cut-off score (4.17). The scatter plot of
Development of EPA3, providing health education the three domain scores of the EQual is shown in Fig. 1.
and consultation (TP‑EPA3)
The description of TP-EPA3 is shown in Appendix 1. Discussion
The EPA comprises 8 parts: title; specifications and limi- To the best of our knowledge, this study was the first to
tations; potential risks in case of failure; most relevant illustrate the development process of EPAs in pediatric
competency domains; required knowledge, skills, atti- occupational therapy, specifically tailored for use in the
tude and experiences; assessment information sources final year of undergraduate clinical training and post-
to assess progress and ground a summative entrustment graduate clinical training in the pediatric domain. The
decision; entrustment for which level of supervision is to EPAs developed in this study can complement those
be reached at which stage of training; and expiration date. developed in Singapore [27, 28], which are utilized dur-
The entrustment and supervision scale for TP-EPA3 ing the earlier years of undergraduate education. Early
adopted Chen’s entrustment and supervision scale [36]. exposure to EPAs in undergraduate education can
Specifically, clinical teachers were asked to assess the enhance students’ understanding of the EPA concept,

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 4 of 7

Table 1 EQual rubric item, domain, and overall scores for the TP-EPA3
Item Mean (SD) Median Mode

1 This EPA has a clearly defined beginning and 3.17 (1.42) 3 3,4,5
end
2 This EPA is independently executable to 4.06 (1.0) 4 4
achieve a defined clinical outcome
3 This EPA is specific and focused 3.94 (0.94) 4 4,5
4 This EPA is observable in process 4.17 (0.51) 4 4
5 This EPA is measurable in outcome 4.05 (0.64) 4 4
6 This EPA is clearly distinguished from other 4.00 (0.69) 4 4
EPAs in the framework
7 This EPA describes work that is essential and 4.72 (0.46) 5 5
important to the profession
8 Performing this EPA leads to recognized output 4.28 (0.83) 4.5 5
or outcome of labor
9 The performance of this EPA in clinical practice 4.00 (0.97) 4 5
is restricted to qualified personnel
10 This EPA addresses professional work that is 4.83 (0.38) 5 5
suitable for entrustment
11 This EPA requires the application of knowledge, 4.39 (0.50) 4 4
skills, and/or attitudes (KSAs) acquired through
training
12 This EPA involves application and integration 4.67 (0.49) 5 5
of multiple domains of competence
13 The EPA title describes a task, not qualities or 4.33 (0.49) 4 4
competencies of a learner
14 This EPA describes a task and avoids adjectives 4.28 (0.75) 4 5
(or adverbs) that refer to proficiency
Domain 1: Discrete units of work (average score of 3.90 (0.69)
Item 1 to item 6) (cut-off score: 4.17)
Domain 2: Entrustable, essential, and important tasks 4.46 (0.44)
of the profession (average score of item 7 to item 10) (cut-off score: 4.00)
Domain 3: Curricular role (average score of item 11 4.42 (0.45)
to item 14) (cut-off score: 4.00)
Average overall EQual score (cut-off score: 4.07) 4.21 (0.50)
EPA Entrustable Professional Activity

increase clinical engagement, foster a stronger sense of EQual domain scores for DU than for the other domains.
professional identity, bridge the gap between theoretical Notably, the average scores for item 1 (“This EPA has a
knowledge and clinical practice, and facilitate compre- clearly defined beginning and end”) and item 3 (“This
hension of future practice expectations during condi- EPA is specific and focused”) were the lowest (Table 1).
tional registration [28, 37, 38]. Using EPAs in pediatric In pediatric occupational therapy, health education and
occupational therapy during the final year of undergradu- consultations frequently occurred during various interac-
ate clinical training and post-graduate clinical training tions with parents, such as following screenings, assess-
can assess students’ advanced clinical skills in pediatric ments, interventions, cessation of interventions, or even
occupational therapy domain, enable students to engage during casual conversations about the child’s recent
in self-directed learning to address their weakness, as behaviors or challenges. Therapists often used these
well as determine their readiness to become independent opportunities to recommend home program, activity
pediatric occupational therapists [39, 40]. adjustments, environmental modifications, or changes in
The overall EQual score of TP-EPA3 (4.21), being parenting strategies. Due to the nature of these interac-
higher than the cut-off score of 4.07, indicated good tions, it would be challenging to identify a clear begin-
validity and quality. However, the EQual domain score ning and end for providing consultations and health
for DU (3.90), below the cut-off score of 4.17, indicated education. This might explain why items 1 and 3 received
a need for further revisions of the items within this lower scores. Consequently, the observation contexts of
domain. The scatter plot revealed greater variability in TP-EPA3 were refined to focus on four specific contexts:

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 5 of 7

Fig. 1 Scatter plot of the three EQual domain scores of TP-EPA3: Providing Health Education and Consultation in pediatric occupational
therapy in Taiwan. Note: EPA = entrustable professional activity. DU = Discrete units of work. EEIR = Entrustable, essential, and important tasks
of the profession. CR = Curricular role

after screening, after evaluation, after intervention, and TP-EPA3. The key point in determining the summa-
intervention discontinuation. These specifications were tive entrustment and supervision levels for EPAs is to
revised in alignment with the definitions, sequences, and thoroughly consider the outcomes of multiple assess-
crucial observation points related to providing health ment methods and assessments. This approach prevents
education and consultation. The revised version of the trainees from being unfairly labeled as “under proactive”
TP-EPA3 is provided in Appendix 3. based solely on one performance or poor performance on
The TP-EPA3 presented in this paper may not be uni- severe patients [41].
versally applicable to all occupational therapy fields, such Since our EPAs were designed to evaluate both UGY
as physical, mental, and community settings, or at differ- and PGY trainees, Chen’s prospective entrustment and
ent levels of hospitals or community agencies, or in all supervision scale [36] was adopted for two main rea-
countries. However, occupational therapists can employ sons. First, the prospective nature of Chen’s scale could
the EPA topic development process [29] and EPA con- reduce the influence of contextual factors such as time of
tent development process in this paper to develop their observation and work load, as well as task factors such as
core EPAs tailored to their respective fields, hospitals or complexity of patient’s conditions [41]. Second, Chen’s
community agencies, or countries. In cases where occu- scale expands the lower levels of the scale to include
pational therapy units provide specialized services or finer gradation of supervision, making it more suitable
interventions, specialized EPAs may also be developed by for assessing the performances of UGY trainees [36].
following this EPA development process. For instance, if Thus, the scale offers a more comprehensive framework
an occupational therapy unit specializes in telemedicine for evaluating the trainees’ performances at different
or screening, specialized EPAs can be developed. Moreo- stages of training, allowing more detailed analysis of their
ver, if only certain components of the professional tasks progress.
of the EPAs can be performed due to the size or other
constraints, nested EPAs [11], which are smaller units of Limitations and suggestions
the original EPA, can be considered. This study had four major limitations. First, although
The assessment information sources utilized in evalu- the overall EQual score of the initial TP-EPA3 indi-
ating progress and grounding a summative entrust- cated acceptable content validity, the revised TP-EPA3
ment decision for the TP-EPA3, as presented in this still needs to be examined to determine whether the
study, encompass all the assessment methods typically DU domain score has been improved. Second, since
employed to evaluate trainees’ capabilities. Occupa- only the content validity of TP-EPA3 was examined,
tional therapy clinical teachers can select the assessment its inter-rater and intra-rater reliability, convergent
methods they already utilize from those provided in the and discriminant validity, and responsiveness should

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 6 of 7

be further investigated. Third, the target entrustment Acknowledgements


We gratefully appreciate the Taiwan Occupational Therapy Association, the
and supervision levels of UGY and PGY trainees were President, Dr. Ching-Yi Wu, the Chair of the Professional Quality Committee,
recommended by the expert committee. Future stud- Dr. I-Ping Hsueh, and Yi-Fang Wu for their support of our research. We also
ies should investigate the perspectives of occupa- acknowledge the non-committee occupational therapy experts for their help
in examining the validity of the EPAs.
tional therapy clinical teachers on these target levels.
Fourth, a potential limitation of our study is the over- Authors’ contributions
lap of committee members across the development and C.P.F: co-principal investigator, wrote manuscript, designed research, collected
and analyzed data, one of the expert committee members. C.K.H., Y.C.Y., W.S.L.,
evaluation phases of TP-EPA3. Sixteen of the nineteen S.M.H., W.D.C., Y.J.C., M.W.L., YJ.L., C.L.W., H.Y.C., C.Y.L., F.M.C., Y.L.C., C.F.T.: expert
experts who assessed TP-EPA3 using the EQual rubric committee members, assisted in research execution, EPAs lead authors. T.H.L.:
evaluation were involved in the initial development. Taught the concepts and framework of competency-based medical education
and entrustable professional activities to the expert committee, guided the
Despite all raters being trained using the EQual rubric, occupational therapy expert committee to develop EPAs, assisted in design‑
their prior involvement could introduce unintentional ing research, assisted in writing manuscripts, shared EPAs developmental
rater bias, potentially influencing the impartiality of experiences in family medicine. C.T.S.: edited manuscripts, one of the expert
committee members. A.L.Y.: shared EPAs development experiences in physical
their assessments. therapy, external experts, edited manuscripts. Corresponding author N.C.K.:
lead author of the TP-EPA3 for providing health education and consultation in
occupational therapy, which is presented in this manuscript, one of the expert
committee members, assisted in research execution. Co-corresponing author
Conclusion W.Y.C.: principal investigator, lead author of the TP-EPA3 which is presented in
EPAs provide a time-efficient, feedback-oriented, and this manuscript, one of the expert committee members, assisted in research
workplace-based assessment for evaluating whether execution.
trainees can perform clinical professional tasks com- Funding
petently without supervision. The EPA development This study was supported by research grants from the Taipei Hospital, Ministry
process outlined in this study can help occupational of Health and Welfare (Project No. 202315).
therapists develop core EPAs, specialized EPAs, or nested Availability of data and materials
EPAs tailored to their specific fields, hospitals or com- Data is available upon reasonable request from corresponding author. The
munity agencies, or countries. In conclusion, EPAs are e-mail of the corresponding author is yves7116@[Link] and wany‑
ing0928@[Link] .
not only easy and intuitive for assessing the learning
outcomes of CBME but also support clinical teachers in
Declarations
evaluating trainee independence in significant clinical
professional activities and in curriculum design. Further- Ethics approval and consent to participate
more, EPAs help trainees prepare for clinical professional This study was approved by the institutional review boards of Fu Jen Catholic
University (C110093) and Taipei Hospital, Ministry of Health and Welfare (TH-
activities. Specifically, the TP-EPA3, which focus on pro- IRB-0022–0027). Informed consent was obtained from all participants.
viding health education and consultation in pediatric
occupational therapy in Taiwan, has been validated using Consent for publication
Not applicable.
the EQual rubric, paving the way for the development of
additional core EPAs using the process described. Competing interests
The authors declare no competing interests.
Abbreviations
EPA Entrustable Professional Activity Author details
CBME Competency-based medical education 1
Department of Occupational Therapy, College of Medicine, Fu Jen Catholic
TP-EPA3 EPA3 for occupational therapy focused on providing health edu‑ University, New Taipei City, Taiwan. 2 Department of Rehabilitation, Occu‑
cation and consultation pational Therapy, Linkuo Chang Gung Memorial Hospital, Taoyuan, Taiwan.
DU Discrete units of work 3
Department of Rehabilitation, Lotung Poh-Ai Hospital, Yilan, Taiwan. 4 Depart‑
EEIT Entrustable, essential, and important tasks of the profession ment of Rehabilitation, Taipei Medical University Hospital, Taipei, Taiwan.
CR Curricular role 5
Department of Rehabilitation, Sijhih Cathay General Hospital, New Taipei City,
ACGME Accreditation Council for Graduate Medical Education Taiwan. 6 Department of Rehabilitation, Mackay Memorial Hospital, Taipei, Tai‑
CanMEDS Canadian Medical Education Directives for Specialists wan. 7 Department of Rehabilitation, Kaohsiung Chang Gung Memorial Hos‑
UGY​ Undergraduate year pital, Kaohsiung, Taiwan. 8 Department of Rehabilitation, Changhua Christian
PGY Post-graduate year Hospital, Changhua, Taiwan. 9 Department of Rehabilitation, Cathay General
Hospital, Taipei, Taiwan. 10 Department of Physical Medicine and Rehabilitation,
National Taiwan University Hospital, Taipei, Taiwan. 11 Department of Physical
Supplementary Information Medicine and Rehabilitation, Taipei Veterans General Hospital, Taipei, Taiwan.
The online version contains supplementary material available at [Link] 12
Department of Family Medicine, Taipei Tzu Chi Hospital, New Taipei City, Tai‑
org/​10.​1186/​s12909-​024-​05670-1. wan. 13 School of Medicine, Tzu Chi University, Hualien City, Taiwan. 14 Institute
of Sports Sciences, University of Taipei, Taipei, Taiwan. 15 Department of Occu‑
Supplementary Material 1. pational Therapy, Taoyuan General Hospital, Ministry of Health and Welfare,,
No. 1492, Zhongshan Rd.,Taoyuan Dist., Taoyuan 330, Taiwan. 16 Department
Supplementary Material 2. of Physical Medicine and Rehabilitation, Taipei Hospital, Ministry of Health
Supplementary Material 3. and Welfare, No. 127, Su‑Yuan Rd., Hsin‑Chung Dist., New Taipei City, Taiwan.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Fu et al. BMC Medical Education (2024) 24:705 Page 7 of 7

Received: 3 February 2024 Accepted: 18 June 2024 23. Deitte LA, Gordon LL, Zimmerman RD, Stern EJ, McLoud TC, Diaz-
Marchan PJ, Mullins ME. Entrustable professional activities: ten things
radiologists do. Acad Radiol. 2016;23(3):374–81.
24. Royal College of Physicians and Surgeons of Canada. Entrustable profes‑
sional activities for diagnostic radiology 2022. Available from: https://
References Users/medot/Downloads/[Link] .
1. Association of American Medical Colleges. Competency-Based Medical 25. Tu CY, Huang KM, Cheng CH, Lin WJ, Liu CH, Yang CW. Development,
Education (CBME). Available from: [Link] implementation, and evaluation of entrustable professional activities
on-​areas/​medic​al-​educa​tion/​cbme. (EPAs) for medical radiation technologists in Taiwan: a nationwide experi‑
2. Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. ence. BMC Med Educ. 2024;24(1):95.
Competency-based medical education: theory to practice. Med Teach. 26. Zainuldin R, Tan HY. Development of entrustable professional activities for
2010;32(8):638–45. a physiotherapy undergraduate programme in Singapore. Physiotherapy.
3. Carraccio C, Burke AE. Beyond competencies and milestones: adding 2021;112:64–71.
meaning through context. J Grad Med Educ. 2010;2(3):419–22. 27. Zainuldin R, Tan HY. Entrustable professional activities developed for
4. Jones MD Jr, Rosenberg AA, Gilhooly JT, Carraccio CL. Perspective: allied health entry-level programs across a national level training stand‑
competencies, outcomes, and controversy–linking professional activities ards framework in Singapore. J Allied Health. 2023;52(2):104–12.
to competencies to improve resident education and practice. Acad Med. 28. Zainuldin R, Tan HSK. Entrustable professional activities implementa‑
2011;86(2):161–5. tion in undergraduate allied health therapy programs. Asia Pac Schol.
5. van Loon KA, Driessen EW, Teunissen PW, Scheele F. Experiences with 2024;9(1):42–8.
EPAs, potential benefits and pitfalls. Med Teach. 2014;36(8):698–702. 29. Fu CP, Chiang FM, Lee CY, Chi HY, Wu CL, Lin YJ, et al. Developing the top‑
6. ten Cate O. Entrustability of professional activities and competency- ics of entrustable professional activities in pediatric occupational therapy
based training. Med Educ. 2005;39(12):1176–7. in Taiwan: a pilot study. Taiwan J Occup Ther. 2023;41(2):1–20.
7. ten Cate O, Scheele F. Competency-based postgraduate training: can 30. Tsai SL, Chang SC, Ho MJ. Defining the core competencies of medical
we bridge the gap between theory and clinical practice? Acad Med. humanities education through the nominal group technique. J Med
2007;82(6):542–7. Educ. 2008;12(2):70–6.
8. Royal College of Physicians and Surgeons of Canada. EPAs and Milestones 31. Chiu HY. Survey research methods. Taipei: San Min Book Co., Ltd.; 2007.
2017. 2017. Available from: [Link] 32. Taylor DR, Park YS, Egan R, Chan MK, Karpinski J, Touchie C, et al. EQual,
menta​tion/​cbd-​miles​tones-​epas-e. a novel rubric to evaluate entrustable professional activities for quality
9. Lin HJ, Wu JH, Chen CY. Competency-based medical education and and structure. Acad Med. 2017;92((11S association of American medical
milestones assessment. J Int Med Taiwan. 2020;31(2):115–21. colleges learn serve lead: proceedings of the 56th annual research in
10. Shorey S, Lau TC, Lau ST, Ang E. Entrustable professional activities in medical education sessions)):S110–7.
health care education: a scoping review. Med Educ. 2019;53(8):766–77. 33. Department of Medicine Queen’s University. EQual rubric training video
11. Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Cur‑ for EPA evaluation. Available from: [Link]
riculum development for the workplace using Entrustable Professional yQZuW​dzkQKM.
Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002. 34. Meyer EG, Taylor DR, Uijtdehaage S, Durning SJ. EQual rubric evaluation
12. Hauer KE, Kohlwes J, Cornett P, Hollander H, Ten Cate O, Ranji SR, et al. of the association of american medical colleges’ core entrustable profes‑
Identifying entrustable professional activities in internal medicine train‑ sional activities for entering residency. Acad Med. 2020;95(11):1755–62.
ing. J Grad Med Educ. 2013;5(1):54–9. 35. Chen JW, Hsu WC. Developing a competency-based medical education
13. Kearse LE, Schmiederer IS, Anderson TN, Dent DL, Payne DH, Korndorffer for Taiwan otolaryngology-head and neck surgery resident physician
JR Jr. American board of surgery entrustable professional activities (EPAs): training-an integrated entrustable professional activities model. J Taiwan
assessing graduating residents’ perception of preoperative entrustment. J Otolaryngol Head Neck Surg. 2022;57(2):110–22.
Surg Educ. 2021;78(6):e183–8. 36. Chen HC, van den Broek WE, ten Cate O. The case for use of entrustable
14. McCloskey CB, Domen RE, Conran RM, Hoffman RD, Post MD, Brissette professional activities in undergraduate medical education. Acad Med.
MD, et al. Entrustable professional activities for pathology: recommenda‑ 2015;90(4):431–6.
tions from the college of american pathologists graduate medical educa‑ 37. Kuehl SE, Spicer JO. Using entrustable professional activities to better pre‑
tion committee. Acad Pathol. 2017;4:2374289517714283. pare students for their postgraduate medical training: a medical student’s
15. Mallow M, Baer H, Moroz A, Nguyen VQ. Entrustable professional activities perspective. Perspect Med Educ. 2022;11(6):359–64.
for residency training in physical medicine and rehabilitation. Am J Phys 38. Bramley AL, McKenna L. Entrustable professional activities in entry-
Med Rehabil. 2017;96(10):762–4. level health professional education: a scoping review. Med Educ.
16. Royal College of Physicians and Surgeons of Canada. Entrustable profes‑ 2021;55(9):1011–32.
sional activities for internal medicine. 2019. 39. Stephan A, Cheung G, van der Vleuten C. Entrustable professional activi‑
17. Shaughnessy AF, Sparks J, Cohen-Osher M, Goodell KH, Sawin GL, Gravel J ties and learning: the postgraduate trainee perspective. Acad Psychiatry.
Jr. Entrustable professional activities in family medicine. J Grad Med Educ. 2023;47(2):134-42.
2013;5(1):112–8. 40. de Graaf J, Bolk M, Dijkstra A, van der Horst M, Hoff RG, Ten Cate O. The
18. Young JQ, Hasser C, Hung EK, Kusz M, O’Sullivan PS, Stewart C, et al. implementation of entrustable professional activities in postgraduate
Developing end-of-training entrustable professional activities for psychia‑ medical education in the netherlands: rationale, process, and current
try: results and methodological lessons. Acad Med. 2018;93(7):1048–54. status. Acad Med. 2021;96(7S):S29–35.
19. Ramaswamy V, Fitzgerald M, Danciu T, Nalliah R, de Peralta T, Munz SM, 41. Hauer KE, Ten Cate O, Boscardin C, Irby DM, Iobst W, O’Sullivan PS. Under‑
Murdoch-Kinch CA. Entrustable professional activities framework for standing trust as an essential element of trainee supervision and learning
assessment in predoctoral dental education, developed using a modified in the workplace. Adv Health Sci Educ Theory Pract. 2014;19(3):435–56.
Delphi process. J Dent Educ. 2021;85(8):1349–61.
20. Zhou W, Poh CL, Chan HL, Shorey S. Development of entrustable profes‑
sional activities for advanced practice nurses education. Nurse Educ
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in pub‑
Today. 2022;116:105462.
lished maps and institutional affiliations.
21. Lockman K, Lowry MF, DiScala S, Lovell AG, Uritsky TJ, Kematick BS,
et al. Development of entrustable professional activities for special‑
ist hospice and palliative care pharmacists. J Pain Symptom Manage.
2022;64(1):37–48.
22. Pittenger AL, Chapman SA, Frail CK, Moon JY, Undeberg MR, Orzoff JH.
Entrustable professional activities for pharmacy practice. Am J Pharm
Educ. 2016;80(4):57.

Content courtesy of Springer Nature, terms of use apply. Rights reserved.


Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:

1. use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
2. use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
3. falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
4. use bots or other automated methods to access the content or redirect messages
5. override any security feature or exclusionary protocol; or
6. share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at

onlineservice@[Link]

You might also like