Definition

An entrustable professional activity (EPA) has been defined as ‘a unit of professional practice that may be entrusted to a learner to execute tasks (critical specialized activities) unsupervised once he or she has demonstrated the required competence’ (ten Cate Reference ten Cate2005, Reference ten Cate and Scheele2007). To expand on this definition: (a) it is a method of trainee assessment by the trainee's supervisor; (b) entrustment is given when the supervisor acknowledges that the trainee has sufficient knowledge and supervised experience to carry out a task independently; (c) it can only assess medical specialised tasks, i.e. tasks that require training and are relevant to the trainee's specialty, and (d) it is objective, observable and measurable in a given time frame (ten Cate Reference ten Cate and Scheele2007). The characteristics of EPAs are portrayed in Fig. 1.

FIG 1

Characteristics of entrustable professional activities (EPAs) as described by ten Cate & Scheele (Reference ten Cate and Scheele2007).

The outcome of the EPA is a summative entrustment decision on whether the trainee can be entrusted with the activity being assessed (and if so, to what extent). It should be noted that the term ‘entrustment’ rather than trust is used, as it refers to the readiness of a trainee to perform a task independently (‘Can I entrust this activity to my trainee without direct supervision?’), whereas trust could be considered a characteristic of the person carrying out the activity (‘Is my trainee trustworthy?’).

An EPA is seen as consistent with how supervisors think in day-to-day clinical practice and is compatible with the GMC's guidance as set out in both the General Professional Capabilities Framework and Excellence by Design (General Medical Council 2017a, 2017b). It allows supervisors to make credible and robust assessments of trainees’ capabilities and behaviours as measured against the expectations set out by the curriculum. More importantly, supervisors will be able to ascertain trainees’ readiness for safe, effective and independent clinical practice. When supervisors allocate a clinical task to a trainee, they are in fact having to decide whether to be with the trainee while the task is being carried out, to be available for a discussion afterwards or to let the trainee do it totally unsupervised. An EPA makes this process explicit. This involves a shift from the supervisor assessing how the trainee has performed in the task being observed to assessing their readiness to carry out the task unsupervised in the future.

To further aid the summative process, ten Cate and colleagues propose entrustment scales with five levels of confidence – based on Miller's pyramid of professional competence (ten Cate Reference ten Cate and Taylor2021). They have illustrated this using examples of EPAs in obstetrics and gynaecology, with the expected levels of confidence (on an entrustment scale) rated against the number of years of training progression (ten Cate Reference ten Cate and Scheele2007). For example, ‘the care of complicated pregnancies’ was identified as an EPA. A trainee at the beginning of their training should be able to demonstrate level 1 of confidence and progress to level 3 in their second year, level 4 in their fourth year, and level 5 at the end of their training in year 6. The entrustment scale is illustrated in Fig. 2.

FIG 2

An entrustment scale, based on ten Cate et al (Reference ten Cate, Carraccio and Damodaran2021).

Making the entrustment decision

An entrustment-focused assessment differs from a performance-focused assessment. In the former the assessor needs to think ahead to how the trainee might perform in a situation where there is no one to observe or help. The assessor also relies on a broader evidence base to reach an entrustment decision – this might include multiple WPBAs, longitudinal observations in the workplace and multisource feedback. Research shows that many factors contribute to how supervisors make an entrustment decision. Cho et al (Reference Cho, Parry and Wade2014) showed that there are trainee factors (such as communication skills, perceived confidence), supervisor factors (such as approachability, ability to delegate, their own experience of training), task-related and systemic factors (such as clinical workload, case complexity, comorbidity, the task setting, staff mix, urgency of the task, and so on). Entrusting a task to a trainee with minimal or no supervision involves trust between the supervisor and the trainee, and this also depends on the time spent together and the strength of the supervisory relationship.

ten Cate & Chen (Reference ten Cate and Chen2020) have synthesised the research on trainee-related factors that contribute to entrustment decisions and summarised the framework using a mnemonic – ‘A RICH’ entrustment decision takes into account the trainee's:

• • agency, indicating a proactive attitude towards work, team, safety and personal development

• • reliability, denoting consistent, predictable and conscientious behaviour driven by a sense of accountability and responsibility

• • integrity, characterised by truthfulness, benevolence and patent-centredness

• • capability, referring to the trainee's ability to perform a task in a variety of settings and within appropriate time frames

• • humility, i.e. their awareness of their limitations and their ability to ask for help and to learn from mistakes and feedback.

It is important for trainees to be aware of these attributes (which supervisors are looking for) and for supervisors to be explicit about these in their feedback.

Advantages of an EPA-based curriculum

ten Cate & Scheele (Reference ten Cate and Scheele2007) recommend the adoption of EPA-based curricula as these offer clear pathways to assessing and achieving competencies. This translates into several benefits for both trainees and supervisors that are outlined in Table 1. Mapping competencies to EPAs makes assessments more focused and clinically grounded. A large number of competencies can be condensed into a smaller and manageable number of EPAs, allowing for streamlining of the learning and evaluation process, leading to more meaningful and targeted educational experiences.

TABLE 1

Benefits to trainees and supervisors provided by adoption of entrustable professional activities (EPAs) in training curricula

TABLE 1 Long description

A table with two columns and four rows comparing the benefits of adopting entrustable professional activities (EPAs) in training curricula for trainees and supervisors. The columns are labeled 'Trainees' and 'Supervisors'. Row 1: Clarity. Trainees: Offers clear expectations for competencies through a limited number of EPAs. Supervisors: Provides a structured framework to assess trainee competence. Row 2: Focus. Trainees: Enables targeted, relevant learning and assessments with a practicable number of EPAs. Supervisors: Enhances precision and focus of assessments with a defined set of EPAs. Row 3: Proactive learning and assessment. Trainees: Encourages strategic, forward-thinking approach to WBPAs, leading to relevant preparation. Supervisors: Facilitates proactive planning and organisation of WBPAs, improving efficiency. Row 4: Comprehensive evaluation. Trainees: Allows demonstration of competencies through a variety of formative WBPAs, enriching feedback and development. Supervisors: Permits evaluation of performance across a range of activities and perspectives, enhancing reliability.

WPBA, workplace-based assessment.

For trainees, EPAs encourage a forward-looking approach to training. Instead of trying to impose a WPBA framework on clinical experiences, and then mapping these to curriculum competencies post hoc, trainees can proactively align their clinical learning activities with predefined EPAs, thus enhancing the reliability of their training experiences. This also promotes strategic planning and organisation in their learning, thus increasing the efficiency and relevance of their preparation.

For supervisors, EPAs offer a clear, structured framework for assessing trainees’ ‘real life’ competence, thus reducing ambiguity and enhancing the validity of learning and assessments. Supervisors are better equipped to evaluate performance across a range of activities and from multiple perspectives. Additionally, the prospective nature of EPAs allows for proactive planning and organisation of WBPAs and other learning experiences, fostering a more efficient supervisory process. Finally, as EPAs are broader clinical constructs that allow multiple competencies to be mapped to them, they can include a range of WPBAs, thus having more value as summative assessments, as a single specialised activity can be assessed from multiple perspectives: case-based discussions, reflections, observation of clinical skills, multi-source feedback, etc. (Jurd Reference Jurd, de Beer and Aimer2015; ten Cate Reference ten Cate and Taylor2021).

A critical perspective of an EPA-based curriculum

Although EPAs have clear advantages, as outlined above, some authors have highlighted potential risks with EPAs too. Ross (Reference Ross2015), while critiquing the EPA concept, described risks of ‘reductionism’ and ‘distortion’. Complex clinical activities are not easily amenable to be split into constituent measurable components of an EPA, and reductionistic attempts at identifying measurable objectives risk losing sight of the overarching aims (and essence) of the assessment itself. Distortion refers to the risk of losing important skills by shifting the curriculum towards easily defined or easily measurable outcomes. In his view, trainers and trainees may focus on achieving minimal competence rather than excellence. There is also a risk that once a trainee has been deemed competent and signed off, the trainee might be reluctant to seek supervision for difficult cases and the trainer might also not see the need for supervision for that activity, thereby endangering patient safety. Furthermore, literature on EPAs suggests that there is diversity in how they are interpreted and applied, leading to concept confusion, thus affecting their practical implementation (ten Cate Reference ten Cate and Taylor2021).

Characteristics of EPAs in psychiatry

The literature shows variability in the form, type and number of EPAs used in psychiatry postgraduate training.

In this context, the form mainly refers to the summative assessment remit of an EPA. Two main types of EPA have been described based on their ‘form’: (a) a ‘broad-form’ EPA has a broader remit of assessment – for example, ‘Performing psychiatric assessments and providing differential diagnoses and management plans for children and youth’ (Royal College of Physicians and Surgeons of Canada 2020) or ‘Manage psychiatric patients longitudinally’ (Young Reference Young, Hasser and Hung2018) and (b) a ‘narrow-form’ EPA has a more narrow remit, such as ‘Use of antipsychotic medication in patients with psychosis’ (RANZCP 2012) or ‘Ability to do a risk assessment’ or ‘Ability to formulate a management plan for panic disorder’ (Chauhan Reference Chauhan, Chatterjee and Prakash2022).

Tied to the form of the EPAs is the number of EPAs required to fulfil the curriculum needs. If EPAs are broadly stated, between 10 and 20 appear to be satisfactory for curriculum needs. In contrast, if the EPAs are narrower, a larger number would be required, varying between 40 and 170 narrow EPAs. Clearly, a balance needs to be struck between the structure and number of EPAs that will be required to fulfil a particular curriculum. To reduce assessment burden, it is possible that some curricula may mandate a smaller number of representative narrow EPAs, as similar competencies may underpin different clinical tasks.

Finally, a distinction has been drawn between those EPAs that are considered an essential (and therefore mandatory) part of the curriculum and those that are desirable (and therefore optional). Different terminology is used to describe this, depending on authors: (a) mandatory versus elective EPAs (RANZCP 2012), (b) essential versus non-essential (Young Reference Young, Hasser and Hung2018), (c) true EPAs versus EPA-like activities (Weiss Reference Weiss, Ozdoba and Carroll2016) and (d) vital versus essential versus desirable EPAs (Chauhan Reference Chauhan, Chatterjee and Prakash2022). Clinically relevant activities are usually considered mandatory (‘Performing psychiatric assessments and providing differential diagnoses and management plans for children and youth’), essential (‘Manage involuntary commitment and treatment’) or vital (‘Life-saving or common medication or interventions’), whereas hard to assess activities such as ‘Engaging in lifelong learning’, ‘Demonstrating professional behaviour’ and ‘Advocating for individual patients’ have been described as ‘EPA-like’ (Weiss Reference Weiss, Ozdoba and Carroll2016). The RANZCP (2012) mandates EPAs in certain subspecialties; for example, by the end of stage 2 of training, trainees must be entrusted with two addiction psychiatry EPAs and two old age psychiatry EPAs. Curiously, Young et al (Reference Young, Hasser and Hung2018) found psychotherapy-related activities such as ‘Provide CBT therapy’ non-essential; however, they acknowledge that more research is needed on the topic.

Constructing EPAs in psychiatry

Various strategies have been employed to construct valid EPAs. The most common method involves putting together a committee comprising both faculty members and junior doctors, and the method with most validity in developing EPAs is reported to be the Delphi method (Stone Fish Reference Stone Fish, Busby, Sprenkle and Piercy2005). We give a summary of these methods here.

Weiss et al (Reference Weiss, Ozdoba and Carroll2016) established a milestones committee and tasked members to individually arrive at 5–10 EPAs after being educated on the concept. The proposed EPAs were then discussed by the committee to arrive at a final number. This approach produced 15 broad EPAs. The committee found the experience challenging, especially in differentiating what constituted an EPA from other training milestones that did not meet the criteria for an EPA but were still mandated and considered essential. They decided to retain the latter and called them non-EPA activities.

Chauhan et al (Reference Chauhan, Chatterjee and Prakash2022) used a similar method but broke down the process in five structured phases: divergent thinking, convergent thinking, deconstruction, internal peer review, and finalisation, a process that took 5 months.

Young et al (Reference Young, Hasser and Hung2018) used a Delphi approach to develop EPAs. The process consisted of three steps: an initial (individual) step, a refining step (group discussion and input from EPA experts) and a finalising step (by using two rounds of the Delphi survey). This type of Delphi approach has been used in other specialties as well and is reported to be the preferred strategy for developing valid EPAs (Wisman-Zwarter Reference Wisman-Zwarter, van der Schaaf and ten Cate2016).

Boyce et al (Reference Boyce, Spratt and Davies2011) employed a different method. They started by surveying their faculty members for their opinions on what could be potential EPA topics. The faculty members were then asked to rate these on their clinical importance. The survey showed an increase in supervisors’ confidence in using EPAs for trainee assessments.

Finally, Hung et al (Reference Hung, Jibson and Sadhu2021) proposed a step-by-step implementation guide for EPAs in postgraduate psychiatry curricula. The steps were: making the case for EPAs; choosing suitable topics; developing and adapting EPAs and entrustment scales; implementation in an iterative fashion; and evaluation of its impact on trainees, on the training programme and on faculty members' development.

Advantages of EPAs in psychiatry

EPAs have been suggested as a useful aid to simplify or add structure to curricula by trimming competencies that are irrelevant, too granular or too abstract and connecting remaining ones to a specialised activity that is considered core for psychiatry (ten Cate Reference ten Cate and Scheele2007; Young Reference Young and McClure2020; Hung Reference Hung, Jibson and Sadhu2021). Another advantage of EPAs is their adaptability to a diverse range of settings and needs, from different specialties (Leipzig Reference Leipzig, Sauvigné and Granville2014; Schultz Reference Schultz, Griffiths and Lacasse2015; Wisman-Zwarter Reference Wisman-Zwarter, van der Schaaf and ten Cate2016) to different training schemes within psychiatry (Weiss Reference Weiss, Ozdoba and Carroll2016; Young Reference Young, Hasser and Hung2018; Chauhan Reference Chauhan, Chatterjee and Prakash2022). An EPA-based psychiatry curriculum has been implemented in training programmes in Canada (Royal College of Physicians and Surgeons of Canada 2020) and Australia and New Zealand (Jurd Reference Jurd, de Beer and Aimer2015), thus demonstrating that the concept of EPAs is translatable into clinical training and practice on the ground. A number of advantages have been reported from these countries, including that EPAs added structure to supervision, made it easier to track progress and improved mechanisms for useful feedback. Liu et al (Reference Liu, Jiang and Qi2021) and Englander & Carraccio (Reference Englander and Carraccio2014) found that EPAs were associated with better engagement with learning, increased confidence and preparedness in trainees across different specialties.

On a slightly different note, potential benefits of researching EPAs in psychiatry have been proposed. Pinilla et al (Reference Pinilla, Lenouvel and Strik2020) felt that psychiatry EPAs can guide other specialties in understanding, defining and mapping communication competencies, which have historically been difficult to assess.

Assessment tools for EPAs in psychiatry

In the literature search for this article in 2023, we did not come across any established entrustment tools for EPAs in psychiatry training. The Psychopharmacotherapy-Structured Clinical Observation (P-SCO) checklist has been proposed as a validated EPA assessment tool (Young Reference Young, Frank and Holmboe2021) but is specific to psychopharmacology. A mobile app is currently being developed and piloted to generate entrustment scores and to provide meaningful feedback (Young Reference Young and McClure2020).

The RANZCP assesses EPAs by integrating pre-existing WPBAs with the entrustment decision. A minimum of three formative WPBAs are used to feed into a summative EPA decision (Jurd Reference Jurd, de Beer and Aimer2015). These are reviewed by the trainee, the supervisor and the training programme director. The Royal College of Psychiatrists in Canada follows a similar model. Boyce et al (Reference Boyce, Spratt and Davies2011) proposed the use of an indicative question to help the examiner reach an entrustment decision. Examples of such indicative questions are: ‘Is the use of this medication evidence-based?’ and ‘What plan is there to assess outcome?’. As things stand, all current applications of EPAs in postgraduate psychiatry are summative in their remit.

Some authors have suggested a possible formative role for EPAs in postgraduate education (Weiss Reference Weiss, Ozdoba and Carroll2016; Young Reference Young, Frank and Holmboe2021) but the literature and evidence for their practicability and validity is scarce. Formative psychiatry EPAs have been researched and validated more at undergraduate level (Holzhausen Reference Holzhausen, Maaz and März2019; Pinilla Reference Pinilla, Lenouvel and Cantisani2021).

Where would EPAs fit?

One of the features of the new curricula introduced by the RCPsych is the placement-specific personal developmental plan (PSPDP). This is both flexible and personalised, encouraging trainers and trainees to set activities for key capabilities at the start of each placement (RCPsych 2024). The incorporation of EPAs within the PSPDP can offer a structured approach to monitoring curricular progress (Fig. 3).

FIG 3

Hub and spoke model showing entrustable professional activities (EPAs) within the curricular framework. The hub represents an EPA and the spokes are capabilities assessed by the EPA (the key capabilities already included within the curriculum). PSPDP, placement-specific personal developmental plan; PL, placement; CT, core trainee year.

In the following sections, we use the core training curriculum in psychiatry (RCPsych 2022) to illustrate how EPAs could be embedded within training. During the 3-year core training programme, trainees engage in six clinical placements (of 6 months each), each placement requiring its own PSPDP. For this illustration, we have included, within a given PSPDP, a selection of pertinent EPAs that can be tailored to the specific placement and its unique context. Each EPA encompasses a set of associated key capabilities, which may either span across the entire HLOs framework (Fig. 4) or align more closely with a specific HLO (Fig. 5). This variation in capability alignment depends on the nature of the individual EPA. We envisage that the number of EPAs would need to be such that they do not massively increase the assessment burden of supervisors and trainees, and that the number of WPBAs required is not too different from current requirements.

FIG 4

Hypothetical EPA 2 (Box 1) with capabilities linked to the core psychiatry curriculum (RCPsych 2022). The item numbers (e.g. 2.1.5) refer to the key capabilities linked to the high level outcomes (HLOs) in the core curriculum. Hx, history; MSE, mental state examination.

FIG 5

Hypothetical EPA 15 (Box 1) with capabilities linked to the core psychiatry curriculum. The item numbers (e.g. 2.1.1) refer to the key capabilities linked to the high level outcomes (HLOs) in the core curriculum. CAMHS, child and adolescent mental health services; Hx, history; MSE, mental state examination.

This assumes the existence of an RCPsych-ratified catalogue of psychiatry EPAs to build the PSPDP. EPAs will need to follow a gradient of difficulty and be synchronous with the trainee's ability and level. Ideally, at the beginning of training, the curriculum should drive the acquisition of basic patient assessment and management skills and then escalate into more advanced skills, such as leadership and research. For example, leadership skills might not be considered essential for a core trainee (making it a non-mandatory EPA), but a higher trainee would be expected to demonstrate leadership in their daily practice (thus it becomes a mandatory EPA).

What would EPAs look like?

To better demonstrate this concept, let us imagine the journey of Dr T, a fictitious psychiatry core trainee. Two scenarios have been prepared to illustrate their experience. For this exercise, the list of EPAs featured in Box 1, chosen from the hypothetical catalogue of psychiatry EPAs, serves as the reference. The catalogue allows supervisors and trainees to collaboratively select a set of EPAs, aligning them with the trainee's prior performance, stage in training and, notably, the opportunities offered by the placement. This customised selection of EPAs ensures that the trainee's learning experience is both personally meaningful and professionally enriching.

In the first scenario, we have Dr T, starting their first placement, on an adult in-patient ward. EPAs 1, 2 and 3 were agreed on in their first supervision, with the potential of adding more EPAs later during their placement, based on their progress. Periodic progress checks will guide which EPAs stay, are moved forward or added. A visual representation of EPA 2 is portrayed in Fig. 4.

Moving on to Dr T's final placement, in the third year of core training (CT3), in a children's intellectual disability service, a plan for his sixth PSPDP is proposed, knowing that child and adolescent mental health services (CAMHS) and intellectual disability settings are good for practising and achieving advanced communication skills in psychiatry. To assess these skills, EPA 15 and EPA 16 were agreed on. EPA 15 is exemplified in Fig. 5.

Use of EPAs to guide trainee progression

If EPAs are selected and included in the PSPDP right from the beginning, both the trainee and trainer will be able to plan how to best achieve the agreed EPAs and, more importantly, agree on how to demonstrate them (which and how many WPBAs would be necessary). Figure 6 portrays a possibility of assessing EPAs by integrating existing WPBAs with the entrustment scale. Dr T's progress will be used to explain further.

FIG 6

A possible array of workplace-based assessments and other educational tools to use to inform the entrustment decision. AOT, assessment of teaching; LV, level; CBD, case-based discussion; CP, case presentation; ACE, assessment of clinical expertise; mini-ACE, mini-assessed clinical encounter; DONCS, direct observation of non-clinical skills; CPD, continuing professional development.

Dr T is their fourth post in core training in a home treatment team (HTT) placement and decides with their supervisor to choose EPA 36, regarding leading a discharge planning meeting well. Dr T agreed with the supervisor to approach this skill in a stepwise manner.

First, Dr T will need to demonstrate theoretical knowledge (‘knows’) of the trust's and team's policies regarding discharging patients from the HTT to other community mental health teams and the important ethical frameworks around it. Dr T can demonstrate this by explaining their understanding in a guided conversation during supervision or/and by reflecting on a recent case they have been involved in. After the supervisor is satisfied with the level of knowledge, they ask Dr T to prepare a case-based discussion (‘knows how’) of a case in which they actively participated in the discharge planning process. If the supervisor is satisfied with Dr T's ability to translate the theory into practice, then they can offer the opportunity for Dr T to demonstrate their practical skills (‘shows how/does’). For example, Dr T might lead a discharge planning meeting observed by the supervisor. Only when the supervisor is confident that Dr T consistently demonstrates the skills and competencies will Dr T be entrusted with independent practice. If at any of these stages, Dr T stumbles, the WPBA decided on can be repeated, with feedback and support from the supervisor, until the skill is achieved.

When should EPAs be assessed?

Ideally, individual WPBAs (in the current form) or other formative supervised learning experiences (SLEs) will be first assessed by the clinical supervisor or other qualified professionals throughout the 6-month placements. These will feed into the agreed EPAs, and the entrustment decision, along with supporting comments, will be made by the named clinical supervisor who does the end of placement psychiatric supervisor report. In addition to the prescribed WPBAs, other evidence, such as feedback from multidisciplinary colleagues, might also contribute to the entrustment decision. The EPAs achieved during the posts will be reviewed by the educational supervisor at the end of each post. The role of the educational supervisor would be to review the EPAs achieved (in relation to the overall curriculum) and the feedback, comments and recommendations made by the clinical supervisor. This should inform a plan of further development. Finally, the number of EPAs, the number and quality of WPBAs, and comments/recommendations of the clinical supervisor and educational supervisor would be reviewed by the annual review of competency progression (ARCP) panel for signing off the final summative decision. This would preserve the current relationship between the clinical supervisor, educational supervisor and ARCP panel.

Proposal for implementation

The RCPsych has included EPAs as a potential assessment strategy (in line with the model adopted by the RANZCP) in its Assessment Strategy Review (RCPsych 2023). It has recommended the setting up of a working group to explore this option further with input from trainers with expertise and experience. EPAs are essentially premised on being summative assessments, with various components feeding into the entrustment decision. The RCPsych is considering introduction of EPAs as part of its formative assessment review. This raises the question about how formative assessments such as SLEs relate to EPAs and the summative entrustment decision. It is unclear at the time of writing this article whether the working group will recommend a thorough overhaul of the current assessment system or add entrustment scales to existing WPBAs.

If it is decided to further explore EPAs as an assessment approach for curricular achievement, we suggest an implementation schedule as outlined in the Fig. 7. This will initially involve identifying a range of EPAs by a committee of psychiatric educators and trainee representatives in consultation with international experts. A validated research methodology such as the Delphi method could be used in the next stage to achieve consensus and to select the final number, form and essentiality (mandatory versus optional) of EPAs. This could be followed by a consultation exercise with educators and/or trainees and plans could be further refined (alongside the development of the relevant tools in the electronic portfolio). A piloting exercise would help assess the usefulness, reliability and validity of the approach before it could be considered for a wider roll out. We envisage that this process might take a couple of years.

FIG 7

Creation and implementation of entrustable professional activities (EPAs) in psychiatry.