AIRR - ANZCA Institutional Research Repository
Skip navigation
Please use this identifier to cite or link to this item: https://hdl.handle.net/11055/50
Full metadata record
DC FieldValueLanguage
dc.contributor.authorWeller, JM-
dc.contributor.authorCastanelli, DJ-
dc.contributor.authorChen, Y-
dc.contributor.authorJolly, B-
dc.date.accessioned2017-11-09T05:00:54Z-
dc.date.available2017-11-09T05:00:54Z-
dc.date.issued2017-02-
dc.identifier.citationWeller JM, Castanelli DJ, Chen Y, Jolly B. Making robust assessments of specialist trainees workplace performance. Br J Anaesth 2017;118(2):207-214en_US
dc.identifier.issn0007-0912en_US
dc.identifier.urihttp://hdl.handle.net/11055/50-
dc.descriptionAcknowledgement: This work was supported by a grant from the Australian and New Zealand College of Anaesthetists (S14/002).en_US
dc.description.abstractBACKGROUND: Workplace-based assessments should provide a reliable measure of trainee performance, but have met with mixed success. We proposed that using an entrustability scale, where supervisors scored trainees on the level of supervision required for the case would improve the utility of compulsory mini-clinical evaluation exercise (CEX) assessments in a large anaesthesia training program. METHODS: We analysed mini-CEX scores from all Australian and New Zealand College of Anaesthetists trainees submitted to an online database over a 12-month period. Supervisors' scores were adjusted for the expected supervision requirement for the case for trainees at different stages of training. We used generalisability theory to determine score reliability. RESULTS: 7808 assessments were available for analysis. Supervision requirements decreased significantly (P < 0.05) with increased duration and level of training, supporting validity. We found moderate reliability (G > 0.7) with a feasible number of assessments. Adjusting scores against the expected supervision requirement considerably improved reliability, with G > 0.8 achieved with only nine assessments. Three per cent of trainees generated average mini-CEX scores below the expected standard. CONCLUSIONS: Using an entrustment scoring system, where supervisors score trainees on the level of supervision required, mini-CEX scores demonstrated moderate reliability within a feasible number of assessments, and evidence of validity. When scores were adjusted against an expected standard, underperforming trainees could be identified, and reliability much improved. Taken together with other evidence on trainee ability, the mini-CEX is of sufficient reliability for inclusion in high stakes decisions on trainee progression towards independent specialist practice.en_US
dc.subjecteducational assessmenten_US
dc.subjecteducational measurementen_US
dc.subjectMedical Educationen_US
dc.subjectWorkplace-based assessmentsen_US
dc.titleMaking robust assessments of specialist trainees' workplace performanceen_US
dc.typeJournal Articleen_US
dc.type.contentTexten_US
dc.identifier.journaltitleBritish journal of anaesthesiaen_US
dc.identifier.doi10.1093/bja/aew412en_US
dc.description.affiliatesAustralian and New Zealand College of Anaesthetistsen_US
dc.description.pubmedurihttps://www.ncbi.nlm.nih.gov/pubmed/?term=Making+robust+assessments+of+specialist+trainees+workplace+performanceen_US
dc.ispartof.anzcaresearchfoundationYes-
item.fulltextNo Fulltext-
item.grantfulltextnone-
item.cerifentitytypePublications-
item.openairetypeJournal Article-
item.openairecristypehttp://purl.org/coar/resource_type/c_18cf-
Appears in Collections:Scholarly and Clinical
Show simple item record

Page view(s)

12
checked on Mar 28, 2024

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.