AIRR - ANZCA Institutional Research Repository
Skip navigation
Please use this identifier to cite or link to this item:
Title: Examining reliability of WHOBARS: a tool to measure the quality of administration of WHO surgical safety checklist using generalisability theory with surgical teams from three New Zealand hospitals.
Authors: Medvedev ON
Merry AF
Skilton C
Gargiulo DA
Mitchell SJ
Weller JM
Keywords: WHOBARS
clinical audit
Risk management
Source: 9(1):e022625
Journal Title: BMJ Open
Abstract: OBJECTIVES: To extend reliability of WHO Behaviourally Anchored Rating Scale (WHOBARS) to measure the quality of WHO Surgical Safety Checklist administration using generalisability theory. In this context, extending reliability refers to establishing generalisability of the tool scores across populations of teams and raters by accounting for the relevant sources of measurement errors. DESIGN: Cross-sectional random effect measurement design assessing surgical teams by the five items on the three Checklist phases, and at three sites by two trained raters simultaneously. SETTING: The data were collected in three tertiary hospitals in Auckland, New Zealand in 2016 and included 60 teams observed in 60 different cases with an equal number of teams (n=20) per site. All elective and acute cases (adults and children) involving surgery under general anaesthesia during normal working hours were eligible. PARTICIPANTS: The study included 243 surgical staff members, 138 (50.12%) women. MAIN OUTCOME MEASURE: Absolute generalisability coefficient that accounts for variance due to items, phases, sites and raters for the WHOBARS measure of the quality of WHO Surgical Safety Checklist administration. RESULTS: The WHOBARS in its present form has demonstrated good generalisability of scores across teams and raters (G absolute=0.83). The largest source of measurement error was the interaction between the surgical team and the rater, accounting for 16.7% (95% CI 16.4 to 16.9) of the total variance in the data. Removing any items from the WHOBARS led to a decrease in the overall reliability of the instrument. CONCLUSIONS: Assessing checklist administration quality is important for promoting improvement in its use, and WHOBARS offers a reliable approach for doing this.
DOI: 10.1136/bmjopen-2018-022625
PubMed URL:
Type: Journal Article
Affiliates: University of Auckland
Auckland City Hospital
Study/Trial: Randomized Controlled Clinical Trial/Controlled Clinical Trial
Appears in Collections:Scholarly and Clinical

Show full item record

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.