Abstract
•Immersive virtual reality (IVR) simulations can be effectively assessed in real-time by multiple faculty evaluators using live stream casting.•Findings support the interrater reliability of the CCEI 2.0 when used with prelicensure nursing students in IVR simulated environment.•The CCEI 2.0 is a reliable evaluation tool for IVR simulation-based learning.
The use of immersive virtual reality (IVR) as a pedagogical simulation tool in nursing education is increasing, but reliable instruments for evaluating competency in this learning environment are limited. This study assessed the interrater agreement among raters using the Creighton Competency Evaluation Instrument 2.0 (CCEI 2.0) during an IVR simulated scenario.
A convenience sample of 72 BSN students participated in an IVR scenario that was evaluated in real-time using the 25-item dichotomous CCEI 2.0 tool.
Overall, CCEI 2.0 interrater agreement was strong, with a mean Phi/Pearson r of 0.74 and a Gwet’s AC of 0.86, indicating good to excellent agreement. Absolute agreement averaged 91.72%, with most individual items demonstrating high agreement (Gwet’s AC > 0.7). Both of these measures support of interrater reliability for the CCEI 2.0
The CCEI 2.0 demonstrates strong interrater agreement, supporting interrater reliability and confirming that it is a valid and feasible assessment tool in IVR simulated environment.