This Article Figures Only Full Text Full Text (PDF) All Versions of this Article: j.jacc.2005.12.053v1 47/9/1796    most recent Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (25) Citing Articles via Google Scholar Google Scholar Articles by Patel, A. D. Articles by Cates, C. U. Search for Related Content PubMed PubMed Citation Articles by Patel, A. D. Articles by Cates, C. U.

CLINICAL RESEARCH: INTERVENTIONAL CARDIOLOGY

Learning Curves and Reliability Measures for Virtual Reality Simulation in the Performance Assessment of Carotid Angiography

Emory Angiographic Simulation Training (EAST) Center, Department of Medicine, Division of Cardiology, Emory University School of Medicine, Atlanta, Georgia

Manuscript received July 30, 2005; revised manuscript received December 15, 2005, accepted December 20, 2005.

^_* Reprint requests and correspondence: Dr. Christopher U. Cates, Vascular Intervention, Emory University, 1364 Clifton Road NE, Suite C-430, Atlanta, Georgia 30322 (Email: Christopher_Cates{at}emoryhealthcare.org).

OBJECTIVES: Improvement in performance as measured by metric-based procedural errors must be demonstrated if virtual reality (VR) simulation is to be used as a valid means of proficiency assessment and improvement in procedural-based medical skills.

BACKGROUND: The Food and Drug Administration requires completion of VR simulation training for physicians learning to perform carotid stenting.

METHODS: Interventional cardiologists (n = 20) participating in the Emory NeuroAnatomy Carotid Training program underwent an instructional course on carotid angiography and then performed five serial simulated carotid angiograms on the Vascular Interventional System Trainer (VIST) VR simulator (Mentice AB, Gothenburg, Sweden). Of the subjects, 90% completed the full assessment. Procedure time (PT), fluoroscopy time (FT), contrast volume, and composite catheter handling errors (CE) were recorded by the simulator.

RESULTS: An improvement was noted in PT, contrast volume, FT, and CE when comparing the subjects’ first and last simulations (all p < 0.05). The internal consistency of the VIST VR simulator as assessed with standardized coefficient alpha was high (range 0.81 to 0.93), except for FT (alpha = 0.36). Test-retest reliability was high for CE (r = 0.9, p = 0.0001).

CONCLUSIONS: A learning curve with improved performance was demonstrated on the VIST simulator. This study represents the largest collection of such data to date in carotid VR simulation and is the first report to establish the internal consistency of the VIST simulator and its test-retest reliability across several metrics. These metrics are fundamental benchmarks in the validation of any measurement device. Composite catheter handling errors represent measurable dynamic metrics with high test-retest reliability that are required for the high-stakes assessment of procedural skills.

Abbreviations and Acronyms   CE = composite catheter handling errors   FT = fluoroscopy time   OR = operating room   PT = procedure time   VIST = Vascular Interventional System Trainer   VR = virtual reality

This article has been cited by other articles:

				I. Van Herzeele, R. Aggarwal, and I. Malik Use of simulators in vascular training Heart, April 1, 2009; 95(8): 613 - 614. [Full Text] [PDF]

				W. F. Dunn and E. Armstrong How Many Unjustifiable Lectures Are Worth $2.4 Billion? Chest, December 1, 2008; 134(6): 1117 - 1120. [Full Text] [PDF]

				J. Marco and D. R. Holmes Jr Simulation: Present and Future Roles J. Am. Coll. Cardiol. Intv., October 1, 2008; 1(5): 590 - 592. [Full Text] [PDF]

				W. Dunn and J. G. Murphy Simulation: About Safety, Not Fantasy Chest, January 1, 2008; 133(1): 6 - 9. [Full Text] [PDF]

				D. B. Wayne, A. Didwania, J. Feinglass, M. J. Fudala, J. H. Barsuk, and W. C. McGaghie Simulation-Based Education Improves Quality of Care During Cardiac Arrest Team Responses at an Academic Teaching Hospital: A Case-Control Study Chest, January 1, 2008; 133(1): 56 - 61. [Abstract] [Full Text] [PDF]

				E. R. Bates, C. J. D. Babb, D. E. Casey, C. U. Cates, G. R. Duckwiler, T. E. Feldman, W. A. Gray, K. Ouriel, E. D. Peterson, K. Rosenfield, et al. ACCF/SCAI/SVMB/SIR/ASITN 2007 Clinical Expert Consensus Document on Carotid Stenting: A Report of the American College of Cardiology Foundation Task Force on Clinical Expert Consensus Documents (ACCF/SCAI/SVMB/SIR/ASITN Clinical Expert Consensus Document Committee on Carotid Stenting) Vascular Medicine, February 1, 2007; 12(1): 35 - 83. [PDF]

				C. U. Cates, A. D. Patel, and W. J. Nicholson Use of Virtual Reality Simulation for Mission Rehearsal for Carotid Stenting JAMA, January 17, 2007; 297(3): 265 - 266. [Full Text] [PDF]

				American Society of Interventional & Therapeutic N, Society for Cardiovascular Angiography and Interve, Society for Vascular Medicine and Biology, Society of Interventional Radiology, E. R. Bates, J. D. Babb, D. E. Casey Jr, C. U. Cates, G. R. Duckwiler, T. E. Feldman, et al. ACCF/SCAI/SVMB/SIR/ASITN 2007 Clinical Expert Consensus Document on Carotid Stenting: A Report of the American College of Cardiology Foundation Task Force on Clinical Expert Consensus Documents (ACCF/SCAI/SVMB/SIR/ASITN Clinical Expert Consensus Document Committee on Carotid Stenting) J. Am. Coll. Cardiol., January 2, 2007; 49(1): 126 - 170. [Full Text] [PDF]