Feasibility of remote administration of the fundamentals of laparoscopic surgery (FLS) skills test using Google wearable device

Abstract

Background The fundamentals of laparoscopic surgery (FLS) program is a simulation-based training program designed to teach and assess the basic skills necessary for laparoscopic surgery. Preliminary work has demonstrated the feasibility of using Skype™ as a telesimulation modality in reliably scoring the exam for remote centers. Google Glass (GG) (Mountain View, California) is referred to as a wearable computer containing a heads-up display and front-facing camera allowing point-of-view video transmission. The objective of this study was to evaluate the feasibility of GG in scoring the technical skills component of the FLS exam. Methods Twenty-eight participants were asked to complete the peg transfer and intracorporeal knot tasks of FLS using both GG and Skype™ setups. GG employed a third-party HIPAA-compliant video software (Pristine; Austin, TX) for video transmission. Participants were alternated between setups and evaluated by onsite and remote proctors. Times and errors were recorded by both proctors. Interrater reliability of their FLS scores was compared using Intraclass Correlation Coefficients (ICCs). GG experience was evaluated based on participant survey responses using a 5-point Likert scale. Results Interrater reliability for GG demonstrated a statistically significant correlation between onsite (OP) and remote (RP) proctors with ICCs of 0.985 (95% Confidence Interval [CI], 0.969–0.993) and 0.997 (95% CI 0.993–0.998), respectively, for peg and suture tasks. Skype™ demonstrated ICCs of 1.0 (95% CI 1.0–1.0). Average Likert scale responses found GG to be distracting (2.71), obstructive of the view (2.79), and a limitation to task execution (2.75). Overall, there was no statistical difference in scores between GG and Skype™ setups for either the peg ( t \u2009=\u20091.446, p \u2009=\u20090.154) or suture task ( t \u2009=\u2009−\u20090.710, p \u2009=\u20090.480), only 1 participant found the use of GG superior to Skype™. Conclusions Our findings suggest that although GG are feasible in remote assessment of FLS with strong interrater reliability (ICC\u2009>\u20090.95), Skype™ was the preferred modality.