A practical augmented reality-assisted maintenance system framework for adaptive user support

Abstract

Abstract This paper describes an Augmented Reality Maintenance System (ARMS) that can provide adaptive support and feedback to a user during maintenance. An innovative wrist-based haptic tracking methodology is implemented to provide maintenance step awareness to the maintenance operator when he/she is working within the maintenance workspace. This is integrated with an image-based step detection module to facilitate the determination on whether a step has been conducted correctly. To further adapt to the user s visualisation requirements during maintenance, a novel adaptive human-machine interface module has been incorporated. The result is a seamless AR-assisted maintenance platform that can better cater to the needs of the operators during maintenance by providing useful feedback to the operators. The system has been demonstrated through a case study to highlight the viability of the methodology in actual industrial scenarios.