MR and ultrasound cardiac image dynamic visualization and synchronization over Internet for distributed heart function diagnosis

Abstract

Dual-modality 4D cardiac data visualization can convey a significant amount of complementary image information from various sources into a single and meaningful display. Even though there are existing publications on combining multiple medical images into a unique representation, there has been no work on rendering a series of cardiac image sequences, acquired from multiple sources, using web browsers and synchronizing the result over the Internet in real time. The ability to display multi-modality beating heart images using Web-based technology is hampered by the lack of efficient algorithms for fusing and visualizing constantly updated multi-source images and streaming the rendering results using internet protocols. To address this practical issue, in this paper we introduce a new Internet-based algorithm and a software platform running on a Node.js server, where a series of registered cardiac images from both magnetic resonance (MR) and ultrasound are employed to display dynamic fused cardiac structures in web browsers. Taking advantage of the bidirectional WebSocket protocol and WebGL-based graphics acceleration, internal cardiac structures are dynamically displayed, and the results of rendering and data exploration are synchronized among all the connected client computers. The presented research and software have the potential to provide clinicians with comprehensive information and intuitive feedback relating to cardiac behavior and anatomy and could impact areas such as distributed diagnosis of cardiac function and collaborative treatment planning for various heart diseases.