Laura J. Brattain

Automated B-Line Scoring on Thoracic Sonography

With the proliferation of portable sonography and the increase in nontraditional users, there is an increased need for automated decision support to standardize results. We developed algorithms to evaluate the presence or absence of “B‐lines” on thoracic sonography as a marker for interstitial fluid. Algorithm performance was compared against an average of scores from 2 expert clinical sonographers. On the set for algorithm development, 90% of the scores matched the average expert scores with differences of 1 or less. On the independent set, a perfect match was achieved. We believe that these are the first reported results in computerized B‐line scoring.

Automated pointing of cardiac imaging catheters

Intracardiac echocardiography (ICE) catheters enable high-quality ultrasound imaging within the heart, but their use in guiding procedures is limited due to the difficulty of manually pointing them at structures of interest. This paper presents the design and testing of a catheter steering model for robotic control of commercial ICE catheters. The four actuated degrees of freedom (4-DOF) are two catheter handle knobs to produce bi-directional bending in combination with rotation and translation of the handle. An extra degree of freedom in the system allows the imaging plane (dependent on orientation) to be directed at an object of interest. A closed form solution for forward and inverse kinematics enables control of the catheter tip position and the imaging plane orientation. The proposed algorithms were validated with a robotic test bed using electromagnetic sensor tracking of the catheter tip. The ability to automatically acquire imaging targets in the heart may improve the efficiency and effectiveness of intracardiac catheter interventions by allowing visualization of soft tissue structures that are not visible using standard fluoroscopic guidance. Although the system has been developed and tested for manipulating ICE catheters, the methods described here are applicable to any long thin tendon-driven tool (with single or bi-directional bending) requiring accurate tip position and orientation control.

Real-time 4d ultrasound mosaicing and visualization

Intra-cardiac 3D ultrasound imaging has enabled new minimally invasive procedures. Its narrow field of view, however, limits its efficacy in guiding beating heart procedures where geometrically complex and spatially extended moving anatomic structures are often involved. In this paper, we present a system that performs electrocardiograph gated 4D mosaicing and visualization of 3DUS volumes. Real-time operation is enabled by GPU implementation. The method is validated on phantom and porcine heart data.

Simple and effective ultrasound needle guidance system

In this paper, we describe our prototype of an ultrasound guidance system to address the need for an easy-to-use, cost-effective, and portable technology to improve ultrasound-guided procedures. The system consists of a lockable, articulating needle guide that attaches to an ultrasound probe and a user-interface that provides real-time visualization of the predicted needle trajectory overlaid on the ultrasound image. Our needle guide ensures proper needle alignment with the ultrasound imaging plane. Moreover, the calculated needle trajectory is superimposed on the real-time ultrasound image, eliminating the need for the practitioner to estimate the target trajectory, and thereby reducing injuries from needle readjustment. Finally, the guide is lockable to prevent needle deviation from the desired trajectory during insertion. This feature will also allow the practitioner to free one hand to complete simple tasks that usually require a second practitioner to perform. Overall, our system eliminates the experience required to develop the fine hand movement and dexterity needed for traditional ultrasound-guided procedures. The system has the potential to increase efficiency, safety, quality, and reduce costs for a wide range of ultrasound-guided procedures. Furthermore, in combination with portable ultrasound machines, this system will enable these procedures to be more easily performed by unskilled practitioners in non-ideal situations such as the battlefield and other disaster relief areas.

Algorithms for Automated Pointing of Cardiac Imaging Catheters

This paper presents a modified controller and expanded algorithms for automatically positioning cardiac ultrasound imaging catheters within the heart to improve treatment of cardiac arrhythmias such as atrial fibrillation. Presented here are a new method for controlling the position and orientation of a catheter, smoother and more accurate automated catheter motion, and initial results of image processing into clinically useful displays. Ultrasound imaging (intracardiac echo, or ICE) catheters are steered by four actuated degrees of freedom (DOF) to produce bi-directional bending in combination with handle rotation and translation. Closed form solutions for forward and inverse kinematics enable position control of the catheter tip. Additional kinematic calculations enable 1-DOF angular control of the imaging plane. The combination of positioning with imager rotation enables a wide range of visualization capabilities, such as recording a sequence of ultrasound images and reconstructing them into 3D or 4D volumes for diagnosis and treatment. The algorithms were validated with a robotic test bed and the resulting images were reconstructed into 3D volumes. This capability may improve the efficiency and effectiveness of intracardiac catheter interventions by allowing visualization of soft tissues or working instruments. The methods described here are applicable to any long thin tendon-driven tool (with single or bi-directional bending) requiring accurate tip position and orientation control.

Machine learning for medical ultrasound: status, methods, and future opportunities

Ultrasound (US) imaging is the most commonly performed cross-sectional diagnostic imaging modality in the practice of medicine. It is low-cost, non-ionizing, portable, and capable of real-time image acquisition and display. US is a rapidly evolving technology with significant challenges and opportunities. Challenges include high inter- and intra-operator variability and limited image quality control. Tremendous opportunities have arisen in the last decade as a result of exponential growth in available computational power coupled with progressive miniaturization of US devices. As US devices become smaller, enhanced computational capability can contribute significantly to decreasing variability through advanced image processing. In this paper, we review leading machine learning (ML) approaches and research directions in US, with an emphasis on recent ML advances. We also present our outlook on future opportunities for ML techniques to further improve clinical workflow and US-based disease diagnosis and characterization.

Benchmarking SciDB data import on HPC systems

SciDB is a scalable, computational database management system that uses an array model for data storage. The array data model of SciDB makes it ideally suited for storing and managing large amounts of imaging data. SciDB is designed to support advanced analytics in database, thus reducing the need for extracting data for analysis. It is designed to be massively parallel and can run on commodity hardware in a high performance computing (HPC) environment. In this paper, we present the performance of SciDB using simulated image data. The Dynamic Distributed Dimensional Data Model (D4M) software is used to implement the benchmark on a cluster running the MIT SuperCloud software stack. A peak performance of 2.2M database inserts per second was achieved on a single node of this system. We also show that SciDB and the D4M toolbox provide more efficient ways to access random sub-volumes of massive datasets compared to the traditional approaches of reading volumetric data from individual files. This work describes the D4M and SciDB tools we developed and presents the initial performance results. This performance was achieved by using parallel inserts, a in-database merging of arrays as well as supercomputing techniques, such as distributed arrays and single-program-multiple-data programming.

Instrument Tracking and Visualization for Ultrasound Catheter Guided Procedures

We present an instrument tracking and visualization system for intra-cardiac ultrasound catheter guided procedures, enabled through the robotic control of ultrasound catheters. Our system allows for rapid acquisition of 2D ultrasound images and accurate reconstruction and visualization of a 3D volume. The reconstructed volume addresses the limited field of view, an inherent problem of ultrasound imaging, and serves as a navigation map for procedure guidance. Our robotic system can track a moving instrument by continuously adjusting the imaging plane and visualizing the instrument tip. The overall instrument tracking accuracy is 2.2mm RMS in position and 0.8° in angle.

Enabling 3d ultrasound procedure guidance through enhanced visualization

Real-time 3D ultrasound (3DUS) imaging offers improved spatial orientation information relative to 2D ultrasound. However, in order to improve its efficacy in guiding minimally invasive intra-cardiac procedures where real-time visual feedback of an instrument tip location is crucial, 3DUS volume visualization alone is inadequate. This paper presents a set of enhanced visualization functionalities that are able to track the tip of an instrument in slice views at real-time. User study with in vitro porcine heart indicates a speedup of over 30% in task completion time.

Algorithms for Automatically Pointing Ultrasound Imaging Catheters

A system for automatically pointing ultrasound (US) imaging catheters will enable clinicians to monitor anatomical structures and track instruments during interventional procedures. Off-the-shelf US catheters provide high-quality US images from within the patient. While this method of imaging has been proven to be effective for guiding many interventional treatments, significant training is required to overcome the difficulty in manually steering the imager to point at desired structures. Our system uses closed-form four degree-of-freedom (DOF) kinematic solutions to automatically position the US catheter and point the imager. Algorithms for steering and imager pointing were developed for a range of useful diagnostic and interventional motions. The system was validated on a robotic test bed by steering the catheter within a water environment containing phantom objects. While the system described here was designed for pointing US catheters, these algorithms are applicable to accurate 4-DOF steering and orientation control of any long thin tendon-driven tool with single or bidirectional bending.