Torsten Hopp

Automatic multimodal 2D/3D breast image registration using biomechanical FEM models and intensity-based optimization.

Due to their different physical origin, X-ray mammography and Magnetic Resonance Imaging (MRI) provide complementary diagnostic information. However, the correlation of their images is challenging due to differences in dimensionality, patient positioning and compression state of the breast. Our automated registration takes over part of the correlation task. The registration method is based on a biomechanical finite element model, which is used to simulate mammographic compression. The deformed MRI volume can be compared directly with the corresponding mammogram. The registration accuracy is determined by a number of patient-specific parameters. We optimize these parameters--e.g. breast rotation--using image similarity measures. The method was evaluated on 79 datasets from clinical routine. The mean target registration error was 13.2mm in a fully automated setting. On basis of our results, we conclude that a completely automated registration of volume images with 2D mammograms is feasible. The registration accuracy is within the clinically relevant range and thus beneficial for multimodal diagnosis.

2D/3D image fusion of X-ray mammograms with breast MRI: visualizing dynamic contrast enhancement in mammograms

PurposeBreast cancer is the most common cancer among women. The established screening method to detect breast cancer is X-ray mammography. Additionally, MRI is used for diagnosis in clinical routine. Due to complementary diagnostic information, both modalities are often read in combination. Yet, the correlation is challenging due to different dimensionality of images and different patient positioning. In this paper, we describe a method to fuse X-ray mammograms with DCE-MRI. The present study was conducted to evaluate the feasibility of the approach.MethodsFor the combination of information from both modalities, the images have to be registered using a compression simulation based on a patient-specific biomechanical model. The registered images can be compared directly. The contrast enhancement in the DCE-MRI volume is evaluated using parametric enhancement maps. A projection image of the contrast enhancement is created. The image fusion combines it with X-ray mammograms for intuitive multimodal diagnosis.ResultsThe image fusion was evaluated using 11 clinical datasets. For 10 of 11 datasets, a good accuracy of the image registration was achieved. The overlap of contrast-enhanced regions with marked lesions in the mammogram is 61%. Lesions are clearly differentiable from surrounding tissue by the DCE-MRI projection in 10 of 11 cases.ConclusionThe described preliminary results are promising, thus we expect the visualization of quantitative information from dynamic MRI together with mammograms to be beneficial for multimodal diagnosis. Because of the use of clinical standard modalities, no additional image acquisition is needed.

3D ultrasound computer tomography of the breast: A new era?

A promising candidate for imaging of breast cancer is ultrasound computer tomography (USCT). The main advantages of a USCT system are simultaneous recording of reproducible reflection, attenuation and speed of sound volumes, high image quality, and fast data acquisition. The here presented 3D USCT prototype realizes for the first time the full potential of such a device. It is ready for a clinical study. Full volumes of a breast can be acquired in four minutes. In this paper images acquired with a clinical breast phantom are presented. The resolution and imaged details of the reflectivity reconstruction are comparable to a 3 tesla MRI volume of the phantom. Image quality and resolution is isotropic in all three dimensions, confirming the successful implementation experimentally.

First results of a clinical study with 3D ultrasound computer tomography

The KIT 3D USCT was tested in a pilot study on ten patients. The primary goals of the pilot study were to test the USCT device, the data acquisition protocols, the image reconstruction methods and the image fusion techniques in a clinical environment. The study was conducted successfully; the data acquisition could be carried out for all patients with an average imaging time of six minutes per breast. First reconstructions provide promising images. Overlaid volumes of the modalities show qualitative and quantitative information at a glance. The results led to further optimization of the system and the data acquisition protocol.

Image fusion of Ultrasound Computer Tomography volumes with X-ray mammograms using a biomechanical model based 2D/3D registration

Ultrasound Computer Tomography (USCT) is a promising breast imaging modality under development. Comparison to a standard method like mammography is essential for further development. Due to significant differences in image dimensionality and compression state of the breast, correlating USCT images and X-ray mammograms is challenging. In this paper we present a 2D/3D registration method to improve the spatial correspondence and allow direct comparison of the images. It is based on biomechanical modeling of the breast and simulation of the mammographic compression. We investigate the effect of including patient-specific material parameters estimated automatically from USCT images. The method was systematically evaluated using numerical phantoms and in-vivo data. The average registration accuracy using the automated registration was 11.9mm. Based on the registered images a method for analysis of the diagnostic value of the USCT images was developed and initially applied to analyze sound speed and attenuation images based on X-ray mammograms as ground truth. Combining sound speed and attenuation allows differentiating lesions from surrounding tissue. Overlaying this information on mammograms, combines quantitative and morphological information for multimodal diagnosis.

Phantom image results of an optimized full 3D USCT

A promising candidate for improved imaging of breast cancer is ultrasound computer tomography (USCT). Current experimental USCT systems are still focused in elevation dimension resulting in a large slice thickness, limited depth of field, loss of out-of-plane reflections, and a large number of movement steps to acquire a stack of images. 3DUSCT emitting and receiving spherical wave fronts overcomes these limitations. We built an optimized 3DUSCT with nearly isotropic 3DPSF, realizing for the first time the full benefits of a 3Dsystem. In this paper results of the 3D point spread function measured with a dedicated phantom and images acquired with a clinical breast phantom are presented. The point spread function could be shown to be nearly isotropic in 3D, to have very low spatial variability and fit the predicted values. The contrast of the phantom images is very satisfactory in spite of imaging with a sparse aperture. The resolution and imaged details of the reflectivity reconstruction are comparable to a 3TeslaMRI volume of the breast phantom. Image quality and resolution is isotropic in all three dimensions, confirming the successful optimization experimentally.

Fusion of dynamic contrast-enhanced magnetic resonance mammography at 3.0 T with X-ray mammograms: Pilot study evaluation using dedicated semi-automatic registration software

RATIONALE AND OBJECTIVES To evaluate the semi-automatic image registration accuracy of X-ray-mammography (XR-M) with high-resolution high-field (3.0T) MR-mammography (MR-M) in an initial pilot study. MATERIAL AND METHODS MR-M was acquired on a high-field clinical scanner at 3.0T (T1-weighted 3D VIBE ± Gd). XR-M was obtained with state-of-the-art full-field digital systems. Seven patients with clearly delineable mass lesions >10mm both in XR-M and MR-M were enrolled (exclusion criteria: previous breast surgery; surgical intervention between XR-M and MR-M). XR-M and MR-M were matched using a dedicated image-registration algorithm allowing semi-automatic non-linear deformation of MR-M based on finite-element modeling. To identify registration errors (RE) a virtual craniocaudal 2D mammogram was calculated by the software from MR-M (with and w/o Gadodiamide/Gd) and matched with corresponding XR-M. To quantify REs the geometric center of the lesions in the virtual vs. conventional mammogram were subtracted. The robustness of registration was quantified by registration of X-MRs to both MR-Ms with and w/o Gadodiamide. RESULTS Image registration was performed successfully for all patients. Overall RE was 8.2mm (1 min after Gd; confidence interval/CI: 2.0-14.4mm, standard deviation/SD: 6.7 mm) vs. 8.9 mm (no Gd; CI: 4.0-13.9 mm, SD: 5.4mm). The mean difference between pre- vs. post-contrast was 0.7 mm (SD: 1.9 mm). CONCLUSION Image registration of high-field 3.0T MR-mammography with X-ray-mammography is feasible. For this study applying a high-resolution protocol at 3.0T, the registration was robust and the overall registration error was sufficient for clinical application.

First in vivo results with 3D ultrasound computer tomography

We designed and built a 3D ultrasound computer tomography (USCT) device with a nearly isotropic and spatially invariant 3D point spread function, to be tested in a clinical study. The objective of this work was to image two healthy volunteers and to evaluate the USCT volumes in comparison to corresponding Magnetic Resonance Images (MRI). The here presented volumes are reflectivity images generated with 3D synthetic aperture focusing technique. The volunteers were imaged with different parameterizations of the data acquisition. The data acquisition time was between four and twelve minutes. For both volunteers we found that the breast surface and inner structures are clearly shown in the USCT volume and fit the structures given by the MRI.

2D/3D registration for localization of mammographically depicted lesions in breast MRI

X-ray mammography (XRM) and Magnetic Resonance Imaging (MRI) are likely to provide complementary diagnostic information for early breast cancer detection. However, topographic correlation of both modalities is challenging due to different dimensionality of images, patient positioning and compression state of the breast. In this paper we present an automated registration method, which allows prediction of the position of a lesion in the contrary modality. It is based on a FEM simulation mimicking the mammographic compression and is carried out using a patient-specific biomechanical model. An intensity-based optimization of the registration parameters is proposed to incorporate with the clinical variability of datasets. After registration, the position of a point of interest can be estimated within the three-dimensional MRI volume based on two mammograms acquired from different projection angles. The method was evaluated with 47 datasets from clinical routine. The mean registration error for localizing a lesion in the 3D MRI volume was 14.3 mm. The automatic registration method enables localization of e.g. microcalcifications which are only visible in XRM, within the corresponding MRI volume. It is therefore likely to assist radiologists in multimodal diagnosis.

P1A-4 Model-Based Pulse Detection for 3D Ultrasound Computer Tomography

At Forschungszentrum Karlsruhe a 3D ultrasound computer tomograph (USCT) for breast cancer diagnosis is currently under development. For many applications, i.e. reconstruction of speed of sound maps, signal denoising,signal compression and calibration, it is necessary to detect pulses and their parameters (center frequency, bandwidth factor, time of arrival, phase and amplitude) accurately and robustly. The pulse detection is demanding due to low signal-to-noise ratios (SNR) caused by unfocused pulses from single emitters. Besides that angle dependent pulse shapes result in ultrasonic echoes which are similar in their center frequency but vary strongly in their bandwidth factor. Additionally, in sum 3.5 million A-scans (20 GB) are acquired, so that the pulse detection has to be fast and efficient. This is achieved by using a fast pre-classifler in order to separate the ultrasonic echoes from the non-white system noise of our system. The detected echoes are then passed individually to a parameter estimation method to determine pulse parameters accurately. An analysis of several classifiers resulted in an alternating decision tree which is both fast and accurate. Classification performance of 95% could be achieved as well as robust parameter estimation with non-white system noise if the SNR is larger than 3 dB. A comparative image reconstruction resulted in significantly sharper images.