Thomy Mertzanidou

Development of patient-specific biomechanical models for predicting large breast deformation

Physically realistic simulations for large breast deformation are of great interest for many medical applications such as cancer diagnosis, image registration, surgical planning and image-guided surgery. To support fast, large deformation simulations of breasts in clinical settings, we proposed a patient-specific biomechanical modelling framework for breasts, based on an open-source graphics processing unit-based, explicit, dynamic, nonlinear finite element (FE) solver. A semi-automatic segmentation method for tissue classification, integrated with a fully automated FE mesh generation approach, was implemented for quick patient-specific FE model generation. To solve the difficulty in determining material parameters of soft tissues in vivo for FE simulations, a novel method for breast modelling, with a simultaneous material model parameter optimization for soft tissues in vivo, was also proposed. The optimized deformation prediction was obtained through iteratively updating material model parameters to maximize the image similarity between the FE-predicted MR image and the experimentally acquired MR image of a breast. The proposed method was validated and tested by simulating and analysing breast deformation experiments under plate compression. Its prediction accuracy was evaluated by calculating landmark displacement errors. The results showed that both the heterogeneity and the anisotropy of soft tissues were essential in predicting large breast deformations under plate compression. As a generalized method, the proposed process can be used for fast deformation analyses of soft tissues in medical image analyses and surgical simulations.

NiftySim: A GPU-based nonlinear finite element package for simulation of soft tissue biomechanics

PurposeNiftySim, an open-source finite element toolkit, has been designed to allow incorporation of high-performance soft tissue simulation capabilities into biomedical applications. The toolkit provides the option of execution on fast graphics processing unit (GPU) hardware, numerous constitutive models and solid-element options, membrane and shell elements, and contact modelling facilities, in a simple to use library.MethodsThe toolkit is founded on the total Lagrangian explicit dynamics (TLEDs) algorithm, which has been shown to be efficient and accurate for simulation of soft tissues. The base code is written in C

A hybrid fem-based method for aligning prone and supine images for image guided breast surgery

++

MRI to X-ray mammography registration using a volume-preserving affine transformation

++, and GPU execution is achieved using the nVidia CUDA framework. In most cases, interaction with the underlying solvers can be achieved through a single Simulator class, which may be embedded directly in third-party applications such as, surgical guidance systems. Advanced capabilities such as contact modelling and nonlinear constitutive models are also provided, as are more experimental technologies like reduced order modelling. A consistent description of the underlying solution algorithm, its implementation with a focus on GPU execution, and examples of the toolkit’s usage in biomedical applications are provided.ResultsEfficient mapping of the TLED algorithm to parallel hardware results in very high computational performance, far exceeding that available in commercial packages.ConclusionThe NiftySim toolkit provides high-performance soft tissue simulation capabilities using GPU technology for biomechanical simulation research applications in medical image computing, surgical simulation, and surgical guidance applications.

The effect of motion correction on pharmacokinetic parameter estimation in dynamic-contrast-enhanced MRI

Determining corresponding regions between an MRI and an X-ray mammogram is a clinically useful task that is challenging for radiologists due to the large deformation that the breast undergoes between the two image acquisitions. In this work we propose an intensity-based image registration framework, where the biomechanical transformation model parameters and the rigid-body transformation parameters are optimised simultaneously. Patient-specific biomechanical modelling of the breast derived from diagnostic, prone MRI has been previously used for this task. However, the high computational time associated with breast compression simulation using commercial packages, did not allow the optimisation of both pose and FEM parameters in the same framework. We use a fast explicit Finite Element (FE) solver that runs on a graphics card, enabling the FEM-based transformation model to be fully integrated into the optimisation scheme. The transformation model has seven degrees of freedom, which include parameters for both the initial rigid-body pose of the breast prior to mammographic compression, and those of the biomechanical model. The framework was tested on ten clinical cases and the results were compared against an affine transformation model, previously proposed for the same task. The mean registration error was 11.6±3.8mm for the CC and 11±5.4mm for the MLO view registrations, indicating that this could be a useful clinical tool.

Biomechanically guided prone-to-supine image registration of breast MRI using an estimated reference state

In breast conserving surgery clinicians may benefit from information from preoperative images (e.g. high quality dynamic contrast enhanced magnetic resonant image obtained in the prone position), by registering them to the supine patient on the operating table in the theatre. Due to large deformation involved between prone and supine, either non-rigid intensity-based mage registration methods or biomechanical model based methods alone have limited success. In this paper, we proposed a hybrid finite element method (FEM) based image registration method by combining patient-specific biomechanical models with nonrigid intensity-based image registration methods. FEM-based biomechanical models were used to estimate the major deformation of breasts while non-rigid intensity based image registration methods were used to recover the difference between experimental acquisitions and FE predictions due to the simplifications and approximations of biomechanical models. The proposed method shows a good performance for image registration, demonstrated by the experimental example of prone and supine MR breast image registration.

X-ray mammography – MRI registration using a volume-preserving affine transformation and an EM-MRF for breast tissue classification

Breast radiology encompasses the full range of imaging modalities from routine imaging via x-ray mammography, magnetic resonance imaging and ultrasound (both two- and three-dimensional), to more recent technologies such as digital breast tomosynthesis, and dedicated breast imaging systems for positron emission mammography and ultrasound tomography. In addition new and experimental modalities, such as Photoacoustics, Near Infrared Spectroscopy and Electrical Impedance Tomography etc, are emerging. The breast is a highly deformable structure however, and this greatly complicates visual comparison of imaging modalities for the purposes of breast screening, cancer diagnosis (including image guided biopsy), tumour staging, treatment monitoring, surgical planning and simulation of the effects of surgery and wound healing etc. Due primarily to the challenges posed by these gross, non-rigid deformations, development of automated methods which enable registration, and hence fusion, of information within and across breast imaging modalities, and between the images and the physical space of the breast during interventions, remains an active research field which has yet to translate suitable methods into clinical practice. This review describes current research in the field of breast biomechanical modelling and identifies relevant publications where the resulting models have been incorporated into breast image registration and simulation algorithms. Despite these developments there remain a number of issues that limit clinical application of biomechanical modelling. These include the accuracy of constitutive modelling, implementation of representative boundary conditions, failure to meet clinically acceptable levels of computational cost, challenges associated with automating patient-specific model generation (i.e. robust image segmentation and mesh generation) and the complexity of applying biomechanical modelling methods in routine clinical practice.

Intensity-based MRI to x-ray mammography registration with an integrated fast biomechanical transformation

X-ray mammography is routinely used in national screening programmes and as a clinical diagnostic tool. Magnetic Resonance Imaging (MRI) is commonly used as a complementary modality, providing functional information about the breast and a 3D image that can overcome ambiguities caused by the superimposition of fibro-glandular structures associated with X-ray imaging. Relating findings between these modalities is a challenging task however, due to the different imaging processes involved and the large deformation that the breast undergoes. In this work we present a registration method to determine spatial correspondence between pairs of MR and X-ray images of the breast, that is targeted for clinical use. We propose a generic registration framework which incorporates a volume-preserving affine transformation model and validate its performance using routinely acquired clinical data. Experiments on simulated mammograms from 8 volunteers produced a mean registration error of 3.8±1.6mm for a mean of 12 manually identified landmarks per volume. When validated using 57 lesions identified on routine clinical CC and MLO mammograms (n=113 registration tasks) from 49 subjects the median registration error was 13.1mm. When applied to the registration of an MR image to CC and MLO mammograms of a patient with a localisation clip, the mean error was 8.9mm. The results indicate that an intensity based registration algorithm, using a relatively simple transformation model, can provide radiologists with a clinically useful tool for breast cancer diagnosis.