Cornel Zachiu

An improved optical flow tracking technique for real-time MR-guided beam therapies in moving organs.

Magnetic resonance (MR) guided high intensity focused ultrasound and external beam radiotherapy interventions, which we shall refer to as beam therapies/interventions, are promising techniques for the non-invasive ablation of tumours in abdominal organs. However, therapeutic energy delivery in these areas becomes challenging due to the continuous displacement of the organs with respiration. Previous studies have addressed this problem by coupling high-framerate MR-imaging with a tracking technique based on the algorithm proposed by Horn and Schunck (H and S), which was chosen due to its fast convergence rate and highly parallelisable numerical scheme. Such characteristics were shown to be indispensable for the real-time guidance of beam therapies. In its original form, however, the algorithm is sensitive to local grey-level intensity variations not attributed to motion such as those that occur, for example, in the proximity of pulsating arteries.In this study, an improved motion estimation strategy which reduces the impact of such effects is proposed. Displacements are estimated through the minimisation of a variation of the H and S functional for which the quadratic data fidelity term was replaced with a term based on the linear L(1)norm, resulting in what we have called an L(2)-L(1) functional.The proposed method was tested in the livers and kidneys of two healthy volunteers under free-breathing conditions, on a data set comprising 3000 images equally divided between the volunteers. The results show that, compared to the existing approaches, our method demonstrates a greater robustness to local grey-level intensity variations introduced by arterial pulsations. Additionally, the computational time required by our implementation make it compatible with the work-flow of real-time MR-guided beam interventions.To the best of our knowledge this study was the first to analyse the behaviour of an L(1)-based optical flow functional in an applicative context: real-time MR-guidance of beam therapies in moving organs.

A framework for the correction of slow physiological drifts during MR-guided HIFU therapies: Proof of concept

PURPOSEnWhile respiratory motion compensation for magnetic resonance (MR)-guided high intensity focused ultrasound (HIFU) interventions has been extensively studied, the influence of slow physiological motion due to, for example, peristaltic activity, has so far been largely neglected. During lengthy interventions, the magnitude of the latter can exceed acceptable therapeutic margins. The goal of the present study is to exploit the episodic workflow of these therapies to implement a motion correction strategy for slow varying drifts of the target area and organs at risk over the entire duration of the intervention.nnnMETHODSnThe therapeutic workflow of a MR-guided HIFU intervention is in practice often episodic: Bursts of energy delivery are interleaved with periods of inactivity, allowing the effects of the beam on healthy tissues to recede and/or during which the plan of the intervention is reoptimized. These periods usually last for at least several minutes. It is at this time scale that organ drifts due to slow physiological motion become significant. In order to capture these drifts, the authors propose the integration of 3D MR scans in the therapy workflow during the inactivity intervals. Displacements were estimated using an optical flow algorithm applied on the 3D acquired images. A preliminary study was conducted on ten healthy volunteers. For each volunteer, 3D MR images of the abdomen were acquired at regular intervals of 10 min over a total duration of 80 min. Motion analysis was restricted to the liver and kidneys. For validating the compatibility of the proposed motion correction strategy with the workflow of a MR-guided HIFU therapy, an in vivo experiment on a porcine liver was conducted. A volumetric HIFU ablation was completed over a time span of 2 h. A 3D image was acquired before the first sonication, as well as after each sonication.nnnRESULTSnFollowing the volunteer study, drifts larger than 8 mm for the liver and 5 mm for the kidneys prove that slow physiological motion can exceed acceptable therapeutic margins. In the animal experiment, motion tracking revealed an initial shift of up to 4 mm during the first 10 min and a subsequent continuous shift of ∼2 mm/h until the end of the intervention. This leads to a continuously increasing mismatch of the initial shot planning, the thermal dose measurements, and the true underlying anatomy. The estimated displacements allowed correcting the planned sonication cell cluster positions to the true target position, as well as the thermal dose estimates during the entire intervention and to correct the nonperfused volume measurement. A spatial coherence of all three is particularly important to assure a confluent ablation volume and to prevent remaining islets of viable malignant tissue.nnnCONCLUSIONSnThis study proposes a motion correction strategy for displacements resulting from slowly varying physiological motion that might occur during a MR-guided HIFU intervention. The authors have shown that such drifts can lead to a misalignment between interventional planning, energy delivery, and therapeutic validation. The presented volunteer study and in vivo experiment demonstrate both the relevance of the problem for HIFU therapies and the compatibility of the proposed motion compensation framework with the workflow of a HIFU intervention under clinical conditions.

EVolution: an Edge-based Variational method for non-rigid multi-modal image registration

Image registration is part of a large variety of medical applications including diagnosis, monitoring disease progression and/or treatment effectiveness and, more recently, therapy guidance. Such applications usually involve several imaging modalities such as ultrasound, computed tomography, positron emission tomography, x-ray or magnetic resonance imaging, either separately or combined. In the current work, we propose a non-rigid multi-modal registration method (namely EVolution: an edge-based variational method for non-rigid multi-modal image registration) that aims at maximizing edge alignment between the images being registered. The proposed algorithm requires only contrasts between physiological tissues, preferably present in both image modalities, and assumes deformable/elastic tissues. Given both is shown to be well suitable for non-rigid co-registration across different image types/contrasts (T1/T2) as well as different modalities (CT/MRI). This is achieved using a variational scheme that provides a fast algorithm with a low number of control parameters. Results obtained on an annotated CT data set were comparable to the ones provided by state-of-the-art multi-modal image registration algorithms, for all tested experimental conditions (image pre-filtering, image intensity variation, noise perturbation). Moreover, we demonstrate that, compared to existing approaches, our method possesses increased robustness to transient structures (i.e. that are only present in some of the images).

Anatomically plausible models and quality assurance criteria for online mono- and multi-modal medical image registration

Medical imaging is currently employed in the diagnosis, planning, delivery and response monitoring of cancer treatments. Due to physiological motion and/or treatment response, the shape and location of the pathology and organs-at-risk may change over time. Establishing their location within the acquired images is therefore paramount for an accurate treatment delivery and monitoring. A feasible solution for tracking anatomical changes during an image-guided cancer treatment is provided by image registration algorithms. Such methods are, however, often built upon elements originating from the computer vision/graphics domain. Since the original design of such elements did not take into consideration the material properties of particular biological tissues, the anatomical plausibility of the estimated deformations may not be guaranteed. In the current work we adapt two existing variational registration algorithms, namely Horn-Schunck and EVolution, to online soft tissue tracking. This is achieved by enforcing an incompressibility constraint on the estimated deformations during the registration process. The existing and the modified registration methods were comparatively tested against several quality assurance criteria on abdominal in vivo MR and CT data. These criteria included: the Dice similarity coefficient (DSC), the Jaccard index, the target registration error (TRE) and three additional criteria evaluating the anatomical plausibility of the estimated deformations. Results demonstrated that both the original and the modified registration methods have similar registration capabilities in high-contrast areas, with DSC and Jaccard index values predominantly in the 0.8-0.9 range and an average TRE of 1.6-2.0u2009mm. In contrast-devoid regions of the liver and kidneys, however, the three additional quality assurance criteria have indicated a considerable improvement of the anatomical plausibility of the deformations estimated by the incompressibility-constrained methods. Moreover, the proposed registration models maintain the potential of the original methods for online image-based guidance of cancer treatments.

Accelerating multi-modal image registration using a supervoxel-based variational framework

For the successful completion of medical interventional procedures, several concepts, such as daily positioning compensation, dose accumulation or delineation propagation, rely on establishing a spatial coherence between planning images and images acquired at different time instants over the course of the therapy. To meet this need, image-based motion estimation and compensation relies on fast, automatic, accurate and precise registration algorithms. However, image registration quickly becomes a challenging and computationally intensive task, especially when multiple imaging modalities are involved. In the current study, a novel framework is introduced to reduce the computational overhead of variational registration methods. The proposed framework selects representative voxels of the registration process, based on a supervoxel algorithm. Costly calculations are hereby restrained to a subset of voxels, leading to a less expensive spatial regularized interpolation process. The novel framework is tested in conjunction with the recently proposed EVolution multi-modal registration method. This results in an algorithm requiring a low number of input parameters, is easily parallelizable and provides an elastic voxel-wise deformation with a subvoxel accuracy. The performance of the proposed accelerated registration method is evaluated on cross-contrast abdominal T1/T2 MR-scans undergoing a known deformation and annotated CT-images of the lung. We also analyze the ability of the method to capture slow physiological drifts during MR-guided high intensity focused ultrasound therapies and to perform multi-modal CT/MR registration in the abdomen. Results have shown that computation time can be reduced by 75% on the same hardware with no negative impact on the accuracy.

Non-rigid CT/CBCT to CBCT registration for online external beam radiotherapy guidance

Image-guided external beam radiotherapy (EBRT) allows radiation dose deposition with a high degree of accuracy and precision. Guidance is usually achieved by estimating the displacements, via image registration, between cone beam computed tomography (CBCT) and computed tomography (CT) images acquired at different stages of the therapy. The resulting displacements are then used to reposition the patient such that the location of the tumor at the time of treatment matches its position during planning. Moreover, ongoing research aims to use CBCT-CT image registration for online plan adaptation. However, CBCT images are usually acquired using a small number of x-ray projections and/or low beam intensities. This often leads to the images being subject to low contrast, low signal-to-noise ratio and artifacts, which ends-up hampering the image registration process. Previous studies addressed this by integrating additional image processing steps into the registration procedure. However, these steps are usually designed for particular image acquisition schemes, therefore limiting their use on a case-by-case basis. In the current study we address CT to CBCT and CBCT to CBCT registration by the means of the recently proposed EVolution registration algorithm. Contrary to previous approaches, EVolution does not require the integration of additional image processing steps in the registration scheme. Moreover, the algorithm requires a low number of input parameters, is easily parallelizable and provides an elastic deformation on a point-by-point basis. Results have shown that relative to a pure CT-based registration, the intrinsic artifacts present in typical CBCT images only have a sub-millimeter impact on the accuracy and precision of the estimated deformation. In addition, the algorithm has low computational requirements, which are compatible with online image-based guidance of EBRT treatments.

Real-time non-rigid target tracking for ultrasound-guided clinical interventions

Biological motion is a problem for non- or mini-invasive interventions when conducted in mobile/deformable organs due to the targeted pathology moving/deforming with the organ. This may lead to high miss rates and/or incomplete treatment of the pathology. Therefore, real-time tracking of the target anatomy during the intervention would be beneficial for such applications. Since the aforementioned interventions are often conducted under B-mode ultrasound (US) guidance, target tracking can be achieved via image registration, by comparing the acquired US images to a separate image established as positional reference. However, such US images are intrinsically altered by speckle noise, introducing incoherent gray-level intensity variations. This may prove problematic for existing intensity-based registration methods. In the current study we address US-based target tracking by employing the recently proposed EVolution registration algorithm. The method is, by construction, robust to transient gray-level intensities. Instead of directly matching image intensities, EVolution aligns similar contrast patterns in the images. Moreover, the displacement is computed by evaluating a matching criterion for image sub-regions rather than on a point-by-point basis, which typically provides more robust motion estimates. However, unlike similar previously published approaches, which assume rigid displacements in the image sub-regions, the EVolution algorithm integrates the matching criterion in a global functional, allowing the estimation of an elastic dense deformation. The approach was validated for soft tissue tracking under free-breathing conditions on the abdomen of seven healthy volunteers. Contact echography was performed on all volunteers, while three of the volunteers also underwent standoff echography. Each of the two modalities is predominantly specific to a particular type of non- or mini-invasive clinical intervention. The method demonstrated on average an accuracy ofu2009u2009∼1.5u2009mm and submillimeter precision. This, together with a computational performance of 20 images per second make the proposed method an attractive solution for real-time target tracking during US-guided clinical interventions.

A framework for continuous target tracking during MR-guided high intensity focused ultrasound thermal ablations in the abdomen

BackgroundDuring lengthy magnetic resonance-guided high intensity focused ultrasound (MRg-HIFU) thermal ablations in abdominal organs, the therapeutic work-flow is frequently hampered by various types of physiological motion occurring at different time-scales. If left un-addressed this can lead to an incomplete therapy and/or to tissue damage of organs-at-risk. While previous studies focus on correction schemes for displacements occurring at a particular time-scale within the work-flow of an MRg-HIFU therapy, in the current work we propose a motion correction strategy encompassing the entire work-flow.MethodsThe proposed motion compensation framework consists of several linked components, each being adapted to motion occurring at a particular time-scale. While respiration was addressed through a fast correction scheme, long term organ drifts were compensated using a strategy operating on time-scales of several minutes. The framework relies on a periodic examination of the treated area via MR scans which are then registered to a reference scan acquired at the beginning of the therapy. The resulting displacements were used for both on-the-fly re-optimization of the interventional plan and to ensure the spatial fidelity between the different steps of the therapeutic work-flow. The approach was validated in three complementary studies: an experiment conducted on a phantom undergoing a known motion pattern, a study performed on the abdomen of 10 healthy volunteers and during 3 in-vivo MRg-HIFU ablations on porcine liver.ResultsResults have shown that, during lengthy MRg-HIFU thermal therapies, the human liver and kidney can manifest displacements that exceed acceptable therapeutic margins. Also, it was demonstrated that the proposed framework is capable of providing motion estimates with sub-voxel precision and accuracy. Finally, the 3 successful animal studies demonstrate the compatibility of the proposed approach with the work-flow of an MRg-HIFU intervention under clinical conditions.ConclusionsIn the current study we proposed an image-based motion compensation framework dedicated to MRg-HIFU thermal ablations in the abdomen, providing the possibility to re-optimize the therapy plan on-the-fly with the patient on the interventional table. Moreover, we have demonstrated that even under clinical conditions, the proposed approach is fully capable of continuously ensuring the spatial fidelity between the different phases of the therapeutic work-flow.

An Adaptive Non-Local-Means Filter for Real-Time MR-Thermometry

Proton resonance frequency shift-based magnetic resonance thermometry is a currently used technique for monitoring temperature during targeted thermal therapies. However, in order to provide temperature updates with very short latency times, fast MR acquisition schemes are usually employed, which in turn might lead to noisy temperature measurements. This will, in general, have a direct impact on therapy control and endpoint detection. In this paper, we address this problem through an improved non-local filtering technique applied on the temperature images. Compared with previous non-local filtering methods, the proposed approach considers not only spatial information but also exploits temporal redundancies. The method is fully automatic and designed to improve the precision of the temperature measurements while at the same time maintaining output accuracy. In addition, the implementation was optimized in order to ensure real-time availability of the temperature measurements while having a minimal impact on latency. The method was validated in three complementary experiments: a simulation, an ex-vivo and an in-vivo study. Compared to the original non-local means filter and two other previously employed temperature filtering methods, the proposed approach shows considerable improvement in both accuracy and precision of the filtered data. Together with the low computational demands of the numerical scheme, the proposed filtering technique shows great potential for improving temperature measurements during real-time MR thermometry dedicated to targeted thermal therapies.

A framework for slow physiological motion compensation during HIFU interventions in the liver: proof of concept

While respiratory motion compensation for HIFU interventions for liver cancer therapy has been extensively studied, the influence of slow physiological motion, such as peristalsis, has so far been largely neglected. During the lengthy intervention, the magnitude of the latter can exceed acceptable therapeutic margins and lead to a substantial mismatch between planned ablation volume, thermal dose estimates and the measured non-perfused volume (NPV). Given the episodic nature of a HIFU intervention, this study proposes the integration of a 3D motion compensation procedure based on MR-images for slow physiological motion and validates the approach on in vivo ablations on a porcine liver.