Gemma Piella

A new quality metric for image fusion

We present three variants of a new quality metric for image fusion. The interest of our metrics, which are based on an image quality index recently introduced by Wang and Bovik in [Z. Wang et al., March 2002], lies in the fact that they do not require a ground-truth or reference image. We perform several simulations which show that our metrics are compliant with subjective evaluations and can therefore be used to compare different image fusion methods or to find the best parameters for a given fusion algorithm.

Temporal diffeomorphic free-form deformation: Application to motion and strain estimation from 3D echocardiography

This paper presents a new registration algorithm, called Temporal Diffeomorphic Free Form Deformation (TDFFD), and its application to motion and strain quantification from a sequence of 3D ultrasound (US) images. The originality of our approach resides in enforcing time consistency by representing the 4D velocity field as the sum of continuous spatiotemporal B-Spline kernels. The spatiotemporal displacement field is then recovered through forward Eulerian integration of the non-stationary velocity field. The strain tensor is computed locally using the spatial derivatives of the reconstructed displacement field. The energy functional considered in this paper weighs two terms: the image similarity and a regularization term. The image similarity metric is the sum of squared differences between the intensities of each frame and a reference one. Any frame in the sequence can be chosen as reference. The regularization term is based on the incompressibility of myocardial tissue. TDFFD was compared to pairwise 3D FFD and 3D+t FFD, both on displacement and velocity fields, on a set of synthetic 3D US images with different noise levels. TDFFD showed increased robustness to noise compared to these two state-of-the-art algorithms. TDFFD also proved to be more resistant to a reduced temporal resolution when decimating this synthetic sequence. Finally, this synthetic dataset was used to determine optimal settings of the TDFFD algorithm. Subsequently, TDFFD was applied to a database of cardiac 3D US images of the left ventricle acquired from 9 healthy volunteers and 13 patients treated by Cardiac Resynchronization Therapy (CRT). On healthy cases, uniform strain patterns were observed over all myocardial segments, as physiologically expected. On all CRT patients, the improvement in synchrony of regional longitudinal strain correlated with CRT clinical outcome as quantified by the reduction of end-systolic left ventricular volume at follow-up (6 and 12months), showing the potential of the proposed algorithm for the assessment of CRT.

Image Fusion for Enhanced Visualization: A Variational Approach

We present a variational model to perform the fusion of an arbitrary number of images while preserving the salient information and enhancing the contrast for visualization. We propose to use the structure tensor to simultaneously describe the geometry of all the inputs. The basic idea is that the fused image should have a structure tensor which approximates the structure tensor obtained from the multiple inputs. At the same time, the fused image should appear ‘natural’ and ‘sharp’ to a human interpreter. We therefore propose to combine the geometry merging of the inputs with perceptual enhancement and intensity correction. This is performed through a minimization functional approach which implicitly takes into account a set of human vision characteristics.

A spatiotemporal statistical atlas of motion for the quantification of abnormal myocardial tissue velocities

In this paper, we present a new method for the automatic comparison of myocardial motion patterns and the characterization of their degree of abnormality, based on a statistical atlas of motion built from a reference healthy population. Our main contribution is the computation of atlas-based indexes that quantify the abnormality in the motion of a given subject against a reference population, at every location in time and space. The critical computational cost inherent to the construction of an atlas is highly reduced by the definition of myocardial velocities under a small displacements hypothesis. The indexes we propose are of notable interest for the assessment of anomalies in cardiac mobility and synchronicity when applied, for instance, to candidate selection for cardiac resynchronization therapy (CRT). We built an atlas of normality using 2D ultrasound cardiac sequences from 21 healthy volunteers, to which we compared 14 CRT candidates with left ventricular dyssynchrony (LVDYS). We illustrate the potential of our approach in characterizing septal flash, a specific motion pattern related to LVDYS and recently introduced as a very good predictor of response to CRT.

Adaptive update lifting with a decision rule based on derivative filters

This letter treats a class of adaptive update-lifting schemes that do not require bookkeeping for perfect reconstruction. The choice of the update-lifting filter is triggered by a binary threshold criterion based on a generalized gradient that is chosen in such a way that it only smooths homogeneous regions. This criterion can be chosen so that it ignores portions of a signal that are polynomial up to a given order. The update-lifting filter modifies the signal in these polynomial regions but leaves other portions unaffected.

3D Strain Assessment in Ultrasound (Straus): A Synthetic Comparison of Five Tracking Methodologies

This paper evaluates five 3D ultrasound tracking algorithms regarding their ability to quantify abnormal deformation in timing or amplitude. A synthetic database of B-mode image sequences modeling healthy, ischemic and dyssynchrony cases was generated for that purpose. This database is made publicly available to the community. It combines recent advances in electromechanical and ultrasound modeling. For modeling heart mechanics, the Bestel-Clement-Sorine electromechanical model was applied to a realistic geometry. For ultrasound modeling, we applied a fast simulation technique to produce realistic images on a set of scatterers moving according to the electromechanical simulation result. Tracking and strain accuracies were computed and compared for all evaluated algorithms. For tracking, all methods were estimating myocardial displacements with an error below 1 mm on the ischemic sequences. The introduction of a dilated geometry was found to have a significant impact on accuracy. Regarding strain, all methods were able to recover timing differences between segments, as well as low strain values. On all cases, radial strain was found to have a low accuracy in comparison to longitudinal and circumferential components.

Constrained manifold learning for the characterization of pathological deviations from normality

This paper describes a technique to (1) learn the representation of a pathological motion pattern from a given population, and (2) compare individuals to this population. Our hypothesis is that this pattern can be modeled as a deviation from normal motion by means of non-linear embedding techniques. Each subject is represented by a 2D map of local motion abnormalities, obtained from a statistical atlas of myocardial motion built from a healthy population. The algorithm estimates a manifold from a set of patients with varying degrees of the same disease, and compares individuals to the training population using a mapping to the manifold and a distance to normality along the manifold. The approach extends recent manifold learning techniques by constraining the manifold to pass by a physiologically meaningful origin representing a normal motion pattern. Interpolation techniques using locally adjustable kernel improve the accuracy of the method. The technique is applied in the context of cardiac resynchronization therapy (CRT), focusing on a specific motion pattern of intra-ventricular dyssynchrony called septal flash (SF). We estimate the manifold from 50 CRT candidates with SF and test it on 37 CRT candidates and 21 healthy volunteers. Experiments highlight the relevance of non-linear techniques to model a pathological pattern from the training set and compare new individuals to this pattern.

Temporal diffeomorphic free-form deformation for strain quantification in 3D-US images

This paper presents a new diffeomorphic temporal registration algorithm and its application to motion and strain quantification from a temporal sequence of 3D images. The displacement field is computed by forward eulerian integration of a non-stationary velocity field. The originality of our approach resides in enforcing time consistency by representing the velocity field as a sum of continuous spatiotemporal B-Spline kernels. The accuracy of the developed diffeomorphic technique was first compared to a simple pairwise strategy on synthetic US images with known ground truth motion and with several noise levels, being the proposed algorithm more robust to noise than the pairwise case. Our algorithm was then applied to a database of cardiac 3D+t Ultrasound (US) images of the left ventricle acquired from eight healthy volunteers and three Cardiac Resynchronization Therapy (CRT) patients. On healthy cases, the measured regional strain curves provided uniform strain patterns over all myocardial segments in accordance with clinical literature. On CRT patients, the obtained normalization of the strain pattern after CRT agreed with clinical outcome for the three cases.

Temporal diffeomorphic free form deformation (TDFFD) applied to motion and deformation quantification of tagged MRI sequences

This paper presents strain quantification results obtained from the Tagged Magnetic Resonance Imaging (TMRI) sequences acquired for the 1st cardiac Motion Analysis Challenge (cMAC). We applied the Temporal Diffeomorphic Free Form Deformation (TDFFD) algorithm to the phantom and the 15 healthy volunteers of the cMAC database. The TDFFD was modified in two ways. First, we modified the similarity metric to incorporate frame to frame intensity differences. Second, on volunteer sequences, we performed the tracking backward in time since the first frames did not show the contrast between blood and myocardium, making these frames poor choices of reference. On the phantom, we propagated a grid adjusted to tag lines to all frames for visually assessing the influence of the different algorithmic parameters. The weight between the two metric terms appeared to be a critical parameter for making a compromise between good tag tracking while preventing drifts and avoiding tag jumps. For each volunteer, a volumetric mesh was defined in the Steady-State Free Precession (SSFP) image, at the closest cardiac time from the last frame of the tagging sequence. Uniform strain patterns were observed over all myocardial segments, as physiologically expected.

Multiview diffeomorphic registration: Application to motion and strain estimation from 3D echocardiography

This paper presents a new registration framework for quantifying myocardial motion and strain from the combination of multiple 3D ultrasound (US) sequences. The originality of our approach lies in the estimation of the transformation directly from the input multiple views rather than from a single view or a reconstructed compounded sequence. This allows us to exploit all spatiotemporal information available in the input views avoiding occlusions and image fusion errors that could lead to some inconsistencies in the motion quantification result. We propose a multiview diffeomorphic registration strategy that enforces smoothness and consistency in the spatiotemporal domain by modeling the 4D velocity field continuously in space and time. This 4D continuous representation considers 3D US sequences as a whole, therefore allowing to robustly cope with variations in heart rate resulting in different number of images acquired per cardiac cycle for different views. This contributes to the robustness gained by solving for a single transformation from all input sequences. The similarity metric takes into account the physics of US images and uses a weighting scheme to balance the contribution of the different views. It includes a comparison both between consecutive images and between a reference and each of the following images. The strain tensor is computed locally using the spatial derivatives of the reconstructed displacement fields. Registration and strain accuracy were evaluated on synthetic 3D US sequences with known ground truth. Experiments were also conducted on multiview 3D datasets of 8 volunteers and 1 patient treated by cardiac resynchronization therapy. Strain curves obtained from our multiview approach were compared to the single-view case, as well as with other multiview approaches. For healthy cases, the inclusion of several views improved the consistency of the strain curves and reduced the number of segments where a non-physiological strain pattern was observed. For the patient, the improvement (pacing ON vs. OFF) in synchrony of regional strain correlated with clinician blind assessment and could be seen more clearly when using the multiview approach.