Andriy Fedorov

3D Slicer as an image computing platform for the Quantitative Imaging Network

Quantitative analysis has tremendous but mostly unrealized potential in healthcare to support objective and accurate interpretation of the clinical imaging. In 2008, the National Cancer Institute began building the Quantitative Imaging Network (QIN) initiative with the goal of advancing quantitative imaging in the context of personalized therapy and evaluation of treatment response. Computerized analysis is an important component contributing to reproducibility and efficiency of the quantitative imaging techniques. The success of quantitative imaging is contingent on robust analysis methods and software tools to bring these methods from bench to bedside. 3D Slicer is a free open-source software application for medical image computing. As a clinical research tool, 3D Slicer is similar to a radiology workstation that supports versatile visualizations but also provides advanced functionality such as automated segmentation and registration for a variety of application domains. Unlike a typical radiology workstation, 3D Slicer is free and is not tied to specific hardware. As a programming platform, 3D Slicer facilitates translation and evaluation of the new quantitative methods by allowing the biomedical researcher to focus on the implementation of the algorithm and providing abstractions for the common tasks of data communication, visualization and user interface development. Compared to other tools that provide aspects of this functionality, 3D Slicer is fully open source and can be readily extended and redistributed. In addition, 3D Slicer is designed to facilitate the development of new functionality in the form of 3D Slicer extensions. In this paper, we present an overview of 3D Slicer as a platform for prototyping, development and evaluation of image analysis tools for clinical research applications. To illustrate the utility of the platform in the scope of QIN, we discuss several use cases of 3D Slicer by the existing QIN teams, and we elaborate on the future directions that can further facilitate development and validation of imaging biomarkers using 3D Slicer.

Non-rigid alignment of pre-operative MRI, fMRI, and DT-MRI with intra-operative MRI for enhanced visualization and navigation in image-guided neurosurgery.

OBJECTIVE The usefulness of neurosurgical navigation with current visualizations is seriously compromised by brain shift, which inevitably occurs during the course of the operation, significantly degrading the precise alignment between the pre-operative MR data and the intra-operative shape of the brain. Our objectives were (i) to evaluate the feasibility of non-rigid registration that compensates for the brain deformations within the time constraints imposed by neurosurgery, and (ii) to create augmented reality visualizations of critical structural and functional brain regions during neurosurgery using pre-operatively acquired fMRI and DT-MRI. MATERIALS AND METHODS Eleven consecutive patients with supratentorial gliomas were included in our study. All underwent surgery at our intra-operative MR imaging-guided therapy facility and have tumors in eloquent brain areas (e.g. precentral gyrus and cortico-spinal tract). Functional MRI and DT-MRI, together with MPRAGE and T2w structural MRI were acquired at 3 T prior to surgery. SPGR and T2w images were acquired with a 0.5 T magnet during each procedure. Quantitative assessment of the alignment accuracy was carried out and compared with current state-of-the-art systems based only on rigid registration. RESULTS Alignment between pre-operative and intra-operative datasets was successfully carried out during surgery for all patients. Overall, the mean residual displacement remaining after non-rigid registration was 1.82 mm. There is a statistically significant improvement in alignment accuracy utilizing our non-rigid registration in comparison to the currently used technology (p<0.001). CONCLUSIONS We were able to achieve intra-operative rigid and non-rigid registration of (1) pre-operative structural MRI with intra-operative T1w MRI; (2) pre-operative fMRI with intra-operative T1w MRI, and (3) pre-operative DT-MRI with intra-operative T1w MRI. The registration algorithms as implemented were sufficiently robust and rapid to meet the hard real-time constraints of intra-operative surgical decision making. The validation experiments demonstrate that we can accurately compensate for the deformation of the brain and thus can construct an augmented reality visualization to aid the surgeon.

Multiparametric MRI of prostate cancer: An update on state‐of‐the‐art techniques and their performance in detecting and localizing prostate cancer

Magnetic resonance (MR) examinations of men with prostate cancer are most commonly performed for detecting, characterizing, and staging the extent of disease to best determine diagnostic or treatment strategies, which range from biopsy guidance to active surveillance to radical prostatectomy. Given both the exams importance to individual treatment plans and the time constraints present for its operation at most institutions, it is essential to perform the study effectively and efficiently. This article reviews the most commonly employed modern techniques for prostate cancer MR examinations, exploring the relevant signal characteristics from the different methods discussed and relating them to intrinsic prostate tissue properties. Also, a review of recent articles using these methods to enhance clinical interpretation and assess clinical performance is provided. J. Magn. Reson. Imaging 2013;37:1035–1054.

GBM Volumetry using the 3D Slicer Medical Image Computing Platform

Volumetric change in glioblastoma multiforme (GBM) over time is a critical factor in treatment decisions. Typically, the tumor volume is computed on a slice-by-slice basis using MRI scans obtained at regular intervals. (3D)Slicer – a free platform for biomedical research – provides an alternative to this manual slice-by-slice segmentation process, which is significantly faster and requires less user interaction. In this study, 4 physicians segmented GBMs in 10 patients, once using the competitive region-growing based GrowCut segmentation module of Slicer, and once purely by drawing boundaries completely manually on a slice-by-slice basis. Furthermore, we provide a variability analysis for three physicians for 12 GBMs. The time required for GrowCut segmentation was on an average 61% of the time required for a pure manual segmentation. A comparison of Slicer-based segmentation with manual slice-by-slice segmentation resulted in a Dice Similarity Coefficient of 88.43 ± 5.23% and a Hausdorff Distance of 2.32 ± 5.23 mm.

Toward real-time image guided neurosurgery using distributed and grid computing

Neurosurgical resection is a therapeutic intervention in the treatment of brain tumors. Precision of the resection can be improved by utilizing magnetic resonance imaging (MRI) as an aid in decision making during image guided neurosurgery (IGNS). Image registration adjusts pre-operative data according to intra-operative tissue deformation. Some of the approaches increase the registration accuracy by tracking image landmarks through the whole brain volume. High computational cost used to render these techniques inappropriate for clinical applications. In this paper we present a parallel implementation of a state of the art registration method, and a number of needed incremental improvements. Overall, we reduced the response time for registration of an average dataset from about an hour and for some cases more than an hour to less than seven minutes, which is within the time constraints imposed by neurosurgeons. For the first time in clinical practice we demonstrated, that with the help of distributed computing non-rigid MRI registration based on volume tracking can be computed intra-operatively

Image registration for targeted MRI-guided transperineal prostate biopsy.

To develop and evaluate image registration methodology for automated re‐identification of tumor‐suspicious foci from preprocedural MR exams during MR‐guided transperineal prostate core biopsy.

Transperineal In-Bore 3-T MR Imaging–guided Prostate Biopsy: A Prospective Clinical Observational Study

PURPOSE To determine the detection rate, clinical relevance, Gleason grade, and location of prostate cancer ( PCa prostate cancer ) diagnosed with and the safety of an in-bore transperineal 3-T magnetic resonance (MR) imaging-guided prostate biopsy in a clinically heterogeneous patient population. MATERIALS AND METHODS This prospective retrospectively analyzed study was HIPAA compliant and institutional review board approved, and informed consent was obtained. Eighty-seven men (mean age, 66.2 years ± 6.9) underwent multiparametric endorectal prostate MR imaging at 3 T and transperineal MR imaging-guided biopsy. Three subgroups of patients with at least one lesion suspicious for cancer were included: men with no prior PCa prostate cancer diagnosis, men with PCa prostate cancer who were undergoing active surveillance, and men with treated PCa prostate cancer and suspected recurrence. Exclusion criteria were prior prostatectomy and/or contraindication to 3-T MR imaging. The transperineal MR imaging-guided biopsy was performed in a 70-cm wide-bore 3-T device. Overall patient biopsy outcomes, cancer detection rates, Gleason grade, and location for each subgroup were evaluated and statistically compared by using χ(2) and one-way analysis of variance followed by Tukey honestly significant difference post hoc comparisons. RESULTS Ninety biopsy procedures were performed with no serious adverse events, with a mean of 3.7 targets sampled per gland. Cancer was detected in 51 (56.7%) men: 48.1% (25 of 52) with no prior PCa prostate cancer , 61.5% (eight of 13) under active surveillance, and 72.0% (18 of 25) in whom recurrence was suspected. Gleason pattern 4 or higher was diagnosed in 78.1% (25 of 32) in the no prior PCa prostate cancer and active surveillance groups. Gleason scores were not assigned in the suspected recurrence group. MR targets located in the anterior prostate had the highest cancer yield (40 of 64, 62.5%) compared with those for the other parts of the prostate (P < .001). CONCLUSION In-bore 3-T transperineal MR imaging-guided biopsy, with a mean of 3.7 targets per gland, allowed detection of many clinically relevant cancers, many of which were located anteriorly.

Computational Radiomics System to Decode the Radiographic Phenotype

Radiomics aims to quantify phenotypic characteristics on medical imaging through the use of automated algorithms. Radiomic artificial intelligence (AI) technology, either based on engineered hard-coded algorithms or deep learning methods, can be used to develop noninvasive imaging-based biomarkers. However, lack of standardized algorithm definitions and image processing severely hampers reproducibility and comparability of results. To address this issue, we developed PyRadiomics, a flexible open-source platform capable of extracting a large panel of engineered features from medical images. PyRadiomics is implemented in Python and can be used standalone or using 3D Slicer. Here, we discuss the workflow and architecture of PyRadiomics and demonstrate its application in characterizing lung lesions. Source code, documentation, and examples are publicly available at www.radiomics.io With this platform, we aim to establish a reference standard for radiomic analyses, provide a tested and maintained resource, and to grow the community of radiomic developers addressing critical needs in cancer research. Cancer Res; 77(21); e104-7. ©2017 AACR.

3T MR-guided in-bore transperineal prostate biopsy: A comparison of robotic and manual needle-guidance templates

To demonstrate the utility of a robotic needle‐guidance template device as compared to a manual template for in‐bore 3T transperineal magnetic resonance imaging (MRI)‐guided prostate biopsy.

A comparison of two methods for estimating DCE-MRI parameters via individual and cohort based AIFs in prostate cancer: A step towards practical implementation☆

Multi-parametric Magnetic Resonance Imaging, and specifically Dynamic Contrast Enhanced (DCE) MRI, play increasingly important roles in detection and staging of prostate cancer (PCa). One of the actively investigated approaches to DCE MRI analysis involves pharmacokinetic (PK) modeling to extract quantitative parameters that may be related to microvascular properties of the tissue. It is well-known that the prescribed arterial blood plasma concentration (or Arterial Input Function, AIF) input can have significant effects on the parameters estimated by PK modeling. The purpose of our study was to investigate such effects in DCE MRI data acquired in a typical clinical PCa setting. First, we investigated how the choice of a semi-automated or fully automated image-based individualized AIF (iAIF) estimation method affects the PK parameter values; and second, we examined the use of method-specific averaged AIF (cohort-based, or cAIF) as a means to attenuate the differences between the two AIF estimation methods. Two methods for automated image-based estimation of individualized (patient-specific) AIFs, one of which was previously validated for brain and the other for breast MRI, were compared. cAIFs were constructed by averaging the iAIF curves over the individual patients for each of the two methods. Pharmacokinetic analysis using the Generalized kinetic model and each of the four AIF choices (iAIF and cAIF for each of the two image-based AIF estimation approaches) was applied to derive the volume transfer rate (K(trans)) and extravascular extracellular volume fraction (ve) in the areas of prostate tumor. Differences between the parameters obtained using iAIF and cAIF for a given method (intra-method comparison) as well as inter-method differences were quantified. The study utilized DCE MRI data collected in 17 patients with histologically confirmed PCa. Comparison at the level of the tumor region of interest (ROI) showed that the two automated methods resulted in significantly different (p<0.05) mean estimates of ve, but not of K(trans). Comparing cAIF, different estimates for both ve, and K(trans) were obtained. Intra-method comparison between the iAIF- and cAIF-driven analyses showed the lack of effect on ve, while K(trans) values were significantly different for one of the methods. Our results indicate that the choice of the algorithm used for automated image-based AIF determination can lead to significant differences in the values of the estimated PK parameters. K(trans) estimates are more sensitive to the choice between cAIF/iAIF as compared to ve, leading to potentially significant differences depending on the AIF method. These observations may have practical consequences in evaluating the PK analysis results obtained in a multi-site setting.