Baiyu Chen

Evaluation of conventional imaging performance in a research whole-body CT system with a photon-counting detector array

This study evaluated the conventional imaging performance of a research whole-body photon-counting CT system and investigated its feasibility for imaging using clinically realistic levels of x-ray photon flux. This research system was built on the platform of a 2nd generation dual-source CT system: one source coupled to an energy integrating detector (EID) and the other coupled to a photon-counting detector (PCD). Phantom studies were conducted to measure CT number accuracy and uniformity for water, CT number energy dependency for high-Z materials, spatial resolution, noise, and contrast-to-noise ratio. The results from the EID and PCD subsystems were compared. The impact of high photon flux, such as pulse pile-up, was assessed by studying the noise-to-tube-current relationship using a neonate water phantom and high x-ray photon flux. Finally, clinical feasibility of the PCD subsystem was investigated using anthropomorphic phantoms, a cadaveric head, and a whole-body cadaver, which were scanned at dose levels equivalent to or higher than those used clinically. Phantom measurements demonstrated that the PCD subsystem provided comparable image quality to the EID subsystem, except that the PCD subsystem provided slightly better longitudinal spatial resolution and about 25% improvement in contrast-to-noise ratio for iodine. The impact of high photon flux was found to be negligible for the PCD subsystem: only subtle high-flux effects were noticed for tube currents higher than 300 mA in images of the neonate water phantom. Results of the anthropomorphic phantom and cadaver scans demonstrated comparable image quality between the EID and PCD subsystems. There were no noticeable ring, streaking, or cupping/capping artifacts in the PCD images. In addition, the PCD subsystem provided spectral information. Our experiments demonstrated that the research whole-body photon-counting CT system is capable of providing clinical image quality at clinically realistic levels of x-ray photon flux.

Initial results from a prototype whole-body photon-counting computed tomography system.

X-ray computed tomography (CT) with energy-discriminating capabilities presents exciting opportunities for increased dose efficiency and improved material decomposition analyses. However, due to constraints imposed by the inability of photon-counting detectors (PCD) to respond accurately at high photon flux, to date there has been no clinical application of PCD-CT. Recently, our lab installed a research prototype system consisting of two x-ray sources and two corresponding detectors, one using an energy-integrating detector (EID) and the other using a PCD. In this work, we report the first third-party evaluation of this prototype CT system using both phantoms and a cadaver head. The phantom studies demonstrated several promising characteristics of the PCD sub-system, including improved longitudinal spatial resolution and reduced beam hardening artifacts, relative to the EID sub-system. More importantly, we found that the PCD sub-system offers excellent pulse pileup control in cases of x-ray flux up to 550 mA at 140 kV, which corresponds to approximately 2.5×1011 photons per cm2 per second. In an anthropomorphic phantom and a cadaver head, the PCD sub-system provided image quality comparable to the EID sub-system for the same dose level. Our results demonstrate the potential of the prototype system to produce clinically-acceptable images in vivo.

Technical note: Development and validation of an open data format for CT projection data

PURPOSE Lack of access to projection data from patient CT scans is a major limitation for development and validation of new reconstruction algorithms. To meet this critical need, this work developed and validated a vendor-neutral format for CT projection data, which will further be employed to build a library of patient projection data for public access. METHODS A digital imaging and communication in medicine (DICOM)-like format was created for CT projection data (CT-PD), named the DICOM-CT-PD format. The format stores attenuation information in the DICOM image data block and stores parameters necessary for reconstruction in the DICOM header under various tags (51 tags to store the geometry and scan parameters and 9 tags to store patient information). To validate the accuracy and completeness of the new format, CT projection data from helical scans of the ACR CT accreditation phantom were acquired from two clinical CT scanners (Somatom Definition Flash, Siemens Healthcare, Forchheim, Germany and Discovery CT750 HD, GE Healthcare, Waukesha, WI). After decoding (by the authors for Siemens, by the manufacturer for GE), the projection data were converted to the DICOM-CT-PD format. Off-line CT reconstructions were performed by internal and external reconstruction researchers using only the information stored in the DICOM-CT-PD files and the DICOM-CT-PD field definitions. RESULTS Compared with the commercially reconstructed CT images, the off-line reconstructed images created using the DICOM-CT-PD format are similar in terms of CT numbers (differences of 5 HU for the bone insert and -9 HU for the air insert), image noise (±1 HU), and low contrast detectability (6 mm rods visible in both). Because of different reconstruction approaches, slightly different in-plane and cross-plane high contrast spatial resolution were obtained compared to those reconstructed on the scanners (axial plane: GE off-line, 7 lp/cm; GE commercial, 7 lp/cm; Siemens off-line, 8 lp/cm; Siemens commercial, 7 lp/cm. Coronal plane: Siemens off-line, 6 lp/cm; Siemens commercial, 8 lp/cm). CONCLUSIONS A vendor-neutral extended DICOM format has been developed that enables open sharing of CT projection data from third-generation CT scanners. Validation of the format showed that the geometric parameters and attenuation information in the DICOM-CT-PD file were correctly stored, could be retrieved with use of the provided instructions, and contained sufficient data for reconstruction of CT images that approximated those from the commercial scanner.

Low-dose CT for the detection and classification of metastatic liver lesions: Results of the 2016 Low Dose CT Grand Challenge

Purpose: Using common datasets, to estimate and compare the diagnostic performance of image‐based denoising techniques or iterative reconstruction algorithms for the task of detecting hepatic metastases. Methods: Datasets from contrast‐enhanced CT scans of the liver were provided to participants in an NIH‐, AAPM‐ and Mayo Clinic‐sponsored Low Dose CT Grand Challenge. Training data included full‐dose and quarter‐dose scans of the ACR CT accreditation phantom and 10 patient examinations; both images and projections were provided in the training data. Projection data were supplied in a vendor‐neutral standardized format (DICOM‐CT‐PD). Twenty quarter‐dose patient datasets were provided to each participant for testing the performance of their technique. Images were provided to sites intending to perform denoising in the image domain. Fully preprocessed projection data and statistical noise maps were provided to sites intending to perform iterative reconstruction. Upon return of the denoised or iteratively reconstructed quarter‐dose images, randomized, blinded evaluation of the cases was performed using a Latin Square study design by 11 senior radiology residents or fellows, who marked the locations of identified hepatic metastases. Markings were scored against reference locations of clinically or pathologically demonstrated metastases to determine a per‐lesion normalized score and a per‐case normalized score (a faculty abdominal radiologist established the reference location using clinical and pathological information). Scores increased for correct detections; scores decreased for missed or incorrect detections. The winner for the competition was the entry that produced the highest total score (mean of the per‐lesion and per‐case normalized score). Reader confidence was used to compute a Jackknife alternative free‐response receiver operating characteristic (JAFROC) figure of merit, which was used for breaking ties. Results: 103 participants from 90 sites and 26 countries registered to participate. Training data were shared with 77 sites that completed the data sharing agreements. Subsequently, 41 sites downloaded the 20 test cases, which included only the 25% dose data (CTDIvol = 3.0 ± 1.8 mGy, SSDE = 3.5 ± 1.3 mGy). 22 sites submitted results for evaluation. One site provided binary images and one site provided images with severe artifacts; cases from these sites were excluded from review and the participants removed from the challenge. The mean (range) per‐lesion and per‐case normalized scores were −24.2% (−75.8%, 3%) and 47% (10%, 70%), respectively. Compared to reader results for commercially reconstructed quarter‐dose images with no noise reduction, 11 of the 20 sites showed a numeric improvement in the mean JAFROC figure of merit. Notably two sites performed comparably to the reader results for full‐dose commercial images. The study was not designed for these comparisons, so wide confidence intervals surrounded these figures of merit and the results should be used only to motivate future testing. Conclusion: Infrastructure and methodology were developed to rapidly estimate observer performance for liver metastasis detection in low‐dose CT examinations of the liver after either image‐based denoising or iterative reconstruction. The results demonstrated large differences in detection and classification performance between noise reduction methods, although the majority of methods provided some improvement in performance relative to the commercial quarter‐dose images with no noise reduction applied.

Evaluation of a projection-domain lung nodule insertion technique in thoracic CT

Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Inserting lesions into existing cases to simulate positive cases is a promising alternative approach. The aim of this study was to evaluate a recently-developed raw-data based lesion insertion technique in thoracic CT. Lung lesions were segmented from patient CT images, forward projected, and reinserted into the same patient CT projection data. In total, 32 nodules of various attenuations were segmented from 21 CT cases. Two experienced radiologists and 2 residents blinded to the process independently evaluated these inserted nodules in two sub-studies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a rating score from 1 to 10 (1=absolutely artificial to 10=absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader, who identified the inserted lesion and provided a confidence score (1=no confidence to 5=completely certain). For the randomized evaluation, discrimination of real versus artificial nodules was poor with areas under the receiver operative characteristic curves being 0.69 (95% CI: 0.58-0.78), 0.57 (95% CI: 0.46-0.68), and 0.62 (95% CI: 0.54-0.69) for the 2 radiologists, 2 residents, and all 4 readers, respectively. For the side-by-side evaluation, although all 4 readers correctly identified inserted lesions in 103/128 pairs, the confidence score was moderate (2.6). Our projection-domain based lung nodule insertion technique provides a robust method to artificially generate clinical cases that prove to be difficult to differentiate from real cases.

Construction of realistic liver phantoms from patient images using 3D printer and its application in CT image quality assessment

The purpose of this study is to use 3D printing techniques to construct a realistic liver phantom with heterogeneous background and anatomic structures from patient CT images, and to use the phantom to assess image quality with filtered back-projection and iterative reconstruction algorithms. Patient CT images were segmented into liver tissues, contrast-enhanced vessels, and liver lesions using commercial software, based on which stereolithography (STL) files were created and sent to a commercial 3D printer. A 3D liver phantom was printed after assigning different printing materials to each object to simulate appropriate attenuation of each segmented object. As high opacity materials are not available for the printer, we printed hollow vessels and filled them with iodine solutions of adjusted concentration to represent enhance levels in contrast-enhanced liver scans. The printed phantom was then placed in a 35×26 cm oblong-shaped water phantom and scanned repeatedly at 4 dose levels. Images were reconstructed using standard filtered back-projection and an iterative reconstruction algorithm with 3 different strength settings. Heterogeneous liver background were observed from the CT images and the difference in CT numbers between lesions and background were representative for low contrast lesions in liver CT studies. CT numbers in vessels filled with iodine solutions represented the enhancement of liver arteries and veins. Images were run through a Channelized Hotelling model observer with Garbor channels and ROC analysis was performed. The AUC values showed performance improvement using the iterative reconstruction algorithm and the amount of improvement increased with strength setting.

A virtual clinical trial using projection-based nodule insertion to determine radiologist reader performance in lung cancer screening CT

Task-based image quality assessment using model observers is promising to provide an efficient, quantitative, and objective approach to CT dose optimization. Before this approach can be reliably used in practice, its correlation with radiologist performance for the same clinical task needs to be established. Determining human observer performance for a well-defined clinical task, however, has always been a challenge due to the tremendous amount of efforts needed to collect a large number of positive cases. To overcome this challenge, we developed an accurate projection-based insertion technique. In this study, we present a virtual clinical trial using this tool and a low-dose simulation tool to determine radiologist performance on lung-nodule detection as a function of radiation dose, nodule type, nodule size, and reconstruction methods. The lesion insertion and low-dose simulation tools together were demonstrated to provide flexibility to generate realistically-appearing clinical cases under well-defined conditions. The reader performance data obtained in this virtual clinical trial can be used as the basis to develop model observers for lung nodule detection, as well as for dose and protocol optimization in lung cancer screening CT.

Correlation between a 2D channelized Hotelling observer and human observers in a low‐contrast detection task with multislice reading in CT

Purpose: Model observers have been successfully developed and used to assess the quality of static 2D CT images. However, radiologists typically read images by paging through multiple 2D slices (i.e., multislice reading). The purpose of this study was to correlate human and model observer performance in a low‐contrast detection task performed using both 2D and multislice reading, and to determine if the 2D model observer still correlate well with human observer performance in multislice reading. Methods: A phantom containing 18 low‐contrast spheres (6 sizes × 3 contrast levels) was scanned on a 192‐slice CT scanner at five dose levels (CTDIvol = 27, 13.5, 6.8, 3.4, and 1.7 mGy), each repeated 100 times. Images were reconstructed using both filtered‐backprojection (FBP) and an iterative reconstruction (IR) method (ADMIRE, Siemens). A 3D volume of interest (VOI) around each sphere was extracted and placed side‐by‐side with a signal‐absent VOI to create a 2‐alternative forced choice (2AFC) trial. Sixteen 2AFC studies were generated, each with 100 trials, to evaluate the impact of radiation dose, lesion size and contrast, and reconstruction methods on object detection. In total, 1600 trials were presented to both model and human observers. Three medical physicists acted as human observers and were allowed to page through the 3D volumes to make a decision for each 2AFC trial. The human observer performance was compared with the performance of a multislice channelized Hotelling observer (CHO_MS), which integrates multislice image data, and with the performance of previously validated CHO, which operates on static 2D images (CHO_2D). For comparison, the same 16 2AFC studies were also performed in a 2D viewing mode by the human observers and compared with the multislice viewing performance and the two CHO models. Results: Human observer performance was well correlated with the CHO_2D performance in the 2D viewing mode [Pearson product‐moment correlation coefficient R = 0.972, 95% confidence interval (CI): 0.919 to 0.990] and with the CHO_MS performance in the multislice viewing mode (R = 0.952, 95% CI: 0.865 to 0.984). The CHO_2D performance, calculated from the 2D viewing mode, also had a strong correlation with human observer performance in the multislice viewing mode (R = 0.957, 95% CI: 879 to 0.985). Human observer performance varied between the multislice and 2D modes. One reader performed better in the multislice mode (P = 0.013); whereas the other two readers showed no significant difference between the two viewing modes (P = 0.057 and P = 0.38). Conclusions: A 2D CHO model is highly correlated with human observer performance in detecting spherical low contrast objects in multislice viewing of CT images. This finding provides some evidence for the use of a simpler, 2D CHO to assess image quality in clinically relevant CT tasks where multislice viewing is used.

Predicting detection performance with model observers: Fourier domain or spatial domain?

The use of Fourier domain model observer is challenged by iterative reconstruction (IR), because IR algorithms are nonlinear and IR images have noise texture different from that of FBP. A modified Fourier domain model observer, which incorporates nonlinear noise and resolution properties, has been proposed for IR and needs to be validated with human detection performance. On the other hand, the spatial domain model observer is theoretically applicable to IR, but more computationally intensive than the Fourier domain method. The purpose of this study is to compare the modified Fourier domain model observer to the spatial domain model observer with both FBP and IR images, using human detection performance as the gold standard. A phantom with inserts of various low contrast levels and sizes was repeatedly scanned 100 times on a third-generation, dual-source CT scanner at 5 dose levels and reconstructed using FBP and IR algorithms. The human detection performance of the inserts was measured via a 2-alternative-forced-choice (2AFC) test. In addition, two model observer performances were calculated, including a Fourier domain non-prewhitening model observer and a spatial domain channelized Hotelling observer. The performance of these two mode observers was compared in terms of how well they correlated with human observer performance. Our results demonstrated that the spatial domain model observer correlated well with human observers across various dose levels, object contrast levels, and object sizes. The Fourier domain observer correlated well with human observers using FBP images, but overestimated the detection performance using IR images.

Impact of number of repeated scans on model observer performance for a low-contrast detection task in computed tomography.

Abstract. Channelized Hotelling observer (CHO) models have been shown to correlate well with human observers for several phantom-based detection/classification tasks in clinical computed tomography (CT). A large number of repeated scans were used to achieve an accurate estimate of the model’s template. The purpose of this study is to investigate how the experimental and CHO model parameters affect the minimum required number of repeated scans. A phantom containing 21 low-contrast objects was scanned on a 128-slice CT scanner at three dose levels. Each scan was repeated 100 times. For each experimental configuration, the low-contrast detectability, quantified as the area under receiver operating characteristic curve, Az, was calculated using a previously validated CHO with randomly selected subsets of scans, ranging from 10 to 100. Using Az from the 100 scans as the reference, the accuracy from a smaller number of scans was determined. Our results demonstrated that the minimum number of repeated scans increased when the radiation dose level decreased, object size and contrast level decreased, and the number of channels increased. As a general trend, it increased as the low-contrast detectability decreased. This study provides a basis for the experimental design of task-based image quality assessment in clinical CT using CHO.