Claudia Mello-Thoms

Assessment of Interradiologist Agreement Regarding Mammographic Breast Density Classification Using the Fifth Edition of the BI-RADS Atlas

OBJECTIVE The objective of the present study was to assess interradiologist agreement regarding mammographic breast density assessment performed using the rating scale outlined in the fifth edition of the BI-RADS atlas of the American College of Radiology. MATERIALS AND METHODS Breast density assessments of 1000 cases were conducted by five radiologists from the same institution who together had recently undergone retraining in mammographic breast density classification based on the fifth edition of BI-RADS. The readers assigned breast density grades (A-D) on the basis of the BI-RADS classification scheme. Repeat assessment of 100 cases was performed by all readers 1 month after the initial assessment. A weighted kappa was used to calculate intrareader and interreader agreement. RESULTS Intrareader agreement ranged from a kappa value of 0.86 (95% CI, 0.77-0.93) to 0.89 (95% CI, 0.81-0.95) on a four-category scale (categories A-D) and from 0.89 (95% CI, 0.86-0.92) to 0.94 (95% CI, 0.89-0.97) on a two-category scale (category A-B vs category C-D). Interreader agreement ranged from substantial (κ = 0.76; 95% CI, 0.73-0.78) to almost perfect (κ = 0.87; 95% CI, 0.86-0.89) on a four-category scale, and the overall weighted kappa value was substantial (0.79; 95% CI, 0.78-0.83). Interreader agreement on a two-category scale ranged from a kappa value of 0.85 (95% CI, 0.83-0.86) to 0.91 (95% CI, 0.90-0.92), and the overall weighted kappa was 0.88 (95% CI, 0.87-0.89). CONCLUSION Overall, with regard to mammographic breast density classification, radiologists had substantial interreader agreement when a four-category scale was used and almost perfect interreader agreement when a dichotomous scale was used.

What effect does mammographic breast density have on lesion detection in digital mammography

Effective detection of breast cancer using mammography is an important public health issue worldwide. Breasts that contain higher levels of fibroglandular compared with fatty tissue increase breast radio-opacity making it more difficult to differentiate between normal and abnormal findings. The higher prevalence of breast cancer amongst women with denser breasts demands the origination of effective solutions to manage this common radiographic appearance. This brief review considers the impact of higher levels of density on cancer detection and the importance of digital technology in possibly reducing the negative effects of increased density.

Virtual reality microscope versus conventional microscope regarding time to diagnosis: an experimental study

Aims:  To create and evaluate a virtual reality (VR) microscope that is as efficient as the conventional microscope, seeking to support the introduction of digital slides into routine practice.

An analysis of perceptual errors in reading mammograms using quasi-local spatial frequency spectra.

In this pilot study the authors examined areas on a mammogram that attracted the visual attention of experienced mammographers and mammography fellows, as well as areas that were reported to contain a malignant lesion, and, based on their spatial frequency spectrum, they characterized these areas by the type of decision outcome that they yielded: true-positives (TP), false-positives (FP), true-negatives (TN), and false-negatives (FN). Five 2-view (craniocaudal and medial-lateral oblique) mammogram cases were examined by 8 experienced observers, and the eye position of the observers was tracked. The observers were asked to report the location and nature of any malignant lesions present in the case. The authors analyzed each area in which either the observer made a decision or in which the observer had prolonged (>1,000 ms) visual dwell using wavelet packets, and characterized these areas in terms of the energy contents of each spatial frequency band. It was shown that each decision outcome is characterized by a specific profile in the spatial frequency domain, and that these profiles are significantly different from one another. As a consequence of these differences, the profiles can be used to determine which type of decision a given observer will make when examining the area. Computer-assisted perception correctly predicted up to 64% of the TPs made by the observers, 77% of the FPs, and 70% of the TNs.

Automated detection of heuristics and biases among pathologists in a computer-based system.

The purpose of this study is threefold: (1) to develop an automated, computer-based method to detect heuristics and biases as pathologists examine virtual slide cases, (2) to measure the frequency and distribution of heuristics and errors across three levels of training, and (3) to examine relationships of heuristics to biases, and biases to diagnostic errors. The authors conducted the study using a computer-based system to view and diagnose virtual slide cases. The software recorded participant responses throughout the diagnostic process, and automatically classified participant actions based on definitions of eight common heuristics and/or biases. The authors measured frequency of heuristic use and bias across three levels of training. Biases studied were detected at varying frequencies, with availability and search satisficing observed most frequently. There were few significant differences by level of training. For representativeness and anchoring, the heuristic was used appropriately as often or more often than it was used in biased judgment. Approximately half of the diagnostic errors were associated with one or more biases. We conclude that heuristic use and biases were observed among physicians at all levels of training using the virtual slide system, although their frequencies varied. The system can be employed to detect heuristic use and to test methods for decreasing diagnostic errors resulting from cognitive biases.

Diagnosis of major cancer resection specimens with virtual slides: impact of a novel digital pathology workstation.

Digital pathology promises a number of benefits in efficiency in surgical pathology, yet the longer time required to review a virtual slide than a glass slide currently represents a significant barrier to the routine use of digital pathology. We aimed to create a novel workstation that enables pathologists to view a case as quickly as on the conventional microscope. The Leeds Virtual Microscope (LVM) was evaluated using a mixed factorial experimental design. Twelve consultant pathologists took part, each viewing one long cancer case (12-25 slides) on the LVM and one on a conventional microscope. Total time taken and diagnostic confidence were similar for the microscope and LVM, as was the mean slide viewing time. On the LVM, participants spent a significantly greater proportion of the total task time viewing slides and revisited slides more often. The unique design of the LVM, enabling real-time rendering of virtual slides while providing users with a quick and intuitive way to navigate within and between slides, makes use of digital pathology in routine practice a realistic possibility. With further practice with the system, diagnostic efficiency on the LVM is likely to increase yet more.

Effect of Display Resolution on Time to Diagnosis with Virtual Pathology Slides in a Systematic Search Task

Performing diagnoses using virtual slides can take pathologists significantly longer than with glass slides, presenting a significant barrier to the use of virtual slides in routine practice. Given the benefits in pathology workflow efficiency and safety that virtual slides promise, it is important to understand reasons for this difference and identify opportunities for improvement. The effect of display resolution on time to diagnosis with virtual slides has not previously been explored. The aim of this study was to assess the effect of display resolution on time to diagnosis with virtual slides. Nine pathologists participated in a counterbalanced crossover study, viewing axillary lymph node slides on a microscope, a 23-in 2.3-megapixel single-screen display and a three-screen 11-megapixel display consisting of three 27-in displays. Time to diagnosis and time to first target were faster on the microscope than on the single and three-screen displays. There was no significant difference between the microscope and the three-screen display in time to first target, while the time taken on the single-screen display was significantly higher than that on the microscope. The results suggest that a digital pathology workstation with an increased number of pixels may make it easier to identify where cancer is located in the initial slide overview, enabling quick location of diagnostically relevant regions of interest. However, when a comprehensive, detailed search of a slide has to be made, increased resolution may not offer any additional benefit.

Effect of radiologists’ experience on breast cancer detection and localization using digital breast tomosynthesis

AbstractObjectivesThe objectives are To to compare the diagnostic performance of combined digital breast tomosynthesis (DBT) and digital mammography (DM) with that of DM alone, as a function of radiologists’ experience with DBT.MethodsEthical committee approval was obtained. Fifty cases (27 cancer, 23 normal), each containing both digital mammography (DM) and digital breast tomosynthesis (DBT) images, were reviewed by 26 radiologists, divided into three groups according to level of experience with DBT (none, workshop experience, and clinical experience). The radiologists’ diagnostic performance using DM was compared with that using DM + DBT, and evaluated by area under receiver-operating characteristic curve (AUC), jackknife free-response receiver-operator characteristics figure of metric (JAFROC FOM), sensitivity, location sensitivity, and specificity.ResultsFor all readers combined, performance using DM + DBT was significantly higher than for DM alone by both AUC (0.788 vs 0.681, p < 0.001) and JAFROC FOM (0.745 vs 0.621, p < 0.001). Similar results were obtained for readers with no DBT experience (AUC 0.775 vs 0.682, p = 0.004; JAFROC FOM 0.695 vs 0.603, p = 0.016) and with clinical DBT experience (AUC 0.789 vs 0.681, p = 0.042; and JAFROC FOM 0.764 vs 0.632, p = 0.031).ConclusionsAddition of DBT to DM significantly improves radiologists’ diagnostic performance whether or not they have prior DBT experience.Key p oints• Adding DBT to DM increased the number of detected cancers • DBT + DM led to more accurate localization of breast cancers than DM • Addition of DBT improved radiologists’ performance regardless of prior DBT experience • High-volume radiologists with different DBT experience levels performed similarly on DM + DBT

Different Search Patterns and Similar Decision Outcomes: How Can Experts Agree in the Decisions They Make When Reading Digital Mammograms?

Experts may agree in most decisions that they make when they read a case set of digital mammograms, but eye-position tracking studies suggest that they use very different visual search strategies to make such decisions. If indeed each expert uses a unique strategy, it may be very difficult to teach radiology trainees effective ways to search the background parenchyma. In this study, we examined how much agreement exists in the actual locations used by the experts in their decision making process when reading digital mammograms.

Review of prospects and challenges of eye tracking in volumetric imaging

Abstract. While eye tracking research in conventional radiography has flourished over the past decades, the number of eye tracking studies that looked at multislice images lags behind. A possible reason for the lack of studies in this area might be that the eye tracking methodology used in the context of conventional radiography cannot be applied one-on-one to volumetric imaging material. Challenges associated with eye tracking in volumetric imaging are particularly associated with the selection of stimulus material, the detection of events in the eye tracking data, the calculation of meaningful eye tracking parameters, and the reporting of abnormalities. However, all of these challenges can be addressed in the design of the experiment. If this is done, eye tracking studies using volumetric imaging material offer almost unlimited opportunity for perception research and are highly relevant as the number of volumetric images that are acquired and interpreted is rising.