Kriscia Tapia

Certain performance values arising from mammographic test set readings correlate well with clinical audit

Test sets have been increasingly utilised to augment clinical audit in breast screening programmes; however, their relationship has never been satisfactorily understood. This study examined the relationship between mammographic test set performance and clinical audit data.

BREAST: a novel method to improve the diagnostic efficacy of mammography

High quality breast imaging and accurate image assessment are critical to the early diagnoses, treatment and management of women with breast cancer. Breast Screen Reader Assessment Strategy (BREAST) provides a platform, accessible by researchers and clinicians world-wide, which will contain image data bases, algorithms to assess reader performance and on-line systems for image evaluation. The platform will contribute to the diagnostic efficacy of breast imaging in Australia and beyond on two fronts: reducing errors in mammography, and transforming our assessment of novel technologies and techniques. Mammography is the primary diagnostic tool for detecting breast cancer with over 800,000 women X-rayed each year in Australia, however, it fails to detect 30% of breast cancers with a number of missed cancers being visible on the image [1-6]. BREAST will monitor the mistakes, identify reasons for mammographic errors, and facilitate innovative solutions to reduce error rates. The BREAST platform has the potential to enable expert assessment of breast imaging innovations, anywhere in the world where experts or innovations are located. Currently, innovations are often being assessed by limited numbers of individuals who happen to be geographically located close to the innovation, resulting in equivocal studies with low statistical power. BREAST will transform this current paradigm by enabling large numbers of experts to assess any new method or technology using our embedded evaluation methods. We are confident that this world-first system will play an important part in the future efficacy of breast imaging.

Breast Cancer in Australian Indigenous Women: Incidence, Mortality, and Risk Factors

The Indigenous people of Australia face significant health gaps compared with the general population, with lower life expectancies, higher rates of death, and chronic illness occurring more often than in non-indigenous Australians. Cancer is the second largest contributor to the burden of disease with breast cancer being the most common invasive cancer diagnosed for females. Despite a lower breast cancer incidence compared with non-indigenous women, fatalities occur at an elevated rate and breast cancers have an earlier age of onset. For indigenous women there are also more advanced and distant tumours at diagnosis, fewer hospitalisations for breast cancer, and lower participation in breast screening. Concomitantly there are demographic, socio-economic and lifestyle factors associated with breast cancer risks that are heavily represented within Indigenous communities. The aim of this two-part narrative review is to examine the available evidence on breast cancer and its risk factors in Australian Indigenous women. Part One presents a summary of the latest incidence, survival and mortality data. Part Two presents the risk factors most strongly associated with breast cancer including age, place of residence, family risk, genetics, reproductive history, tobacco use, alcohol intake, physical activity, participation in screening and breast density. With increasing emphasis on personalized health care, a clear understanding of breast cancer incidence, survival, mortality, and causal agents within the Indigenous population is required if breast cancer prevention and management is to be optimized for Indigenous Australians.

Impact of Breast Reader Assessment Strategy on mammographic radiologists' test reading performance.

The detection of breast cancer is somewhat limited by human factors, and thus there is a need to improve reader performance. This study assesses whether radiologists who regularly undertake the education in the form of the Breast Reader Assessment Strategy (BREAST) demonstrate any changes in mammography interpretation performance over time.

Experience in reading digital images may decrease observer accuracy in mammography

Rationale and Objectives: To identify parameters linked to higher levels of performance in screening mammography. In particular we explored whether experience in reading digital cases enhances radiologists’ performance. Methods: A total of 60 cases were presented to the readers, of which 20 contained cancers and 40 showed no abnormality. Each case comprised of four images and 129 breast readers participated in the study. Each reader was asked to identify and locate any malignancies using a 1-5 confidence scale. All images were displayed using 5MP monitors, supported by radiology workstations with full image manipulation capabilities. A jack-knife free-response receiver operating characteristic, figure of merit (JAFROC, FOM) methodology was employed to assess reader performance. Details were obtained from each reader regarding their experience, qualifications and breast reading activities. Spearman and Mann Whitney U techniques were used for statistical analysis. Results: Higher performance was positively related to numbers of years professionally qualified (r= 0.18; P<0.05), number of years reading breast images (r= 0.24; P<0.01), number of mammography images read per year (r= 0.28; P<0.001) and number of hours reading mammographic images per week (r= 0.19; P<0.04). Unexpectedly, higher performance was inversely linked to previous experience with digital images (r= - 0.17; p<0.05) and further analysis, demonstrated that this finding was due to changes in specificity. Conclusion: This study suggests suggestion that readers with experience in digital images reporting may exhibit a reduced ability to correctly identify normal appearances requires further investigation. Higher performance is linked to number of cases read per year.

Evaluation of the effect of zoom function on lesion detection by soft-copy reading of screening mammograms

This study aims to evaluate the effectiveness of zooming in improving screen‐reader performance in reporting digital mammograms.

Radiologists can detect the ‘gist’ of breast cancer before any overt signs of cancer appear

Radiologists can detect abnormality in mammograms at above-chance levels after a momentary glimpse of an image. The study investigated this instantaneous perception of an abnormality, known as a “gist” response, when 23 radiologists viewed prior mammograms of women that were reported as normal, but later diagnosed with breast cancer at subsequent screening. Five categories of cases were included: current cancer-containing mammograms, current mammograms of the normal breast contralateral to the cancer, prior mammograms of normal cases, prior mammograms with visible cancer signs in a breast from women who were initially reported as normal, but later diagnosed with breast cancer at subsequent screening in the same breast, and prior mammograms without any visible cancer signs from women labelled as initially normal but subsequently diagnosed with cancer. Our findings suggest that readers can distinguish patients who were diagnosed with cancer, from individuals without breast cancer (normal category), at above-chance levels based on a half-second glimpse of the mammogram even before any lesion becomes visible on the mammogram. Although 20 of the 23 radiologists demonstrated this ability, radiologists’ abilities for perceiving the gist of the abnormal varied between the readers and appeared to be linked to expertise. These results could have implications for identifying women of higher than average risk of a future malignancy event, thus impacting upon tailored screening strategies.

Assessment of Jordanian Radiologist Performance in the Detection of Breast Cancers

This study aims to monitor diagnostic accuracy amongst Jordanian mammography readers and identify parameters linked to higher levels of performance. In this study, we have used the Breast Screen Reader Assessment Strategy (BREAST) platform to facilitate 27 radiologists in reading a case set of 60 digital mammograms, 20 of which included cancers. Each case consisted of the four standard cranio-caudal (CC) and medio-lateral oblique (MLO) projections. All radiologists were registered to read mammograms at their workplace by the Jordanian Ministry of Health. Each reader was asked to locate any malignancies, provide a confidence rating using a scale of 1 - 5, and identify the type of appearance. All images were displayed using 8 MP monitor, supported by radiology workstations with full image manipulation facilities. Results were evaluated using Jackknife Alternative Free-Response Receiver Operating Characteristic (JAFROC). Demographics obtained from each radiologist regarding their experience, qualifications and breast-reading activities were correlated against JAFROC scores using Spearman techniques. The results showed that the mean JAFROC score was 0. 52 (95% confidence interval (CI): 0.46, 0.58); location sensitivity score was 0. 41 (95% CI: 0.41, 0.56); specificity score was 0.73 (95% CI: 0.68, 0.83). Higher performance in term of JAFROC scores was directly related to number of years since professional qualification (r = 0.433; p = 0.024), number of years reading breast images (r = 0.62; r = 0.001) and number of mammography images read per year (r = 0.69; p = 0.001). On the other hand, higher performance was inversely linked to the frequency of reading other modalities per week (r = -0.48; p = 0.010). No other statistical differences were significant. Finally, higher radiologists’ performance in cancer detection is correlated with increasing the number of mammograms reads per week.

Characteristics of the group of radiologists that benefits the most using Breast Screen Reader Assessment Strategy (BREAST).

Purpose: To determine the impact of Breast Screen Reader Assessment Strategy (BREAST) over time in improving radiologists’ breast cancer detection performance, and to identify the group of radiologists that benefit the most by using BREAST as a training tool. Materials and Methods: Thirty-six radiologists who completed three case-sets offered by BREAST were included in this study. The case-sets were arranged in radiologists’ chronological order of completion and five performance measures (sensitivity, specificity, location sensitivity, receiver operating characteristics area under the curve (ROC AUC) and jackknife alternative free-response receiver operating characteristic (JAFROC) figure–of-merit (FOM)), available from BREAST, were compared between case-sets to determine the level of improvement achieved. The radiologists were then grouped based on their characteristics and the above performance measures between the case-sets were compared. Paired t-tests or Wilcoxon signed-rank tests with statistical significance set at p < 0.05 were used to compare the performance measures. Results: Significant improvement was demonstrated in radiologists’ case-set performance in terms of location sensitivity and JAFROC FOM over the years, and radiologists’ location sensitivity and JAFROC FOM showed significant improvement irrespective of their characteristics. In terms of ROC AUC, significant improvement was shown for radiologists who were reading screen mammograms for more than 7 years and spent more than 9 hours per week reading mammograms. Conclusion: Engaging with case-sets appears to enhance radiologists’ performance suggesting the important value of initiatives such as BREAST. However, such performance enhancement was not shown for everyone, highlighting the need to tailor the BREAST platform to benefit all radiologists.

Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies

RATIONALE AND OBJECTIVES To establish the efficacy of pairing readers randomly and evaluate the merits of developing optimal pairing methodologies. MATERIALS AND METHODS Sensitivity, specificity, and proportion correct were computed for three different case sets that were independently read by 16 radiologists. Performance of radiologists as single readers was compared to expected double reading performance. We theoretically evaluated all possible pairing methodologies. Bootstrap resampling methods were used for statistical analyses. RESULTS Significant improvements in expected performance for double versus single reading (ie, delta performance) were shown for all performance measures and case-sets (p ≤ .003), with overall delta performance across all theoretically possible pairing schemes (n = 10,395) ranging between .05 and .08. Delta performance for the 20 best pairing schemes was significant (p < .001) and ranged between .07 and .10. Delta performance for 20 random pairing schemes was also significant (p ≤ .003) and ranged between .05 and .08. Delta performance for the 20 worst pairing schemes ranged between .03 and .06, reaching significance in delta proportion correct (p ≤ .021) for all three case-sets and in delta specificity for two case-sets (p ≤ .033) but not for a third case-set (p = .131), and not reaching significance in delta sensitivity for any of the three case-sets (.098 ≥ p ≥ .067). CONCLUSION Significant benefits accrue from double reading, and while random reader pairing achieves most double reading benefits, a strategic pairing approach may maximize the benefits of double reading.