Digital breast tomosynthesis versus digital mammography: integration of image modalities enhances deep learning-based breast mass classification

Abstract

Objective To evaluate the impact of utilizing digital breast tomosynthesis (DBT) or/and full-field digital mammography (FFDM), and different transfer learning strategies on deep convolutional neural network (DCNN)-based mass classification for breast cancer. Methods We retrospectively collected 441 patients with both DBT and FFDM on which regions of interest (ROIs) covering the malignant, benign and normal tissues were extracted for DCNN training and validation. Experiments were conducted for tasks in distinguishing malignant/benign/normal: (1) classification capabilities of DBT vs FFDM and the role of transfer learning were validated on 2D-DCNN; (2) different strategies of combining DBT and FFDM and the associated impacts on classification were explored; (3) 2D-DCNN and 3D-DCNN trained from scratch with volumetric DBT were compared. Results 2D-DCNN with transfer learning outperformed that without for DBT in distinguishing malignant (ΔAUC\u2009=\u20090.059\u2009±\u20090.009, p \u2009<\u20090.001), benign (ΔAUC\u2009=\u20090.095\u2009±\u20090.010, p \u2009<\u20090.001) and normal tissue (ΔAUC\u2009=\u20090.042\u2009±\u20090.004, p \u2009<\u20090.001) (paired samples t \xa0test). 2D-DCNN trained on DBT (with transfer learning) achieved higher accuracy than those on FFDM (malignant: ΔAUC\u2009=\u20090.014\u2009±\u20090.014, p \u2009=\u20090.037; benign: ΔAUC\u2009=\u20090.031\u2009±\u20090.006, p \u2009<\u20090.001; normal: ΔAUC\u2009=\u20090.017\u2009±\u20090.004, p \u2009<\u20090.001) (independent samples t \xa0test). The 2D-DCNN employing both DBT and FFDM for training achieved better performances in benign (FFDM: ΔAUC\u2009=\u20090.010\u2009±\u20090.008, p\u2009< \xa00.001; DBT: ΔAUC =\xa00.009\u2009±\u20090.005, p \u2009<\u20090.001) and normal (FFDM: ΔAUC\u2009=\u20090.005\u2009±\u20090.003, p \u2009<\u20090.001; DBT: ΔAUC\u2009=\u20090.002\u2009±\u20090.002, p \u2009<\u20090.001) (related samples Friedman test). The 3D-DCNN and 2D-DCNN trained from scratch with DBT only produced moderate classification. Conclusions Transfer learning facilitates mass classification for both DBT and FFDM, and DBT outperforms FFDM when equipped with transfer learning. Integrating DBT and FFDM in DCNN training enhances mass classification accuracy for breast cancer. Key Points • Transfer learning facilitates mass classification for both DBT and FFDM, and the DBT-based DCNN outperforms the FFDM-based DCNN when equipped with transfer learning. • Integrating DBT and FFDM in DCNN training enhances breast mass classification accuracy. • 3D-DCNN/2D-DCNN trained from scratch with volumetric DBT but without transfer learning only produce moderate mass classification result.