Rachel Toomey

Diagnostic Efficacy of Handheld Devices for Emergency Radiologic Consultation

OBJECTIVE Orthopedic injury and intracranial hemorrhage are commonly encountered in emergency radiology, and accurate and timely diagnosis is important. The purpose of this study was to determine whether the diagnostic accuracy of handheld computing devices is comparable to that of monitors that might be used in emergency teleconsultation. SUBJECTS AND METHODS Two handheld devices, a Dell Axim personal digital assistant (PDA) and an Apple iPod Touch device, were studied. The diagnostic efficacy of each device was tested against that of secondary-class monitors (primary class being clinical workstation display) for each of two image types-posteroanterior wrist radiographs and slices from CT of the brain-yielding four separate observer performance studies. Participants read a bank of 30 wrist or brain images searching for a specific abnormality (distal radial fracture, fresh intracranial bleed) and rated their confidence in their decisions. A total of 168 readings by examining radiologists of the American Board of Radiology were gathered, and the results were subjected to receiver operating characteristics analysis. RESULTS In the PDA brain CT study, the scores of PDA readings were significantly higher than those of monitor readings for all observers (p < or = 0.01) and for radiologists who were not neuroradiology specialists (p < or = 0.05). No statistically significant differences between handheld device and monitor findings were found for the PDA wrist images or in the iPod Touch device studies, although some comparisons approached significance. CONCLUSION Handheld devices show promise in the field of emergency teleconsultation for detection of basic orthopedic injuries and intracranial hemorrhage. Further investigation is warranted.

The Development of Expertise in Radiology: In Chest Radiograph Interpretation, "Expert" Search Pattern May Predate "Expert" Levels of Diagnostic Accuracy for Pneumothorax Identification.

Purpose To investigate the development of chest radiograph interpretation skill through medical training by measuring both diagnostic accuracy and eye movements during visual search. Materials and Methods An institutional exemption from full ethical review was granted for the study. Five consultant radiologists were deemed the reference expert group, and four radiology registrars, five senior house officers (SHOs), and six interns formed four clinician groups. Participants were shown 30 chest radiographs, 14 of which had a pneumothorax, and were asked to give their level of confidence as to whether a pneumothorax was present. Receiver operating characteristic (ROC) curve analysis was carried out on diagnostic decisions. Eye movements were recorded with a Tobii TX300 (Tobii Technology, Stockholm, Sweden) eye tracker. Four eye-tracking metrics were analyzed. Variables were compared to identify any differences between groups. All data were compared by using the Friedman nonparametric method. Results The average area under the ROC curve for the groups increased with experience (0.947 for consultants, 0.792 for registrars, 0.693 for SHOs, and 0.659 for interns; P = .009). A significant difference in diagnostic accuracy was found between consultants and registrars (P = .046). All four eye-tracking metrics decreased with experience, and there were significant differences between registrars and SHOs. Total reading time decreased with experience; it was significantly lower for registrars compared with SHOs (P = .046) and for SHOs compared with interns (P = .025). Conclusion Chest radiograph interpretation skill increased with experience, both in terms of diagnostic accuracy and visual search. The observed level of experience at which there was a significant difference was higher for diagnostic accuracy than for eye-tracking metrics. (©) RSNA, 2016 Online supplemental material is available for this article.

Optimization of Region of Interest Luminances May Enhance Radiologists’ Light Adaptation

RATIONALE AND OBJECTIVES Radiologic image details are best discriminated at luminance levels to which the eye is adapted. Recommendations that ambient light conditions are matched to overall monitor luminance to encourage appropriate adaptation are based on an assumption that clinically significant regions within the image match average monitor luminance. The current work examines this assumption. MATERIALS AND METHODS Three image types were considered: posteroanterior (PA) chest; PA wrist; and computed tomography (CT) head. Luminance at clinically significant regions was measured at hilar region and peripheral lung (chest), distal radius (wrist), and supraventricular white matter (head). Average monitor luminances were calculated from measurements at 16 regions of the display face plate. Three ambient light levels-30, 100 and 400 lux-were employed. Thirty samples of each image type were used. RESULTS Statistically significant differences were noted between average monitor luminances and clinically important regions of interest of up to a factor of 3.8, 2, and 6.3 for chest, wrist, and CT head images respectively (P < .0001). Values for the hilum of the chest and distal radius were higher than average monitor levels, whereas the reverse was observed for the peripheral lung and CT brain. Increasing ambient light had no impact on results. CONCLUSIONS Clinically important radiologic information for common radiologic examinations is not being presented to observers in a way that facilitates optimized adaptation. This may have a significant impact on the ability of the observer to identify details with low contrast discriminability. The importance of image-processing algorithms focussing on clinically significant abnormalities rather than anatomic regions is highlighted.

Rheumatoid arthritis: a novel radiographic projection for hand assessment

Rheumatoid arthritis (RA) is the most common form of inflammatory disease, affecting 1-2% of the population. Posteroanterior (PA) and Brewerton projections are well established in radiographic practice for scoring and monitoring RA, but there is little evidence to demonstrate the diagnostic efficacy of these techniques. This work, by varying the positioning of a cadaveric hand, investigates whether an alternative radiographic projection could yield greater diagnostic information than the traditional techniques. Phase I of the study evaluated moving the hand 15 degrees from the anteroposterior position and then in 5 degrees increments in four directions: medial rotation, lateral rotation, flexion of the wrist and extension of the wrist. Phase II of the study took the optimum projections from Phase I and further manipulated these positions in a direction at right angles to the original position. Images were scored based on joint space visualisation in 29 joints. Results demonstrated that significantly higher diagnostic efficacy was evident with 15 degrees lateral rotation of the hand or 15 degrees flexion at the wrist compared to the Brewerton projection. Either projection is recommended, but on the basis of patient comfort, the latter of these novel positions, now known as the UCD projection, was chosen as the optimum procedure to replace the Brewerton projection. The value of using cadavers for the establishment of optimum radiographic procedures is highlighted.

An initial investigation of radiologist eye movements in vascular imaging

Eye tracking has been used by many researchers to try to shed light on the perceptual processes involved in medical image perception. Despite a large volume of data having been published regarding radiologist viewing patterns for static images, and more recently for stacked imaging modalities, little has been produced concerning angiographic images, which commonly have substantially different characteristics. A study was performed in which 7 expert radiologists viewed a range of digital subtraction angiograms of the peripheral vascular system. Initial results are presented. The observers were free to control the rate at which they viewed the images. Eye position data was recorded for each participant using Tobii TX300 eyetrackers. Analysis was performed in Tobii Studio software and included qualitative analysis of gaze pattern and analysis of metrics including first and total fixation duration etc. for areas of clinical interest. Early results indicate that experts briefly fixate on lesions but do not dwell in the area, rather continuing to inspect the more distal vascular segments before returning. Some individual variation was noted. Further research is required and ongoing.

Do radiographers base the diagnostic acceptability of a radiograph on anatomical structures

Background The document “European Guidelines on Quality Criteria for Diagnostic Radiographic Images” describes the visualisation of anatomical criteria to which a radiograph of diagnostic quality should comply. This research investigates the correlation between the evaluation of anatomical structures, presented in the European guidelines, and the classification of radiographs for diagnostic acceptability. Methods Sixteen radiographers classified 22 chest radiographs in terms of diagnostic acceptability using the RadLex categories, and scored the representation of five anatomical criteria on a scale from 1 to 5. All radiographs were visualised with ViewDex on a DICOM calibrated display. Observers were recruited in Belgium and Ireland. An interclass correlation coefficient was applied to evaluate internal consistency for each observer group. A Mann–Whitney U-test was applied to investigate differences in classification between countries. The relationship with the evaluation of anatomical structures was investigated with ordinal logistic regression. Results Both groups of observers performed with acceptable consistency. The Mann–Whitney U test illustrated a significant difference in classification between the two countries. The ordinal logistic regression indicated for each country a weak correlation between the RadLex and the anatomical structures. Certain factors in the radiograph, possibly others than anatomical elements, must be significantly better before the observer will attribute a higher RadLex score. Conclusion The relationship between the evaluation of anatomical criteria and the diagnostic acceptability is weak for both countries. When assigning a radiograph to a certain category of acceptability, other factors influence the decision.

AN INVESTIGATION INTO CT RADIATION DOSE VARIATIONS FOR HEAD EXAMINATIONS ON MATCHED EQUIPMENT

This study investigated radiation dose and image quality differences for computed tomography (CT) head examinations across centres with matched CT equipment. Radiation dose records and imaging protocols currently employed across three European university teaching hospitals were collated, compared and coded as Centres A, B and C from specification matched CT equipment models. Patient scans (n = 40) obtained from Centres A and C were evaluated for image quality, based on the visualisation of Commission of European Community (CEC) image quality criteria using visual grading characteristic (VGC) analysis, where American Board of Radiology examiners (n = 11) stated their confidence in identifying anatomical criteria. Mean doses in terms of CT dose index (CTDIvol-mGy) and dose length product (DLP-mGy cm) were as follows: Centre A-33.12 mGy and 461.45 mGy cm; Centre B -101 mGy (base)/32 mGy (cerebrum) and 762 mGy cm and Centre C-71.98 mGy and 1047.26 mGy cm, showing a significant difference (p ≤ 0.05) in DLP across centres. VGC analysis indicated better visualisation of CEC criteria on Centre C images (VGCAUC 0.225). All three imaging protocols are routinely used clinically, and image quality is acceptable in each centre. Clinical centres with identical model CT scanners have variously customised their protocols achieving a range of dose savings and still resulting in clinically acceptable image quality.

Variability amongst radiographers in the categorization of clinical acceptability for digital trauma radiography

Introduction: Radiographers evaluate anatomical structures to judge clinical acceptability of a radiograph. Whether a radiograph is deemed acceptable for diagnosis or not depends on the individual decision of the radiographer. Individual decisions cause variation in the accepted image quality. To minimise these variations definitions of acceptability, such as in RadLex, were developed. On which criteria radiographers attribute a RadLex categories to radiographs is unknown. Insight into these criteria helps to further optimise definitions and reduce variability in acceptance between radiographers. Therefore, this work aims the evaluation of the correlation between the RadLex classification and the evaluation of anatomical structures, using a Visual Grading Analysis (VGA) Methods: Four radiographers evaluated the visibility of five anatomical structures of 25 lateral cervical spine radiographs on a secondary class display with a VGA. They judged clinical acceptability of each radiograph using RadLex. Relations between VGAS and RadLex category were analysed with Kendall’s Tau correlation and Nagelkerke pseudo-R². Results: The overall VGA score (VGAS) and the RadLex score correlate (rτ= 0.62, p<0.01, R2=0.72) strongly. The observers’ evaluation of contrast between bone, air (trachea) and soft tissue has low value in predicting (rτ=0.55, p<0.01, R2=0.03) the RadLex score. The reproduction of spinous processes (rτ=0.67, p<0.01, R2=0.31) and the evaluation of the exposure (rτ=0.65, p<0.01, R2=0.56) have a strong correlation with high predictive value for the RadLex score. Conclusion: RadLex scores and VGAS correlate positively, strongly and significantly. The predictive value of bony structures may support the use of these in the judgement of clinical acceptability. Considerable inter-observer variations in the VGAS within a certain RadLex category, suggest that observers use of observer specific cut-off values.

An investigation of the relationship between ambient lighting and image manipulation behavior

Purpose: This study examines the relationship between ambient lighting level and image manipulation. Method: Academic radiographers (n=10), with experience in observer performance studies, each assessed 70 postero-anterior projection radiographs of the wrist / scaphoid in both low (12.5 lux) and high (150 lux) ambient lighting. Half of the images featured one or more acute fractures and the remainder did not. Observers were encouraged to window the images to a level they felt was appropriate and, requested to rate their confidence that an acute fracture was present, marking the locations of any suspected acute fractures on the image. The images were displayed on a secondary-class monitor using Ziltron software, which recorded the adjustments to brightness and contrast made for each image. The images were presented in different orders for each lighting level to reduce potential memory effects. Results: Student’s t-tests were applied to compare the mean brightness and contrast adjustments made to the images in each ambient lighting level. Tests were carried out to include all images, only positive cases, and only cases where observers elected to change the brightness and/or contrast. No statistically significant differences were noted except when images where no brightness/contrast adjustments were made were discounted. In that case, mean brightness levels were slightly higher in the high ambient light level (p=0.049). Conclusion: No convincing difference in adjustments of brightness and contrast between high and low ambient lighting levels, although further research is warranted.

The effect of viewing distance on observer performance in skeletal radiographs

A number of different viewing distances are recommended by international agencies, however none with specific reference to radiologist performance. The purpose of this study was to ascertain the extent to which radiologists performance is affected by viewing distance on softcopy skeletal reporting. Eighty dorsi-palmar (DP) wrist radiographs, of which half feature 1 or more fractures, were viewed by seven observers at 2 viewing distances, 30cm and 70cm. Observers rated the images as normal or not on a scale of 1 to 5 and could mark multiple locations on the images when they visualised a fracture. Viewing distance was measured from the centre of the face plate to the outer canthus of the eye. The DBM MRM analysis showed no statistically significant differences between the area under the curve for the two distances (p = 0.482). The JAFROC analysis, however, demonstrated a statistically significantly higher area under the curve with the 30cm viewing distance than with the 70 cm distance (p = 0.035). This suggests that while observers were able to make decisions about whether an image contained a fracture or not equally well at both viewing distances, they may have been less reliable in terms of fracture localisation or detection of multiple fractures. The impact of viewing distance warrants further attention from both clinical and scientific perspectives.