Ram Vaderhobli

Detection and characterization of usability problems in structured data entry interfaces in dentistry

BACKGROUND Poor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses. OBJECTIVES In this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method. METHODS Fieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24). RESULTS User testing revealed that only 22-41% of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. DISCUSSION Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.

Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR

OBJECTIVE To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. MATERIALS AND METHODS Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35). RESULTS The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. DISCUSSION Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. CONCLUSION We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges.

Treatment planning in dentistry using an electronic health record: implications for undergraduate education

OBJECTIVE Treatment planning, an essential component of clinical practice, has received little attention in the dental literature and there appears to be no consistent format being followed in the teaching and development of treatment plans within dental school curricula. No investigation, to our knowledge, has been carried out to explore the subject of treatment planning since the advent of electronic health record (EHR) use in dentistry. It is therefore important to examine the topic of treatment planning in the context of EHRs. METHODS This paper reports on how 25 predoctoral dental students from two U.S. schools performed when asked to complete diagnosis and treatment planning exercises for two clinical scenarios in an EHR. Three calibrated clinical teaching faculty scored diagnosis entry, diagnosis-treatment (procedure) pairing, and sequencing of treatment according to criteria taught in their curriculum. Scores were then converted to percent correct and reported as means (with standard deviations). RESULTS Overall, the participants earned 48.2% of the possible points. Participants at School 2 earned a mean of 54.3% compared with participants at School 1, who earned 41.9%. Students fared better selecting the appropriate treatment (59.8%) compared with choosing the correct diagnoses (41.9%) but performed least favorably when organizing the sequence of their treatment plans (41.7%). CONCLUSION Our results highlight the need to improve the current process by which treatment planning is taught and also to consider the impact of technology on the fundamental skills of diagnosis and treatment planning within the modern educational setting.

Advances in Dental Materials

The use of materials to rehabilitate tooth structures is constantly changing. Over the past decade, newer material processing techniques and technologies have significantly improved the dependability and predictability of dental material for clinicians. The greatest obstacle, however, is in choosing the right combination for continued success. Finding predictable approaches for successful restorative procedures has been the goal of clinical and material scientists. This article provides a broad perspective on the advances made in various classes of dental restorative materials in terms of their functionality with respect to pit and fissure sealants, glass ionomers, and dental composites.

Near-infrared imaging of secondary caries lesions around composite restorations at wavelengths from 1300–1700-nm

BACKGROUND AND OBJECTIVES Current clinical methods for diagnosing secondary caries are unreliable for identifying the early stages of decay around restorative materials. The objective of this study was to access the integrity of restoration margins in natural teeth using near-infrared (NIR) reflectance and transillumination images at wavelengths between 1300 and 1700-nm and to determine the optimal NIR wavelengths for discriminating composite materials from dental hard tissues. MATERIALS AND METHODS Twelve composite margins (n=12) consisting of class I, II and V restorations were chosen from ten extracted teeth. The samples were imaged in vitro using NIR transillumination and reflectance, polarization sensitive optical coherence tomography (PS-OCT) and a high-magnification digital microscope. Samples were serially sectioned into 200-μm slices for histological analysis using polarized light microscopy (PLM) and transverse microradiography (TMR). Two independent examiners evaluated the presence of demineralization at the sample margin using visible detection with 10× magnification and NIR images presented digitally. Composite restorations were placed in sixteen sound teeth (n=16) and imaged at multiple NIR wavelengths ranging from λ=1300 to 1700-nm using NIR transillumination. The image contrast was calculated between the composite and sound tooth structure. RESULTS Intensity changes in NIR images at wavelengths ranging from 1300 to 1700-nm correlate with increased mineral loss measured using TMR. NIR reflectance and transillumination at wavelengths coincident with increased water absorption yielded significantly higher (P<0.001) contrast between sound enamel and adjacent demineralized enamel. In addition, NIR reflectance exhibited significantly higher (P<0.01) contrast between sound enamel and adjacent composite restorations than visible reflectance. SIGNIFICANCE This study shows that NIR imaging is well suited for the rapid screening of secondary caries lesions.

The dangers of dental devices as reported in the Food and Drug Administration Manufacturer and User Facility Device Experience Database.

BACKGROUND The authors conducted a study to determine the frequency and type of adverse events (AEs) associated with dental devices reported to the Food and Drug Administration Manufacturer and User Facility Device Experience (MAUDE) database. METHODS The authors downloaded and reviewed the dental device-related AEs reported to MAUDE from January 1, 1996, through December 31,2011. RESULTS MAUDE received a total of 1,978,056 reports between January 1, 1996, and December 31, 2011. Among these reports, 28,046 (1.4%) AE reports were associated with dental devices. Within the dental AE reports that had event type information, 17,261 reported injuries, 7,777 reported device malfunctions, and 66 reported deaths. Among the 66 entries classified as death reports, 52 reported a death in the description; the remaining were either misclassified or lacked sufficient information in the report to determine whether a death had occurred. Of the dental device-associated AEs, 53.5% pertained to endosseous implants. CONCLUSIONS A plethora of devices are used in dental care. To achieve Element 1 of Agency for Healthcare Research and Qualitys Patient Safety Initiative, clinicians and researchers must be able to monitor the safety of dental devices. Although MAUDE was identified by the authors as essentially the sole source of this valuable information on adverse events, their investigations led them to conclude that MAUDE had substantial limitations that prevent it from being the broad-based patient safety sentinel the profession requires. PRACTICAL IMPLICATIONS As potential contributors to MAUDE, dental care teams play a key role in improving the professions access to information about the safety of dental devices.

Dental clinical research: an illustration of the value of standardized diagnostic terms

Abstract Objective Secondary data are a significant resource for in‐depth epidemiologic and public health research. It also allows for effective quality control and clinical outcomes measurement. To illustrate the value of structured diagnostic entry, a use case was developed to quantify adherence to current practice guidelines for managing chronic moderate periodontitis (CMP). Methods Six dental schools using the same electronic health record (EHR) contribute data to a dental data repository (BigMouth) based on the i2b2 data‐warehousing platform. Participating institutions are able to query across the full repository without being able to back trace specific data to its originating institution. At each of the three sites whose data are included in this analysis, the Dental Diagnostic System (DDS) terminology was used to document diagnoses in the clinics. We ran multiple queries against this multi‐institutional database, and the output was validated by manually reviewing a subset of patient charts. Results Over the period under study, 1,866 patients were diagnosed with CMP. Of these, 15 percent received only periodontal prophylaxis treatment, 20 percent received only periodontal maintenance treatment, and only 41 percent received periodontal maintenance treatment in combination with other AAP guideline treatments. Conclusions Our results showed that most patients with CMP were not treated according to the AAP guidelines. On the basis of this use case, we conclude that the availability and habitual use of a structured diagnosis in an EHR allow for the aggregation and secondary analyses of clinical data to support downstream analyses for quality improvement and epidemiological assessments.

Original ContributionsPatient SafetyThe dangers of dental devices as reported in the Food and Drug Administration Manufacturer and User Facility Device Experience Database

BACKGROUND The authors conducted a study to determine the frequency and type of adverse events (AEs) associated with dental devices reported to the Food and Drug Administration Manufacturer and User Facility Device Experience (MAUDE) database. METHODS The authors downloaded and reviewed the dental device-related AEs reported to MAUDE from January 1, 1996, through December 31,2011. RESULTS MAUDE received a total of 1,978,056 reports between January 1, 1996, and December 31, 2011. Among these reports, 28,046 (1.4%) AE reports were associated with dental devices. Within the dental AE reports that had event type information, 17,261 reported injuries, 7,777 reported device malfunctions, and 66 reported deaths. Among the 66 entries classified as death reports, 52 reported a death in the description; the remaining were either misclassified or lacked sufficient information in the report to determine whether a death had occurred. Of the dental device-associated AEs, 53.5% pertained to endosseous implants. CONCLUSIONS A plethora of devices are used in dental care. To achieve Element 1 of Agency for Healthcare Research and Qualitys Patient Safety Initiative, clinicians and researchers must be able to monitor the safety of dental devices. Although MAUDE was identified by the authors as essentially the sole source of this valuable information on adverse events, their investigations led them to conclude that MAUDE had substantial limitations that prevent it from being the broad-based patient safety sentinel the profession requires. PRACTICAL IMPLICATIONS As potential contributors to MAUDE, dental care teams play a key role in improving the professions access to information about the safety of dental devices.

In vitro study of the soft tissue effects of microsecond-pulsed CO2 laser parameters during soft tissue incision and sulcular debridement

Carbon dioxide (CO2) lasers are an important part of dental treatment. Advances in laser technology have produced microsecond pulse durations and small beam sizes. The histological effects of porcine intraoral soft tissue with a range of microsecond‐pulsed CO2 laser parameters used for incision and sulcular debridement were evaluated in vitro and compared with historical histologic data.

Evaluating quality of dental care among patients with diabetes: Adaptation and testing of a dental quality measure in electronic health records

BACKGROUND Patients with diabetes are at increased risk of developing oral complications, and annual dental examinations are an endorsed preventive strategy. The authors evaluated the feasibility and validity of implementing an automated electronic health record (EHR)-based dental quality measure to determine whether patients with diabetes received such evaluations. METHODS The authors selected a Dental Quality Alliance measure developed for claims data and adapted the specifications for EHRs. Automated queries identified patients with diabetes across 4 dental institutions, and the authors manually reviewed a subsample of charts to evaluate query performance. After assessing the initial EHR measure, the authors defined and tested a revised EHR measure to capture better the oral care received by patients with diabetes. RESULTS In the initial and revised measures, the authors used EHR automated queries to identify 12,960 and 13,221 patients with diabetes, respectively, in the reporting year. Variations in the measure scores across sites were greater with the initial measure (range, 36.4-71.3%) than with the revised measure (range, 78.8-88.1%). The automated query performed well (93% or higher) for sensitivity, specificity, and positive and negative predictive values for both measures. CONCLUSIONS The results suggest that an automated EHR-based query can be used successfully to measure the quality of oral health care delivered to patients with diabetes. The authors also found that using the rich data available in EHRs may help estimate the quality of care better than can relying on claims data. PRACTICAL IMPLICATIONS Detailed clinical patient-level data in dental EHRs may be useful to dentists in evaluating the quality of dental care provided to patients with diabetes.