Judith A. Cantrill

The Delphi and nominal group techniques in health services research

This review examines two methodologies that are being increasingly used in health services research (HSR): the Delphi and nominal group techniques. The Delphi is a survey technique for decision making among isolated respondents while the nominal group technique (NGT) is a highly controlled small group process for the generation of ideas. Typical applications of the techniques are for the development of consensus guidelines or standards in areas where research based evidence is absent or inconclusive. We discuss methodological issues associated with these techniques, namely, sample size and composition, response rates, anonymity, feedback and consensus, and reliability and validity. We also illustrate the range of applications of the techniques in HSR, including pharmacy practice. Although not widely used to date, both methodologies are potentially valuable additions to the practice researchers toolbox.

Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability.

OBJECTIVES: To develop valid, reliable indicators of the appropriateness of long-term prescribing in general practice medical records in the United Kingdom. DESIGN: A nominal group was used to identify potential indicators of appropriateness of prescribing. Their face and content validity were subsequently assessed in a two round Delphi exercise. Feasibility and reliability between raters were evaluated for the indicators for which consensus was reached and were suitable for application. PARTICIPANTS: The nominal group comprised a disciplinary mix of nine opinion leaders and prominent academics in the field of prescribing. The Delphi panel was composed of 100 general practitioners and 100 community pharmacists. RESULTS: The nominal group resulted in 20 items which were refined to produce 34 statements for the Delphi exercise. Consensus was reached on 30, from which 13 indicators suitable for application were produced. These were applied by two independent raters to the records of 49 purposively sampled patients in one general practice. Nine indicators showed acceptable reliability between raters. CONCLUSIONS: 9 indicators of prescribing appropriateness were produced suitable for application to the medical record of any patient on long term medication in United Kingdom general practice. Although the use of the medical record has limitations, this is currently the only available method to assess a patients drug regimen in its entirety.

Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice.

OBJECTIVE: To develop review criteria to assess the quality of care for three major chronic diseases: adult asthma, stable angina, and non-insulin dependent diabetes mellitus. SUBJECTS AND METHODS: Modified panel process based upon the RAND/UCLA (University College of Los Angeles) appropriateness method. Three multiprofessional panels made up of general practitioners, hospital specialists, and practice nurses. RESULTS: The RAND/UCLA appropriateness method of augmenting evidence with expert opinion was used to develop criteria for the care of the three conditions. Of those aspects of care which were rated as necessary by the panels, only 26% (16% asthma, 10% non-insulin dependent diabetes, 40% angina) were subsequently rated by the panels as being based on strong scientific evidence. CONCLUSION: The results show the importance of a systematic approach to combining evidence with expert opinion to develop review criteria for assessing the quality of three chronic diseases in general practice. The evidence base for the criteria was often incomplete, and explicit methods need to be used to combine evidence with expert opinion where evidence is not available.

Pharmacists’ Interventions in Prescribing Errors at Hospital Discharge

AbstractBackground: Pharmacists have an essential role in improving drug usage and preventing prescribing errors (PEs). PEs at the interface of care are common, sometimes leading to adverse drug events (ADEs). This was the first study to investigate, using a computerized search method, the number, types, severity, pharmacists’ impact on PEs and predictors of PEs in the context of electronic prescribing (e-prescribing) at hospital discharge. Method: This was a retrospective, observational, 4-week study, carried out in 2008 in the Medical and Elderly Care wards of a 904-bed teaching hospital in the northwest of England, operating an e-prescribing system at discharge. Details were obtained, using a systematic computerized search of the system, of medication orders either entered by doctors and discontinued by pharmacists or entered by pharmacists. Meetings were conducted within 5 days of data extraction with pharmacists doing their routine clinical work, who categorized the occurrence, type and severity of their interventions using a scale. An independent senior pharmacist retrospectively rated the severity and potential impact, and subjectively judged, based on experience, whether any error was a computer-related error (CRE). Discrepancies were resolved by multidisciplinary discussion. The Statistical Package for Social Sciences was used for descriptive data analysis. For the PE predictors, a multivariate logistic regression was performed using STATA® 7. Nine predictors were selected a priori from available prescribers’, patients’ and drug data. Results: There were 7920 medication orders entered for 1038 patients (doctors entered 7712 orders; pharmacists entered 208 omitted orders). There were 675 (8.5% of 7920) interventions by pharmacists; 11 were not associated with PEs. Incidences of erroneous orders and patients with error were 8.0% (95% CI 7.4, 8.5 [n = 630/7920]) and 20.4% (95% CI 18.1, 22.9 [n = 212/1038]), respectively. The PE incidence was 8.4% (95% CI 7.8, 9.0 [n = 664/7920]). The top three medications associated with PEs were paracetamol (acetaminophen; 30 [4.8%]), salbutamol (albuterol; 28 [4.4%]) and omeprazole (25 [4.0%]). Pharmacists intercepted 524 (83.2%) erroneous orders without referring to doctors, and 70% of erroneous orders within 24 hours. Omission (31.0%), drug selection (29.4%) and dosage regimen (18.1%) error types accounted for >75% of PEs. There were 18 (2.9%) serious, 481 (76.3%) significant and 131 (20.8%) minor erroneous orders. Most erroneous orders (469 [74.4%]) were rated as of significant severity and significant impact of pharmacists on PEs. CREs (n = 279) accounted for 44.3% of erroneous orders. There was a significant difference in severity between CREs and non-CREs (χ2= 38.88; df=4; p<0.001), with CREs being less severe than non-CREs. Drugs with multiple oral formulations (odds ratio [OR] 2.1; 95% CI 1.25, 3.37; p = 0.004) and prescribing by junior doctors (OR 2.54; 95% CI 1.08, 5.99; p = 0.03) were significant predictors of PEs. Conclusions: PEs commonly occur at hospital discharge, even with the use of an e-prescribing system. User and computer factors both appeared to contribute to the high error rate. The e-prescribing system facilitated the systematic extraction of data to investigate PEs in hospital practice. Pharmacists play an important role in rapidly documenting and preventing PEs before they reach and possibly harm patients. Pharmacists should understand CREs, so they complement, rather than duplicate, the e-prescribing system’s strengths.

Prevalence of potentially inappropriate long term prescribing in general practice in the United Kingdom, 1980-95: systematic literature review.

Abstract Objective: To determine the prevalence of potentially inappropriate long term prescribing in general practice in the United Kingdom. Design: Review of 62 studies of the appropriateness of prescribing identified from seven electronic databases, from reference lists, and by hand searching of journals. A nominal group of 10 experts helped to define the appropriateness of prescribing. Setting: General practice in the United Kingdom. Main outcome measures: Prevalences of 19 indicators of inappropriate long term prescribing representing five dimensions: indication, choice of drug, drug administration, communication, and review. Results: Prevalences of potentially inappropriate prescribing varied by indicator and chronic condition, but drug dosages outside the therapeutic range consistently recorded the highest rates. The lowest rates were generally associated with indicators of the choice of the drug, except cost minimisation. Communication is studied less frequently than other dimensions of prescribing appropriateness. Conclusions: The evidence base to support allegations of widespread inappropriate prescribing in general practice is unsound. Although inappropriate prescribing has occurred, the scale of the problem is unknown because of limitations associated with selection of a standard, publication bias, and uncertainty about the context of prescribing decisions. Opportunities for cost savings and effectiveness gains are thus unclear. Indicators applicable to individual patients could yield evidence of prescribing appropriateness.

Preventing drug-related morbidity: the development of quality indicators

Objective:  To describe the process that has been undertaken to (i) validate further UK indicators for preventable drug‐related morbidity (PDRM) generated by a previous study and (ii) develop additional new indicators derived from UK clinical practice.

Patient safety features of clinical computer systems: questionnaire survey of GP views

Aim: To investigate general practitioners’ (GPs’) stated knowledge, use and training needs related to the patient safety features of computerised clinical systems in England. Design: Questionnaire survey. Subjects and setting: GPs from six English primary care trusts. Outcome measures: GPs’ views on the importance of specified patient safety features on their computer system; their knowledge of the presence of specified safety features; previous training and perceived future training needs. Results: Three hundred and eighty one GPs (64.0%) completed and returned the questionnaire. Although patient safety features were considered to be an important part of their computer system by the vast majority of GPs, many were unsure as to whether the system they were currently using possessed some of the specified features. Some respondents erroneously believed that their computers would warn them about potential contraindications or if an abnormal dose frequency had been prescribed. Only a minority had received formal training on the use of their system’s patient safety features. Conclusions: Patient safety was an issue high on the agenda of this GP sample. The importance of raising GPs’ awareness of both the potential use and deficiencies of the patient safety features on their systems and ensuring that appropriate training is available should not be underestimated.

Pharmacists’ changing views of their supplementary prescribing authority

ObjectiveTo investigate the views and experiences of pharmacists in England before and after they registered as supplementary prescribers.MethodEight pharmacists were recruited from training courses; seven from secondary care and one from primary care and interviewed during training and again after registration. In the first interviews, topics included previous experience, views on current roles, responsibilities and accountability for prescribing and how these might change. In the second interviews, the pharmacists discussed how these had actually changed after gaining supplementary prescribing authority, how their role worked in practice and how they saw it developing in the future.Main outcome measureDescriptions of anticipated and actual changes in their roles, responsibilities and accountability before and after registration as supplementary prescribersResultsThe pharmacists anticipated that training would legitimise their current ‘informal’ prescribing practices, with increased legal responsibility and accountability, but experienced many procedural delays in implementing their new role. Pharmacists who were already heavily involved with prescribing were more likely to work as prescribers, but not necessarily within the clinical management plan framework. The desire to maintain the efficiency of their existing clinical services impacted negatively on the pharmacists’ ability or willingness to prescribe in this legally approved manner.ConclusionClear and realistic expectations need to be set by the pharmacists as to what is achievable and greater attention needs to be paid to minimising delays between the end of training and the beginning of practice, to minimise reduction in motivation and redeployment of staff.

An embedded longitudinal multi-faceted qualitative evaluation of a complex cluster randomized controlled trial aiming to reduce clinically important errors in medicines management in general practice

BackgroundThere is a need to shed light on the pathways through which complex interventions mediate their effects in order to enable critical reflection on their transferability. We sought to explore and understand key stakeholder accounts of the acceptability, likely impact and strategies for optimizing and rolling-out a successful pharmacist-led information technology-enabled (PINCER) intervention, which substantially reduced the risk of clinically important errors in medicines management in primary care.MethodsData were collected at two geographical locations in central England through a combination of one-to-one longitudinal semi-structured telephone interviews (one at the beginning of the trial and another when the trial was well underway), relevant documents, and focus group discussions following delivery of the PINCER intervention. Participants included PINCER pharmacists, general practice staff, researchers involved in the running of the trial, and primary care trust staff. PINCER pharmacists were interviewed at three different time-points during the delivery of the PINCER intervention. Analysis was thematic with diffusion of innovation theory providing a theoretical framework.ResultsWe conducted 52 semi-structured telephone interviews and six focus group discussions with 30 additional participants. In addition, documentary data were collected from six pharmacist diaries, along with notes from four meetings of the PINCER pharmacists and feedback meetings from 34 practices. Key findings that helped to explain the success of the PINCER intervention included the perceived importance of focusing on prescribing errors to all stakeholders, and the credibility and appropriateness of a pharmacist-led intervention to address these shortcomings. Central to this was the face-to-face contact and relationship building between pharmacists and a range of practice staff, and pharmacists’ explicitly designated role as a change agent. However, important concerns were identified about the likely sustainability of this new model of delivering care, in the absence of an appropriate support network for pharmacists and career development pathways.ConclusionsThis embedded qualitative inquiry has helped to understand the complex organizational and social environment in which the trial was undertaken and the PINCER intervention was delivered. The longitudinal element has given insight into the dynamic changes and developments over time. Medication errors and ways to address these are high on stakeholders’ agendas. Our results further indicate that pharmacists were, because of their professional standing and skill-set, able to engage with the complex general practice environment and able to identify and manage many clinically important errors in medicines management. The transferability of the PINCER intervention approach, both in relation to other prescribing errors and to other practices, is likely to be high.

'You don't really feel you can function normally': women's perceptions and personal management of vaginal thrush

Vaginal symptoms caused by thrush are extremely common. However, there have been few qualitative studies reporting womens perceptions and self - management of this condition. This paper reports the results of 30 telephone interviews that were conducted with women who had previously presented at community pharmacies with a self - diagnosis of vaginal thrush. Some women reported that thrush made them feel miserable, unable to work, embarrassed, or even stigmatized. About half of the women knew that they could take simple measures to prevent the symptoms of thrush, but others wanted more information. Most women reported that over - the - counter medicines had cured their symptoms, but some stressed that alternative remedies such as natural yoghurt were also beneficial. Since it appears that thrush may have a major impact on womens lives, it should be taken seriously by health care professionals. Women need reassurance that thrush is a common condition, and that it is not generally regarded as sexually transmitted. Some researchers have argued that women suffering from chronic thrush may benefit from the development of psychological treatment initiatives. However, it is also important to ensure that women know how to prevent thrush, and to inform women about the range of effective remedies that now exist for this condition.