Sjoerd Hobma

The use of portfolios for assessment of the competence and performance of doctors in practice.

Background  The use of portfolios can potentially provide flexibility in the summative assessment of doctors in practice. An assessment system should reflect and reinforce the active and planned professional development goals of individual doctors. This paper discusses some of the issues involved in developing such a system.

Effectiveness of interdisciplinary primary care approach to reduce disability in community dwelling frail older people: cluster randomised controlled trial.

Objective To evaluate whether an interdisciplinary primary care approach for community dwelling frail older people is more effective than usual care in reducing disability and preventing (further) functional decline. Design Cluster randomised controlled trial. Setting 12 general practices in the south of the Netherlands Participants 346 frail older people (score ≥5 on Groningen Frailty Indicator) were included; 270 (78%) completed the study. Interventions General practices were randomised to the intervention or control group. Practices in the control group delivered care as usual. Practices in the intervention group implemented the “Prevention of Care” (PoC) approach, in which frail older people received a multidimensional assessment and interdisciplinary care based on a tailor made treatment plan and regular evaluation and follow-up. Main outcome measures The primary outcome was disability, assessed at 24 months by means of the Groningen Activity Restriction Scale. Secondary outcomes were depressive symptomatology, social support interactions, fear of falling, and social participation. Outcomes were measured at baseline and at 6, 12, and 24 months’ follow-up. Results 193 older people in the intervention group (six practices) received the PoC approach; 153 older people in the control group (six practices) received care as usual. Follow-up rates for patients were 91% (n=316) at six months, 86% (n=298) at 12 months, and 78% (n=270) at 24 months. Mixed model multilevel analyses showed no significant differences between the two groups with regard to disability (primary outcome) and secondary outcomes. Pre-planned subgroup analyses confirmed these results. Conclusions This study found no evidence for the effectiveness of the PoC approach. The study contributes to the emerging body of evidence that community based care in frail older people is a challenging task. More research in this field is needed. Trial registration Current Controlled Trials ISRCTN31954692.

Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice.

This study compares the predictive values of written‐knowledge tests and a standardized multiple‐station examination for the actual medical performance of general practitioners (GPs) in order to select effective assessment methods to be used in quality‐improvement activities.

Linking assessment to learning: a new route to quality assurance in medical practice

Background  If continuing professional development is to work and be sensible, an understanding of clinical practice is needed, based on the daily experiences of doctors within the multiple factors that determine the nature and quality of practice. Moreover, there must be a way to link performance and assessment to ensure that ongoing learning and continuing competence are, in reality, connected. Current understanding of learning no longer holds that a doctor enters practice thoroughly trained with a lifetimes storehouse of knowledge. Rather a doctors ongoing learning is a ‘journey’ across a practice lifetime, which involves the doctor as a person, interacting with their patients, other health professionals and the larger societal and community issues.

Setting a standard for performance assessment of doctor-patient communication in general practice

Context  Continuing professional development (CPD) of general practitioners.

Reducing disability in community-dwelling frail older people: cost-effectiveness study alongside a cluster randomised controlled trial

BACKGROUND although proactive primary care, including early detection and treatment of community-dwelling frail older people, is a part of the national healthcare policy in several countries, little is known about its cost-effectiveness. OBJECTIVE to evaluate the cost-effectiveness of a proactive primary care approach in community-dwelling frail older people. DESIGN AND SETTING embedded in a cluster randomised trial among 12 Dutch general practitioner practices, an economic evaluation was performed from a societal perspective with a time horizon of 24 months. METHOD frail older people in the intervention group received an in-home assessment and interdisciplinary care based on a tailor-made treatment plan and regular evaluation and follow-up. Practices in the control group delivered usual care. The primary outcome for the cost-effectiveness and cost-utility analysis was disability and health-related quality of life, respectively. RESULTS multilevel analyses among 346 frail older people showed no significant differences between the groups regarding disability and health-related quality of life at 24 months. People in the intervention group used, as expected, more primary care services, but there was no decline in more expensive hospital and long-term care. Total costs over 24 months tended to be higher in the intervention group than in the control group (€26,503 versus €20,550, P = 0.08). CONCLUSIONS the intervention under study led to an increase in healthcare utilisation and related costs without providing any beneficial effects. This study adds to the scarce amount of evidence of the cost-effectiveness of proactive primary care in community-dwelling frail older people. TRIAL REGISTRATION Current Controlled Trials, ISRCTN 31954692.

A disability prevention programme for community-dwelling frail older persons

This series of articles for rehabilitation in practice aims to cover a knowledge element of the rehabilitation medicine curriculum. Nevertheless they are intended to be of interest to a multidisciplinary audience. The competency addressed in this article is ‘The trainee consistent demonstrates a knowledge of how evidence based methods and strategies can be incorporated in an integral and multidisciplinary programme for community-dwelling frail elderly.’ Abstract Objective: To describe and justify a primary care interdisciplinary programme for community-dwelling frail older people aimed to prevent disability. Background: Disability is a negative outcome of frailty among older persons. Policy reports and research studies emphasize the need for programmes to reduce disability progression. Between 2008 and 2010 we developed such a programme. Development: Following the Intervention Mapping protocol, a research team and a multidisciplinary professional developed the programme. Literature reviews and an expert meeting led to identification of basic elements, theory-based methods and practical tools. The programme: The general practitioner and the practice nurse comprise the core team that can be extended by other professionals such as occupational and physical therapist. The programme includes six steps: (1) screening, (2) assessment, (3) analysis and preliminary action plan, (4) agreement on an action plan, (5) execution of the action plan (toolbox parts) and (6) evaluation and follow-up. The main features are: identifying risks for developing disability and targeting risk factors using professional standards and the 5A Behavioural Change Model to support self management, and identifying problems in performing activities and enhancing meaningful activities based on the Model of Human Occupation. Screening, individual assessment, tailor-made and client-centred care, self-management support, case management and interdisciplinary cooperation are important principles in delivering the programme. Discussion: The disability-prevention programme seems promising for addressing the needs of frail older people for independent living and for targeting risk factors. Its feasibility and effects are currently being tested in a randomized controlled trial.

Follow-up care by patient's own general practitioner after contact with out-of-hours care. A descriptive study

BackgroundLittle is known about the care process after patients have contacted a GP cooperative for out-of-hours care. The objective of this study was to determine the proportion of patients who seek follow-up care after contact with a GP cooperative for out-of-hours care, and to gain insight into factors that are related to this follow-up care.MethodsA total of 2805 patients who contacted a GP cooperative for out-of-hours care were sent a questionnaire. They were asked whether they had attended their own GP within a week after their contact with the cooperative, and for what reason. To investigate whether other variables are related to follow-up care, a logistic regression analysis was applied. Variables that entered in this analysis were patient characteristics (age, gender, etc.) and patient opinion on correctness of diagnosis, urgency and severity of the medical complaint.ResultsThe response rate was 42%. In total, 48% of the patients received follow-up care from their own GP. Only 20% were referred or advised to attend their own GP. Others attended because their medical condition worsened or because they were concerned about their complaint. Variables that predicted follow-up care were the patients opinion on the correctness of the diagnosis, patients health insurance, and severity of the medical problem.ConclusionAlmost half of all patients in this study who contacted the GP cooperative for out-of-hours care attended their own GP during office hours within a week, for the same medical complaint. The most important factor that predicted follow-up care from the patients own GP after an out-of-hours contact was the patients degree of confidence in the diagnosis established at the GP cooperative. Despite the limited generalisability, this study is a first step in providing insight into the dimension of follow-up care after a patient has contacted the GP cooperative for out-of-hours primary care.

Establishing a European research agenda on 'gut feelings' in general practice. A qualitative study using the nominal group technique.

Abstract Objective: Although ‘gut feelings’ are perceived as playing a substantial role in the diagnostic reasoning of the general practitioner (GP), there is little evidence about their diagnostic and prognostic value. Consensus on both types of ‘gut feelings’ (a ‘sense of alarm’, a ‘sense of reassurance’) has enabled us to operationalize the concept. As a next step we wanted to identify research questions that are considered relevant to validate the concept of ‘gut feelings’ and to estimate its usefulness for daily practice and medical education. Moreover, we were interested in the study designs considered appropriate to study these research questions. Methods: The nominal group technique (NGT) is a qualitative research method of judgmental decision-making involving four phases: generating ideas, recording them, evaluation and prioritization. Dutch and Belgian academics whose subject is general practice (n = 18), attended one of three meetings during which NGT was used to produce a ‘research agenda’ on ‘gut feelings’. Results: NGT yielded ten research questions and nine corresponding appropriate designs on four topics, i.e. the diagnostic value of ‘gut feelings’, the validation of its determinants, the opportunities for integrating ‘gut feelings’ in medical education and a rest group. The study designs respectively included recording and follow-up of ‘gut feelings’, video recording of consultations with stimulated recall using simulated and real patients respectively, analysing trainees’ consultation stories and videos, linguistic analyses, and vignette studies. Furthermore, two experimental designs were proposed. Conclusion: A European research agenda on ‘gut feelings’ in general practice has been established and could be used in collaborative research.

The challenge of transferring an implementation strategy from academia to the field. A process evaluation of local quality improvement collaboratives in Dutch primary care using the normalization process theory

RATIONALE, AIMS AND OBJECTIVES A quality improvement strategy consisting of comparative feedback and peer review embedded in available local quality improvement collaboratives proved to be effective in changing the test-ordering behaviour of general practitioners. However, implementing this strategy was problematic. We aimed for large-scale implementation of an adapted strategy covering both test ordering and prescribing performance. Because we failed to achieve large-scale implementation, the aim of this study was to describe and analyse the challenges of the transferring process. METHODS In a qualitative study 19 regional health officers, pharmacists, laboratory specialists and general practitioners were interviewed within 6 months after the transfer period. The interviews were audiotaped, transcribed and independently coded by two of the authors. The codes were matched to the dimensions of the normalization process theory. RESULTS The general idea of the strategy was widely supported, but generating the feedback was more complex than expected and the need for external support after transfer of the strategy remained high because participants did not assume responsibility for the work and the distribution of resources that came with it. CONCLUSION Evidence on effectiveness, a national infrastructure for these collaboratives and a general positive attitude were not sufficient for normalization. Thinking about managing large databases, responsibility for tasks and distribution of resources should start as early as possible when planning complex quality improvement strategies. Merely exploring the barriers and facilitators experienced in a preceding trial is not sufficient. Although multifaceted implementation strategies to change professional behaviour are attractive, their inherent complexity is also a pitfall for large-scale implementation.