Brendan Clarke

The evidence that evidence-based medicine omits

According to current hierarchies of evidence for EBM, evidence of correlation (e.g., from RCTs) is always more important than evidence of mechanisms when evaluating and establishing causal claims. We argue that evidence of mechanisms needs to be treated alongside evidence of correlation. This is for three reasons. First, correlation is always a fallible indicator of causation, subject in particular to the problem of confounding; evidence of mechanisms can in some cases be more important than evidence of correlation when assessing a causal claim. Second, evidence of mechanisms is often required in order to obtain evidence of correlation (for example, in order to set up and evaluate RCTs). Third, evidence of mechanisms is often required in order to generalise and apply causal claims. While the EBM movement has been enormously successful in making explicit and critically examining one aspect of our evidential practice, i.e., evidence of correlation, we wish to extend this line of work to make explicit and critically examine a second aspect of our evidential practices: evidence of mechanisms.

Is undergraduate otorhinolaryngology teaching relevant to junior doctors working in accident and emergency departments

Undergraduate ENT teaching provides junior doctors with skills and knowledge useful for the practice of medicine. However, ENT has been removed from the curriculum of nine of the 29 medical schools in the United Kingdom, as it was not deemed relevant to general medical practice. A telephone survey was performed of 20 senior house officers working in accident and emergency (A&E) departments across the United Kingdom. The results showed that 90 per cent felt their undergraduate ENT teaching was directly beneficial to working in A&E, 75 per cent felt they had not received enough undergraduate ENT teaching and 45 per cent currently received no postgraduate teaching whilst working in A&E. These results illustrate the importance of ENT teaching in the undergraduate curriculum and its value to practising doctors. They highlight the fact that prospective studies are required to examine the effect on junior doctors of changing the curriculum.

Modelling mechanisms with causal cycles

Mechanistic philosophy of science views a large part of scientific activity as engaged in modelling mechanisms. While science textbooks tend to offer qualitative models of mechanisms, there is increasing demand for models from which one can draw quantitative predictions and explanations. Casini et al. (Theoria 26(1):5–33, 2011) put forward the Recursive Bayesian Networks (RBN) formalism as well suited to this end. The RBN formalism is an extension of the standard Bayesian net formalism, an extension that allows for modelling the hierarchical nature of mechanisms. Like the standard Bayesian net formalism, it models causal relationships using directed acyclic graphs. Given this appeal to acyclicity, causal cycles pose a prima facie problem for the RBN approach. This paper argues that the problem is a significant one given the ubiquity of causal cycles in mechanisms, but that the problem can be solved by combining two sorts of solution strategy in a judicious way.

A Radical Approach to Ebola: Saving Humans and Other Animals

As the usual regulatory framework did not fit well during the last Ebola outbreak, innovative thinking still needed. In the absence of an outbreak, randomised controlled trials of clinical efficacy in humans cannot be done, while during an outbreak such trials will continue to face significant practical, philosophical, and ethical challenges. This article argues that researchers should also test the safety and effectiveness of novel vaccines in wild apes by employing a pluralistic approach to evidence. There are three reasons to test vaccines in wild populations of apes: i) protect apes; ii) reduce Ebola transmission from wild animals to humans; and iii) accelerate vaccine development and licensing for humans. Data obtained from studies of vaccines among wild apes and chimpanzees may even be considered sufficient for licensing new vaccines for humans. This strategy will serve to benefit both wild apes and humans.

Causation and melanoma classification.

In this article, I begin by giving a brief history of melanoma causation. I then discuss the current manner in which malignant melanoma is classified. In general, these systems of classification do not take account of the manner of tumour causation. Instead, they are based on phenomenological features of the tumour, such as size, spread, and morphology. I go on to suggest that misclassification of melanoma is a major problem in clinical practice. I therefore outline an alternative means of classifying these tumours based on causal factors. By analogy with similar systems that have recently emerged for other cancers, I suggest that this causal classification is likely to be both workable and helpful, even in the absence of a full causal-mechanistic understanding of the aetiology of the tumour.

Evaluating Evidence of Mechanisms in Medicine: Principles and Procedures

This book is the first to develop explicit methods for evaluating evidence of mechanisms in the field of medicine. It explains why it can be important to make this evidence explicit, and describes how to take such evidence into account in the evidence appraisal process. In addition, it develops procedures for seeking evidence of mechanisms, for evaluating evidence of mechanisms, and for combining this evaluation with evidence of association in order to yield an overall assessment of effectiveness. Evidence-based medicine seeks to achieve improved health outcomes by making evidence explicit and by developing explicit methods for evaluating it. To date, evidence-based medicine has largely focused on evidence of association produced by clinical studies. As such, it has tended to overlook evidence of pathophysiological mechanisms and evidence of the mechanisms of action of interventions. The book offers a useful guide for all those whose work involves evaluating evidence in the health sciences, including those who need to determine the effectiveness of health interventions and those who need to ascertain the effects of environmental exposures.

An Introduction to Mechanisms

This chapter offers a brief summary of mechanisms, as including complex-system mechanisms (a complex arrangement of entities and activities, organised in such a way as to be regularly or predictably responsible for the phenomenon to be explained) and mechanistic processes (a spatio-temporal pathway along which certain features are propagated from the starting point to the end point). The chapter emphasises that EBM+ is concerned with evidence of mechanisms, not mere just-so stories, and summarises some key roles assessing evidence of mechanisms can play, particularly with respect to assessing efficacy and external validity.

Using Evidence of Mechanisms to Evaluate Efficacy and External Validity

Previous chapters in Part III develop accounts of how to gather and evaluate evidence of claims about mechanisms. This chapter explains how this evaluation can be combined with an evaluation of evidence for relevant correlations in order to produce an overall evaluation of a causal claim. The procedure is broken down to address efficacy, external validity, and then the overall presentation of the claim.

Evaluating Evidence of Mechanisms

In this chapter, we discuss how to evaluate evidence of mechanisms. This begins with an account of how a mechanistic study provides evidence for features of specific mechanism hypotheses, laying out a three step procedure of evaluating: (1) the methods used, (2) the implementation of the methods, and (3), the stability of the results. The next step is to combine those evaluations to present the quality of evidence of the general mechanistic claim.

Gathering Evidence of Mechanisms

In this chapter we put forward more theoretical proposals for gathering evidence of mechanisms. Specifically, the chapter covers the identification of a number of mechanism hypotheses, formulation of review questions for search, and then how to refine and present the resulting evidence. Key issues include increased precision concerning the nature of the hypothesis being examined, attention to differences between the study population (or populations) and the target population of the evidence assessors, and being alert for masking mechanisms, which are other mechanisms which may mask the action of the mechanism being assessed. An outline example concerning probiotics and dental caries is given. (Databases that may be helpful for some searches can be found online in Appendix A).