B.H. Verhoeven

Non-Invasive Markers for Early Diagnosis and Determination of the Severity of Necrotizing Enterocolitis

Objectives:To improve diagnosis of necrotizing enterocolitis (NEC) by noninvasive markers representing gut wall integrity loss (I-FABP and claudin-3) and gut wall inflammation (calprotectin). Furthermore, the usefulness of I-FABP to predict NEC severity and to screen for NEC was evaluated. Methods:Urinary I-FABP and claudin-3 concentrations and fecal calprotectin concentrations were measured in 35 consecutive neonates suspected of NEC at the moment of NEC suspicion. To investigate I-FABP as screening tool for NEC, daily urinary levels were determined in 6 neonates who developed NEC out of 226 neonates included before clinical suspicion of NEC. Results:Of 35 neonates suspected of NEC, 14 developed NEC. Median I-FABP, claudin-3, and calprotectin levels were significantly higher in neonates with NEC than in neonates with other diagnoses. Cutoff values for I-FABP (2.20 pg/nmol creatinine), claudin-3 (800.8 INT), and calprotectin (286.2 &mgr;g/g feces) showed clinically relevant positive likelihood ratios (LRs) of 9.30, 3.74, 12.29, and negative LRs of 0.08, 0.36, 0.15, respectively. At suspicion of NEC, median urinary I-FABP levels of neonates with intestinal necrosis necessitating surgery or causing death were significantly higher than urinary I-FABP levels in conservatively treated neonates.Of the 226 neonates included before clinical suspicion of NEC, 6 developed NEC. In 4 of these 6 neonates I-FABP levels were not above the cutoff level to diagnose NEC before clinical suspicion. Conclusions:Urinary I-FABP levels are not suitable as screening tool for NEC before clinical suspicion. However, urinary I-FABP and claudin-3 and fecal calprotectin are promising diagnostic markers for NEC. Furthermore, urinary I-FABP might also be used to predict disease severity.

Growth of medical knowledge

Background  Knowledge is an essential component of medical competence and a major objective of medical education. Thus, the degree of acquisition of knowledge by students is one of the measures of the effectiveness of a medical curriculum. We studied the growth in student knowledge over the course of Maastricht Medical Schools 6‐year problem‐based curriculum.

The effect on reliability of adding a separate written assessment component to an objective structured clinical examination.

To determine the effect on test reliability when a separate written assessment component is added to an objective structured clinical examination (OSCE).

Panel expertise for an Angoff standard setting procedure in progress testing: item writers compared to recently graduated students.

Introduction  An earlier study showed that an Angoff procedure with ≥ 10 recently graduated students as judges can be used to estimate the passing score of a progress test. As the acceptability and feasibility of this approach are questionable, we conducted an Angoff procedure with test item writers as judges. This paper reports on thereliability and credibility of this procedure and compares the standards set by the two different panels.

The versatility of progress testing assessed in an international context: a start for benchmarking global standardization?

Sharing and collaboration relating to progress testing already takes place on a national level and allows for quality control and comparisons of the participating institutions. This study explores the possibilities of international sharing of the progress test after correction for cultural bias and translation problems. Three progress tests were reviewed and administered to 3043 Pretoria and 3001 Maastricht medical students. In total, 16% of the items were potentially biased and removed from the test items administered to the Pretoria students (9% due to translation problems; 7% due to cultural differences). Of the three clusters (basic, clinical and social sciences) the social sciences contained most bias (32%), basic sciences least (11%). The differences that were found, comparing the student results of both schools, seem a reflection of the deliberate accentuations that both curricula pursue. The results suggest that the progress test methodology provides a versatile instrument that can be used to assess medical schools across the world. Sharing of test material is a viable strategy and test outcomes are interesting and can be used in international quality control.

An Inter- and Intra-University Comparison With Short Case-Based Testing

Comparisons between PBL and non-PBL medical schools on problem-solving ability often show no differences. This could be either due to the fact that no difference in problem-solving skills exists or that the instruments used are inadequate. In this study a key-feature approach case-based examination was used to compare two medical schools in the Netherlands, one of which has a PBL curriculum (Maastricht) and one which has a program half way a transition from a non-PBL towards a PBL curriculum (Groningen). Differences were found both in proficiency scores and in the pattern of response times, both supporting the assumption that a PBL approach would lead to a higher level of problem solving ability. The effect size, however, is not as large as originally assumed by the PBL proponents. Conclusions must be drawn with caution, but it seems likely that a test based on large numbers of short cases is the most sensitive in detecting differences in problem solving ability between students of different curricula.

The reliability of multisource feedback in competency-based assessment programs: the effects of multiple occasions and assessor groups

Purpose Residency programs around the world use multisource feedback (MSF) to evaluate learners’ performance. Studies of the reliability of MSF show mixed results. This study aimed to identify the reliability of MSF as practiced across occasions with varying numbers of assessors from different professional groups (physicians and nonphysicians) and the effect on the reliability of the assessment for different competencies when completed by both groups. Method The authors collected data from 2008 to 2012 from electronically completed MSF questionnaires. In total, 428 residents completed 586 MSF occasions, and 5,020 assessors provided feedback. The authors used generalizability theory to analyze the reliability of MSF for multiple occasions, different competencies, and varying numbers of assessors and assessor groups across multiple occasions. Results A reliability coefficient of 0.800 can be achieved with two MSF occasions completed by at least 10 assessors per group or with three MSF occasions completed by 5 assessors per group. Nonphysicians’ scores for the “Scholar” and “Health advocate” competencies and physicians’ scores for the “Health advocate” competency had a negative effect on the composite reliability. Conclusions A feasible number of assessors per MSF occasion can reliably assess residents’ performance. Scores from a single occasion should be interpreted cautiously. However, every occasion can provide valuable feedback for learning. This research confirms that the (unique) characteristics of different assessor groups should be considered when interpreting MSF results. Reliability seems to be influenced by the included assessor groups and competencies. These findings will enhance the utility of MSF during residency training.

Does Laparoscopy Lower the Threshold for the Surgical Treatment of Gastroesophageal Reflux Disease in Children

Objective: To assess whether laparoscopic surgery lowers the threshold for surgical intervention, we examined whether the introduction of the laparoscopic technique at our institution in 1997 has resulted in an increase in antireflux surgery in children at our clinic. Patients and Methods: The number of annual fundoplications between 1997 and 2008 at a single institution was assessed in children younger than 18 years. The number of fundoplications was compared with the number of pyloromyotomies and appendicectomies per year in the same period of time to prove or exclude a general increase in the referral of children. Results: Since 1997, the proportion of laparoscopic fundoplications increased from 60% in 1997 to 100% in 2008. During this period, 109 laparoscopic fundoplications were performed: 31 in the period from 1997 to 2002 and 78 from 2003 to 2008. Regression analysis shows a significant increase in the number of performed fundoplications (slope: 1.03 ± 0.28, P = 0.0043), whereas both the number of pyloromyotomies and appendicectomies remained stable (slopes: −0.14 ± 0.40, P = 0.73, and −0.75 ± 0.47, P = 0.14, respectively). Conclusions: Since the introduction of minimally invasive surgery at our tertiary referral center in 1997, the number of patients referred for an antireflux operation has increased. This cannot be explained by an increase of referrals from outside the region or a change in the indication for surgery. We conclude that laparoscopy lowers the threshold for the surgical treatment of gastroesophageal reflux disease in children.