Sebastiaan Koole

Factors confounding the assessment of reflection: a critical review

BackgroundReflection on experience is an increasingly critical part of professional development and lifelong learning. There is, however, continuing uncertainty about how best to put principle into practice, particularly as regards assessment. This article explores those uncertainties in order to find practical ways of assessing reflection.DiscussionWe critically review four problems: 1. Inconsistent definitions of reflection; 2. Lack of standards to determine (in)adequate reflection; 3. Factors that complicate assessment; 4. Internal and external contextual factors affecting the assessment of reflection.SummaryTo address the problem of inconsistency, we identified processes that were common to a number of widely quoted theories and synthesised a model, which yielded six indicators that could be used in assessment instruments. We arrived at the conclusion that, until further progress has been made in defining standards, assessment must depend on developing and communicating local consensus between stakeholders (students, practitioners, teachers, supervisors, curriculum developers) about what is expected in exercises and formal tests. Major factors that complicate assessment are the subjective nature of reflections content and the dependency on descriptions by persons being assessed about their reflection process, without any objective means of verification. To counter these validity threats, we suggest that assessment should focus on generic process skills rather than the subjective content of reflection and where possible to consider objective information about the triggering situation to verify described reflections. Finally, internal and externalcontextual factors such as motivation, instruction, character of assessment (formative or summative) and the ability of individual learning environments to stimulate reflection should be considered.

A survey on undergraduate implant dentistry education in Europe

INTRODUCTION The aim of the survey was to assess the status of implant dentistry education and addressed various aspects related to competence level, practical implementation and barriers for further development in the field. MATERIALS AND METHODS An e-mail survey was performed amongst 73 opinion leaders from 18 European countries invited to the Association for Dental Education in Europe (ADEE) workshop on implant dentistry. RESULTS Forty-nine surveys were returned (67%) and it was found that theoretical and pre-clinical courses to an average of 36 h are given to undergraduates; 70% reported that students assist or treat patients with prosthetics; 53% reported that students assist with surgery and only 5% is operating patients. In 23% of the schools optional undergraduate courses are available and 90% offer postgraduate training. Barriers for including prosthetics and surgery are lack of time, funding or staff. Partial restorations, including surgery, in the posterior regions may be provided by dentists after attendance at additional courses but complex treatments should be limited to specialists. CONCLUSION This survey confirms that implant dentistry is part of the undergraduate curriculum, albeit with a disparity in time. Whereas implant dentistry is an important part of clinical practice, coverage in the curriculum is limited and when compared with 10 years ago, even stagnating. Priorities within the curriculum should be evaluated depending on demands and treatment needs of the population. To optimise education, learning guidelines should be developed, based on the expected competencies for practicing dentists. Undergraduate education may start the process that must continue through all levels of education, including the postgraduate level.

Impact of three alternative consultation training formats on self-efficacy and consultation skills of medical students

Background: Conducting a consultation is a core competence of medical professionals. Consultation training of medical students centers on clinical, communication, reasoning and reflection skills. The training incorporates practice with a standardized simulated patient and supervising physician, to prepare for real patient encounters. To meet the request for more training, while dealing with an increasing student population and limited staff availability, alternative formats of consultation training were developed and evaluated. Aim: To investigate the impact of three consultation training formats on students’ self-efficacy beliefs and their consultation skills acquisition. The three formats comprised (1) traditional training with supervising physician, (2) autonomous training with feedback from simulated patients and peers, without direct supervision and (3) online training based on video fragments and answering guiding questions. Methods: A quasi-experimental pre/posttest study was set up, with random assignment of students to a training condition. The differential impact was tested on two dependent measures: self-efficacy and consultation performance. Self-efficacy was tested with a nine-item scale and the cognitive component of consultation performance was tested on the base of responses to a standardized video case. Results: The autonomous training has a significant positive effect on students’ self-efficacy (p = 0.016). The traditional training and the online training did only positively influence the cognitive component of the consultation competence (p < 0.001 and p = 0.003). Conclusions: Each consultation training contributes to the learning process in a different way. In order to achieve optimum learning effects, medical educators should be aware of the particular impact of specific trainings on the cognitive and motivational side of skills and pursue a balanced mixture of instructional formats.

Does reflection have an effect upon case-solving abilities of undergraduate medical students?

BackgroundReflection on professional experience is increasingly accepted as a critical attribute for health care practice; however, evidence that it has a positive impact on performance remains scarce. This study investigated whether, after allowing for the effects of knowledge and consultation skills, reflection had an independent effect on students’ ability to solve problem cases.MethodsData was collected from 362 undergraduate medical students at Ghent University solving video cases and reflected on the experience of doing so. For knowledge and consultation skills results on a progress test and a course teaching consultation skills were used respectively. Stepwise multiple linear regression analysis was used to test the relationship between the quality of case-solving (dependent variable) and reflection skills, knowledge, and consultation skills (dependent variables).ResultsOnly students with data on all variables available (n = 270) were included for analysis. The model was significant (Anova F(3,269) = 11.00, p < 0.001, adjusted R square 0.10) with all variables significantly contributing.ConclusionMedical students’ reflection had a small but significant effect on case-solving, which supports reflection as an attribute for performance. These findings suggest that it would be worthwhile testing the effect of reflection skills training on clinical competence.

Implant dentistry education in Europe: 5 years after the Association for Dental Education in Europe consensus report

INTRODUCTION To promote consensus on implant dentistry university education in Europe, a workshop amongst university teachers and opinion leaders was organised in 2008. As a result, guidelines on both under- and postgraduate education were issued. This study aims to investigate the current status of university teaching of implant dentistry and the impact of the recommendations for teaching and assessment, 5 years after the first consensus. Finally, this report attempts to identify future directions in education within the discipline. MATERIALS AND METHODS An online survey was distributed amongst 105 academic leaders in implant education in Europe, and 52 questionnaires were returned (response rate 50%). RESULTS The average amount of implant dentistry in undergraduate curricula has increased to 74 h, compared to 36 h in 2008, and the inclusion of pre-clinical and clinical education has increased. No change occurred with regard to the aimed competence levels. It was suggested that certain implant procedures including surgery should be provided by dentists after attending additional courses, whilst complex treatments will still require specialist training. The 2008 workshop guidelines have been implemented to a varying extent (25-100%) in under- and postgraduate education. Main reported implementation barriers included limited time availability in the curriculum and limited financial/material resources. Future discussions about implant dentistry in Europe should be focused towards integration in current dental curricula, approaches to overcome barriers and the relations with and role of industrial partners. CONCLUSION Implant dentistry is increasingly integrating in undergraduate dental education. Development of the consensus guidelines in 2008 may have facilitated this process. Nevertheless, further progress is needed on all educational levels to align training of professionals to the growing treatment needs of the population.

Using video-cases to assess student reflection: development and validation of an instrument.

BackgroundReflection is a meta-cognitive process, characterized by: 1. Awareness of self and the situation; 2. Critical analysis and understanding of both self and the situation; 3. Development of new perspectives to inform future actions. Assessors can only access reflections indirectly through learners’ verbal and/or written expressions. Being privy to the situation that triggered reflection could place reflective materials into context. Video-cases make that possible and, coupled with a scoring rubric, offer a reliable way of assessing reflection.MethodsFourth and fifth year undergraduate medical students were shown two interactive video-cases and asked to reflect on this experience, guided by six standard questions. The quality of students’ reflections were scored using a specially developed Student Assessment of Reflection Scoring rubric (StARS®). Reflection scores were analyzed concerning interrater reliability and ability to discriminate between students. Further, the intra-rater reliability and case specificity were estimated by means of a generalizability study with rating and case scenario as facets.ResultsReflection scores of 270 students ranged widely and interrater reliability was acceptable (Krippendorff’s alpha = 0.88). The generalizability study suggested 3 or 4 cases were needed to obtain reliable ratings from 4th year students and ≥ 6 cases from 5th year students.ConclusionUse of StARS® to assess student reflections triggered by standardized video-cases had acceptable discriminative ability and reliability. We offer this practical method for assessing reflection summatively, and providing formative feedback in training situations.

Contemporary undergraduate implant dentistry education: a systematic review

INTRODUCTION Consensus reports recommend that students upon graduation should possess a significant level of knowledge and competence in implant dentistry, including basic competences in diagnostics, treatment planning, restorative, straightforward surgical and maintenance procedures. In response, undergraduate curricula need to integrate implant dentistry. This narrative review explores educational programmes in terms of competences, related research and barriers or reflections, regarding implementation in undergraduate curricula. MATERIALS AND METHODS Publications (2008-2013) were searched systematically in WoS, PubMed and ERIC and screened independently by two authors in four stages: removal of duplicates, title screening, abstract screening and full-text reading. Inclusion criteria encompassed implant dentistry in undergraduate education. RESULTS Finally, 37 of 420 papers were included. Detailed information regarding programme content, number of participants, staff input, logistics/funding issues is scattered. Theoretical education is predominant, and pre-clinical/clinical training is offered minimally, often carried out in elective programmes. However, selected straightforward cases treated by undergraduates yield positive outcomes with low failure rates, few complications, high patient satisfaction and student appreciation. Barriers to implementing implant dentistry in the undergraduate curriculum include funding issues, limitations in time or staff availability/competence and lack of suitable patients. Overcoming these barriers is worthwhile as experience-based implant education affects future practice as well-informed students propose more restorative alternatives to their patients. CONCLUSION Although implant dentistry is increasingly integrated in undergraduate curricula, challenges remain in developing strategies to implement existing competence profiles and the extent of experience-based education. To support further advancement, universities should report comprehensively on their implant programmes to allow comparison and reproduction in other environments.

Developing implant dentistry education in Europe: the continuum from undergraduate to postgraduate education and continuing professional development.

INTRODUCTION Implant dentistry is a treatment modality which has mainstream clinical practice of comprehensive care, which however is not adequately represented in the undergraduate dental curricula. A consensus workshop organised by ADEE in 2008, set the benchmarks for the knowledge and competences a modern dental practitioner must possess with regard to implant dentistry, as well as defined undergraduate and postgraduate pathways for the acquisition of these competences. Today, 5 years later, there exist several challenges for the implementation of these benchmarks in both undergraduate curricula but also post-graduation educational pathways. METHODS A consensus workshop was organised by ADEE, bringing together 48 opinion leaders, including academic teachers of all disciplines related to implant dentistry, specialists, representatives of relevant scientific and professional associations, as well as industry delegates. The objectives of the workshop were to evaluate the existing scientific literature, reported experience and best practices in order to identify potential and limitations for the implementation of implant dentistry in the undergraduate curriculum, as well produce recommendations for the optimal educational structures for postgraduate programmes and continuing professional development. RESULTS The scientific committee conducted two European-wide questionnaire surveys to better document the current state of education in implant dentistry. Upon completion of the surveys, reviewers were appointed to produce three scientific review papers, identifying current achievements and future challenges. Finally, during the 3 days of the workshop, all the evidence was reviewed and the main conclusions and recommendations that were adopted by all participants are reported in the present Consensus Paper. CONCLUSIONS Implementation of implant dentistry in the undergraduate curriculum has improved significantly, but still lags behind the benchmarks set in 2008 and the diversity between institutions remains big. At the post-graduation level, there is currently a wide diversity of courses and pathways towards competences related to implant dentistry and there is at present a great need for quality assurance, as well as standardisation and transparency of the learning outcomes.

A novel Medical Achievement Self-efficacy Scale (MASS): A valid and reliable tool

In search for an instrument to measure overall curriculum impact, we developed a Medical Achievement Self-efficacy Scale (MASS) and presented it to medical students enrolled in the different years of the integrated Ghent curriculum. The research aim was to study the validity and reliability of this new scale. MASS items were constructed based on the end terms of the Ghent curriculum, as it is related to the general competency frameworks of CanMEDs and the Five-star Doctor. The scale includes at least two items for each CanMEDS competency domain. Items were examined by seven experts in view of content and face validity. This resulted in an MASS version, containing 18 items, to be rated on a five-point Likert scale. This version was piloted on 94 undergraduate medical students enrolled at the Catholic University of Leuven. The final version was presented to 1066 undergraduate medical students enrolled at Ghent University. Reliability of the MASS scale was high (α = 0.89). As expected, self-efficacy scores increased significantly over the years (F = 39.11, p < 0.001). In view of determining predictive validity, regression analysis was carried out to predict students’ academic achievement from self-efficacy scores. As expected, MASS scores significantly predicted Maastricht Progress Test scores (F = 108.18, p < 0.001).

The provision of oral hygiene instructions and patient motivation in a dental care system without dental hygienists

INTRODUCTION Oral hygiene instructions (OHI) and patient motivation (PM), often provided by dental hygienists, are essential attributes to establishing good oral health in patients. The purpose of this study was to investigate the provision of OHI and PM by dental professionals in a dental care system without dental hygienists. METHODS AND MATERIALS A questionnaire, including 22 items (demographics, OHI and PM), was presented to 1037 dental professionals (=21.6% Flemish population). Descriptive statistics were used to analyse the provision of OHI and PM. Additionally, the Fisher-Freeman-Halton exact test was used to investigate the influence of qualification (general practitioner/specialist), work experience (< or ≥ 25 years), workload (< or ≥ 30 h), location of practice (rural/urban) and chair-side assistance (with/without). RESULTS Response rate was 75%. Participants reported a single strategy for preventive care and felt their efforts were not in harmony with the results. Lack of time, remuneration and patient interest were reported as complicating factors and participants agreed on allowing assistants to provide preventive care. Significant variance was found based on qualification (12/17 items), work experience (7/17 items), workload (1/17 items), location of practice (2/17 items) and chair-side assistance (15/17 items). CONCLUSION In a context without dental hygienists, OHI and PM appeared non-compliant with current international guidelines. Although dental professionals were concerned with preventive dentistry, they reported barriers including lack of time, remuneration and patient compliance. Almost all participants expressed the need for delegation of in-mouth OHI, suggesting a need for dental hygienists.