Piet Van den Bossche

Effects of problem-based learning: A meta-analysis.

This meta-analysis has two aims: (a) to address the main effects of problem based learning on two categories of outcomes: knowledge and skills; and (b) to address potential moderators of the effect of problem based learning. We selected 43 articles that met the criteria for inclusion: empirical studies on problem based learning in tertiary education conducted in real-life classrooms. The review reveals that there is a robust positive effect from PBL on the skills of students. This is shown by the vote count, as well as by the combined effect size. Also no single study reported negative effects. A tendency to negative results is discerned when considering the effect of PBL on the knowledge of students. The combined effect size is significantly negative. However, this result is strongly influenced by two studies and the vote count does not reach a significant level. It is concluded that the combined effect size for the effect on knowledge is non-robust. As possible moderators of PBL effects, methodological factors, expertise-level of students, retention period and type of assessment method were investigated. This moderator analysis shows that both for knowledge- and skills-related outcomes the expertise-level of the student is associated with the variation in effect sizes. Nevertheless, the results for skills give a consistent positive picture. For knowledge-related outcomes the results suggest that the differences encountered in the first and the second year disappear later on. A last remarkable finding related to the retention period is that students in PBL gained slightly less knowledge, but remember more of the acquired knowledge.

Effects of Problem-Based Learning: A Meta-Analysis From the Angle of Assessment

This meta-analysis investigated the influence of assessment on the reported effects of problem-based learning (PBL) by applying Sugrue’s (1995) model of cognitive components of problem solving. Three levels of the knowledge structure that can be targeted by assessment of problem solving are used as the main independent variables: (a) understanding of concepts, (b) understanding of the principles that link concepts, and (c) linking of concepts and principles to conditions and procedures for application. PBL had the most positive effects when the focal constructs being assessed were at the level of understanding principles that link concepts. The results suggest that the implications of assessment must be considered in examining the effects of problem-based learning and probably in all comparative education research.

Social and Cognitive Factors Driving Teamwork in Collaborative Learning Environments Team Learning Beliefs and Behaviors

A team is more than a group of people in the same space, physical or virtual. In recent years, increasing attention has been devoted to the social bases of cognition, taking into consideration how social processes in groups and teams affect performance. This article investigates when and how teams in collaborative learning environments engage in building and maintaining mutually shared cognition, leading to increased perceived performance. In doing so, this research looks for discourse practices managing the co-construction of mutually shared cognition and reveals conditions in the interpersonal context that contribute to engagement in these knowledge-building practices. A comprehensive theoretical framework was developed and tested. The constructs in the model were measured with the Team Learning Beliefs & Behaviors Questionnaire and analyzed using regression and path analysis methodology. Results showed that both interpersonal and sociocognitive processes have to be taken into account to understand the formation of mutually shared cognition, resulting in higher perceived team performance.

The Relationship between Students' Approaches to Learning and the Assessment of Learning Outcomes

The purpose of the present study is to gain more insight into the relationship between students’ approaches to learning and students’ quantitative learning outcomes, as a function of the different components of problem-solving that are measured within the assessment. Data were obtained from two sources: the revised two factor study process questionnaire (R-SPQ-2F) and students’ scores in their final multiple-choice exam. Using a model of cognitive components of problem-solving translated into specifications for assessment, the multiple-choice questions were divided into three categories. Three aspects of the knowledge structure that can be targeted by assessment of problem-solving were used as the distinguishing categories. These were: understanding of concepts; understanding of the principles that link concepts; and linking of concepts and principles to application conditions and procedures. The 133 second year law school students in our sample had slightly higher scores for the deep approach than for the surface approach to learning. Plotting students’ approaches to learning indicated that many students had low scores for both deep and surface approaches to learning. Correlational analysis showed no relationship between students’ approaches to learning and the components of problem-solving being measured within the multiple choice assessment. Several explanations are discussed.RésuméLe but de cette étude est d’avoir une meilleure vue sur la relation qui y a entre la manière d’étudier des étudiants et les résultats quantitatifs, en fonction des différents composants de ‘résolution de cas’ qui sont estimés dans l’examen. Les données ont été obtenus par deux sources: le questionnaire révise de processus facteur deux [revised two factor study process questionnaire (R-SPQ-2F)] et les points obtenus par les étudiants dans leur examen choix multiple final. Employant un modèle de composants cognitifs de ‘résolution de cas’ traduits dans les spécifications de l’examen, les questions du choix multiple étaient divisées en trois catégories. Trois aspects de la structure concernant la connaissance qui peuvent être estimés par un examen de résolution de cas, sont repris dans l’examen distingués par catégories. Cela comprenait: la compréhension des concepts; la compréhension des principes qui lie les concepts; et lier les concepts et principes pour appliquer des conditions et procédures. Les 133 étudiants de deuxième année en droit de notre sondage avaient des points un peu meilleurs pour l’approche de l’étude en profondeur que pour l’approche en surface. Le tracé des manières d’étudier indique que beaucoup d’étudiants avaient des mauvais points pour l’approche en profondeur ainsi qu’en surface. L’analyse corrélationnel ne montre aucune relation entre la manière d’étudier et les composants de ‘résolution de cas’, estimée dans l’examen choix multiple. Plusieurs explications ont été débattues.

The role of academic motivation in Computer-Supported Collaborative Learning

In recent years, increasing attention has been devoted to virtual learning. In the last decade, a large number of studies in Computer-Supported Collaborative Learning (CSCL) have assessed how social interaction, learning processes and outcomes in virtual settings are intertwined. Although recent research findings indicate that learners differ with respect to the amount and type of discourse contributed in virtual settings, little is known about the causes of these differences. The research presented here looks into the effects of motivation of learners on their contribution to discourse using the Deci and Ryan framework of (intrinsic/extrinsic) motivation. This study of 100 participants who were randomly distributed in six groups of 14 members collaborated in a virtual setting to remediate deficiencies in economics indicates that individuals differed with respect to the amount of discourse activity. Furthermore, an integrated multi-method approach (Content Analysis, Social Network Analysis and Academic Motivation Scale) was used in order to examine the impact of academic motivation on the type of discourse activity contributed and on the position of the learner in the social network. The results indicate that highly intrinsically motivated learners become central and prominent contributors to cognitive discourse. In contrast, extrinsically motivated learners contribute on average and are positioned throughout the social network. The research results reveal that differences in academic motivation influences the type of contributions to discourse as well as the position a learner takes within the social network.

Exploring deliberate practice in medicine: how do physicians learn in the workplace?

Medical professionals need to keep on learning as part of their everyday work to deliver high-quality health care. Although the importance of physicians’ learning is widely recognized, few studies have investigated how they learn in the workplace. Based on insights from deliberate practice research, this study examined the activities physicians engage in during their work that might further their professional development. As deliberate practice requires a focused effort to improve performance, the study also examined the goals underlying this behaviour. Semi-structured interviews were conducted with 50 internal medicine physicians: 19 residents, 18 internists working at a university hospital, and 13 working at a non-university hospital. The results showed that learning in medical practice was very much embedded in clinical work. Most relevant learning activities were directly related to patient care rather than motivated by competence improvement goals. Advice and feedback were sought when necessary to provide this care. Performance standards were tied to patients’ conditions. The patients encountered and the discussions with colleagues about patients were valued most for professional development, while teaching and updating activities were also valued in this respect. In conclusion, physicians’ learning is largely guided by practical experience rather than deliberately sought. When professionals interact in diagnosing and treating patients to achieve high-quality care, their experiences contribute to expertise development. However, much could be gained from managing learning opportunities more explicitly. We offer suggestions for increasing the focus on learning in medical practice and further research.

Transfer of training: the role of feedback in supportive social networks

The transfer of training to the workplace often fails to occur. The authors argue that feedback generated within the work environment about the application of newly learned skills in the workplace helps to close the gap between the current performance and the desired goal of full application of what is learned during training. This study takes a social network perspective and explores the role of feedback generated within the social network in fostering motivation-to-transfer and the transfer of training. The results show that the number of people providing feedback and the helpfulness of this feedback are positively related to the motivation for and actual transfer of training. The frequency of feedback appears to be negatively related. This study underlines the importance of feedback in turning the workplace into a learning environment fostering the transfer of training. It also suggests the value of adopting a social network perspective.

Evaluating the effects of redesigning a problem-based learning environment

Though learner-centered and constructivist, there is broad agreement that ProblemBased Learning (PBL) environments are effective in various aspects. Self-dependent learning skills and a well-structured knowledge base are mentioned as two benefits of PBL, with self-dependent learning defined as a tool as well as a goal (Barrows & Tamblyn, 1980; Blumberg & Michael 1992; Dolmans & Schmidt, 1994, 1996; Norman & Schmidt, 1992; Vernon & Blake, 1993). However, various research studies indicate problems within PBL practice. One of the issues of most concern is the learning paradox noted by Schanck and Cleave (1995, p. 178): “how can students learn by doing what they do, when they do not know how to do what they have to learn. 7” Vermunt and Verloop (1999) argue that the degree of self-dependent learning is not always developed at optimum level in the PBL practice. Effective educational systems should gradually offer more control over the process of learning by students. They should scaffold for self-dependent learning. Authors like Williams (1992) Kinzie (1990) and Savery and Duffy (1995) have expressed similar ideas. Thomas (2000) states that the effectiveness of PBL as an instructional method probably depends to a great extent on the incorporation of a range of supports to help

Building Learning Experiences in a Changing World

Advances in Business Education & Training is a Book Series to foster advancement in the field of Business Education and Training. It serves as an international forum for scholarly and state-of-the-art research and development into all aspects of Business Education and Training. This new volume deals with several aspects of the challenge to design learning in and for a changing world. The first part concerns program development. How to build curricula that are future-proof? Principles to innovate our curricula are identified. It answers the question how we can incorporate the need for change in our thinking about curriculum-development and identify the necessary elements to incorporate in our curricula. The second part focuses on the increasing diversity of students and employees within our schools and organizations, in terms of culture, language, and perception of ability, gifts, and talents. This offers a range of opportunities, but at the same time can possibly jeopardize some processes that are taken for granted. Chapters in this part analyze the processes that play a crucial role in dealing with this diversity and identify educational practices that can help to harvest the potential that lies within this diversity. The third part of this book digs further into the possibilities that are opened up by the implementation of ICT-support in our learning environments. E-learning provides tools to adapt these environments to the needs of an increasingly diverse student-population. In the last part we focus specifically on the workplace and how learning can be designed in such a way that employees are equipped for a shifting workplace. On the one hand it is looked how training can affect performance in the workplace. Does learning transfer to the work environment? On the other hand it is questioned how one can design affordances to trigger learning in the workplace.

Investigating the relation between team learning and the team situation model.

The development of a team situation model (TSM), a shared understanding of the current situation developed by team members moment by moment, and its impact on team effectiveness have received minor attention in team research. This study investigates a moderated mediation model including the relationship between the team learning processes of co-construction and constructive conflict, the TSM, and team effectiveness. Forty-seven emergency management command-and-control teams participated in this field study. Their task was to manage a realistic emergency simulation developed and organized by field experts. The multi-rater approach included ratings of team members, researchers, and field experts. Results show that co-construction is related to the TSM under the condition of high constructive conflict. The TSM predicts team effectiveness in terms of the quality of actions at the incident scene.