Martin Valcke

Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review

Research in the field of Computer Supported Collaborative Learning (CSCL) is based on a wide variety of methodologies. In this paper, we focus upon content analysis, which is a technique often used to analyze transcripts of asynchronous, computer mediated discussion groups in formal educational settings. Although this research technique is often used, standards are not yet established. The applied instruments reflect a wide variety of approaches and differ in their level of detail and the type of analysis categories used. Further differences are related to a diversity in their theoretical base, the amount of information about validity and reliability, and the choice for the unit of analysis. This article presents an overview of different content analysis instruments, building on a sample of models commonly used in the CSCL-literature. The discussion of 15 instruments results in a number of critical conclusions. There are questions about the coherence between the theoretical base and the operational translation of the theory in the instruments. Instruments are hardly compared or contrasted with one another. As a consequence the empirical base of the validity of the instruments is limited. The analysis is rather critical when it comes to the issue of reliability. The authors put forward the need to improve the theoretical and empirical base of the existing instruments in order to promote the overall quality of CSCL-research.

Collaborative learning in asynchronous discussion groups: What about the impact on cognitive processing?

Abstract Does working in a Computer supported collaborative learning (CSCL) environment, and more specific, working in “asynchronous electronic discussion groups”, have an impact on cognitive processing? This general research question has been researched in a study involving 230 freshmen taking the course “educational sciences”. During four months, students were working in 23 discussion groups on collaboration tasks based on authentic situations and problems. The transcripts of eight groups were randomly selected and analysed. A variety of content analysis models was adopted to ground theoretical assumptions about the value of collaborative learning environments. The messages were coded building on the models by Veerman and Veldhuis-Diermanse (2001) and Gunawardena, Lowe, and Anderson (1997) . The theoretical basis of the study integrates the models in a conceptual framework, building on the information processing approach to knowledge construction and social-constructivist principles. The results confirm that interaction in the discussion is very task-oriented, stays task-oriented and reflects high phases in knowledge construction. Clear results can be presented about the impact of the amount of discussion activity on the nature and quality of the discussions and the phases of knowledge construction. In the discussion section, methodological issues are presented. The research points at a number of methodological issues and directions for future research.

ICT integration in the classroom: Challenging the potential of a school policy

Despite the assumption that the integration of ICT influences the entire school system, research focusing on ICT in schools is generally limited to the study of variables at class level. In contrast to these studies, the present research explores ICT integration from a school improvement approach. More particularly, it examines the local school policy with respect to ICT integration from both the principals perspective and perceptions of teachers. Furthermore, it studies the relationship between school policies and the actual use of ICT in the classroom. To answer the research questions, a representative sample of 53 primary school principals was interviewed. In addition, the interview data were supplemented with survey data of 574 teachers from the same 53 schools. What emerged from the analyses was that school-related policies, such as an ICT plan, ICT support and ICT training have a significant effect on class use of ICT. In addition, the findings from the interviews indicate that school policies are often underdeveloped and underutilised. The discussion section focuses on challenges to improve the potential of an ICT school policy.

Fostering knowledge construction in university students through asynchronous discussion groups

Does collaborative learning in asynchronous discussion groups result in enhancing academic discourse and knowledge construction? This general research question has been researched in a study involving 300 students, working during six months in 38 electronic discussion groups. The transcripts of the discussions were coded and analysed to test hypotheses related to the impact on knowledge construction. Coding of the units of analysis was based on the models of Fahy, P. J., Crawford, G., Ally, M., Cookson, P., Keller, V., & Prosser, F. (2000). The development and testing of a tool for analysis of computer mediated conferencing transcripts. Alberta Journal of Educational Research, 46(1), 85-88 and Veerman, A., & Veldhuis-Diermanse E. (2001). Collaborative learning through computer-mediated communication in academic education. In P. Dillenbourg, A. Eurelings, & K. Hakkarainen (Eds.), European Perspectives on Computer-Supported Collaborative Learning. Proceedings of the First European Conference on CSCL. Maastricht: McLuhan Institute, University of Maastricht. The results confirm that students in the discussion groups are very task-oriented and that higher proportions of high phases of knowledge construction are observed. Significant increases in the cognitive interaction, task-orientation and higher phases of knowledge construction are detected. Group size is a significant interaction variable. Discussion in smaller groups reflects larger proportions of higher levels of knowledge construction. The results point at the critical impact of structure in the task environment. In the discussion section, methodological issues are presented. The article concludes with directions for future research and some implications for instructional practice.

Explaining different types of computer use among primary school teachers

In order to identify differences in determinants of supportive and class use of computers, path modelling was applied in a sample of 468 primary school teachers. Independent variables were categorised in three levels: demographics (age and gender), computer experience (computer training, computer experience expressed over time, intensity of computer use), and attitude measures (general computer attitudes, attitudes toward computers in education, and technological innovativeness).Supportive and class use of computers are not related to the same set of variables. Supportive computer use was mainly predicted by computer experience variables and general computer attitudes. Strongest predictors of class use were technological innovativeness and gender. Yet, the degree of explained variance for class use of computer was considerably lower compared to supportive computer use. These results indicate the limitations of explaining complex forms of professional computer use on the basis of both individual determinants and quantitative models. The article concludes with some practical implications and recommendations for further research.RésuméA fin d’identifier les différences dans les déterminants de l’utilisation de l’ordinateur comme support et en classe, path modelling a été appliqué au moyen d’un échantillon de 468 instituteurs.Les variables indépendantes ont été catégorisées en trois niveaux: démographie (âge et sexe), expérience avec l’ordinateur (apprentissage d’informatique, expérience informatique exprimée en fonction du temps et de l’intensité de l’utilisation de l’ordinateur), et mesures d’attitude (attitudes générales vis-à-vis de l’ordinateur, attitudes vis-à-vis de l’emploi d’ordinateurs dans l’enseignement et de l’innovation technologique).L’utilisation de l’ordinateur comme support et celle en classe ne sont pas relatées au même ensemble de variables. L’emploi comme support est principalement prédit par les variables qui expriment l’expérience avec l’ordinateur et les attitudes générales vis-à-vis de l’ordinateur. Les prédicateurs les plus forts pour l’emploi en classe sont l’attitude par rapport à l’innovation technologique et le sexe. Mais le degré de la variance expliquée est considérablement plus faible pour ce qui concerne l’utilisation en classe que pour l’utilisation comme support. Ces résultats indiquent les limitations à expliquer des formes complexes de l’utilisation professionnelle de l’ordinateur à base de déterminants individuels et de models quantitatifs. L’article conclue avec quelques implications pratiques et recommandations pour des recherches futures.

Internet parenting styles and the impact on Internet use of primary school children

Next to available data about actual Internet use of young children at home, most research especially focuses on the threats and opportunities about active Internet usage. Limited empirical research focuses on the role and impact of parents in this context. In the present study, Internet parenting styles are defined and operationalized to study the impact on actual Internet usage of children at home. Two dimensions are distinguished in Internet parenting styles: parental control and parental warmth. Based on a survey, involving 533 parents from children in primary schools, this Internet usage was studied from the perspective of Internet parenting styles. Results point at high Internet access at home. As to the parenting styles, we observe a dominance of the authoritative parenting style (59.4%). The styles differ when controlling for parent gender, educational background and age. Parenting styles are also linked to level of parent Internet usage, Internet attitude and Internet experience. Parenting styles also significantly affect child Internet usage. The highest child usage level is perceived when parents adopt a permissive parenting style; the lowest level is observed when parents adopt an authoritarian Internet parenting style. The variables Internet parenting style, parent Internet behavior, and parent educational background significantly predict Internet usage of children at home (R^2=.44). Theoretical and practical implications are discussed and directions for future research.

Towards a typology of computer use in primary education

Abstract  In the present study, we reject the view that computer use can be studied as an isolated variable in a learning environment. Our main objective is to develop an instrumental tool to measure different types of educational computer use in the classroom. This builds on a comprehensive review of the literature about computer use in education. This review helped to construct a questionnaire to identify a typology of computer use in primary education. In addition, the questionnaire was enriched by input of experts in this field. The questionnaire was presented to a sample of 352 primary school teachers. The input from a first subsample was used to carry out an exploratory factor analysis; the second subsample was used to verify the identified factor structure via confirmatory factor analysis. A three-factor structure of computer use in primary education was identified: ‘the use of computers as an information tool’, ‘the use of computers as a learning tool,’ and ‘learning basic computer skills’. The three-factor structure was confirmed in the confirmatory factor analysis. The results underpin a number of meaningful differences in the current practice of computer use in primary education.

Scripting by assigning roles: Does it improve knowledge construction in asynchronous discussion groups?

This article describes the impact of learning in asynchronous discussion groups on students’ levels of knowledge construction. A design-based approach enabled the comparison of two successive cohorts of students (N = 223 and N = 286) participating in discussion groups for one semester. Multilevel analyses were applied to uncover the influence of student, group, and task variables on the one hand, and the specific impact of a particular form of scripting – namely the assignment of roles to group members – on the other. Results indicate that a large part of the overall variability in students’ level of knowledge construction can be attributed to the discussion assignment. More intensive and active individual participation in the discussion groups and adopting a positive attitude towards the learning environment also positively relates to a higher level of student knowledge construction. Task characteristics – differences between the consecutive discussion themes – appeared to significantly affect levels of knowledge construction, although further analysis revealed that these differences largely disappeared after correcting for task complexity. Finally, comparisons between both cohorts revealed that the introduction of student roles led to significantly higher levels of knowledge construction. An effect size of 0.5 was detected.

Mapping the Learning Styles “Jungle”: An overview of the literature based on citation analysis

Educationists and researchers who consider the use of the learning style concept to address individual differences in learning are often daunted by the multitude of definitions, models, and instruments. It is difficult to make an informed choice. The confusion with cognitive style, a term often used as a synonym, makes it even more complicated. Reviews of the literature give some direction, but there are a number of arguments why the available reviews raise new problems. In this paper, citation analysis is presented as a technique to develop an alternative organisation of the learning style and cognitive style literature. Application of this technique results in a review that clarifies dominant theoretical orientations in the literature, is helpful to identify the relative impact of different orientations, and helps to illuminate their interrelationships. As such, this alternative review of the literature can serve as a roadmap for novices to the styles field.

How effective are self- and peer assessment of oral presentation skills compared with teachers' assessments?

Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the teachers. Comparison of the teacher and peer assessment rubric scores points at a positive relationship, but also at critical differences. The lower intra-class correlation suggests that peers and teachers still interpret the criteria and indicators of the rubric in a different way. With regard to the comparison of self-assessment scores and teacher scores, we have to conclude that there are significant differences between these scores. Self-assessment scores are, for the most part, higher than the marks given by teachers. The results also reflect a very positive attitude of students towards peer assessment as a relevant source of external feedback.