Youn-Jeng Choi

Using Educative Assessments to Support Science Teaching for Middle School English-language Learners

Grounded in Hallidayan perspectives on academic language, we report on our development of an educative science assessment as one component of the language-rich inquiry science for English-language learners teacher professional learning project for middle school science teachers. The project emphasizes the role of content-area writing to support teachers in diagnosing their students’ emergent understandings of science inquiry practices, science content knowledge, and the academic language of science, with a particular focus on the needs of English-language learners. In our current school policy context, writing for meaningful purposes has received decreased attention as teachers struggle to cover large numbers of discrete content standards. Additionally, high-stakes assessments presented in multiple-choice format have become the definitive measure of student science learning, further de-emphasizing the value of academic writing for developing and expressing understanding. To counter these trends, we examine the implementation of educative assessment materials—writing-rich assessments designed to support teachers’ instructional decision making. We report on the qualities of our educative assessment that supported teachers in diagnosing their students’ emergent understandings, and how teacher–researcher collaborative scoring sessions and interpretation of assessment results led to changes in teachers’ instructional decision making to better support students in expressing their scientific understandings. We conclude with implications of this work for theory, research, and practice.

Differential Item Functioning Analysis Using a Mixture 3-Parameter Logistic Model With a Covariate on the TIMSS 2007 Mathematics Test

The purpose of this study was to explore what may be contributing to differences in performance in mathematics on the Trends in International Mathematics and Science Study 2007. This was done by using a mixture item response theory modeling approach to first detect latent classes in the data and then to examine differences in performance on items taken by examinees in the different latent classes. An exploratory mixture 3-Parameter Logistic model analysis detected two latent groups in the data. The model considered in this study used internet access as a covariate to illustrate the effect of the covariate on latent class membership.

Physics Instructional Resource Usage by High-, Medium-, and Low-Skilled MOOC Students

In this paper we examine how different types of participants in a physics Massive Open Online Course (MOOC) tend to use the existing course resources. We use data from the 2013 offering of the Massive Open Online Course 8.MReVx designed by the RELATE (REsearch in Learning Assessing and Tutoring Effectively) Group at the Massachusetts Institute of Technology and offered on the edX platform. We propose six measures of student performance in a course, and, based on these measures, we divide the student population into clusters and analyze the resource usage of the students from each cluster. This course contains a wide variety of physics problems targeting various levels of thinking. Our analysis focuses on 1080 participants (out of 16,787 enrolled in the course) who attempted more than 50% of available problems, as this is an indicator of students who participated actively in the entire course.

Researching for better instructional methods using AB experiments in MOOCs: results and challenges

We conducted two AB experiments (treatment vs. control) in a massive open online course. The first experiment evaluates deliberate practice activities (DPAs) for developing problem solving expertise as measured by traditional physics problems. We find that a more interactive drag-and-drop format of DPA generates quicker learning than a multiple choice format but DPAs do not improve performance on solving traditional physics problems more than normal homework practice. The second experiment shows that a different video shooting setting can improve the fluency of the instructor which in turn improves the engagement of the students although it has no significant impact on the learning outcomes. These two cases demonstrate the potential of MOOC AB experiments as an open-ended research tool but also reveal limitations. We discuss the three most important challenges: wide student distribution, “open-book” nature of assessments, and large quantity and variety of data. We suggest possible methods to cope with those.

Stakeholder perceptions of contextual factors related to PBIS implementation in high need schools

ABSTRACT Positive behavior intervention and supports (PBIS) is a thoroughly researched three-tiered framework for preventing and treating challenging behavior in schools. While more than 20 years of research contribute to the literature base, less is known about PBIS implementation in high-needs school settings, particularly those that serve students predominantly from low-income families and majority minority student populations across urban and rural districts. This study investigated the critical contextual factors of PBIS implementation from the stakeholder perspective. Specifically, we surveyed 161 participants including teachers, school staff members, and administrators who were PBIS team members and had received technical assistance in PBIS implementation. The completed surveys were analyzed with participants and their schools coded for district type, Title I funding, and position in order to determine how the perceptions of issues such as buy-in, administrator support, PBIS in secondary school settings, and poverty affect PBIS implementation and team needs. The factor analysis and resulting structure along with statistically significant results for each factor are presented along with implications.