Shannon Willoughby

Listening to student conversations during clicker questions: What you have not heard might surprise you!

When instructors provide time for students to discuss their ideas in Peer Instruction, instructors minimally expect that the conversation partners will discuss their opinions relating to the physical attributes posed in a question and submit clicker responses that coincide with individual opinions. We defined conversations that met these two criteria as “standard conversations.” In our study of 361 recorded Peer Instruction conversations from large introductory astronomy classrooms taught by experienced instructors, we found that 38% of student conversations were standard conversations. Of the remaining 62%, we identified three broad categories consisting of ten types of “nonstandard” conversations. The first category of conversations describes student ideas that were not reflected in any of the given multiple choice answers. The second category includes issues related to the interpretation of the statistical feedback provided by electronic classroom response systems. The third category describes common p...

Technology talks: Clickers and grading incentive in the large lecture hall

Two sections of an introductory astronomy class were given different grading incentives for clicker participation for two consecutive semesters. In the high stakes classroom points were awarded only for correct answers, in contrast to the low stakes classroom in which points were awarded simply for participating. Self-formed groups of four students each were recorded in both sections several times during the spring 2007 semester and their conversations were transcribed and categorized into nine topics to analyze the variations between the sections. Performance on clicker questions and tendency to block vote were correlated with class grades and gains for the pre- and post-test scores on the Astronomy Diagnostic Test.

Exploring gender differences with different gain calculations in astronomy and biology

To investigate differences in learning gains by gender, we collected data in large introductory astronomy and biology courses. Male astronomy students had significantly higher pre- and post-test scores than female students on the astronomy diagnostic test. Male students also had significantly higher pretest and somewhat higher post-test scores than female students on a survey instrument designed for an introductory biology course. For both courses, males had higher learning gains than female students only when the normalized gain measure was utilized. No differences were found with any other measures, including other gain calculations, overall course grades, or individual exams. Implications for using different learning gain measures in science classrooms, as well as for research on learning differences by gender are discussed.

Student Understanding of Gravity in Introductory College Astronomy.

Twenty-four free-response questions were developed to explore introductory college astronomy students’ understanding of gravity in a variety of contexts, including in and around Earth, throughout the solar system, and in hypothetical situations. Questions were separated into three questionnaires, each of which was given to a section of introductory college astronomy with 143, 137, and 32 respondents, respectively. Combined with 15 interviews, the exploratory, open-response format allowed themes to emerge naturally, with both documented and undocumented misconceptions observed. The breadth of questions allowed for descriptions of possible student mental frameworks, including alternative models and misapplication of the scientific model.

Development of the Newtonian Gravity Concept Inventory.

We introduce the Newtonian Gravity Concept Inventory (NGCI), a 26-item multiple-choice instrument to assess introductory general education college astronomy (“Astro 101”) student understanding of Newtonian gravity. This paper describes the development of the NGCI through four phases: Planning, Construction, Quantitative Analysis, and Validation. We discuss the evolution of the instrument through three versions, including the refinement of a set of four concept domains and nine examples of items to illustrate how expert review, student interviews, and Classical Test Theory statistics informed our approach. We conclude that the NGCI is a reliable and valid instrument.

Epistemic beliefs of non-STEM majors regarding the nature of science: Where they are and what we can do

Students enrolled in introductory astronomy at a mid-sized land grant institution were surveyed at the start and end of each semester for three years regarding their epistemic beliefs about the physical sciences. After collecting data for two years in the control (baseline) course, the course was revised to include regular discussions of the nature of science, practice identifying pseudoscientific claims, and practice with metacognition. Survey data on epistemic beliefs were collected for one more academic year after the course was revised. This work details how the course was structured during the baseline and revised portions of the study. Data from both portions of the study are analyzed as a whole as well as broken down by gender. Negative trends seen in the baseline data are mostly eradicated in the revised portion of the course. The data analysis motivates a discussion of why including content regarding the nature of science should be integrated in classes geared toward non-science majors.

Applicability of the Newtonian gravity concept inventory to introductory college physics classes

Deposit the VOR in a repository in compliance with university or funder requirements 12 months after publication by AIP Publishing.

Connecting Undergraduate Instruction to the 2017 Solar Eclipse.

Space science is perhaps the science topic that elicits the greatest interest in students in the United States and also worldwide. NASA has always endeavored to leverage that widespread interest to advance STEM education, not least because NASA requires a thriving STEM workforce for the future.