Briana E. Timmerman

Graduate Students’ Teaching Experiences Improve Their Methodological Research Skills

Teaching is not wasted time. Science, technology, engineering, and mathematics (STEM) graduate students are often encouraged to maximize their engagement with supervised research and minimize teaching obligations. However, the process of teaching students engaged in inquiry provides practice in the application of important research skills. Using a performance rubric, we compared the quality of methodological skills demonstrated in written research proposals for two groups of early career graduate students (those with both teaching and research responsibilities and those with only research responsibilities) at the beginning and end of an academic year. After statistically controlling for preexisting differences between groups, students who both taught and conducted research demonstrate significantly greater improvement in their abilities to generate testable hypotheses and design valid experiments. These results indicate that teaching experience can contribute substantially to the improvement of essential research skills.

Faculty Mentors’, Graduate Students’, and Performance-Based Assessments of Students’ Research Skill Development

Faculty mentorship is thought to be a linchpin of graduate education in STEM disciplines. This mixed-method study investigates agreement between student mentees’ and their faculty mentors’ perceptions of the students’ developing research knowledge and skills in STEM. We also compare both assessments against independent ratings of the students’ written research proposals. In most cases, students and their mentors identified divergent strengths and weaknesses. However, when mentor-mentee pairs did identify the same characteristics, mentors and mentees disagreed about the mentee’s abilities in 44% of cases in the Fall semester and 75% of cases in the Spring semester. When compared against performance-based assessments of mentees’ work, neither faculty mentors’ nor their mentees’ perceptions aligned with rubric scores at rates greater than chance in most categories.

The relationship between undergraduate research participation and subsequent research performance of early career STEM graduate students

Undergraduate research experiences have been adopted across higher education institutions. However, most studies examining benefits derived from undergraduate research rely on self-report of skill development. This study used an empirical assessment of research skills to investigate associations between undergraduate research experiences and research skill performance in graduate school. Research experience characteristics including duration, autonomy, collaboration, and motivation were also examined. Undergraduate research experience was linked to heightened graduate school performance in all research skills assessed. While autonomy and collaboration were highlighted in student interviews, duration was most strongly correlated to significant increases in research skill performance. Based on these findings, we advocate for the inclusion of research experiences into the undergraduate science curriculum coupled with the creation of centralized offices of undergraduate research and faculty incentives for involving undergraduates in their research.

Performance-Based Data in the Study of STEM Ph.D. Education

Performance-based assessments of student skill development can help inform decisions about improving graduate education. Understanding the scholarly development of Ph.D. students in science, technology, engineering, and mathematics (STEM) is vital to the preparation of the scientific workforce. During doctoral study, students learn to be professional scientists and acquire the competencies to succeed in those roles. However, this complex process is not well studied. Research to date suffers from overreliance on a narrow range of methods that cannot provide data appropriate for addressing questions of causality or effectiveness of specific practices in doctoral education. We advocate a shift in focus from student and instructor self-report toward the use of actual performance data as a remedy that can ultimately contribute to improved student outcomes.

Graduate education. Performance-based data in the study of STEM Ph.D. education.

Performance-based assessments of student skill development can help inform decisions about improving graduate education. Understanding the scholarly development of Ph.D. students in science, technology, engineering, and mathematics (STEM) is vital to the preparation of the scientific workforce. During doctoral study, students learn to be professional scientists and acquire the competencies to succeed in those roles. However, this complex process is not well studied. Research to date suffers from overreliance on a narrow range of methods that cannot provide data appropriate for addressing questions of causality or effectiveness of specific practices in doctoral education. We advocate a shift in focus from student and instructor self-report toward the use of actual performance data as a remedy that can ultimately contribute to improved student outcomes.

A call for performance-based datain the study of STEM Ph.D. education

Performance-based assessments of student skill development can help inform decisions about improving graduate education. Understanding the scholarly development of Ph.D. students in science, technology, engineering, and mathematics (STEM) is vital to the preparation of the scientific workforce. During doctoral study, students learn to be professional scientists and acquire the competencies to succeed in those roles. However, this complex process is not well studied. Research to date suffers from overreliance on a narrow range of methods that cannot provide data appropriate for addressing questions of causality or effectiveness of specific practices in doctoral education. We advocate a shift in focus from student and instructor self-report toward the use of actual performance data as a remedy that can ultimately contribute to improved student outcomes.