Matthew B. Fuller

Online graduate students’ perceptions of best learning experiences

The purpose of this study is to examine the perceptions of online master’s students regarding their best learning experiences. The authors surveyed 86 graduate students concerning what helped them learn in the online environment. Results indicate that although graduate students learned using the same technological tools as undergraduates, they desired a deeper level of learning that requires more instructional forethought and planning. Student experiences were consistent with the constructivist theory, and implications for improving teaching based upon the constructivist theory are highlighted.

Empirically Exploring Higher Education Cultures of Assessment

Although touted as beneficial to student learning, cultures of assessment have not been examined adequately using validated instruments. Using data collected from a stratified, random sample (N = 370) of U.S. institutional research and assessment directors, the models tested in this study provide empirical support for the value of using the Administrators’ Survey of Assessment Cultures as an assessment tool. The resulting first order model provided good fit statistics and included five factors: a) Faculty Perceptions, b) Use of Data, c) Sharing, d) Compliance or Fear Motivators, and e) Normative Purposes for Assessment. Internal consistency estimates were also good (Cronbach’s α = .792 to .922). Use of the Schmid-Leiman solution afforded further support for the higher order factor, Culture of Assessment. Predictive discriminant analysis correctly classified the majority of the respondents (80.7%) as belonging to a student learning or accreditation group based on the linear classification scores. Implications for assessment leadership, practice, and future research are offered.

Assessment leaders’ perspectives of institutional cultures of assessment: a Delphi study

Institutional cultures of assessment are praised as beneficial to student learning. Yet, extant studies have not explored the theoretical foundations and pragmatic approaches to shaping cultures of assessment. The researchers used the Delphi method to explore 10 higher education assessment leaders’ attitudes and theoretical perspectives regarding cultures of assessment. These expert assessment leaders were iteratively surveyed until a reasonable threshold of consensus was reached. Study participants viewed buy-in as a necessary component of a positive campus culture of assessment, and advice on reshaping negative cultures was offered. Assessment leaders’ guiding theoretical frameworks were implied and loosely defined with metaphors. Finally, advice is offered for improving cultures of assessment by symbolically connecting assessment to student learning through dialogue.

Empirical Reporting Practices in "Community College Journal of Research and Practice" and "Journal of Developmental Education" from 2002 to 2011: A Systematic Review.

The empirical reporting practices of developmental education and community college researchers who published in the Community College Journal of Research and Practice (CCJRP) and the Journal of Developmental Education (JDE) from 2002 to 2011 were investigated. Of the 1,165 articles available, 181 articles met the inclusion criteria and were subjected to full review. Authors identified the following components in the published research studies: problem formulation, theoretical framework, sources of evidence, measurement, statistical analyses, and figures and correlation matrices. Though more than half of the reviewed article authors provided research questions, more than half of those phrased at least one research question in a dichotomous response format. A theoretical framework was reported only 36.5% of the time. The setting for the majority of the reviewed articles was a two-year college; however, this finding varied by journal type. At least 20% of the reviewed article authors did not report the sampling method. The majority of the reviewed article authors did not use a proprietary instrument. Polynomial trend lines were used to describe the fit of the observed frequency of reported statistical techniques in each of the journals. The values of the r2 were greatest for the t test (CCJRP r2quadratic = 89.8%), ANOVA (CCJRP r2cubic = 75.0%), and regression (CCJRP r2quadratic = 72.6%). The most frequently used analysis across both journals was ANOVA (24.5%). Figures (18.2%) and correlation matrices (8.3%) frequently were not reported. Recommendations for improved empirical reporting practices in developmental education research are presented.

A person-centred approach to understanding cultures of assessment

Abstract The purpose of the present study was to investigate how faculty members coalesce into distinguishable groups in terms of their perceived cultures of assessment at their respective institutions. To date, although researchers have posited the existence of various cultures of assessment, no study to our knowledge has empirically demonstrated the presence of these unobserved (latent) cultures analytically. Accordingly, a latent profile analysis was conducted using Mplus to identify these unobserved groups based on faculty (n = 1148) members’ responses to 12 items (6-point Likert scale) selected from the 2014 Faculty Survey of Assessment Culture. The resulting 4-class solution, including a previously unidentified group, was confirmed by the Lo-Mendell-Rubin Adjusted Likelihood Ratio Test: Culture of Student Learning (n = 502); Evolving Student Learning Culture (n = 398); Culture of Compliance (n = 168); and Culture of Fear (n = 80). Characteristics of each class are described and the prevalence of each class by type of degree granting institution and primary discipline is provided.