Marie De Beer

Development of the Learning Potential Computerised Adaptive Test (Lpcat)

An overview of the development of a dynamic test for the measurement of learning potential — the Learning Potential Computerised Adaptive Test (LPCAT) — is provided. The test was developed in South Africa with a view to providing information on the present and potential future level of general non-verbal figurai reasoning ability for persons from different backgrounds in a way that is fair to all concerned. Multicultural samples were used in its development and standardisation. Item response theory principles and computerised adaptive testing technology addressed many of the earlier measurement problems in the dynamic assessment of learning potential and made possible the construction of a psychometrically sound, yet time-efficient and practically useful tool for the measurement of learning potential in multicultural contexts.An overview of the development of a dynamic test for the measurement of learning potential - the Learning Potential Computerised Adaptive Test (LPCAT) - is provided. The test was developed in South Africa with a view to providing information on the present and potential future level of general non-verbal figural reasoning ability for persons from different backgrounds in a way that is fair to all concerned. Multicultural samples were used in its development and standardisation. Item response theory principles and computerised adaptive testing technology addressed many of the earlier measurement problems in the dynamic assessment of learning potential and made possible the construction of a psychometrically sound, yet time-efficient and practically useful tool for the measurement of learning potential in multicultural contexts.

Longitudinal Predictive Validity of a Learning Potential Test

The aim of this article is to provide empirical psychometric evidence of the (longitudinal) predictive validity of a learning potential measure—the Learning Potential Computerised Adaptive Test (LPCAT)—in comparison with standard static tests with school aggregate results as the criterion measure. Participants were 79 boys (mean age 12.44, SD = 0.44) and 72 girls (mean age 11.18, SD = 0.42) attending two private schools. Correlation and regression analyses were used to evaluate the predictive validity of the learning potential and standard test scores for school aggregate academic results as criterion measure. Results indicate that learning potential scores were statistically significant predictors of aggregate academic results and provided results that were comparable to those of the standard test results—providing empirical support for the use of learning potential tests in mainstream educational settings.The aim of this article is to provide empirical psychometric evidence of the (longitudinal) predictive validity of a learning potential measure—the Learning Potential Computerised Adaptive Test (LPCAT)—in comparison with standard static tests with school aggregate results as the criterion measure. Participants were 79 boys (mean age 12.44, SD = 0.44) and 72 girls (mean age 11.18, SD = 0.42) attending two private schools. Correlation and regression analyses were used to evaluate the predictive validity of the learning potential and standard test scores for school aggregate academic results as criterion measure. Results indicate that learning potential scores were statistically significant predictors of aggregate academic results and provided results that were comparable to those of the standard test results—providing empirical support for the use of learning potential tests in mainstream educational settings.

A modern assessment psychometric approach to dynamic assessment

Although dynamic assessment (DA) has been hailed as a positive move towards fair assessment, it has generally not been used in educational or industry settings to the same extent that standard (static) tests have been. The present article attempts to elucidate how the use of Item Response Theory (IRT) and Computerised Adaptive Testing (CAT) can address some of the problems typically associated with dynamic assessment. An example of a DA tool that makes use of IRT and CAT, shows acceptable psychometric properties and is comparable to standard tests in terms of ease of administration illustrates the possibility of wider application of DA in both educational and industry settings.Although dynamic assessment (DA) has been hailed as a positive move towards fair assessment, it has generally not been used in educational or industry settings to the same extent that standard (sta...

Comparability of the Paper-and-Pencil and Computerised Adaptive Versions of the General Scholastic Aptitude Test (GSAT) Senior

A computerised adaptive test was constructed from two existing parallel paper-and-pencil versions of the General Scholastic Aptitude Test (GSAT) Senior. Achievement in the GSAT computerised adaptive test was compared to achievement in one form of the GSAT paper-and-pencil test. In computerised adaptive testing the program tailors each test to the examinees ability level. Based on a statistical method known as Item Response Theory (IRT), the program interactively selects test items which are at the appropriate difficulty level for the individual being tested, thereby allowing a considerable reduction in test length without forfeiting measurement accuracy. The study was undertaken to investigate the equivalence of results obtained with three versions of the GSAT: A paper-and-pencil version, a standard computerised version, and a computerised adaptive version. The standard computerised GSAT was included to study the effects of computerization apart from adaptive testing. The results were used to make adjustments to the GSAT computerised adaptive test to ensure equivalent measurement.

The Role of Gender and Race in Sense of Coherence and Hope Orientation Results

The aim of this study was to evaluate the constructs of sense of coherence and hope orientation, and to compare gender and race groups on these measures. Antonovsky’s (Unravelling the mystery of health: How people manage stress and stay well. Jossey-Bass, San Francisco, 1987) short version orientation-to-life questionnaire (OLQ-13) and the hope orientation measure (HOME) were completed by a group of 730 postgraduate students. Classical analysis methods were used to evaluate the differences in mean scores of gender and race groups, and Rasch analysis methods were used to evaluate the differential item functioning (DIF) for the subgroups. No statistically significant differences were found between the gender groups on either sense of coherence or hope orientation, but statistically significant differences were found between the race groups on both measures for both classical and Rasch analyses.

The psychological coping, learning potential and career preferences profiles of operational force military candidates

The aim of this study was to profile the psychological coping, learning potential and career-related interests of 251 candidates for operational force military selection for the South African National Defence Force (SANDF) – 26 of whom were successful in the selection. Data on their sense of meaning, learning potential and career-related interest were gathered using standardised measures supplemented with open-ended responses. The data were analysed to compare the profiles of the successful candidates against those not selected. The selected group showed significantly higher mean scores on meaningfulness and learning potential, and lower scores for career-related interest in law and medicine. Findings suggest that psychological coping, learning potential and career-related preference information can be used to refine the selection of operational force military candidates.The aim of this study was to profile the psychological coping, learning potential and career-related interests of 251 candidates for operational force military selection for the South African National Defence Force (SANDF) – 26 of whom were successful in the selection. Data on their sense of meaning, learning potential and career-related interest were gathered using standardised measures supplemented with open-ended responses. The data were analysed to compare the profiles of the successful candidates against those not selected. The selected group showed significantly higher mean scores on meaningfulness and learning potential, and lower scores for career-related interest in law and medicine. Findings suggest that psychological coping, learning potential and career-related preference information can be used to refine the selection of operational force military candidates.

Initial review of the psychometric properties of a computerised career preference test for career guidance assessment

Psychometric proprties of the Career Preference Computerised Adaptive Test (CPCAT) (De Beer & Marais, 2010; De Beer, Marais, Maree, & Skrzypczak, 2008) are reported. Participants were high school students (n=343; males=279, females=164)at Grade 9 and Grade 11 level from a South African school district. Reliability and construct validity indices suggest the CPCAT could be of utility in the career counseling of high school students.Psychometric proprties of the Career Preference Computerised Adaptive Test (CPCAT) (De Beer & Marais, 2010; De Beer, Marais, Maree, & Skrzypczak, 2008) are reported. Participants were high school students (n=343; males=279, females=164)at Grade 9 and Grade 11 level from a South African school district. Reliability and construct validity indices suggest the CPCAT could be of utility in the career counseling of high school students.

Psychometric evaluation of the Basic Traits Inventory in the multilingual South African environment

The objective of this study was to evaluate the psychometric properties of the BTI for all the official language groups in South Africa. Item bias analysis was performed by means of Rasch analysis for a sample of 105 342 respondents with representation of each of the 11 language groups. Reliability values were good for all the language groups and bias was revealed in only 12 of the 193 items (6.2%) through item response modelling. Based on these results, the BTI may be an appropriate measure of personality for all the different language groups in South Africa.