Tim Friedman

Same admissions tools, different outcomes : a critical perspective on predictive validity in three undergraduate medical schools

BackgroundAdmission to medical school is one of the most highly competitive entry points in higher education. Considerable investment is made by universities to develop selection processes that aim to identify the most appropriate candidates for their medical programs. This paper explores data from three undergraduate medical schools to offer a critical perspective of predictive validity in medical admissions.MethodsThis study examined 650 undergraduate medical students from three Australian universities as they progressed through the initial years of medical school (accounting for approximately 25 per cent of all commencing undergraduate medical students in Australia in 2006 and 2007). Admissions criteria (aptitude test score based on UMAT, school result and interview score) were correlated with GPA over four years of study. Standard regression of each of the three admissions variables on GPA, for each institution at each year level was also conducted.ResultsOverall, the data found positive correlations between performance in medical school, school achievement and UMAT, but not interview. However, there were substantial differences between schools, across year levels, and within sections of UMAT exposed. Despite this, each admission variable was shown to add towards explaining course performance, net of other variables.ConclusionThe findings suggest the strength of multiple admissions tools in predicting outcomes of medical students. However, they also highlight the large differences in outcomes achieved by different schools, thus emphasising the pitfalls of generalising results from predictive validity studies without recognising the diverse ways in which they are designed and the variation in the institutional contexts in which they are administered. The assumption that high-positive correlations are desirable (or even expected) in these studies is also problematised.

VET leadership for the future : characteristics, contexts and capabilities

This paper examines leadership in Australia’s vocational education and training (VET) sector. VET leaders make a vital and growing contribution to learners, industry and society, yet research on their work is limited. This has direct implications for ensuring leadership is most effective, and for framing evidence-based capacity development. The current research draws together reviews of complex and often competing contexts, analyses of prior research, and results from a national survey of 327 practising VET leaders. Analysis of what VET leaders report doing in their jobs suggests that while they are attuned to the education-focused demands of their roles, they now need new capabilities to respond to internal and external developments. To identify the powerful forces which shape leadership, the study established criteria seen to mark out effective performance in each role. It highlighted a set of indicators identified by VET leaders as those most important in making judgements about the effective delivery of each role. Identifying indicators of effective performance is important, as it is these which, ideally, drive leaders’ aspirations and behaviours. The future capacity of VET in Australia will be underpinned by the capability and regeneration of its leadership. New programmes need to focus on concrete ‘change management’ skills, working through complex real-world problems and leading change in ambiguous environments. The more authentic and active modes of learning were advocated by VET leaders, who expressed an overwhelming preference for practice-based and self-managed, as opposed to formal, forms of professional learning.

Evaluation of the Special Tertiary Admissions Test (STAT).

This paper reports findings from the first national Australian study of the predictive validity of the Special Tertiary Admissions Test (STAT). Background on tertiary admissions procedures in Australia is presented, followed by information on STAT and the research methods. The results affirm that STAT, through the provision of baseline and objective data, offers a valid and efficient means for ensuring that people who are capable of success at university are able to gain admission. They affirm the importance of taking an evidence-based disciplinary perspective to university admissions. Implications for the development and use of the assessment are considered.

Students’ Use of and Engagement with ICT at Home and School

As part of the ICILS 2013 survey, Grade 8 students in the 21 participating ICILS countries completed a questionnaire concerning their use of information and communication technology (ICT) at home and at school, their experience of using ICT, and their access to ICT resources. Students answered this computer-based questionnaire after completing the ICILS assessment of computer and information literacy (CIL).

Teaching with and about Information and Communication Technologies

This chapter focuses not only on the extent to which the teachers who participated in ICILS 2013 were using information and communication technology (ICT) in their classrooms but also on the classroom contexts for acquisition of computer and information literacy (CIL). The chapter’s content pertains to ICILS Research Question 2: What aspects of schools and education systems are related to student achievement in computer and information literacy with respect to (a) school and teaching practices, (b) teacher attitudes to and proficiency in using computers, (c) access to ICT in schools, and (d) teacher professional development?

Using aptitude testing to diversify higher education intake – an Australian case study

Australian higher education is currently entering a new phase of growth. Within the remit of this expansion is an express commitment to widen participation in higher education among under-represented groups – in particular those from low socioeconomic backgrounds. This paper argues that one key mechanism for achieving this goal should be the re-evaluation of university selection processes. The paper explores outcomes of an aptitude test pilot study, focusing on issues of access and equity in selection to university. The results show that, in general, those who gain access to university on the basis of results in the aptitude test have different characteristics than are found in the general university population – in particular, they are more likely to come from a low socioeconomic background. The outcomes of the pilot are important in demonstrating how equity in access to higher education can be improved through the use of supplementary selection metrics.

Students’ perceptions of public institutions and government

While the ICCS 2016 Latin American students tended not to agree with corrupt practices, there was some variation across countries in the extent of agreement.

Discussion of results and implications for research, policy, and practice

Unlike more established Western democracies, most countries in Latin America returned to democratic rule only three or four decades ago or even more recently, and their political, social, and economic stability is often still called into question.

Explaining variation in students’civic knowledge and expected civic engagement

This chapter presents some results of the multivariate analyses of ICCS 2016 data that we conducted in an effort to explain variation in three commonly investigated outcomes of civic and citizenship education: civic knowledge, expected electoral participation, and expected active political participation.

Students’ attitudes toward important issues in society

This chapter explores data relating to ICCS 2016 Research Question 4: What beliefs do students in participating countries hold regarding important civic issues in modern society and what are the factors associated with their variation?