Mahsood Shah

Ten years of external quality audit in Australia: evaluating its effectiveness and success

External quality audits are now being used in universities across the world to improve quality assurance, accountability for quality education and transparency of public funding of higher education. Some countries such as Australia, New Zealand, United Kingdom, Sweden and Denmark have had external quality audits for more than a decade but there has been limited research as to their impact. This study analyses the extent to which external audits in Australia have improved quality assurance in universities over the past 10 years. The analysis is based on discussions with 40 participants in a workshop on the effectiveness of audits and the review of 60 external quality audit reports between 2001 and December 2010. The research found that while external audits have led to an improvement in systems and processes in Australian universities, they have not necessarily improved the student experience. This lack of impact on the student experience in Australia is similar to other countries, according to the literature review. This study is timely in its analysis on the effectiveness of the current improvement-led audits, as government in Australia is in the process of renewing quality assurance arrangements of higher education institutions with a focus on standards and outcomes.

The Renewal of Quality Assurance in Australian Higher Education: The Challenge of Balancing Academic Rigour, Equity and Quality Outcomes.

The renewal of quality in Australian higher education comes at a time of significant change in the external policy framework. Such changes are timely due to the growth of higher education and the emergence of the quality and equity agenda in the context of ongoing decline in public funding. The article provides an overview of current quality assurance arrangements and the outcome of the recent review of higher education. The dilemma faced by Australian universities in improving quality outcomes and maintaining high standards, while meeting the government’s aspiration to increase the enrolment of students from targeted equity groups, is outlined. The article critiques past inequity in rewarding universities based on measures of student satisfaction, rather than using measures of access, participation and retention of students from diverse equity groups. The challenges facing universities in meeting the government’s 2020 equity targets without compromising academic rigour, standards and quality outcomes are presented.

The changing nature of teaching and unit evaluations in Australian universities

Purpose – Teaching and unit evaluations surveys are used to assess the quality of teaching and the quality of the unit of study. An analysis of teaching and unit evaluation survey practices in Australian universities suggests significant changes. One key change discussed in the paper is the shift from voluntary to mandatory use of surveys with the results used to assess and reward academic staff performance. The change in the direction is largely driven by the introduction of performance‐based funding as part of quality assurance arrangements. The paper aims to outline the current trends and changes and the implications in the future such as increased scrutiny of teaching and intrusion to academic autonomy.Design/methodology/approach – The paper is based on the analysis of current teaching and unit evaluation practices across the Australian university sector. The paper presents the case of an Australian university that has introduced performance‐based reward using various measures to assess and reward aca...

Investigating attrition trendsin order to improvestudent retention

Purpose – This paper aims to focus on the experience of monitoring of first year student attrition in a large metropolitan multi‐campus university during 2004‐2010. The paper seeks to discuss the trends in student attrition which have been found and identify key issues which have been and need to be addressed by the university in order to increase retention.Design/methodology/approach – A specially designed survey was repeated across the years and completed over the period by 2,085 undergraduate students who left the university before the end of their first year of study.Findings – The most important of issues which need to be addressed by the university are sufficient, correct and clear information provided to prospective students about the course before they enrol and high‐quality course advice about subject choices after enrolment.Research limitations/implications – Sufficient, correct and clear information provided to prospective students about the course remains an area in need of improvement. Theref...

Student voice: using qualitative feedback from students to enhance their university experience

Many performance indicators in Australian higher education are based on the quantitative data from student feedback surveys, while the qualitative data usually generated by these surveys receive relatively limited attention. This paper argues that these data, if collected and analysed in a systematic way, can be used as an effective and robust institutional performance indicator and can assist in the enhancement of the student experience. The paper describes a comparative analysis of qualitative data generated at a large metropolitan multi-campus university by the annual Course Experience Questionnaire during 2001–2011. In total, approximately 78,800 student open-ended comments have been analysed via CEQuery – a software tool that facilitates analysis of the written comments. The results compared across the years allow the university to identify key trends in student experience and areas that warrant an improvement focus. The paper provides examples on how the university uses the data. It concludes that to be successful, universities should include a focus on what students have to say in their own words and incorporate such feedback into their priorities.

Factors influencing student choice to study at private higher education institutions

Purpose – This paper aims to make a contribution to the current lack of literature in the Australian context by reviewing qualitative feedback collected from students in five private higher education institutions. In particular, the paper seeks to examine factors influencing student choice to study at private higher education institutions and student perceptions of such institutions. Previous studies on this topic are mostly focussed on universities with lack of research with the booming private higher education sector. Design/methodology/approach – This study draws data from five different private for-profit higher education institutions in Australia. It involved feedback from 120 students undertaking higher education courses in different discipline areas at different stages of study. The study involved 15 focus group interviews with eight students in a group. The selection of students was based on the representation of different characteristics of student such as: male/female, domestic/international, an...

Monitoring Trends in Student Satisfaction

Over the last decade, the assessment of student experience has gained significant prominence in Australian higher education. Universities conduct internal surveys in order to identify which of their services students rate higher or lower on importance and performance. Thus, institutions can promote highly performing areas and work on those needing improvement, while students are given an opportunity to influence decision-making in both academic and non-academic spheres of campus life. National student surveys conducted by the government aim to maintain quality assurance in the sector, benchmark outcomes, and, in some cases, reward better performing institutions. This paper outlines the findings of a study which monitored the entire student experience in a large metropolitan multi-campus university during 2005–2011. A specially designed biennial survey was repeated across the years, and completed over the period by 10,562 students from all key cohorts. This paper discusses the trends in perceived importance and performance of various university services and key issues the university has been addressing in order to enhance student experience. It concludes that: (a) the time series data provide a powerful lens into the university’s strategies, initiatives and actions which worked well and those needing further effort or adjustment; (b) it is the total experience of the university that shapes students’ judgements, not just what happens in the classroom; and (c) taking a systematic approach to student feedback, and acting on the results in a timely manner, can significantly improve student engagement and satisfaction.

The Australian higher education quality assurance framework

The Australian government initiated a review of higher education in 2008. One of the outcomes of the review was the formation of a national regulator, the Tertiary Education Quality and Standards Agency (TEQSA), with responsibilities to: register all higher education providers, accredit the courses of the non self-accrediting providers, assure quality against externally set standards and reduce risk by monitoring institutional performance on various measures. One of the key changes in Australian higher education quality assurance is the shift from a ‘fitness-for-purpose’ approach to quality assurance to a compliance-driven approach using an externally developed set of standards monitored by the national regulator, which has legislated powers to place sanctions on universities and other providers for non-compliance. This article outlines the new framework introduced by the government and analyses its limitations in assuring and improving quality in core and support areas. It cautions universities against being dominated by TEQSAs compliance agenda. Rather, it encourages the development and maintenance of shared governance principles and strong internal quality improvement processes along with the establishment of an outcomes focus, which will stand the test of external compliance auditing while allowing the institution to pursue its own educational objectives. The article is based on the authors’ experience and reflection on external, improvement-led quality audits in Australia over the past decade compared with the present compliance-oriented audits now required for institutional registration and ongoing accreditation.

Private for-profit higher education in Australia: widening access, participation and opportunities for public-private collaboration

Private for-profit higher education has grown rapidly in many parts of the world. This growth is attributed to many factors, including a broadening of the student population and the recognition that wider access to higher education will be economically beneficial to individuals, governments and society as a whole. In Australia, the number of students in private for-profit higher education is rising, with dramatic projections for the next 10 years. The Australian government has set a target to increase the participation of students in higher education, with a focus on increasing the access and success of students from disadvantaged backgrounds. It is unclear, however, what role the burgeoning private for-profit institutions will play in meeting the governments targets, and what incentives will be provided for them to increase the access and participation of students from disadvantaged groups. This paper analyses the key drivers of growth in private for-profit higher education in Australia, and discusses issues around quality and standards. It examines the strengths and limitations of the sector, and the extent to which it contributes to diversity, access and the participation of students from disadvantaged backgrounds. It argues that the sector needs clear government directions to improve levels of access, and new government policies to encourage public-private collaborations to help ensure sustainability. The paper also briefly touches on the need for a review into the current structure of Australias higher education sector as a whole, and whether higher education would benefit from the formation of public community colleges with the explicit aim of widening access for disadvantaged student groups. Further, the paper suggests that encouraging such public-private collaboration may be beneficial to ensure access and participation of students from all walks of life, including disadvantaged groups.

The Influence of Strategy and External Quality Audit on University Performance: An Australian perspective

External quality audits have been introduced in many parts of the world including Asia Pacific, Asia, Africa, Europe, and the Middle East. While external quality audits have been introduced for more than a decade in some countries like New Zealand, the United Kingdom (UK), Denmark, and Sweden, there is limited research on the extent to which such audits have improved the performance of universities on educational measures. This paper is based on a large public university in Australia that has used strategy implementation and external quality audit as an opportunity for change and improvement. The paper argues that effective strategy implementation, external quality audits, and internal reviews and improvement processes, if effectively managed, could improve performance of the university on various educational measures. The paper compares various performance data of the university: two years pre-strategy implementation and external quality audit and three years post-audit. Finally, the paper argues that a systematic approach to reviews with evidence-based decision-making enables the university to address the areas needing improvement and address the priorities in a timely manner.