Allyson Holbrook

Consistency and Inconsistency in PhD Thesis Examination.

This is a mixed methods investigation of consistency in PhD examination. At its core is the quantification of the content and conceptual analysis of examiner reports for 804 Australian theses. First, the level of consistency between what examiners say in their reports and the recommendation they provide for a thesis is explored, followed by an examination of the degree of discrepancy between examiner recommendations and university committee decisions on the theses. Two groups of discrepant recommendations are identified and analysed in depth. Finally the main sources of inconsistency are identified. It was found that the comments of a small minority of examiners were inconsistent with each other or with the committee decision in a significant way. Much more commonly the texts of examiner reports were highly consistent and were closely reflected in the final committee decision.

Examiner comment on the literature review in Ph.D. theses

The review of literature, so central to scholarly work and disciplined inquiry, is expected of the Ph.D. student, but how far along the road are they expected to travel? This article investigates the expectations of ‘the literature’ in research and scholarship at Ph.D. level from the examiner and assessment perspective. The analysis draws on the examiner report data for 501 candidates (1310 reports) across five Australian universities. On average about one‐tenth of an examiner report is devoted to the literature and examiners provide detail about coverage, types of errors and the nature of use of the literature. It was the latter type of comment about coherent and substantive use of the literature that provided the most information about ‘expectation’. Examiners identified ‘working understanding’, ‘critical appraisal’ of the body of literature, ‘connection of the literature to findings’, and ‘disciplinary perspective’ as key indicators of performance in the candidate’s use of the literature. While examiners appeared to anticipate that all these elements should be present in scholarly work (and identified them in the best theses), they were prepared to accept less for a barely passable thesis, but pressed for at least some demonstration of critical appraisal.

The rise of ‘professional staff’ and demise of the ‘non-academic’: a study of university staffing nomenclature preferences

Concerns regarding the nomenclature of university administration in Australia and the UK have featured in the higher education literature for over a decade. In response, a significant nomenclature shift is occurring, with Australian universities replacing the term ‘General Staff’ to describe all administrative and technical staff, in favour of ‘Professional Staff’. Following nomenclature trends in the UK, this change has been in gestation for some time having been championed by individuals, groups, professional associations and more recently a national staff union. This paper presents the findings of a doctoral study regarding the nomenclature preferences of 194 Australian university research support staff. It provides insight into the motivations behind the nomenclature shift, with an emphasis on the dissatisfaction expressed for the term ‘Non-Academic Staff’. Drawing on these findings, this paper suggests an aspirational framework for university professional staff in the form of a ‘nomenclature ladder’ for sector-wide application.

Examining PhD and research masters theses

The examination of research theses has only relatively recently attracted research interest that has focused on what examiners do and how consistent they are. The research questions in this study address firstly whether PhD and research masters theses were treated by examiners as qualitatively different on 12 indicators of importance across the areas: contribution of the thesis, the literature review, approach and methodology, analyses and results and presentation. Secondly what was the examiner assessment of quality of a recently examined thesis on the same indicators and, finally, how well the indicators were reflected in a holistic assessment of thesis quality. The work reported here draws on the responses of 353 PhD and 74 research masters thesis examiners. Findings showed the examiners generally rated the relative importance of the indicators very similarly at both degree levels. Further the order of importance across indicators was essentially the same for the two levels of thesis. Anticipated differences did emerge with the examiners giving higher quality gradings for all contribution indicators for PhD as compared with research masters theses. The 12 specific quality indicators, individually and collectively were strongly related to the holistic assessment of thesis quality, particularly at the PhD level.

Student Experience of Final-Year Undergraduate Research Projects: An Exploration of "Research Preparedness".

During this past decade the level of interest in building research capacity has intensified in Australia and internationally, with a particular emphasis on the development of postgraduate research students, but also extending to undergraduate research experience. This study investigated the student experience across a diverse range of fourth-year undergraduate research programs in one Australian university, and explored how this prepared students for further research study. A construct of ‘research preparedness’ was developed from several factors, including research self-efficacy, motivation, research environment and orientation towards research. Overall, students were motivated to complete their research, and were confident in their ability to carry out the tasks involved in the research process regardless of the program they were undertaking. On the whole, students enrolled in a one-year research program had the strongest intent to continue on to further research studies, and were more likely to show evidence of research preparedness.

Doctoral supervision in a cross-cultural context: issues affecting supervisors and candidates

This article presents an analysis of rich data, gathered from interviews with 46 candidates and 38 supervisors from three Australian universities, about experiences of doctoral supervision in cross-cultural situations. Our analysis shows that many of the issues reported by international candidates are the same as those encountered by domestic candidates. However, this study has identified eight intensifiers that make such situations more complicated or difficult for candidates in a cross-cultural context: language; cultural differences in dealing with hierarchy; separation from the familiar; separation from support; other cultural differences; stereotypes; time; and what happens when the candidate returns home. The two intensifiers mentioned by more than 50% of interviewees are separation from the familiar and language. Using intensifiers as a conceptual framework for self-examination may help universities to better understand the real issues, to target resources, to mitigate distress to international candidates and reduce pressure on supervisors.

New South Wales Child Development Study (NSW-CDS): an Australian multiagency, multigenerational, longitudinal record linkage study

Purpose The initial aim of this multiagency, multigenerational record linkage study is to identify childhood profiles of developmental vulnerability and resilience, and to identify the determinants of these profiles. The eventual aim is to identify risk and protective factors for later childhood-onset and adolescent-onset mental health problems, and other adverse social outcomes, using subsequent waves of record linkage. The research will assist in informing the development of public policy and intervention guidelines to help prevent or mitigate adverse long-term health and social outcomes. Participants The study comprises a population cohort of 87 026 children in the Australian State of New South Wales (NSW). The cohort was defined by entry into the first year of full-time schooling in NSW in 2009, at which time class teachers completed the Australian Early Development Census (AEDC) on each child (with 99.7% coverage in NSW). The AEDC data have been linked to the childrens birth, health, school and child protection records for the period from birth to school entry, and to the health and criminal records of their parents, as well as mortality databases. Findings to date Descriptive data summarising sex, geographic and socioeconomic distributions, and linkage rates for the various administrative databases are presented. Child data are summarised, and the mental health and criminal records data of the childrens parents are provided. Future plans In 2015, at age 11 years, a self-report mental health survey was administered to the cohort in collaboration with government, independent and Catholic primary school sectors. A second record linkage, spanning birth to age 11 years, will be undertaken to link this survey data with the aforementioned administrative databases. This will enable a further identification of putative risk and protective factors for adverse mental health and other outcomes in adolescence, which can then be tested in subsequent record linkages.

The focus and substance of formative comment provided by PhD examiners

In practice and process PhD examination is distinctive, reflecting the high expectations of students whose learning has been directed to their becoming researchers. This article builds on previous research on the examination of Australian theses that revealed that examiners in Science (n = 542) and Education (n = 241) provide a substantial proportion of formative comment in their reports, much of which is constructed in a way that anticipates reflective engagement by the student. Detailed examination of the formative text identified nine categories of comment directed at three collective groupings of weaknesses or flaws related to less favourable recommendation. The flaws are related to ‘fundamentals’, ‘project’ and ‘argument’. There were discipline differences, including significantly more comment in Science, indicating that the candidate should attend further to the data and analysis in their project and the fundamentals of presentation. In Education there was more emphasis on improving argument.

PhD theses at the margin: examiner comment on re-examined theses

Abstract It is rare for a PhD candidate who submits a thesis for examination to fail outright. If a thesis exhibits significant flaws the candidate may be required to make major revisions and re‐submit the work for re‐examination. The written comments of examiners before and after resubmission can provide important insights into the process of examination and the qualities examiners identify in a marginal thesis. Drawing on 101 of the most recent, completed theses across fields in one Australian university, this article investigates the differences in examiner comment on the qualities of theses by the same candidates before and after major revision and re‐submission (N = 6), and between these theses and those that were ‘passed’ at the first examination (N=95). Critical comments about the literature review and the degree to which the examiner moved into a supervisory role were found to be strong indicators of theses at the margin’.

Learning Patterns in Music Practice: Links between Disposition, Practice Strategies and Outcomes.

Research into musical practice has over recent decades focused on the technical and organisational strategies employed by novices and experts. What has been less studied are the background factors or influences on the quality of this music practice. Drawing on interview data collected from 66 children and adults from a mixed methods project, we investigate dispositional factors involved in learning and their association with practice strategies and musical and technical outcomes. A qualitative cluster analysis of beliefs about music and learning, expressions of volition and practice strategies produced three distinctive patterns of learning that influenced technical, musical and affective outcomes for the participants. Implications for teaching and learning are discussed.