Anne Leahy

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

BackgroundSurveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors.MethodsA stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost.ResultsThe online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online survey was 38% lower than simultaneous mixed mode and 22% lower than sequential mixed mode. The cost of the sequential mixed mode was 14% lower than simultaneous mixed mode. Compared to the online mode, the sequential mixed mode was the most cost-effective, although exhibiting some evidence of response bias.ConclusionsDecisions on which survey mode to use depend on response rates, response bias, item non-response and costs. The sequential mixed mode appears to be the most cost-effective mode of survey administration for surveys of the population of doctors, if one is prepared to accept a degree of response bias. Online surveys are not yet suitable to be used exclusively for surveys of the doctor population.

Australia's Engagement with Asia, 1990–2010

Asia has emerged as an industrial powerhouse. Australia has a once‐in‐a‐generation opportunity to position itself at the vanguard of a significant change in the global economic architecture. In this article, we examine the dynamics of Australian–Asian relations using a unique multi‐indicator index of ‘engagement’ which incorporates components of trade, investment, education, tourism, research and business development, migration and humanitarian assistance. Our analysis suggests that engagement between Australia and Asia has grown at a much faster rate since 1990 than that between Australia and the rest of the world.

Industrial Capabilities in Victoria

This paper presents the key findings from a small qualitative survey of the main factors associated with the creation and usage of five industrial capabilities in leading Victorian sectors. The capabilities included advanced manufacturing technologies (AMT), design, information and communications technology (ICT), biotechnology and environment technologies. Eighty-eight companies and organisations were interviewed for the study. It was found that the main requirements for the successful creation of a capability was the ability of the company to recruit and retain the best graduates from universities and technical schools, the ability to offer training to these graduates and the ability to financially support high and consistent levels of R&D over time. The main requirement for the successful use of a capability was effective company networking, work cultures conducive to excellence, supportive government regulations and the provision of complementary specialised training.