Stephen Maloney

Breakeven, Cost Benefit, Cost Effectiveness, and Willingness to Pay for Web-Based Versus Face-to-Face Education Delivery for Health Professionals

Background The introduction of Web-based education and open universities has seen an increase in access to professional development within the health professional education marketplace. Economic efficiencies of Web-based education and traditional face-to-face educational approaches have not been compared under randomized controlled trial conditions. Objective To compare costs and effects of Web-based and face-to-face short courses in falls prevention education for health professionals. Methods We designed two short courses to improve the clinical performance of health professionals in exercise prescription for falls prevention. One was developed for delivery in face-to-face mode and the other for online learning. Data were collected on learning outcomes including participation, satisfaction, knowledge acquisition, and change in practice, and combined with costs, savings, and benefits, to enable a break-even analysis from the perspective of the provider, cost-effectiveness analysis from the perspective of the health service, and cost-benefit analysis from the perspective of the participant. Results Face-to-face and Web-based delivery modalities produced comparable outcomes for participation, satisfaction, knowledge acquisition, and change in practice. Break-even analysis identified the Web-based educational approach to be robustly superior to face-to-face education, requiring a lower number of enrollments for the program to reach its break-even point. Cost-effectiveness analyses from the perspective of the health service and cost-benefit analysis from the perspective of the participant favored face-to-face education, although the outcomes were contingent on the sensitivity analysis applied (eg, the fee structure used). Conclusions The Web-based educational approach was clearly more efficient from the perspective of the education provider. In the presence of relatively equivocal results for comparisons from other stakeholder perspectives, it is likely that providers would prefer to deliver education via a Web-based medium. Trial Registration Australian New Zealand Clinical Trials Registry (ACTRN): 12610000135011; http://www.anzctr.org.au/trial_view.aspx?id=335135 (Archived by WebCite at http://www.webcitation.org/668POww4L)

Effectiveness of Web-Based Versus Face-To-Face Delivery of Education in Prescription of Falls-Prevention Exercise to Health Professionals: Randomized Trial

Background Exercise is an effective intervention for the prevention of falls; however, some forms of exercises have been shown to be more effective than others. There is a need to identify effective and efficient methods for training health professionals in exercise prescription for falls prevention. Objective The objective of our study was to compare two approaches for training clinicians in prescribing exercise to prevent falls. Methods This study was a head-to-head randomized trial design. Participants were physiotherapists, occupational therapists, nurses, and exercise physiologists working in Victoria, Australia. Participants randomly assigned to one group received face-to-face traditional education using a 1-day seminar format with additional video and written support material. The other participants received Web-based delivery of the equivalent educational material over a 4-week period with remote tutor facilitation. Outcomes were measured across levels 1 to 3 of Kirkpatrick’s hierarchy of educational outcomes, including attendance, adherence, satisfaction, knowledge, and self-reported change in practice. Results Of the 166 participants initially recruited, there was gradual attrition from randomization to participation in the trial (n = 67 Web-based, n = 68 face-to-face), to completion of the educational content (n = 44 Web-based, n = 50 face-to-face), to completion of the posteducation examinations (n = 43 Web-based, n = 49 face-to-face). Participant satisfaction was not significantly different between the intervention groups: mean (SD) satisfaction with content and relevance of course material was 25.73 (5.14) in the Web-based and 26.11 (5.41) in the face-to-face group; linear regression P = .75; and mean (SD) satisfaction with course facilitation and support was 11.61 (2.00) in the Web-based and 12.08 (1.54) in the face-to-face group; linear regression P = .25. Knowledge test results were comparable between the Web-based and face-to-face groups: median (interquartile range [IQR]) for the Web-based group was 90.00 (70.89–90.67) and for the face-to-face group was 80.56 (70.67–90.00); rank sum P = .07. The median (IQR) scores for the exercise assignment were also comparable: Web-based, 78.6 (68.5–85.1), and face-to-face, 78.6 (70.8–86.9); rank sum P = .61. No significant difference was identified in Kirkpatrick’s hierarchy domain change in practice: mean (SD) Web-based, 21.75 (4.40), and face-to-face, 21.88 (3.24); linear regression P = .89. Conclusion Web-based and face-to-face approaches to the delivery of education to clinicians on the subject of exercise prescription for falls prevention produced equivalent results in all of the outcome domains. Practical considerations should arguably drive choice of delivery method, which may favor Web-based provision for its ability to overcome access issues for health professionals in regional and remote settings. Trial Registration Australian New Zealand Clinical Trials Registry number: ACTRN12610000135011; http://www.anzctr.org.au/ACTRN12610000135011.aspx (Archived by WebCite at http://www.webcitation.org/63MicDjPV)

Clinical Decision Making in Exercise Prescription for Fall Prevention

Background Physical therapists often prescribe exercises for fall prevention. Understanding the factors influencing the clinical decision-making processes used by expert physical therapists working in specialist fall and balance clinics may assist other therapists in prescribing exercises for fall prevention with greater efficacy. Objectives The objective of this study was to describe the factors influencing the clinical decision-making processes used by expert physical therapists to prescribe exercises for fall prevention. Design This investigation was a qualitative study from a phenomenological perspective. Methods Semistructured telephone interviews were conducted with 24 expert physical therapists recruited primarily from the Victorian Falls Clinic Coalition. Interviews focused on 3 exercise prescription contexts: face-to-face individual therapy, group exercise programs, and home exercise programs. Interviews elicited information about therapist practices and the therapist, patient, and environmental factors influencing the clinical decision-making processes for the selection of exercise setting, type, dosage (intensity, quantity, rest periods, duration, and frequency), and progression. Strategies for promoting adherence and safety were also discussed. Data were analyzed with a framework approach by 3 investigators. Results Participants described highly individualized exercise prescription approaches tailored to address key findings from physical assessments. Dissonance between prescribing a program that was theoretically correct on the basis of physiological considerations and prescribing one that a client would adhere to was evident. Safety considerations also were highly influential on the exercise type and setting prescribed. Terminology for describing the intensity of balance exercises was vague relative to terminology for describing the intensity of strength exercises. Conclusions Physical therapists with expertise in fall prevention adopted an individualized approach to exercise prescription that was based on physical assessment findings rather than “off-the-shelf” exercise programs commonly used in fall prevention research. Training programs for people who prescribe exercises for older adults at risk of falling should encompass these findings.

The Acceptability Among Health Researchers and Clinicians of Social Media to Translate Research Evidence to Clinical Practice: Mixed-Methods Survey and Interview Study

Background Establishing and promoting connections between health researchers and health professional clinicians may help translate research evidence to clinical practice. Social media may have the capacity to enhance these connections. Objective The aim of this study was to explore health researchers’ and clinicians’ current use of social media and their beliefs and attitudes towards the use of social media for communicating research evidence. Methods This study used a mixed-methods approach to obtain qualitative and quantitative data. Participation was open to health researchers and clinicians. Data regarding demographic details, current use of social media, and beliefs and attitudes towards the use of social media for professional purposes were obtained through an anonymous Web-based survey. The survey was distributed via email to research centers, educational and clinical institutions, and health professional associations in Australia, India, and Malaysia. Consenting participants were stratified by country and role and selected at random for semistructured telephone interviews to explore themes arising from the survey. Results A total of 856 participants completed the questionnaire with 125 participants declining to participate, resulting in a response rate of 87.3%. 69 interviews were conducted with participants from Australia, India, and Malaysia. Social media was used for recreation by 89.2% (749/840) of participants and for professional purposes by 80.0% (682/852) of participants. Significant associations were found between frequency of professional social media use and age, gender, country of residence, and graduate status. Over a quarter (26.9%, 229/852) of participants used social media for obtaining research evidence, and 15.0% (128/852) of participants used social media for disseminating research evidence. Most participants (95.9%, 810/845) felt there was a role for social media in disseminating or obtaining research evidence. Over half of the participants (449/842, 53.3%) felt they had a need for training in the use of social media for professional development. A key barrier to the professional use of social media was concerns regarding trustworthiness of information. Conclusions A large majority of health researchers and clinicians use social media in recreational and professional contexts. Social media is less frequently used for communication of research evidence. Training in the use of social media for professional development and methods to improve the trustworthiness of information obtained via social media may enhance the utility of social media for communicating research evidence. Future studies should investigate the efficacy of social media in translating research evidence to clinical practice.

Health Professional Learner Attitudes and Use of Digital Learning Resources

Background Web-based digital repositories allow educational resources to be accessed efficiently and conveniently from diverse geographic locations, hold a variety of resource formats, enable interactive learning, and facilitate targeted access for the user. Unlike some other learning management systems (LMS), resources can be retrieved through search engines and meta-tagged labels, and content can be streamed, which is particularly useful for multimedia resources. Objective The aim of this study was to examine usage and user experiences of an online learning repository (Physeek) in a population of physiotherapy students. The secondary aim of this project was to examine how students prefer to access resources and which resources they find most helpful. Methods The following data were examined using an audit of the repository server: (1) number of online resources accessed per day in 2010, (2) number of each type of resource accessed, (3) number of resources accessed during business hours (9 am to 5 pm) and outside business hours (years 1-4), (4) session length of each log-on (years 1-4), and (5) video quality (bit rate) of each video accessed. An online questionnaire and 3 focus groups assessed student feedback and self-reported experiences of Physeek. Results Students preferred the support provided by Physeek to other sources of educational material primarily because of its efficiency. Peak usage commonly occurred at times of increased academic need (ie, examination times). Students perceived online repositories as a potential tool to support lifelong learning and health care delivery. Conclusions The results of this study indicate that today’s health professional students welcome the benefits of online learning resources because of their convenience and usability. This represents a transition away from traditional learning styles and toward technological learning support and may indicate a growing link between social immersions in Internet-based connections and learning styles. The true potential for Web-based resources to support student learning is as yet unknown.

A Cost-Effectiveness Analysis of Blended Versus Face-to-Face Delivery of Evidence-Based Medicine to Medical Students

Background Blended learning describes a combination of teaching methods, often utilizing digital technologies. Research suggests that learner outcomes can be improved through some blended learning formats. However, the cost-effectiveness of delivering blended learning is unclear. Objective This study aimed to determine the cost-effectiveness of a face-to-face learning and blended learning approach for evidence-based medicine training within a medical program. Methods The economic evaluation was conducted as part of a randomized controlled trial (RCT) comparing the evidence-based medicine (EBM) competency of medical students who participated in two different modes of education delivery. In the traditional face-to-face method, students received ten 2-hour classes. In the blended learning approach, students received the same total face-to-face hours but with different activities and additional online and mobile learning. Online activities utilized YouTube and a library guide indexing electronic databases, guides, and books. Mobile learning involved self-directed interactions with patients in their regular clinical placements. The attribution and differentiation of costs between the interventions within the RCT was measured in conjunction with measured outcomes of effectiveness. An incremental cost-effectiveness ratio was calculated comparing the ongoing operation costs of each method with the level of EBM proficiency achieved. Present value analysis was used to calculate the break-even point considering the transition cost and the difference in ongoing operation cost. Results The incremental cost-effectiveness ratio indicated that it costs 24% less to educate a student to the same level of EBM competency via the blended learning approach used in the study, when excluding transition costs. The sunk cost of approximately AUD

Educators and students prefer traditional clinical education to a peer-assisted learning model, despite similar student performance outcomes: a randomised trial

40,000 to transition to the blended model exceeds any savings from using the approach within the first year of its implementation; however, a break-even point is achieved within its third iteration and relative savings in the subsequent years. The sensitivity analysis indicates that approaches with higher transition costs, or staffing requirements over that of a traditional method, are likely to result in negative value propositions. Conclusions Under the study conditions, a blended learning approach was more cost-effective to operate and resulted in improved value for the institution after the third year iteration, when compared to the traditional face-to-face model. The wider applicability of the findings are dependent on the type of blended learning utilized, staffing expertise, and educational context.

Exploring issues of cost and value in professional and interprofessional education

QUESTION What is the efficacy and acceptability of a peer-assisted learning model compared with a traditional model for paired students in physiotherapy clinical education? DESIGN Prospective, assessor-blinded, randomised crossover trial. PARTICIPANTS Twenty-four physiotherapy students in the third year of a 4-year undergraduate degree. INTERVENTION Participants each completed 5 weeks of clinical placement, utilising a peer-assisted learning model (a standardised series of learning activities undertaken by student pairs and educators to facilitate peer interaction using guided strategies) and a traditional model (usual clinical supervision and learning activities led by clinical educators supervising pairs of students). OUTCOME MEASURES The primary outcome measure was student performance, rated on the Assessment of Physiotherapy Practice by a blinded assessor, the supervising clinical educator and by the student in self-assessment. Secondary outcome measures were satisfaction with the teaching and learning experience measured via survey, and statistics on services delivered. RESULTS There were no significant between-group differences in Assessment of Physiotherapy Practice scores as rated by the blinded assessor (p=0.43), the supervising clinical educator (p=0.94) or the students (p=0.99). In peer-assisted learning, clinical educators had an extra 6 minutes/day available for non-student-related quality activities (95% CI 1 to 10) and students received an additional 0.33 entries/day of written feedback from their educator (95% CI 0.06 to 0.61). Clinical educator satisfaction and student satisfaction were higher with the traditional model. CONCLUSION The peer-assisted learning model trialled in the present study produced similar student performance outcomes when compared with a traditional approach. Peer-assisted learning provided some benefits to educator workload and student feedback, but both educators and students were more satisfied with the traditional model. TRIAL REGISTRATION ACTRN12610000859088. [Sevenhuysen S, Skinner EH, Farlie MK, Raitman L, Nickson W, Keating JL, Maloney S, Molloy E, Haines TP (2014) Educators and students prefer traditional clinical education to a peer-assisted learning model, despite similar student performance outcomes: a randomised trial.Journal of Physiotherapy60: 209-216].

Compression socks and functional recovery following marathon running: a randomized controlled trial.

Over the past decade or so there has been a growing interest from policymakers, professionals, students and the public on the amount of money that is spent on educating health and social care professions and the ‘‘value’’ this investment may generate for wider society. In this editorial, we discuss the differing element relating to cost and value in the context of professional and interprofessional education. We argue that while there is an increasing pressure to provide evidence in the form of costeffectiveness, cost-benefit and cost-utility analyses for health professions education, collectively, we continue to provide only a limited effort in response. In addressing this gap, we go on to outline some possible routes forward to begin generating and synthesizing evidence for cost and value for interprofessional education.

Issues of cost-benefit and cost-effectiveness for simulation in health professions education

Abstract Armstrong, SA, Till, ES, Maloney, SR, and Harris, GA. Compression socks and functional recovery following marathon running: A randomized controlled trial. J Strength Cond Res 29(2): 528–533, 2015—Compression socks have become a popular recovery aid for distance running athletes. Although some physiological markers have been shown to be influenced by wearing these garments, scant evidence exists on their effects on functional recovery. This research aims to shed light onto whether the wearing of compression socks for 48 hours after marathon running can improve functional recovery, as measured by a timed treadmill test to exhaustion 14 days following marathon running. Athletes (n = 33, age, 38.5 ± 7.2 years) participating in the 2012 Melbourne, 2013 Canberra, or 2013 Gold Coast marathons were recruited and randomized into the compression sock or placebo group. A graded treadmill test to exhaustion was performed 2 weeks before and 2 weeks after each marathon. Time to exhaustion, average and maximum heart rates were recorded. Participants were asked to wear their socks for 48 hours immediately after completion of the marathon. The change in treadmill times (seconds) was recorded for each participant. Thirty-three participants completed the treadmill protocols. In the compression group, average treadmill run to exhaustion time 2 weeks after the marathon increased by 2.6% (52 ± 103 seconds). In the placebo group, run to exhaustion time decreased by 3.4% (−62 ± 130 seconds), P = 0.009. This shows a significant beneficial effect of compression socks on recovery compared with placebo. The wearing of below-knee compression socks for 48 hours after marathon running has been shown to improve functional recovery as measured by a graduated treadmill test to exhaustion 2 weeks after the event.