Annie Y. S. Lau

Impact of Web Searching and Social Feedback on Consumer Decision Making: A Prospective Online Experiment

Background The World Wide Web has increasingly become an important source of information in health care consumer decision making. However, little is known about whether searching online resources actually improves consumers’ understanding of health issues. Objectives The aim was to study whether searching on the World Wide Web improves consumers’ accuracy in answering health questions and whether consumers’ understanding of health issues is subject to further change under social feedback. Methods This was a pre/post prospective online study. A convenience sample of 227 undergraduate students was recruited from the population of the University of New South Wales. Subjects used a search engine that retrieved online documents from PubMed, MedlinePlus, and HealthInsite and answered a set of six questions (before and after use of the search engine) designed for health care consumers. They were then presented with feedback consisting of a summary of the post-search answers provided by previous subjects for the same questions and were asked to answer the questions again. Results There was an improvement in the percentage of correct answers after searching (pre-search 61.2% vs post-search 82.0%, P <.001) and after feedback with other subjects’ answers (pre-feedback 82.0% vs post-feedback 85.3%, P =.051).The proportion of subjects with highly confident correct answers (ie, confident or very confident) and the proportion with highly confident incorrect answers significantly increased after searching (correct pre-search 61.6% vs correct post-search 95.5%, P <.001; incorrect pre-search 55.3% vs incorrect post-search 82.0%, P <.001). Subjects who were not as confident in their post-search answers were 28.5% more likely than those who were confident or very confident to change their answer after feedback with other subjects’ post-search answers (χ 2 1= 66.65, P <.001). Conclusions Searching across quality health information sources on the Web can improve consumers’ accuracy in answering health questions. However, a consumer’s confidence in an answer is not a good indicator of the answer being correct. Consumers who are not confident in their answers after searching are more likely to be influenced to change their views when provided with feedback from other consumers.

Identifying Measures Used for Assessing Quality of YouTube Videos with Patient Health Information: A Review of Current Literature

Background Recent publications on YouTube have advocated its potential for patient education. However, a reliable description of what could be considered quality information for patient education on YouTube is missing. Objective To identify topics associated with the concept of quality information for patient education on YouTube in the scientific literature. Methods A literature review was performed in MEDLINE, ISI Web of Knowledge, Scopus, and PsychINFO. Abstract selection was first conducted by two independent reviewers; discrepancies were discussed in a second abstract review with two additional independent reviewers. Full text of selected papers were analyzed looking for concepts, definitions, and topics used by its authors that focused on the quality of information on YouTube for patient education. Results In total, 456 abstracts were extracted and 13 papers meeting eligibility criteria were analyzed. Concepts identified related to quality of information for patient education are categorized as expert-driven, popularity-driven, or heuristic-driven measures. These include (in descending order): (1) quality of content in 10/13 (77%), (2) view count in 9/13 (69%), (3) health professional opinion in 8/13 (62%), (4) adequate length or duration in 6/13 (46%), (5) public ratings in 5/13 (39%), (6) adequate title, tags, and description in 5/13 (39%), (7) good description or a comprehensive narrative in 4/13 (31%), (8) evidence-based practices included in video in 4/13 (31%), (9) suitability as a teaching tool in 4/13 (31%), (10) technical quality in 4/13 (31%), (11) credentials provided in video in 4/13 (31%), (12) enough amount of content to identify its objective in 3/13 (23%), and (13) viewership share in 2/13 (15%). Conclusions Our review confirms that the current topics linked to quality of information for patient education on YouTube are unclear and not standardized. Although expert-driven, popularity-driven, or heuristic-driven measures are used as proxies to estimate the quality of video information, caution should be applied when using YouTube for health promotion and patient educational material.

Impact of a web-based personally controlled health management system on influenza vaccination and health services utilization rates: a randomized controlled trial

OBJECTIVE To assess the impact of a web-based personally controlled health management system (PCHMS) on the uptake of seasonal influenza vaccine and primary care service utilization among university students and staff. MATERIALS AND METHODS A PCHMS called Healthy.me was developed and evaluated in a 2010 CONSORT-compliant two-group (6-month waitlist vs PCHMS) parallel randomized controlled trial (RCT) (allocation ratio 1:1). The PCHMS integrated an untethered personal health record with consumer care pathways, social forums, and messaging links with a health service provider. RESULTS 742 university students and staff met inclusion criteria and were randomized to a 6-month waitlist (n=372) or the PCHMS (n=370). Amongst the 470 participants eligible for primary analysis, PCHMS users were 6.7% (95% CI: 1.46 to 12.30) more likely than the waitlist to receive an influenza vaccine (waitlist: 4.9% (12/246, 95% CI 2.8 to 8.3) vs PCHMS: 11.6% (26/224, 95% CI 8.0 to 16.5); χ(2)=7.1, p=0.008). PCHMS participants were also 11.6% (95% CI 3.6 to 19.5) more likely to visit the health service provider (waitlist: 17.9% (44/246, 95% CI 13.6 to 23.2) vs PCHMS: 29.5% (66/224, 95% CI: 23.9 to 35.7); χ(2)=8.8, p=0.003). A dose-response effect was detected, where greater use of the PCHMS was associated with higher rates of vaccination (p=0.001) and health service provider visits (p=0.003). DISCUSSION PCHMS can significantly increase consumer participation in preventive health activities, such as influenza vaccination. CONCLUSIONS Integrating a PCHMS into routine health service delivery systems appears to be an effective mechanism for enhancing consumer engagement in preventive health measures. TRIAL REGISTRATION Australian New Zealand Clinical Trials Registry ACTRN12610000386033. http://www.anzctr.org.au/trial_view.aspx?id=335463.

Social media in health - what are the safety concerns for health consumers?

Recent literature has discussed the unintended consequences of clinical information technologies (IT) on patient safety, yet there has been little discussion about the safety concerns in the area of consumer health IT. This paper presents a range of safety concerns for consumers in social media, with a case study on YouTube. We conducted a scan of abstracts on ‘quality criteria’ related to YouTube. Five areas regarding the safety of YouTube for consumers were identified: (a) harmful health material targeted at consumers (such as inappropriate marketing of tobacco or direct-to-consumer drug advertising); (b) public display of unhealthy behaviour (such as people displaying self-injury behaviours or hurting others); (c) tainted public health messages (i.e. the rise of negative voices against public health messages); (d) psychological impact from accessing inappropriate, offensive or biased social media content; and (e) using social media to distort policy and research funding agendas. The examples presented should contribute to a better understanding about how to promote a safe consumption and production of social media for consumers, and an evidence-based approach to designing social media interventions for health. The potential harm associated with the use of unsafe social media content on the Internet is a major concern. More empirical and theoretical studies are needed to examine how social media influences consumer health decisions, behaviours and outcomes, and devise ways to deter the dissemination of harmful influences in social media.

Ethical Issues of Social Media Usage in Healthcare

OBJECTIVE Social media, web and mobile technologies are increasingly used in healthcare and directly support patientcentered care. Patients benefit from disease self-management tools, contact to others, and closer monitoring. Researchers study drug efficiency, or recruit patients for clinical studies via these technologies. However, low communication barriers in socialmedia, limited privacy and security issues lead to problems from an ethical perspective. This paper summarizes the ethical issues to be considered when social media is exploited in healthcare contexts. METHODS Starting from our experiences in social-media research, we collected ethical issues for selected social-media use cases in the context of patient-centered care. Results were enriched by collecting and analyzing relevant literature and were discussed and interpreted by members of the IMIA Social Media Working Group. RESULTS Most relevant issues in social-media applications are confidence and privacy that need to be carefully preserved. The patient-physician relationship can suffer from the new information gain on both sides since private information of both healthcare provider and consumer may be accessible through the Internet. Physicians need to ensure they keep the borders between private and professional intact. Beyond, preserving patient anonymity when citing Internet content is crucial for research studies. CONCLUSION Exploiting medical social-media in healthcare applications requires a careful reflection of roles and responsibilities. Availability of data and information can be useful in many settings, but the abuse of data needs to be prevented. Preserving privacy and confidentiality of online users is a main issue, as well as providing means for patients or Internet users to express concerns on data usage.

Can Cognitive Biases during Consumer Health Information Searches Be Reduced to Improve Decision Making

OBJECTIVE To test whether the anchoring and order cognitive biases experienced during search by consumers using information retrieval systems can be corrected to improve the accuracy of, and confidence in, answers to health-related questions. DESIGN A prospective study was conducted on 227 undergraduate students who used an online search engine developed by the authors to find health information and then answer six randomly assigned consumer health questions. The search engine was fitted with a baseline user interface and two modified interfaces specifically designed to debias anchoring or order effect. Each subject used all three user interfaces, answering two questions with each. MEASUREMENTS Frequencies of correct answers pre- and post- search and confidence in answers were collected. Time taken to search and then answer a question, the number of searches conducted and the number of links accessed in a search session were also recorded. User preferences for each interface were measured. Chi-square analyses tested for the presence of biases with each user interface. The Kolmogorov-Smirnov test checked for equality of distribution of the evidence analyzed for each user interface. The test for difference between proportions and the Wilcoxon signed ranks test were used when comparing interfaces. RESULTS Anchoring and order effects were present amongst subjects using the baseline search interface (anchoring: p < 0.001; order: p = 0.026). With use of the order debiasing interface, the initial order effect was no longer present (p = 0.34) but there was no significant improvement in decision accuracy (p = 0.23). While the anchoring effect persisted when using the anchor debiasing interface (p < 0.001), its use was associated with a 10.3% increase in subjects who had answered incorrectly pre-search, answering correctly post-search (p = 0.10). Subjects using either debiasing user interface conducted fewer searches and accessed more documents compared to baseline (p < 0.001). In addition, the majority of subjects preferred using a debiasing interface over baseline. CONCLUSION This study provides evidence that (i) debiasing strategies can be integrated into the user interface of a search engine; (ii) information interpretation behaviors can be to some extent debiased; and that (iii) attempts to debias information searching by consumers can influence their ability to answer health-related questions accurately, their confidence in these answers, as well as the strategies used to conduct searches and retrieve information.

A randomised controlled trial of a consumer-focused e-health strategy for cardiovascular risk management in primary care: the Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) study protocol

Introduction Fewer than half of all people at highest risk of a cardiovascular event are receiving and adhering to best practice recommendations to lower their risk. In this project, we examine the role of an e-health-assisted consumer-focused strategy as a means of overcoming these gaps between evidence and practice. Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) aims to test whether a consumer-focused e-health strategy provided to Aboriginal and Torres Strait Islander and non-indigenous adults, recruited through primary care, at moderate-to-high risk of a cardiovascular disease event will improve risk factor control when compared with usual care. Methods and analysis Randomised controlled trial of 2000 participants with an average of 18 months of follow-up to evaluate the effectiveness of an integrated consumer-directed e-health portal on cardiovascular risk compared with usual care in patients with cardiovascular disease or who are at moderate-to-high cardiovascular disease risk. The trial will be augmented by formal economic and process evaluations to assess acceptability, equity and cost-effectiveness of the intervention. The intervention group will participate in a consumer-directed e-health strategy for cardiovascular risk management. The programme is electronically integrated with the primary care providers software and will include interactive smart phone and Internet platforms. The primary outcome is a composite endpoint of the proportion of people meeting the Australian guideline-recommended blood pressure (BP) and cholesterol targets. Secondary outcomes include change in mean BP and fasting cholesterol levels, proportion meeting BP and cholesterol targets separately, self-efficacy, health literacy, self-reported point prevalence abstinence in smoking, body mass index and waist circumference, self-reported physical activity and self-reported medication adherence. Ethics and dissemination Primary ethics approval was received from the University of Sydney Human Research Ethics Committee and the Aboriginal Health and Medical Research Council. Results will be disseminated via the usual scientific forums including peer-reviewed publications and presentations at international conferences Clinical Trials registration number ACTRN12613000715774.

Which Bundles of Features in a Web-Based Personally Controlled Health Management System Are Associated With Consumer Help-Seeking Behaviors for Physical and Emotional Well-Being?

Background Personally controlled health management systems (PCHMS), which include a personal health record (PHR), health management tools, and consumer resources, represent the next stage in consumer eHealth systems. It is still unclear, however, what features contribute to an engaging and efficacious PCHMS. Objective To identify features in a Web-based PCHMS that are associated with consumer utilization of primary care and counselling services, and help-seeking rates for physical and emotional well-being concerns. Methods A one-group pre/posttest online prospective study was conducted on a university campus to measure use of a PCHMS for physical and emotional well-being needs during a university academic semester (July to November 2011). The PCHMS integrated an untethered personal health record (PHR) with well-being journeys, social forums, polls, diaries, and online messaging links with a health service provider, where journeys provide information for consumer participants to engage with clinicians and health services in an actionable way. 1985 students and staff aged 18 and above with access to the Internet were recruited online. Logistic regression, the Pearson product-moment correlation coefficient, and chi-square analyses were used to associate participants’ help-seeking behaviors and health service utilization with PCHMS usage among the 709 participants eligible for analysis. Results A dose-response association was detected between the number of times a user logged into the PCHMS and the number of visits to a health care professional (P=.01), to the university counselling service (P=.03), and help-seeking rates (formal or informal) for emotional well-being matters (P=.03). No significant association was detected between participant pre-study characteristics or well-being ratings at different PCHMS login frequencies. Health service utilization was strongly correlated with use of a bundle of features including: online appointment booking (primary care: OR 1.74, 95% CI 1.01-3.00; counselling: OR 6.04, 95% CI 2.30-15.85), personal health record (health care professional: OR 2.82, 95% CI 1.63-4.89), the poll (health care professional: OR 1.47, 95% CI 1.02-2.12), and diary (counselling: OR 4.92, 95% CI 1.40-17.35). Help-seeking for physical well-being matters was only correlated with use of the personal health record (OR 1.73, 95% CI 1.18-2.53). Help-seeking for emotional well-being concerns (including visits to the university counselling service) was correlated with a bundle comprising the poll (formal or informal help-seeking: OR 1.03, 95% CI 1.00-1.05), diary (counselling: OR 4.92, 95% CI 1.40-17.35), and online appointment booking (counselling: OR 6.04, 95% CI 2.30-15.85). Conclusions Frequent usage of a PCHMS was significantly associated with increased consumer health service utilization and help-seeking rates for emotional health matters in a university sample. Different bundles of PCHMS features were associated with physical and emotional well-being matters. PCHMS appears to be a promising mechanism to engage consumers in help-seeking or health service utilization for physical and emotional well-being matters.

Social Features in Online Communities for Healthcare Consumers --- A Review

This review provides a snapshot of the literature in online communities for healthcare consumers. It summarizes the features commonly used by healthcare consumers in online communities: seeking and sharing personal experiences, opinions and answers, and exchanging social support. This review also identifies behaviors that are commonly practiced by healthcare consumers but are not readily supported in current online communities. These include collaborative healthcare decision-making, conducting social comparison, and lurking in online communities. This review concludes by emphasizing the importance of trust, privacy and safety when designing an online community for healthcare consumers, particularly in the age of Web 2.0.

The role of social media for patients and consumer health : contribution of the IMIA consumer health informatics working group

OBJECTIVES : To provide an overview on social media for consumers and patients in areas of health behaviours and outcomes. METHODS A directed review of recent literature. RESULTS : We discuss the limitations and challenges of social media, ranging from social network sites (SNSs), computer games, mobile applications, to online videos. An overview of current users of social media (Generation Y), and potential users (such as low socioeconomic status and the chronically ill populations) is also presented. Future directions in social media research are also discussed. CONCLUSIONS : We encourage the health informatics community to consider the socioeconomic class, age, culture, and literacy level of their populations, and select an appropriate medium and platform when designing social networked interventions for health. Little is known about the impact of second-hand experiences faciliated by social media, nor the quality and safety of social networks on health. Methodologies and theories from human computer interaction, human factors engineering and psychology may help guide the challenges in designing and evaluating social networked interventions for health. Further, by analysing how people search and navigate social media for health purposes, infodemiology and infoveillance are promising areas of research that should provide valuable insights on present and emergening health behaviours on a population scale.