Ken Deal

Modeling the Bullying Prevention Program Preferences of Educators: A Discrete Choice Conjoint Experiment

We used discrete choice conjoint analysis to model the bullying prevention program preferences of educators. Using themes from computerized decision support lab focus groups (n = 45 educators), we composed 20 three-level bullying prevention program design attributes. Each of 1,176 educators completed 25 choice tasks presenting experimentally varied combinations of the study’s attribute levels. Latent class analysis yielded three segments with different preferences. Decision Sensitive educators (31%) preferred that individual schools select bullying prevention programs. In contrast, Support Sensitive educators (51%) preferred that local school boards chose bullying prevention programs. This segment preferred more logistical and social support at every stage of the adoption, training, implementation, and long term maintenance processes. Cost Sensitive educators (16%) showed a stronger preference for programs minimizing costs, training, and implementation time demands. They felt prevention programs were less effective and that the time and space in the curriculum for bullying prevention was less adequate. They were less likely to believe that bullying prevention was their responsibility and more likely to agree that prevention was the responsibility of parents. All segments preferred programs supported by the anecdotal reports of colleagues from other schools rather than those based on scientific evidence. To ensure that the bullying prevention options available reflect the complex combination of attributes influencing real world adoption decisions, program developers need to accommodate the differing views of the Decision, Support, and Cost Sensitive segments while maximizing the support of parents and students.

Providing Information to Parents of Children with Mental Health Problems: A Discrete Choice Conjoint Analysis of Professional Preferences

We used discrete choice conjoint analysis to model the ways 645 children’s mental health (CMH) professionals preferred to provide information to parents seeking CMH services. Participants completed 20 choice tasks presenting experimentally varied combinations of the study’s 14 4-level CMH information transfer attributes. Latent class analysis revealed three segments. Open Access professionals (32.2%) preferred that intake workers automatically provide all parents with CMH information. They preferred information prepared by professional organizations and located at accessible settings such as public schools. They responded favorably to the internet as a source of information for parents. Controlled Access professionals (22.2%) preferred information that was approved and recommended by a child’s therapist, prepared by an experienced clinician, and located at hospitals and CMH clinics. Process Sensitive professionals (45.6%) showed a stronger preference for active learning materials with parenting groups and therapist “coaching” calls supporting the knowledge transfer process. Simulations suggested that realizing the benefits of CMH information requires the development of knowledge transfer strategies that align the preferences of professionals with those of the families they serve.

Adaptive Choice-Based Conjoint Analysis

Conjoint analysis (CA) has emerged as an important approach to the assessment of health service preferences. This article examines Adaptive Choice-Based Conjoint Analysis (ACBC) and reviews available evidence comparing ACBC with conventional approaches to CA. ACBC surveys more closely approximate the decision-making processes that influence real-world choices. Informants begin ACBC surveys by completing a build-your-own (BYO) task identifying the level of each attribute that they prefer. The ACBC software composes a series of attribute combinations clustering around each participant’s BYO choices. During the Screener section, informants decide whether each of these concepts is a possibility or not. Probe questions determine whether attribute levels consistently included in or excluded from each informant’s Screener section choices reflect ‘Unacceptable’ or ‘Must Have’ simplifying heuristics. Finally, concepts identified as possibilities during the Screener section are carried forward to a Choice Tournament. The winning concept in each Choice Tournament set advances to the next choice set until a winner is determined.A review of randomized trials and cross-over studies suggests that, although ACBC surveys require more time than conventional approaches to CA, informants find ACBC surveys more engaging. In most studies, ACBC surveys yield lower standard errors, improved prediction of hold-out task choices, and better estimates of real-world product decisions than conventional choice-based CA surveys.

Examining Parents’ Preferences for Group and Individual Parent Training for Children with ADHD Symptoms

Parent training (PT) programs have been found to reduce some behavioral impairment associated with childrens attention deficit hyperactivity disorder (ADHD) as well as improve parenting competence, but poor uptake and participation by parents are formidable barriers that affect service effectiveness. We used a discrete-choice experiment (DCE) to examine how parent preferences for treatment format (i.e., group vs. individual) might influence their participation in PT. Participants were 445 parents seeking mental health services for children with elevated symptoms of ADHD in Ontario, Canada. Parents completed a DCE composed of 30 choice tasks used to gauge PT format preference. Results showed that 58.7% of parents preferred individual PT; these parents were most interested in interventions that would make them feel more informed about their childs problems and in understanding—as opposed to solving—their childs problems. A minority of parents (19.4%) preferred group PT; these parents were most interested in active, skill-building services that would help them solve their childs problems. About one fifth of parents (21.9%) preferred the Minimal Information alternative (i.e., receiving neither individual or group PT); these parents reported the highest levels of depression and the most severe mental health problems in their child. Results highlight the importance of considering parent preferences for format and suggest that alternative formats to standard PT should be considered for multiply stressed families.

Using Conjoint Analysis to Model the Preferences of Different Patient Segments for Attributes of Patient-Centered Care

AbstractBackground: A consensus regarding the components of a patient-centered approach to healthcare does not exist. Although patient-centered care should be predicated on patient preferences, existing models provide little evidence regarding the relative importance of different care processes to patients themselves. Objective: To involve patients in the design of a model of patient-centered care for a corporation of Canadian teaching hospitals. Methods: Using themes from focus groups and interviews, a conjoint survey was developed comprising 14 four-level patient-centered care attributes. Sawtooth Software’s Choice Based Conjoint module (version 2.6.7) was used to design the survey. Each participant completed 15 choice tasks, each task presenting a choice between three hospitals described by a different combination of patient-centered care attribute levels. Latent class analysis was used to identify segments of participants with similar patient-centered care choice patterns. Randomized First Choice simulations were used to predict the percentage of participants in each segment who would choose different approaches to improving patient-centered care.Representative hospital service users were recruited from a corporation of five Canadian teaching hospitals serving a regional population of 2.2 million. Results: A total of 508 patients and family members of children completed a choice-based conjoint survey. Latent class analysis revealed two segments: an informed care segment and a convenient care segment. Participants in the informed care segment (71.3% of the sample) were more likely to have higher education, be non-immigrants, speak English as a first language, and be outpatients or family members.The information needed to understand health concerns, an opportunity to learn health improvement skills, teams that communicated effectively, short waiting times, and collaborative treatment planning were more important to the informed care segment than to the convenient care segment. Convenient settings, a welcoming environment, and ease of internal access exerted a greater influence on the choices made by the convenient care segment. Both segments preferred hospitals that provided health information and gave prompt feedback on patient progress. Conclusions: This study suggests that many patients would exchange an increase in waiting times for prompt feedback, information, and the skills to improve their health.

Access to personalized medicine: factors influencing the use and value of gene expression profiling in breast cancer treatment.

UNLABELLED Genomic information is increasingly being used to personalize health care. One example is gene expression profiling (gep) tests, which estimate recurrence risk to inform chemotherapy decisions in breast cancer. Recently, gep tests were publicly funded in Ontario. We explored the perceived utility of gep tests, focusing on the factors influencing their use and value in treatment decision-making by patients and oncologists. METHODS We conducted interviews with oncologists (n = 14) and interviews and a focus group with early-stage breast cancer patients (n = 28) who underwent gep testing. Both groups were recruited through oncology clinics in Ontario. Data were analyzed using the content analysis and constant comparison techniques. RESULTS Narratives from patients and oncologists provided insights into various factors facilitating and restricting access to gep. First, oncologists are positioned as gatekeepers of gep, providing access in medically appropriate cases. However, varying perceptions of appropriateness led to perceived inequities in access and negative impacts on the doctor-patient relationship. Second, media attention facilitated patient awareness of gep, but also complicated gatekeeping. Third, the dedicated administration attached to gep was burdensome and led to long waits for results and also to increased patient anxiety and delayed treatment. Collectively, because of barriers to access, those factors inadvertently heightened the perceived value of gep for patients relative to other prognostic indicators. CONCLUSIONS Our study delineates the factors facilitating and restricting access to gep, and highlights the roles of media and organization of services in the perceived value and utilization of gep. The results identify a need for administrative changes and practice guidelines to support streamlined and standardized use of gep tests.

Modeling Parenting Programs as an Interim Service for Families Waiting for Children's Mental Health Treatment

Using a discrete choice conjoint experiment, we explored the design of parenting programs as an interim strategy for families waiting for childrens mental health treatment. Latent class analysis yielded 4 segments with different design preferences. Simulations predicted the Fast-Paced Personal Contact segment, 22.1% of the sample, would prefer weekly therapist-led parenting groups. The Moderate-Paced Personal Contact segment (24.7%) preferred twice-monthly therapist-led parenting groups with twice-monthly lessons. The Moderate-Paced E–Contact segment (36.3%), preferred weekly to twice-monthly contacts, e-mail networking, and a program combining therapist-led sessions with the support of a computerized telephone e-coach. The Slow-Paced E–Contact segment (16.9%) preferred an approach combining monthly therapist-led sessions, e-coaching, and e-mail networking with other parents. Simulations predicted 45.3% of parents would utilize an option combining 5 therapist coaching calls with 5 e-coaching calls, a model that could reduce costs and extend the availability of interim services. Although 41.0% preferred weekly pacing, 58% were predicted to choose an interim parenting service conducted at a twice-monthly to monthly pace. The results of this study suggest that developing interim services reflecting parental preferences requires a choice of formats that includes parenting groups, telephone-coached distance programs, and e-coaching options conducted at a flexible pace.

Modeling the anti-cyberbullying preferences of university students: Adaptive choice-based conjoint analysis

Adaptive choice-based conjoint analysis was used to study the anti-cyberbullying program preferences of 1,004 university students. More than 60% reported involvement in cyberbullying as witnesses (45.7%), victims (5.7%), perpetrator-victims (4.9%), or perpetrators (4.5%). Men were more likely to report involvement as perpetrators and perpetrator-victims than were women. Students recommended advertisements featuring famous people who emphasized the impact of cyberbullying on victims. They preferred a comprehensive approach teaching skills to prevent cyberbullying, encouraging students to report incidents, enabling anonymous online reporting, and terminating the internet privileges of students involved as perpetrators. Those who cyberbully were least likely, and victims of cyberbullying were most likely, to support an approach combining prevention and consequences. Simulations introducing mandatory reporting, suspensions, or police charges predicted a substantial reduction in the support of uninvolved students, witnesses, victims, and perpetrators.

What Limits the Effectiveness of Antibullying Programs? A Thematic Analysis of the Perspective of Teachers

Prevention programs yield modest reductions in bullying in North American schools. This study explored the perspective of educators regarding factors limiting the impact of these initiatives. Transcripts from nineteen 90-min focus groups with 103 educators were coded thematically. Educators felt that off-site incidents, cyberbullying, and the growing involvement of boys in psychologically aggressive incidents have increased the complexity of bullying. Curriculum demands limit time for training, implementation, and prompt responses to bullying. Principals failing to back teachers up, ambivalent colleagues, uncooperative parents, and a lack of evidence reduce their commitment to implementation. Promising programs are discontinued in favor of new initiatives. Some educators modified programs; others, feeling frustrated and discouraged, struggled to mobilize the enthusiasm needed to ensure successful implementation. Dealing with bullying in the face of limited time, training, and support may increase emotional exhaustion and compromise program effectiveness.

How do women trade-off benefits and risks in chemotherapy treatment decisions based on gene expression profiling for early-stage breast cancer? A discrete choice experiment

Objectives Gene expression profiling (GEP) of tumours informs baseline risk prediction, potentially affecting adjuvant chemotherapy decisions for women with early-stage breast cancer. Since only 15% will experience a recurrence, concerns have been raised about potential harms from overtreatment and high GEP costs in publicly funded healthcare systems. We aimed to estimate preferences and personal utility of GEP testing information and benefit–risk trade-offs in chemotherapy treatment decisions. Design, setting and intervention Based on literature review and findings from our qualitative research (focus groups, interviews with patients with breast cancer and medical oncologists), we developed a discrete choice experiment (DCE) survey and administered it via an internet panel. The DCE included 12 choice tasks with 5 attributes and 3 alternatives considering orthogonality, D-efficiency and level balance. Participants The DCE survey was administered to 1004 Canadian women from the general population. Main outcome measures Preferences were analysed using conditional logit and hierarchical Bayes and evaluated for goodness of fit. We conducted simulation analyses for alternative scenarios. Results GEP test score indicating likely benefit from chemotherapy was the most important attribute. Doctors clinical estimate of the risk of cancer returning, trust in your cancer doctor and side effects of chemotherapy (temporary and permanent) were relatively less important but showed significant differences among levels. In the scenario analyses, 78% were likely to choose chemotherapy in a high-risk scenario, 55% in a moderate-risk scenario and 33% in a low-risk scenario, with the other attributes held constant. A high GEP score was more important in influencing the choice of chemotherapy for those at intermediate clinical risk. Conclusions GEP testing information influences chemotherapy treatment decisions in early-stage breast cancer and varies depending on clinical risk. Clinicians should be aware of these differences and tailor the use of GEP testing accordingly.