Mary Roduta Roberts

Causal or spurious? The relationship of knowledge and attitudes to trust in science and technology

Survey data on 1217 adults living in Alberta, Canada were collected by Ipsos Reid Public Affairs and made available to us for analysis. The survey questioned participants on issues related to science including their perceived knowledge of science, attitudes toward science, and trust in science and technology. We developed a structural equation model to account for the causal relations implied by the correlations among the variables in the data set. Results show that trust in generalized science and technology is a large determiner of trust in specific technologies, but that trust in specific technologies is not a determinant of overall trust in science and technology. We also found that attitudes towards science have an effect on trust in generalized science and technology whereas perceived knowledge does not. Education and gender contribute to attitudes supporting an increased personal attachment to science, which was the strongest predictor of trust in our model.

Collecting clinical data in primary ciliary dyskinesia- challenges and opportunities

Rationale: Primary ciliary dyskinesia (PCD) is under diagnosed and underestimated. Most clinical research has used some form of questionnaires to capture data but none has been critically evaluated particularly with respect to its end-user feasibility and utility. Objective: To critically appraise a clinical data collection questionnaire for PCD used in a large national PCD consortium in order to apply conclusions in future PCD research. Methods: We describe the development, validation and revision process of a clinical questionnaire for PCD and its evaluation during a national clinical PCD study with respect to data collection and analysis, initial completion rates and user feedback. Results: 14 centers participating in the consortium successfully completed the revised version of the questionnaire for 173 patients with various completion rates for various items. While content and internal consistency analysis demonstrated validity, there were methodological deficiencies impacting completion rates and end-user utility. These deficiencies were addressed resulting in a more valid questionnaire. Conclusions: Our experience may be useful for future clinical research in PCD. Based on the feedback collected on the questionnaire through analysis of completion rates, judgmental analysis of the content, and feedback from experts and end users, we suggest a practicable framework for development of similar tools for various future PCD research.

Testing Expert-Based Versus Student-Based Cognitive Models for a Grade 3 Diagnostic Mathematics Assessment

The purpose of this study was to evaluate the adequacy of three cognitive models, one developed by content experts and two generated from student verbal reports for explaining examinee performance on a grade 3 diagnostic mathematics test. For this study, the items were developed to directly measure the attributes in the cognitive model. The performance of each cognitive model was evaluated by examining its fit to different data samples: verbal report, total, high-, moderate-, and low ability using the Hierarchy Consistency Index (Cui & Leighton, 2009), a model-data fit index. This study utilized cognitive diagnostic assessments developed under the framework of construct-centered test design and analyzed using the Attribute Hierarchy Method (Gierl, Wang, & Zhou, 2008; Leighton, Gierl, & Hunka, 2004). Both the expert-based and the student-based cognitive models provided excellent fit to the verbal report and high ability samples, but moderate to poor fit to the total, moderate and low ability samples. Implications for cognitive model development for cognitive diagnostic assessment are discussed.

Validation of the Readiness for Return-To-Work Scale in Outpatient Occupational Rehabilitation in Canada

Purpose To examine construct and concurrent validity of the Readiness for Return-To-Work (RRTW) Scale with injured workers participating in an outpatient occupational rehabilitation program. Methods Lost-time claimants (n = 389) with sub-acute or chronic musculoskeletal disorders completed the RRTW Scale on their first day of their occupational rehabilitation program. Statistical analysis included exploratory and confirmatory factor analyses of the readiness items, reliability analyses, and correlation with related scales and questionnaires. Results For claimants in the non-job attached/not working group (n = 165), three factors were found (1) Contemplation (2) Prepared for Action-Self-evaluative and (3) Prepared for Action-Behavioural. The precontemplation stage was not identified within this sample of injured workers. For claimants who were job attached/working group in some capacity (n = 224), two factors were identified (1) Uncertain Maintenance and (2) Proactive Maintenance. Expected relationships and statistically significant differences were found among the identified Return-To-Work (RTW) readiness factors and related constructs of pain, physical and mental health and RTW expectations. Conclusion Construct and concurrent validity of the RRTW Scale were supported in this study. The results of this study indicate the construct of readiness for RTW can vary by disability duration and occupational category. Physical health appears to be a significant barrier to RRTW for the job attached/working group while mental health significantly compromises RRTW with the non-job attached/not working group.

Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists

Introduction Sleep disordered breathing in the paediatric population can manifest as an array of different systemic symptoms; among them is a distinct malocclusion and craniofacial phenotype. Emerging research suggests that the treatment of this malocclusion and/or craniofacial phenotype through orthodontic intervention may help with the symptoms of these patients. Selecting the patients who would benefit from orthodontic treatment can be a difficult task for the physician with minimal dental training. Therefore the aim of this study is to develop a simple index to be used by medical professionals to identify those paediatric patients with orthodontic treatment needs who may benefit their obstructive sleep apnoea (OSA) symptoms. Methods and analysis The methodology in this project has been devised through the WHOs recommendations on developing an index, with modifications based on the specific needs of this study. Based on the available literature, a draft index will be produced and subjected to multiple iterative revisions based on the feedback from: the Index Development Group, a group of multidisciplinary and internationally acclaimed experts in the field; the External Review Group, a group of potential end users and interested parties and the Steering Committee. Once the index has been formalised, it will be subjected to a pair of reliability tests using physicians and orthodontists scored 2 weeks apart. Subsequently, the index will be validated using dichotomous responses from orthodontists on whether they would treat a patient for OSA symptoms, and comparing the responses to the score of the index on the same patient. Ethics and dissemination The index will be translated into French and will be presented in orthodontic and medical conferences, workshops, seminars, round table discussions, and free copies for download will be made available on the website of the University of Alberta Interdisciplinary Airway Research Clinic (iarc.ualberta.ca). Furthermore, the index will be published in a peer-reviewed medical journal to further increase the exposure of the index.

Examining Score Report Language in Accountability Testing

The purpose of this study was to examine patterns of language use in score reports within a North American context. Using a discourse analysis approach informed by conversation analysis, we explored how language was structured to express ideas or (re-)produce values, practices, and institutions in society. A sample of ten reports from the United States and Canada within the domain of accountability testing was selected. Observed patterns of language represented micro-discourses embedded within broader discourse related to accountability mandates within each country. Three broad themes were identified within and across the score reports— Displays of Information, Knowledge Claims, and Doing Accountability. Within each of the broad themes were sub-themes—script formulations, hedging, establishing authority, establishing responsibility, word choice, and visual representations—that characterized more fine-grained textual features. Future research may explore empirical evidence for the social dynamics identified through this study’s textual analysis. Complementary lines of research on both cognitive and affective factors of score report interpretation and use are encouraged.