Leib Litman

TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences

In recent years, Mechanical Turk (MTurk) has revolutionized social science by providing a way to collect behavioral data with unprecedented speed and efficiency. However, MTurk was not intended to be a research tool, and many common research tasks are difficult and time-consuming to implement as a result. TurkPrime was designed as a research platform that integrates with MTurk and supports tasks that are common to the social and behavioral sciences. Like MTurk, TurkPrime is an Internet-based platform that runs on any browser and does not require any downloads or installation. Tasks that can be implemented with TurkPrime include: excluding participants on the basis of previous participation, longitudinal studies, making changes to a study while it is running, automating the approval process, increasing the speed of data collection, sending bulk e-mails and bonuses, enhancing communication with participants, monitoring dropout and engagement rates, providing enhanced sampling options, and many others. This article describes how TurkPrime saves time and resources, improves data quality, and allows researchers to design and implement studies that were previously very difficult or impossible to carry out on MTurk. TurkPrime is designed as a research tool whose aim is to improve the quality of the crowdsourcing data collection process. Various features have been and continue to be implemented on the basis of feedback from the research community. TurkPrime is a free research platform.

The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk.

In this study, we examined data quality among Amazon Mechanical Turk (MTurk) workers based in India, and the effect of monetary compensation on their data quality. Recent studies have shown that work quality is independent of compensation rates, and that compensation primarily affects the quantity but not the quality of work. However, the results of these studies were generally based on compensation rates below the minimum wage, and far below a level that was likely to play a practical role in the lives of workers. In this study, compensation rates were set around the minimum wage in India. To examine data quality, we developed the squared discrepancy procedure, which is a task-based quality assurance approach for survey tasks whose goal is to identify inattentive participants. We showed that data quality is directly affected by compensation rates for India-based participants. We also found that data were of a lesser quality among India-based than among US participants, even when optimal payment strategies were utilized. We additionally showed that the motivation of MTurk users has shifted, and that monetary compensation is now reported to be the primary reason for working on MTurk, among both US- and India-based workers. Overall, MTurk is a constantly evolving marketplace where multiple factors can contribute to data quality. High-quality survey data can be acquired on MTurk among India-based participants when an appropriate pay rate is provided and task-specific quality assurance procedures are utilized.

Validation of photoplethysmography as a method to detect heart rate during rest and exercise.

Abstract Despite their enhanced marketplace visibility, validity of wearable photoplethysmographic heart rate monitoring is scarce. Forty-seven healthy participants performed seven, 6-min exercise bouts and completed a valid skin type scale. Participants wore an Omron HR500U (OHR) and a Mio Alpha (MA), two commercial wearable photoplethysmographic heart rate monitors. Data were compared to a Polar RS800CX (PRS). Means and error were calculated between devices using minutes 2–5. Compared to PRS, MA data was significantly different in walking, biking (2.41 ± 3.99 bpm and 3.26 ± 11.38 bpm, p < 0.05) and weight lifting (23.30 ± 31.94 bpm, p < 0.01). OHR differed from PRS in walking (4.95 ± 7.53 bpm, p < 0.05) and weight lifting (4.67 ± 8.95 bpm, p < 0.05). MA during elliptical, stair climbing and biking conditions demonstrated a strong correlation between jogging speed and error (r = 0.55, p < 0.0001), and showed differences in participants with less photosensitive skin.

Mobile Exercise Apps and Increased Leisure Time Exercise Activity: A Moderated Mediation Analysis of the Role of Self-Efficacy and Barriers

Background There are currently over 1000 exercise apps for mobile devices on the market. These apps employ a range of features, from tracking exercise activity to providing motivational messages. However, virtually nothing is known about whether exercise apps improve exercise levels and health outcomes and, if so, the mechanisms of these effects. Objective Our aim was to examine whether the use of exercise apps is associated with increased levels of exercise and improved health outcomes. We also develop a framework within which to understand how exercise apps may affect health and test multiple models of possible mechanisms of action and boundary conditions of these relationships. Within this framework, app use may increase physical activity by influencing variables such as self-efficacy and may help to overcome exercise barriers, leading to improved health outcomes such as lower body mass index (BMI). Methods In this study, 726 participants with one of three backgrounds were surveyed about their use of exercise apps and health: (1) those who never used exercise apps, (2) those who used exercise apps but discontinued use, and (3) those who are currently using exercise apps. Participants were asked about their long-term levels of exercise and about their levels of exercise during the previous week with the International Physical Activity Questionnaire (IPAQ). Results Nearly three-quarters of current app users reported being more active compared to under half of non-users and past users. The IPAQ showed that current users had higher total leisure time metabolic equivalent of task (MET) expenditures (1169 METs), including walking and vigorous exercise, compared to those who stopped using their apps (612 METs) or who never used apps (577 METs). Importantly, physical activity levels in domains other than leisure time activity were similar across the groups. The results also showed that current users had lower BMI (25.16) than past users (26.8) and non-users (26.9) and that this association was mediated by exercise levels and self-efficacy. That relationship was also moderated by perceived barriers to exercise. Multiple serial mediation models were tested, which revealed that the association between app use and BMI is mediated by increased self-efficacy and increased exercise. Conclusions Exercise app users are more likely to exercise during their leisure time, compared to those who do not use exercise apps, essentially fulfilling the role that many of these apps were designed to accomplish. Data also suggest that one way that exercise apps may increase exercise levels and health outcomes such as BMI is by making it easier for users to overcome barriers to exercise, leading to increased self-efficacy. We discuss ways of improving the effectiveness of apps by incorporating theory-driven approaches. We conclude that exercise apps can be viewed as intervention delivery systems consisting of features that help users overcome specific barriers.

Relationship Between Peer Victimization and Posttraumatic Stress Among Primary School Children

Peer victimization is a common stressor experienced by children. Although peer victimization has been studied extensively, few studies have examined the potential link between peer victimization and posttraumatic stress disorder (PTSD), and no studies of which we are aware have examined this link among children in primary school. The paucity of studies examining the link between PTSD and peer victimization in primary school is surprising because peer victimization occurs more frequently and is more likely to be physical among 7- and 8-year-old children. This study assessed the relationship between peer victimization and PTSD in a sample of 358 elementary school children (ages 6-11 years). Results indicated that peer victimization accounted for 14.1% of PTSD symptom severity among boys and 10.1% among girls. Additionally, we found gender differences in the types of peer victimization that were most associated with PTSD symptom severity (d = 0.38). The long-term developmental consequences that may be associated with peer victimization-linked PTSD symptomatology are discussed.

Extrinsic Religious Orientation and Disordered Eating Pathology Among Modern Orthodox Israeli Adolescents: The Mediating Role of Adherence to the Superwoman Ideal and Body Dissatisfaction

The role of religious and spiritual factors has been recognized with regard to risk factors for disordered eating pathology (DEP). Specifically, religious orientation, or underlying religious motivation, has been associated with DEP among a variety of religious groups. Extrinsic religious orientation has consistently been found to be associated with increased levels of DEP among Christians and Jews in the USA. However, this paradigm has not been investigated cross-culturally. The current study is the first to examine the association of extrinsic religious orientation and DEP among Modern Orthodox Israeli adolescents. Furthermore, the mediating mechanisms of adherence to the Superwoman Ideal and body dissatisfaction are explored to further elucidate the mechanisms generating the association between religious orientation and DEP. A sample of 120 Modern Orthodox Israeli adolescent females participated in an anonymous survey which asked about DEP, body dissatisfaction, adherence to the Superwoman Ideal and religious orientation. Mediation models revealed a significant association between extrinsic religious orientation and DEP. Furthermore, adherence to the Superwoman Ideal and body dissatisfaction serially mediated the association between religious orientation and DEP. Findings suggest that a pathway through which extrinsic orientation influences DEP is through greater adherence to the Superwoman Ideal which leads to higher levels of body dissatisfaction, which is known to be a proximal risk factor for DEP. This finding is discussed in light of specific cultural pressures within the Modern Orthodox population and related clinical implications.

Development of the Healthcare Triggering Questionnaire in adult sexual abuse survivors.

Objective: One in 4 women and 1 in 10 men in the United States are survivors of sexual abuse (SA). For these survivors, healthcare experiences may trigger memories, thoughts, feelings or sensations related to this past abuse. Such triggering can be associated with negative responses to healthcare (e.g., anxiety, avoidance). However, to date, no healthcare triggering assessment tool exists. Therefore, the study goal was to describe the prevalence of healthcare triggering, to develop a brief Healthcare Triggering Questionnaire (HTQ), and to examine its initial validity. Method: An initial pool of 117 items was developed based on previous research. Two-parameter logistic item response theory models were used to develop the scales. SA survivors [male (n = 233), female (n = 222)] and a comparison group of non-SA individuals [male (n = 114), female (n = 106)] were recruited through Amazon Mechanical Turk and completed the study anonymously online. Results: Three 10-item scales were developed: (a) the HTQ-M for males; (b) the HTQ-F for females; and (c) the HTQ-U (unisex) for all respondents. The results supported the utility and initial validity of the gender-specific and unisex scales. Conclusions: The HTQ scales are a psychometrically sound approach to evaluating healthcare triggering experienced by adult sexual abuse survivors. The HTQ may be considered for use by researchers interested in studying healthcare triggering, healthcare retraumatization, and healthcare adherence. The HTQ may also be of use to clinicians interested in identifying trauma survivors who are more likely to experience triggering in healthcare settings.

The Interplay Between Eating and Sleeping Behavior in Adolescence: Normative and Disordered Trajectories

The present chapter deals with the relation between eating and sleeping patterns among adolescents. The first part describes both normative and pathological changes in eating and sleeping behavior. In the second part, studies that examine sleep-wake patterns among adolescents suffering from eating disorders are presented. Finally, the importance of maintaining a balance between adolescents’ needs for autonomy and the supervision and support of parents as providers of healthy nutrition and sleeping habits is discussed.

A cognitive neuroscience, dual-systems approach to the sorites paradox

Typical approaches to resolving the sorites paradox attempt to show, in one way or another, that the sorites argument is not paradoxical after all. However, if one can show that the sorites is not really paradoxical, the task remains of explaining why it appears to be a paradox. Our approach begins by addressing the appearance of paradox and then explores what this means for the paradox itself. We examine the sorites from the perspective of the various brain systems that are intuitively comfortable with the key features of the premises of the sorites argument. We suggest that the explicit and implicit cognitive systems are separately responsible for the initial plausibility of the categorical and inductive premises. The appearance of paradox is a function of our brains architecture and arises from the conflicting interactions of neurologically distinct systems.