Nadir Weibel

ChronoViz: a system for supporting navigation of time-coded data

We present ChronoViz, a system to aid annotation, visualization, navigation, and analysis of multimodal time-coded data. Exploiting interactive paper technology, ChronoViz also integrates researchers paper notes into the composite data set. Researchers can navigate data in multiple ways, taking advantage of synchronized visualizations and annotations. The goal is to decrease the time and effort required to analyze multimodal data by providing direct indexing and flexible mechanisms to control data exploration.

Click “Like” to Change Your Behavior: A Mixed Methods Study of College Students’ Exposure to and Engagement With Facebook Content Designed for Weight Loss

Background Overweight or obesity is prevalent among college students and many gain weight during this time. Traditional face-to-face weight loss interventions have not worked well in this population. Facebook is an attractive tool for delivering weight loss interventions for college students because of its popularity, potential to deliver strategies found in successful weight loss interventions, and ability to support ongoing adaptation of intervention content. Objective The objective of this study was to describe participant exposure to a Facebook page designed to deliver content to overweight/obese college students in a weight loss randomized controlled trial (N=404) and examine participant engagement with behavior change campaigns for weight loss delivered via Facebook. Methods The basis of the intervention campaign model were 5 self-regulatory techniques: intention formation, action planning, feedback, goal review, and self-monitoring. Participants were encouraged to engage their existing social network to meet their weight loss goals. A health coach moderated the page and modified content based on usage patterns and user feedback. Quantitative analyses were conducted at the Facebook post- and participant-level of analysis. Participant engagement was quantified by Facebook post type (eg, status update) and interaction (eg, like) and stratified by weight loss campaign (sequenced vs nonsequenced). A subset of participants were interviewed to evaluate the presence of passive online engagement or “lurking.” Results The health coach posted 1816 unique messages to the study’s Facebook page over 21 months, averaging 3.45 posts per day (SD 1.96, range 1-13). In all, 72.96% (1325/1816) of the posts were interacted with at least once (eg, liked). Of these, approximately 24.75% (328/1325) had 1-2 interactions, 23.39% (310/1325) had 3-5 interactions, 25.13% (333/1325) had 6-8 interactions, and 41 posts had 20 or more interactions (3.09%, 41/1325). There was significant variability among quantifiable (ie, visible) engagement. Of 199 participants in the final intervention sample, 32 (16.1%) were highly active users and 62 (31.2%) never visibly engaged with the intervention on Facebook. Polls were the most popular type of post followed by photos, with 97.5% (79/81) and 80.3% (386/481) interacted with at least once. Participants visibly engaged less with posts over time (partial r=–.33; P<.001). Approximately 40% of the participants interviewed (12/29, 41%) reported passively engaging with the Facebook posts by reading but not visibly interacting with them. Conclusions Facebook can be used to remotely deliver weight loss intervention content to college students with the help of a health coach who can iteratively tailor content and interact with participants. However, visible engagement with the study’s Facebook page was highly variable and declined over time. Whether the level of observed engagement is meaningful in terms of influencing changes in weight behaviors and outcomes will be evaluated at the completion of the overall study.

Paperproof: a paper-digital proof-editing system

We present PaperProof, a paper-digital proof-editing application that allows users to edit digital documents by means of gesture-based mark-up of their printed versions. This enables users to switch seamlessly back and forth between paper and digital instances of a document throughout the document lifecycle, working with whichever medium is preferred for a given task. Importantly, by maintaining a logical mapping between the printed and digital instances, editing operations on paper can later be integrated into the digital document even if other users have edited the digital version in parallel. The system is based on Anoto digital pen and paper technology and is implemented using the iPaper framework for interactive paper.

Let's look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck

As part of our research on multimodal analysis and visualization of activity dynamics, we are exploring the integration of data produced by a variety of sensor technologies within ChronoViz, a tool aimed at supporting the simultaneous visualization of multiple streams of time series data. This paper reports on the integration of a mobile eye-tracking system with data streams collected from HD video cameras, microphones, digital pens, and simulation environments. We focus on the challenging environment of the commercial airline flight deck, analyzing the use of mobile eye tracking systems in aviation human factors and reporting on techniques and methods that can be applied in this and other domains in order to successfully collect, analyze and visualize eye-tracking data in combination with the array of data types supported by ChronoViz.

Print-n-link: weaving the paper web

Citations form the basis for a web of scientific publications. Search engines, embedded hyperlinks and digital libraries all simplify the task of finding publications of interest on the web and navigating to cited publications or web sites. However the actual reading of publications often takes place on paper and frequently on the move. We present a system Print-n-Link that uses technologies for interactive paper to enhance the reading process by enabling users to access digital information and/or searches for cited documents from a printed version of a publication using a digital pen for interaction. A special virtual printer driver automatically generates links from paper to digital services during the printing process based on an analysis of PDF documents. Depending on the user setting and interaction gesture, the system may retrieve metadata about the citation and inform the user through an audio channel or directly display the cited document on the users screen.

Development and Validation of the San Diego Early Test Score to Predict Acute and Early HIV Infection Risk in Men Who Have Sex With Men

BACKGROUND Although men who have sex with men (MSM) represent a dominant risk group for human immunodeficiency virus (HIV), the risk of HIV infection within this population is not uniform. The objective of this study was to develop and validate a score to estimate incident HIV infection risk. METHODS Adult MSM who were tested for acute and early HIV (AEH) between 2008 and 2014 were retrospectively randomized 2:1 to a derivation and validation dataset, respectively. Using the derivation dataset, each predictor associated with an AEH outcome in the multivariate prediction model was assigned a point value that corresponded to its odds ratio. The score was validated on the validation dataset using C-statistics. RESULTS Data collected at a single HIV testing encounter from 8326 unique MSM were analyzed, including 200 with AEH (2.4%). Four risk behavior variables were significantly associated with an AEH diagnosis (ie, incident infection) in multivariable analysis and were used to derive the San Diego Early Test (SDET) score: condomless receptive anal intercourse (CRAI) with an HIV-positive MSM (3 points), the combination of CRAI plus ≥5 male partners (3 points), ≥10 male partners (2 points), and diagnosis of bacterial sexually transmitted infection (2 points)-all as reported for the prior 12 months. The C-statistic for this risk score was >0.7 in both data sets. CONCLUSIONS The SDET risk score may help to prioritize resources and target interventions, such as preexposure prophylaxis, to MSM at greatest risk of acquiring HIV infection. The SDET risk score is deployed as a freely available tool at http://sdet.ucsd.edu.

Multimodal prediction of expertise and leadership in learning groups

In his study, we investigate low level predictors from audio and writing modalities for the separation and identification of socially dominant leaders and experts within a study group. We use a multimodal dataset of situated computer assisted group learning tasks: Groups of three high-school students solve a number of mathematical problems in two separate sessions. In order to automatically identify the socially dominant student and expert in the group we analyze a number of prosodic and voice quality features as well as writing-based features. In this preliminary study we identify a number of promising acoustic and writing predictors for the disambiguation of leaders, experts and other students. We believe that this exploratory study reveals key opportunities for future analysis of multimodal learning analytics based on a combination of audio and writing signals.

LAB-IN-A-BOX: semi-automatic tracking of activity in the medical office

Patient-centered healthcare and increased efficiency are major goals of modern medicine, and physician–patient interaction and communication are a cornerstone of clinical encounters. The introduction of the electronic health record (EHR) has been a key component in shaping not only organization, clinical workflow and ultimately physicians’ clinical decision making, but also patient–physician communication in the medical office. In order to inform the design of future EHR interfaces and assess their impact on patient-centered healthcare, designers and researchers must understand the multimodal nature of the complex physician–patient–EHR system interaction. However, characterizing multimodal activity is difficult and expensive, often requiring manual coding of hours of video data. We present our Lab-in-a-Box solution that enables the capture of multimodal activity in real-world settings. We focus here on the medical office where our Lab-in-a-Box system exploits a range of sensors to track computer-based activity, speech interaction, visual attention and body movements, and automatically synchronize and segment this data. The fusion of multiple sensors allows us to derive initial activity segmentation and to visualize it for further interactive analysis. By empowering researchers with cutting-edge data collection tools and accelerating analysis of multimodal activity in the medical office, our Lab-in-a-Box has the potential to uncover important insights and inform the next generation of Health IT systems.

TAP & PLAY: an end-user toolkit for authoring interactive pen and paper language activities

Hybrid paper-digital interfaces are a promising approach for supporting language activities. The familiarity of pen and paper makes it a particularly attractive media for many user groups, including young children. Digital pens enhance interaction with traditional paper content by playing and recording audio and recognizing handwriting and gestures. Currently, generating custom interactive paper documents involves some programming, limiting its use by many user groups (e.g., educators and families) who might especially benefit from application of hybrid paper-digital interfaces in their practices. To address this need, we developed an end-user Toolkit for Authoring Pen and Paper Language Activities (TAP & PLAY). This paper describes the iterative development of the toolkit, its accessibility for novice non-technical users, and use in three different contexts for early language learning. We demonstrate and document the systems usability, generality, and utility for people who want to create and tailor their own custom interactive paper-based language activities.

A model for mapping between printed and digital document instances

The first steps towards bridging the paper-digital divide have been achieved with the development of a range of technologies that allow printed documents to be linked to digital content and services. However, the static nature of paper and limited structural information encoded in classical paginated formats make it difficult to map between parts of a printed instance of a document and logical elements of a digital instance of the same document, especially taking document revisions into account. We present a solution to this problem based on a model that combines metadata of the digital and printed instances to enable a seamless mapping between digital documents and their physical counterparts on paper. We also describe how the model was used to develop iDoc, a framework that supports the authoring and publishing of interactive paper documents.