Bruna C. R. Cunha

MoViA: a mobile video annotation tool

The user interaction with mobile devices has dramatically improved over the last years. Increasingly we rely on smartphones and tablets for a wider range of tasks. Modern mobile devices enable users to access, manage and transmit multiple types of media in an easy, convenient and portable way. In this context, the playback of videos on mobile devices becomes a usual activity. Many works regarding video annotations have been made, but few are concerned with the mobile scenario. The ability to add annotations and to share them with others is a content enriching process which can improve activities from educational to entertainment purposes. In this paper, we present an intuitive tool that allows users to perform temporal video annotations on mobile devices. Using conventional tablets and smartphones equipped with the Android operating system, text, audio and digital ink annotations can be made on any video. It is possible to share text annotations with other users and play multiple annotations at the same time. The several display sizes and the possibility to switch between portrait and landscape mode have also been considered.

Video annotation and navigation on mobile devices

The growing ease of capturing and playing back videos using mobile devices demands the investigation of alternatives for improving the user experience, for instance by taking advantage of the expanding culture of end-user content generation. Advances in terms of end-user media capture and media combination aim at enriching and facilitating the authoring experience. This work explores the generation of textual annotations on videos played on mobile device: the approach is to offer an application that allows associating annotations to a navigation line decorated with frames that are representative of the points of interest. The aims is to improve the user experience of video annotation by allowing users to to find interesting points intuitively. Experiments with users identified of new issues, even though the application was considered easy to use.

ESPIM: An Ubiquitous Data Collection and Programmed Intervention System using ESM and Mobile Devices

The present course aims to introduce the attendants to the Experience Sampling and Programmed Intervention Method (ESPIM). This method combines selected procedures from the field of Psychology, such as Individualized Programmed Teaching and Experience Sampling Method (ESM), and the advantages promoted by ubiquitous computing. Our goal is to enhance data collection and interventions in naturalistic settings. The method is supported by a computational system - ESPIM - developed for the Web and mobile platforms by a multidisciplinary team. The ESPIM system allows the design of interventions based on both, explicit and pervasive data collection. The system supports multimedia data exchange between the stakeholders involved in planning data collection and/or intervention. We expect ESPIM to enable researchers and professionals from various fields, as health and education, to create and execute experiments or interventions carried out remotely. During the course attendants will learn about the fundamentals of the ESM and relevant results deriving from this method, data collection and interventions in naturalistic settings. Also, they will be presented to the latest version of the system ESPIM, its functionalities and computational development details. Attendants will have the opportunity to interact with the system, evaluating it in terms of usability and user experience, contributing to the improvement of the system.

A heuristic evaluation of a mobile annotation tool

Modern mobile devices are natural multimedia devices that enable one to access, manage and transmit multiple types of media such as video, photo, audio and maps. Video playing on these devices is becoming part of everyday life for many users. Aiming to enhance the video playback activity, we built a tool that allows temporal video annotation on mobile devices: text, audio and digital ink annotations can be added to the video using Android-based tablets and smartphones. Annotations can be passed along users through the sharing options available on the devices. We conducted a heuristic evaluation with ten experts and the results are discussed in this paper. Two different sets of heuristics were used to find a wider collection of issues. One of them is proposed by us and was developed especially for mobile devices. With this work, we expect to contribute with the theme of authoring on mobile devices in terms of user interface and evaluation.

Personalized Ubiquitous Data Collection and Intervention as Interactive Multimedia Documents

The Experience Sampling Method (ESM) has been proposed as a method for collecting data about peoples experiences in their everyday and natural environments. ESM-based systems offer limited authoring for interactive documents designed to collect text-based responses offered as answers to text-based questions, and integrated with the non-intrusive data collection from sensors. From a document engineering perspective, ESM brings new requirements with respect to the authoring of non-trivial interaction and navigation workflow, in particular when multiple media and collaborative tasks are concerned. Tackling existing challenges, we modeled the Experience Sampling and Programmed Intervention Method (ESPIM) by combining ESM, individualized teaching procedures and ubiquitous computing toward producing interactive personalized multimedia documents applied in data collection.

Opportunistic Collaborative Mobile-Based Multimedia Authoring Based on the Capture of Live Experiences

Despite recent results allowing collaborative video capture using mobile devices, there is a gap in promoting collaborative capture of media other than video. In this paper we report our collaborative model supporting amateur and opportunistic collaborative recording of multiple media using mobile devices. We present a case study carried out in the educational domain. We include a motivating scenario and related requirements, our proposed architecture and associated proof-of-concept prototype for supporting mobile amateur collaborative recording.

Data Collection and Intervention Personalized as Interactive Multimedia Documents

Mobile computing can be a facilitator for collecting data due to the fact that users carry their smartphones almost everywhere and all the time and because they can collect a wide range of data -- textual, audiovisual and data collected automatically by sensors. Considering this opportunity, we developed the ESPIM (Experience Sampling and Programmed Intervention Method), an computer-aided method for programming multimedia data collection forms and carry out remote interventions. Using the ESPIM, professionals of areas such as healthcare and education can plan data collection and define intervention programs using methods and procedures from their own areas. The programs containing the queries and tasks are retrieved by a mobile application installed in the devices of users who participate in the data collection. The mobile application runs the programs according to queries and tasks planned by the specialists. Both queries and responses can contain text, audio, and video data. In this paper we discuss about the technological infrastructure used in ESPIM system and also about the preliminary results obtained through tests and evaluation carried out with stakeholders of the target population. These results allowed us carried out improvements in the system.

Opportunistic Recording of Live Experiences Using Multiple Mobile Devices

In this work, we present a case study in which participants used a mobile application for collaborative record presentations. We developed an application for Android-enabled devices to investigate the usability and design requirements of a mobile and collaborative capture system. Our main concern is to facilitate collaboration and create an enhanced result without adding complexity in relation to the individual capture task. In this way, we focused on problems related to the usability and to the awareness information that enables users to conduct an opportunistic recording. We report our case study results and discuss design requirements we identified for the collaborative recording of presentations by users in possession of smartphones and tablets.

A Platform for the Recommendation of Points of Interest in Brazilian Cities: Architecture and Case Study

The tourism sector in Brazil has grown considerably in recent years. Despite this growth, the sector still presents several problems such as the lack of information in Portuguese and in other languages for Brazilian and foreign tourists. The absence of information about tourist sites and ordinary services also affects individuals when settling in a new city, as it is the case when freshman students move to a new city to start their studies in a college or university. In this work, we propose an innovative vision of a context-aware platform for recommending points of interest in Brazilian cities, designed with mechanisms for collecting data from the web, for extracting points of interest and background information, and for learning context-aware recommendation models. The platform is accessed by a mobile application. To validate our proposal, we ran a case study where freshman students used the platform during their first months in a new city.

Mobile Video Annotations: A Case Study on Supporting Rehabilitation Exercises

Annotations enable us to highlight key points or add information to content presented, for instance, on paper or digital media. Even though smartphones and tablets facilitate video capturing, currently only few applications allow limited video annotations using the mobile device itself. Given that video annotations can assist many tasks that depend or can be enhanced by video capturing, in previous work we have contributed with a tool for allowing multimodal video annotation using mobile devices. Upon experimenting with the tool, we identified that reviewing rehabilitation exercise videos can be especially enhanced with video annotations. Professionals in the field of physiotherapy and occupational therapy can add relevant annotations for their patients to improve performance of their exercises. After an evaluation with a specialist in occupational therapy, we identified new requirements associated with the monitoring of patients. We then identified the opportunity to develop a monitoring system with the collaboration of two rehabilitation specialists. Since these two specialists work with mirror therapy, we defined requirements that are relevant for this type of therapy. The system was developed to support the monitoring of exercises combined with video recording and annotation capabilities. The system aims to support rehabilitation therapy by distance: therapists can monitor patients as they record videos that are sent for evaluation. We identified requirements that may be applied in many scenarios, however mirror therapy demanded many specific requirements related to the recording of videos.