Fausto de Carvalho

Second Life Information Desk System Using Instant Messaging and Short Messaging Service Technologies

Organizations with a presence in the Second Life® world typically only provide direct user interaction with staff at specific schedules, or not at all. We present a system that provides organizations with a simple way to enable constant interaction with users of the Second Life world, by simulating staff presence using automated avatars as communication channels to real-life staff by means of instant messaging and short message service technologies. Staff members are assigned to communication with Second Life avatars based on a hierarchy of information desk staffing priorities, and communication is bidirectional.

Online-Gym: Multiuser Virtual Gymnasium Using RINIONS and Multiple Kinect Devices

To enhance older citizens practice of physical exercise, we present the architecture, development, and pilot testing of a multiuser online gymnasium based on Kinect motion capture and OpenSimulator, which aims to enable socialization and supervision of exercise practice without travel requirements. The prototype was tested simultaneously with 4 elders at different locations, providing data on the feasibility of the approach and informing subsequent development and research.

Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype

ABSTRACT Gestural interaction devices emerged and originated various studies on multimodal human–computer interaction to improve user experience (UX). However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the UX with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality (VR) environment: one as the helmsman aboard Vasco da Gama’s fifteenth-century Portuguese ship and the other as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a VR headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterisation of UX, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human–computer interaction.

Separating Gesture Detection and Application Control Concerns with a Multimodal Architecture

Gesture-controlled applications typically are tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concern-separation architecture, which mediates the following concerns: gesture acquisition, gesture recognition, and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and device-independent data formats and callbacks. Its feasibility is demonstrated with a sample implementation.

Exploring the usage of 3D virtual worlds and kinect interaction in exergames with elderly

The combination of the potentialities of the interactive technologies, like exergames and the emerging motion capture devices with the ability of 3D virtual worlds for socialisation and context, can produce a platform to promote the physical activity of its users, which leverages its potential. The OnlineGym is an exploratory project based on an online 3D virtual worlds platform that allows users to interact with the system through the use of a motion capture device. This paper discusses the chosen technological approaches and the preliminary results of the experiments performed with users.

Architecture for transparent helpdesk system with multimodal presence

Companies that are present at multiple online locations may have difficulty staffing them adequately in terms of helpdesk services with efficient use of human resources. In this paper a technological architecture is presented that allows a team of people to staff several online locations simultaneously, providing to customers/users the indication of human presence to attend them. We also present details on a first prototype implementation of this architecture.