Yu You

Experience Explorer: A Life-Logging Platform Based on Mobile Context Collection

As mobile smart phones are being equipped with multiple radio interfaces and sensors, they are becoming capable of continuously collecting context information related to the users and the environment. This information can be utilized in different applications and services for providing rich, context-aware experiences. In this paper, we present a client-server platform that enables life logging, via mobile context collection, and processes the data so that meaningful higher-level context can be derived. This can then be mashed-up with 3rd party Internet services, for providing richer social networking and content associations, keeping privacy and security in mind. We present our core use cases, the proposed end-to-end architecture and current implementation, as well as an explorer user interface that visualizes users’ life experience.

Enabling Rapid Creation of Content for Consumption in Mobile Augmented Reality

As smart phones are getting powerful multimedia devices, with a plethora of sensors, they are the perfect enablers for Augmented Reality, allowing users to see the real world through a magic lens. Augmented Reality applications and services have been typically utilized in a limited number of domains, while adding new content is typically a privilege of developers, as programming skills are required for linking to existing clients or systems. In this paper we study how power users and small businesses can bring their content, advertizing and general data to an Augmented Reality view, with minimal effort. We present three prototyped approaches based on the Image Space mirror world service.

Bringing user-generated content from Internet services to mobile augmented reality clients

In this paper we describe a system for bringing usergenerated content to mobile augmented reality clients, taking in consideration the metadata required for visualizing it, at a sensor based tracking solution. Our proposal assumes that content is stored in multiple external Internet services, simply treated as a “cloud”, thus making the mobile client service agnostic. A prototype implementation was created for the Image Space service and the learnings of integrating with the popular Flickr service are discussed.

Mixed reality web service platform

This paper presents a RESTful Web service platform for applications for both Web browsers and mobile clients. Having a common service backend makes creating applications fast, simple, and open to third parties. The paper presents two mixed reality applications that have been built on the platform. It summarizes requirements for a mixed reality platform and defines a mixed reality domain model that the platform and applications share. In addition, it describes how the clients can use the REST interface to perform operations on user-generated content, as well as access real-life commercial geo-content such as street-view panoramas and building models.

Experiences in building a RESTful mixed reality web service platform

This paper reports the development of a RESTful Web service platform at Nokia Research Center for building Mixed Reality services. The platform serves geo-spatially oriented multimedia content, geo-data like streetview panoramas, building outlines, 3D objects and point cloud models. It further provides support for identity management and social networks, as well as for aggregating content from third party content repositories. The implemented system is evaluated on architecture qualities like support for evolution and mobile clients. The paper outlines our approach for developing RESTful Web services from requirements to an implemented service, and presents the experiences and insights gained during the platform development, including the benefits and challenges identified from adhering to the Resource Oriented Architecture style.

Developing a ReSTful mixed reality web service platform

This paper discusses the development of a ReSTful Web Service platform for serving Mixed Reality content at Nokia Research Center. The paper gives an overview of the Mixed Reality domain, the requirements for the platform and its implementation. We further outline a method for developing resource oriented web services, beginning with high-level requirements, formalizing them as UML models and refining them to a ReSTful API specification. The approach is demonstrated with detailed examples of designing one particular API subset for Mixed Reality annotations.

A Lightweight Platform for Web Mashups in Immersive Mirror Worlds

Cloud City Scene is a lightweight platform that enables visualizations of Web mashups in an immersive mirror-world environment in which annotations blend in with buildings, terrain, and objects, letting users interact with the underlying real-world scene.

An extensible mirror world from user-generated content

In this paper we describe a system for creating a navigable mirror world, utilizing community photographs of real life environments. We present the essential architecture and a prototype solution for not only geotagging, but also spatially structuring content. Mash-up interfaces are available towards 3rd parties, for linking and georeferencing their content.

Visualizing web mash-ups for in-situ vision-based mobile AR applications

Augmented reality applications are gaining popularity due to increased capabilities of modern mobile devices. Creating AR content however is tedious and traditionally done on desktop environments by professionals, with extensive knowledge and/or even programming skills required. In this demo, we demonstrate a complete mobile approach for creating vision-based AR in both indoor and outdoor environment. Using hyperlinks, Web mashups are built to dynamically augment the physical world by normal users without programing skills.

Augmented and interactive video playback based on global camera pose

This paper proposes a video playback system that allows user to expend the field of view to surrounding environments that are not visible in the original video frame, arbitrarily change the viewing angles, and see the superimposed point-of-interest (POIs) data in an augmented reality manner during the video playback. The processing consists of two main steps: in the first step, client uploads a video to the GeoVideo Engine, and then the GeoVideo Engine extracts the geo-metadata and returns them back to the client; in the second step, client requests POIs from server, and then the client renders the video with POIs.