Sanni Siltanen

Integration of Design and Assembly Using Augmented Reality

This paper presents a methodology and a system for augmented reality aided assembly work. We concentrate in particular on the requirements on information processing and data flow for implementing augmented assembly systems in real life production environments. A pilot case with an augmented assembly task at the Finnish tractor company Valtra is described.

Demonstration of assembly work using augmented reality

In this paper, we describe the demonstration system in which a wooden 3D puzzle is assembled using an augmented reality system. The 3D puzzle emulated a simplified assembly task in a factory. We use the 3D puzzle as a means to study how to implement an augmented assembly system to a real setting in a factory and explore the advantages and disadvantages of augmented reality techniques. With this demonstration system we also test, demonstrate and evaluate different input modalities for augmented assembly setup. Furthermore, the demonstration system helps us better interact with industry and get invaluable feedback.

Texture generation over the marker area

In this paper, we present a method for generating a texture for hiding a marker in augmented reality applications. The texture is generated using the neighbourhood of the detected marker area in the image, which enables photorealistic results. The method presented here shows clear potential for real time use.

Light-weight marker hiding for augmented reality

In augmented reality, marker-based tracking is the most common method for camera pose estimation. Most of the markers are black and white patterns that are visually obtrusive, but they can be hidden from the video using image inpainting methods. In this paper, we present a computationally efficient approach to achieve this. We use a high-resolution hiding texture, which is captured and generated only once. To capture continuous changes in illumination, reflections and exposure, we also compute a very low-resolution texture at each frame. The coarse and fine textures are combined to obtain a detailed hiding texture which reacts to changing conditions and runs efficiently in mobile phone environments.

Multimodal User Interface for Augmented Assembly

In this paper, a multimodal system for augmented reality aided assembly work is designed and implemented. The multimodal interface allows for speech and gestural input. The system emulates a simplified assembly task in a factory. A 3D puzzle is used to study how to implement the augmented assembly system to a real setting in a factory. The system is used as a demonstrator and as a test-bed to evaluate different input modalities for augmented assembly setups. Preliminary system evaluation results are presented, the user experience is discussed, and some directions for future work are given.

Diminished reality for augmented reality interior design

A modular real-time diminished reality pipeline for indoor applications is presented. The pipeline includes a novel inpainting method which requires no prior information of the textures behind the object to be diminished. The inpainting method operates on rectified images and adapts to scene illumination. In typically challenging illumination situations, the method produces more realistic results in indoor scenes than previous approaches. Modularity enables using alternative implementations in different stages and adapting the pipeline for different applications. Finally, practical solutions to problems occurring in diminished reality applications, for example interior design, are discussed.

User participation in co-creative services: developing virtual and augmented reality tools for do-it-yourself home design

This paper presents key findings on user perception of an early AR home design product concept, which combines features of social media, augmented reality (AR) and 3D modelling. In total, there were 241 respondents for the scenario-based survey. In addition, some special co-design sessions were conducted to develop the concept with the target groups and to deepen insight on the needed user-centred AR functionalities with a participatory approach. The scenario-based methods proved valuable in the early phases of concept design. It appears that there is a demand for easy-to-use design tools both for consumers looking for a new apartment and professional users. Getting input for the designs from friends and family was seen important among consumers. For participating professionals, interior design is a creative process, and designers see a great challenge in preserving creativity in technology.

Augmented reality enriches hybrid media

In this paper, we describe how hybrid media will change print products value chain and what kind of opportunities it brings to print media in the future. We interviewed 20 actors of Finnish advertising and media business in order to find out, what kind of opportunities they see that augmented reality (AR) and hybrid media in general bring forward, and what are the critical challenges. One of the key findings was that AR should be part of a broader hybrid media framework. At the moment, the technical performance of smart phones is high enough for AR applications and also the penetration of smart phones is increasing rapidly. Thus markets are ready for mass marker AR applications. According to the results, the actors in print media value chain have mainly very enthusiastic attitude towards augmented reality enriched hybrid media. Especially the interactivity and the new kind of measurability it brings along were found important. The interviewees were unanimous about the components in the hybrid media value chain, although the roles of the actors were not set. The owner of the AR hybrid media framework could vary case-by-case. The need for standardization has been observed.

Augmented Reality Enriches Print Media and Revitalizes Media Business

Print media is in a crisis; it is losing its share of advertising—its main source of income—to digital media. Our aim is to determine how augmented reality (AR) and other hybrid media solutions change print medias value chain and what kind of opportunities they offer. We studied both human and technical aspects and critical challenges. We interviewed 20 actors of Finnish advertising and media business, who are very enthusiastic toward AR-enriched interactive hybrid media. User behavior measurability was found to be important. We present a sketch of the hybrid media value chain with the actors. We also describe and discuss selected AR applications. AR technology is mature enough for the mass market; the technical performance of smartphones is high enough for AR applications, and the penetration of smartphones is increasing rapidly. Our main conclusion is that hybrid media is essential to the future of print media.