Ajune Wanis Ismail

Survey on Collaborative AR for Multi-user in Urban Studies and Planning

This paper describes an augmented reality (AR) environment that allows multiple participants or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban planning, where users can interact naturally and intuitively. In addition, the collaborative AR makes multi-user in urban planning to share simultaneously a real world and virtual world. The fusion between real and virtual world, existed in AR environment by see-through HMDs, achieves higher interactivity as a key features of collaborative AR. In real-time, precise registration between both worlds and multi-user are crucial for the collaborations. Collaborative AR allow multi-user to simultaneously share a real world surrounding them and a virtual world. Common problems in AR environment will be discussed and major issues in collaborative AR will be explained details in this survey. The features of collaboration in AR environment are will be identified and the requirements of collaborative AR will be defined. This paper will give an overview on collaborative AR environment for multi-user in urban studies and planning. The work will also cover numerous systems of collaborative AR environments for multi-user.

Multi-user Interaction in Collaborative Augmented Reality for Urban Simulation

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration approach can be effectively used to develop different interfaces for face-to-face and remote collaboration. This is because AR provides seamless interaction between real and virtual environments, the ability to enhance reality, the presence of spatial cues for face-to-face and remote collaboration, support of a tangible interface metaphor, the ability to transition smoothly between reality and virtuality. In addition, the collaborative AR makes multi-user in urban simulation to share simultaneously a real world and virtual world. The fusion between real and virtual world, existed in AR environment by see-through HMDs, achieves higher interactivity as a key features of collaborative AR. In real-time, precise registration between both worlds and multi-user are crucial for the collaborations. Collaborative AR approach allows multi-user to simultaneously share a real world surrounding them and a virtual world. Common problems in AR environment will be discussed and major issues in collaborative AR will be explained details in this survey. The features of collaboration in AR environment are will be identified and the requirements of collaborative AR will be defined. This paper will give an overview on collaborative AR environment for multi-user in urban studies and planning. The work will also cover numerous systems of collaborative AR environments for multi-user.

Multimodal Fusion: Gesture and Speech Input in Augmented Reality Environment

Augmented Reality (AR) has the capability to interact with the virtual objects and physical objects simultaneously since it combines the real world with virtual world seamlessly. However, most AR interface applies conventional Virtual Reality (VR) interaction techniques without modification. In this paper we explore the multimodal fusion for AR with speech and hand gesture input. Multimodal fusion enables users to interact with computers through various input modalities like speech, gesture, and eye gaze. At the first stage to propose the multimodal interaction, the input modalities are decided to be selected before be integrated in an interface. The paper presents several related works about to recap the multimodal approaches until it recently has been one of the research trends in AR. It presents the assorted existing works in multimodal for VR and AR. In AR, multimodal considers as the solution to improve the interaction between the virtual and physical entities. It is an ideal interaction technique for AR applications since AR supports interactions in real and virtual worlds in the real-time. This paper describes the recent studies in AR developments that appeal gesture and speech inputs. It looks into multimodal fusion and its developments, followed by the conclusion.This paper will give a guideline on multimodal fusion on how to integrate the gesture and speech inputs in AR environment.

Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration approach can be effectively used to develop face to face interfaces. This is because AR provides seamless interaction between real and virtual environments, the ability to enhance reality, the presence of spatial cues for face-to-face and remote collaboration, support of a tangible interface metaphor, the ability to transition smoothly between reality and virtuality. The fusion between real and virtual world, existed in AR environment, achieves higher interactivity as a key features of collaborative AR. Collaborative AR approach allows multi-user to simultaneously share a real world surrounding them and a virtual world. The features of collaboration in AR environment will be identified. The key for the proposed technique of precise registration between both worlds and multi-user are important for the collaborations using AR environment. Common problems in AR environment and issues in collaborative AR will be discussed. This paper will give an overview for collaborative AR framework employed in urban simulation and the multi-user interaction on how to share these virtual spaces with other users in collaboration. The work will also cover numerous systems in different cases of collaborative AR environments for multi-user interaction.

Vision-Based Technique and Issues for Multimodal Interaction in Augmented Reality

Although many progresses have been accomplished in multimodal interaction, most researchers still treat each modality such as vision and speech, separately. They integrate the results at the application stage. This is because the roles of multiple modalities and their interactions continue to be quantified and precisely understood. However, there are many remaining issues in combining each modality individually. This paper will highlight the main vision problems based on our review for multimodal applications. This review paper will give an overview of the Augmented Reality (AR) technologies which are contributing in most of recent multimodal applications. We cluster vision techniques according to the natural human senses such as face, gesture, and speech that are frequently used in multimodal applications. The main contribution of this paper is to consolidate some of the main issues and approaches in vision-based technique, and to study some of the applications in AR that have been developed within the context of multimodal interaction. We conclude this paper with the future directions.

Multimodal fusion: progresses and issues for augmented reality environment

Multimodal fusion enables users to interact with computers through various input modalities like speech, gesture, and eye gaze. At the first stage to propose the multimodal interaction, various input modalities like speech and gesture, needs to be nominated before be integrated in an interface. This paper provides the progresses and issues in multimodal inputs for in augmented reality (AR). The paper presents several related works about to recap the multimodal approaches until it recently has been one of the research trends in AR. It also discusses on the multimodal fusion in AR and reports the various existing works in multimodal interaction with AR tools and techniques. In AR, multimodal considers as the solution to improve the interaction between the virtual and physical entities. It is an ideal interaction technique for AR applications since AR supports interactions in real and virtual worlds in the real-time. This paper describes the recent studies in AR developments that appeal multimodal inputs for AR environment. This paper also looks into multimodal fusion issues and its limitations, followed by the conclusion. This paper will give a guideline on multimodal fusion in AR, about how to integrate the multimodal inputs in AR environment.

Using the S-PI Algorithm for Interaction in Augmented Reality

In this paper, we describe a new interaction approach for intuitive 3D object handling in Augmented Reality (AR). Our method transforms the AR tracking pattern into a point-based representation and then uses this to perform object interaction such as translate, rotate, and clone. This is based on a robust real-time computer vision algorithm that constructs a 6DOF camera pose relative to a handheld paddle used for input. Using a point-by-point calculation of the camera pose relative to the paddle we can overlay 3D graphics on top of the paddle or a ground plane. This allows the user to inspect virtual objects from different viewing angles in the AR interface and perform interactions with the objects. In this paper, we first review related work and then briefly describe our system architecture and tracking method. We evaluate our approach with regard to speed and accuracy, and compare it to existing marker-based AR systems. Finally, we demonstrate the robustness and usefulness of our approach in an example AR application.

Collaborative Augmented Reality Approach for Multi-user Interaction in Urban Simulation

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration approach can be effectively used to develop face to face interfaces. This is because AR provides seamless interaction between real and virtual environments, the ability to enhance reality, the presence of spatial cues for face-to-face and remote collaboration, support of a tangible interface metaphor, the ability to transition smoothly between reality and virtuality. The fusion between real and virtual world, existed in AR environment, achieves higher interactivity as a key features of collaborative AR. Collaborative AR approach allows multi-user to simultaneously share a real world surrounding them and a virtual world. The features of collaboration in AR environment will be identified. The key for the proposed technique of precise registration between both worlds and multi-user are emphasized for the collaborations using AR environment. Common problems in AR environment and issues in collaborative AR will be discussed. This paper will give an overview for collaborative AR framework employed in urban simulation and the multi-user interaction on how to share these virtual spaces with other users in collaboration. The work will also cover numerous systems in different cases of collaborative AR environments for multiuser interaction.