Building-Scale Virtual Reality: Reconstruction and Modification of Building Interior Extends Real World

Abstract

A\ufeffmethod\ufeffis\ufeffpresented\ufeffthat\ufeffextends\ufeffthe\ufeffreal\ufeffworld\ufeffinto\ufeffall\ufeffbuildings.\ufeffThis\ufeffbuilding-scale\ufeffvirtual\ufeffreality\ufeff (VR)\ufeffmethod\ufeffdiffers\ufefffrom\ufeffaugmented\ufeffreality\ufeff(AR)\ufeffin\ufeffthat\ufeffit\ufeffuses\ufeffautomatically\ufeffgenerated\ufeff3D\ufeffpoint\ufeff cloud\ufeffmaps\ufeffof\ufeffbuilding\ufeffinteriors.\ufeffIt\ufefftreats\ufeffan\ufeffentire\ufeffindoor\ufeffarea\ufeffa\ufeffpose\ufefftracking\ufeffarea\ufeffby\ufeffusing\ufeffdata\ufeff collected\ufeffusing\ufeffan\ufeffRGB-D\ufeffcamera\ufeffmounted\ufeffon\ufeffa\ufeffVR\ufeffheadset\ufeffand\ufeffusing\ufeffdeep\ufefflearning\ufeffto\ufeffbuild\ufeffa\ufeffmodel\ufeff from\ufeffthe\ufeffdata.\ufeffIt\ufeffmodifies\ufeffthe\ufeffVR\ufeffspace\ufeffin\ufeffaccordance\ufeffwith\ufeffits\ufeffintended\ufeffusage\ufeffby\ufeffusing\ufeffsegmentation\ufeff and\ufeffreplacement\ufeffof\ufeffthe\ufeff3D\ufeffpoint\ufeffclouds.\ufeffThis\ufeffis\ufeffdifficult\ufeffto\ufeffdo\ufeffwith\ufeffAR\ufeffbut\ufeffis\ufeffessential\ufeffif\ufeffVR\ufeffis\ufeffto\ufeffbe\ufeff used\ufefffor\ufeffactual\ufeffreal-world\ufeffapplications,\ufeffsuch\ufeffas\ufeffdisaster\ufeffsimulation\ufeffincluding\ufeffsimulation\ufeffof\ufefffires\ufeffand\ufeff flooding\ufeffin\ufeffbuildings.\ufeff3D\ufeffpose\ufefftracking\ufeffin\ufeffthe\ufeffbuilding-scale\ufeffVR\ufeffis\ufeffmore\ufeffaccurate\ufeffthan\ufeffconventional\ufeff RGB-D\ufeffsimultaneous\ufefflocalization\ufeffand\ufeffmapping. KEyWoRDS 3D Pose Estimation, 3D Scene Reconstruction, 3D Scene Segmentation, Augmented Reality, Disaster Simulation, Virtual Reality International Journal of Multimedia Data Engineering and Management Volume 10 • Issue 1 • January-March 2019