XR-empowered dynamic reality modeling for AECO applications

The lack of accurate and up-to-date digital information of built assets is devastating to the AECO industry. It leads to improper design, costly in-situ changes and failure costs that can all be easily avoided with accurate digital built environments. Simultaneously, eXtended Reality (XR) technologies are becoming increasingly widespread to improve worker efficiency, inspections and so on. In this project, we propose to take XR to the next level and also deploy it to dynamically map, track changes and interact with the built environment. Specifically, we will (1) align XR measurements with pre-recordings of a site to establish an up-to-date documentation, (2) interpret the resulting remote sensing data to produce meaningful geometries and textures of built environments and (3) bring these digitized assets to the site so operators can use the accurate digitized environments in various AECO applications. A key innovation of this project is the harnessing of generative shape modeling that will –for the first time ever- allow the reality modeling of both seen and unseen AECO objects. The outcomes of this project will keep AECO facilities better up to date and improve information access. Furthermore, it will increase worker productivity and make real-world processes safer since the workers can simulate/train applications with XR on site.