3D SURVEYING, SEMANTIC ENRICHMENT AND VIRTUAL ACCESS OF LARGE CULTURAL HERITAGE

Abstract

Abstract. In recent years, Artificial Intelligence (AI) methods for 3D point cloud classification has assumed an essential role in the heritage field. The association of semantic information to 3D representations became a valuable instrument for measurement, analysis, education or maintenance, in particular in the Cultural Heritage (CH) sector. Moreover, the recent availability and reliability of head-mounted displays and glasses are allowing extraordinary immersive virtual experiences. This paper presents an end-to-end framework to handle large and complex 3D point clouds, from acquisition to semantic segmentation and final access in a Mixed Reality (MR) environment. Three completely different heritage scenarios are considered: the Temple of Neptune in Paestum, the Milan Cathedral and a large portion of Bologna’s porticoes. Mixed Reality experiences are described and shown based on the Microsoft HoloLens 2 device. A video of the results is available at https://youtu.be/Kd_3s0tIX04.