DEPTH MAP ESTIMATION FROM MULTI-VIEW IMAGES WITH NERF-BASED REFINEMENT

In this paper, we propose a method to refine depth maps estimated by Multi-View Stereo (MVS) with Neural Radiance Field (NeRF) optimization to estimate depth maps from multi-view images with high accuracy. MVS estimates the depths inside objects with high accuracy, and NeRF estimates the depths at object boundaries with high accuracy. The key ideas of the proposed method are (i) to combine MVS and NeRF to utilize advantages of both in depth map estimation, (ii) to not require any training process, therefore no training dataset and ground truth are required, and (iii) to use NeRF for depth map refinement. Through a set of experiments using the Redwood3dscan dataset, we demonstrate the effectiveness of the proposed method compared to conventional depth map estimation methods.