Evaluating Neural Radiance Fields for 3D PlantGeometry Reconstruction in Field Conditions

Iowa State University
ArborCLIP

Overview of the NeRFsNeRFs are proposed as an alternative to traditional TLS scans for 3D plant reconstruction, offering cost-effective and efficient modeling from images captured at multipleangles using a smartphone camera, in contrast to the higher expense and extensive processing time required by TLS for multiangle scan registration.

Abstract

We evaluate different Neural Radiance Field (NeRF) techniques for the 3D reconstruction of plants invaried environments, from indoor settings to outdoor fields. Traditional methods usually fail to capture thecomplex geometric details of plants, which is crucial for phenotyping and breeding studies. We evaluatethe reconstruction fidelity of NeRFs in 3 scenarios with increasing complexity and compare the resultswith the point cloud obtained using light detection and ranging as ground truth. In the most realistic fieldscenario, the NeRF models achieve a 74.6% F1 score after 30 min of training on the graphics processingunit, highlighting the efficacy of NeRFs for 3D reconstruction in challenging environments. Additionally, wepropose an early stopping technique for NeRF training that almost halves the training time while achievingonly a reduction of 7.4% in the average F1 score. This optimization process substantially enhances thespeed and efficiency of 3D reconstruction using NeRFs. Our findings demonstrate the potential of NeRFsin detailed and realistic 3D plant reconstruction and suggest practical approaches for enhancing thespeed and efficiency of NeRFs in the 3D reconstruction process.

Dataset Features

Category Distribution

Example images input to NeRFs for reconstruction across 3 different scenarios. (A) Scenario I: Indoor single object. (B) Scenario II: Indoor multiple objects. (C) Scenario III:Outdoor scene

Sample Image 3

Workflow for 3D reconstruction and evaluation.

Results

Precision-recall curves for the three scenarios based on varying distance thresholds after 30,000 iterations (Scenarios I and II) and 60,000 iterations (Scenario III)for (A) Instant-NGP, (B) TensoRF, and (C) NeRFacto

lifestages