Skip to main content

Learning to remove occlusions in light field images using multiscale receptive fields and feature pyramid networks

Research Abstract

Removal of occlusions in light-field (LF) images is strongly influenced by the receptive field of the neural network. Existing methods often suffer from limited receptive fields, restricting their ability to capture long-range dependencies and recover occluded regions effectively. To overcome this, we propose LF-PyrNet, a novel end-to-end deep learning model that enhances occlusion removal through multi-scale receptive field learning and hierarchical feature pyramid-based refinement. Our model consists of three key components. First, the feature extractor expands the receptive field by integrating Residual Atrous Spatial Pyramid Pooling (ResASPP) and a modified receptive field block (RFB). These components allow the model to capture broader context and multi-scale spatial dependencies. Next, the core occlusion reconstruction network consists of three cascaded Residual Dense Blocks (RDBs). Each block contains four densely connected layers. A Feature Pyramid Network (FPN) then performs multi-scale feature fusion and refines the representations effectively. Finally, the refinement module, which incorporates both separable and standard convolutions, enhances detailed structural consistency and improves texture restoration in occluded regions. Experimental results show that expanding the receptive field significantly enhances the occlusion removal performance, making LF-PyrNet a reliable solution for reconstructing occluded regions in LF images.

Research Authors
Mostafa Farouk Senussi, Mahmoud Abdalla, Mahmoud SalahEldin Kasem, Mohamed Mahmoud, Hyun-Soo Kang
Research Date
Research Department
Research File
Research Image
Overall Architecture of LF-PyrNet for Occlusion Removal in Light Field Images, Consisting of Feature Extraction, Reconstruction, and Refinement.
Research Journal
Scientific Reports
Research Pages
36978
Research Publisher
Nature Publishing Group UK
Research Vol
15
Research Website
https://doi.org/10.1038/s41598-025-20786-0
Research Year
2025