跳到主要导航 跳到搜索 跳到主要内容

FourASR: Exploiting Fourier Frequency Information for Efficient Light Field Angular Super-Resolution

  • Hao Zhang
  • , Da Yang*
  • , Zhenglong Cui
  • , Rongshan Chen
  • , Ruixuan Cong
  • , Xuefei Huang
  • , Hao Sheng
  • *此作品的通讯作者
  • Data Science and Intelligent Computing Laboratory
  • Beihang University
  • School of Computer Science and Engineering
  • Faculty of Applied Sciences
  • Macao Polytechnic University

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Light field (LF) angular super-resolution (SR) aims to reconstruct a densely sampled LF from a sparse input. A key challenge is the large disparity between sparse views, which disrupts angular consistency and makes capturing cross-view correlations difficult. Disparity-based methods often yield errors in textureless, occluded, or reflective regions, causing ghosting and edge misalignment. A well-established solution should disentangle the 4D LF into three 2D subspaces - the subaperture image (SAI), horizontal epipolar plane image (HEPI), and vertical epipolar plane image (VEPI). While non-disparity-based methods avoid explicit disparity estimation, they typically process these subspaces using local convolutions with limited receptive fields. To address this, we propose an Adaptive Frequency Selection Neural Operator (AFSNO) to exploit global spatial relationships via frequency-domain modeling. Inspired by the convolution theorem, AFSNO performs adaptive frequency selection through a learnable mask, acting as a global convolution in the spatial domain. However, directly applying AFSNO to numerous LF subspaces incurs significant parameter overhead and lacks resolution flexibility. To overcome this, we introduce a 2D Subspace Patching Strategy (2DSPS) that enables weight sharing across patches. Specifically, 2DSPS tailors the patching scheme to the distinct characteristics of the SAI, HEPI, and VEPI subspaces, instantiating specialized AFSNO operators for each. This strategy drastically reduces model complexity while allowing the network to handle varying input resolutions during inference. Combined with local spatial convolutions, these components form the proposed Four-Block for efficient LF feature enhancement, constituting a simple yet powerful framework called FourASR. Additionally, to better reconstruct high-frequency details, we introduce a Fourier frequency-domain loss. Extensive experiments demonstrate that FourASR outperforms state-of-the-art methods significantly in both quantitative metrics and perceptual quality.

源语言英语
期刊IEEE Transactions on Image Processing
DOI
出版状态已接受/待刊 - 2026

学术指纹

探究 'FourASR: Exploiting Fourier Frequency Information for Efficient Light Field Angular Super-Resolution' 的科研主题。它们共同构成独一无二的学术指纹。

引用此