FAFMNet: A Lightweight Super-Resolution Network via Frequency-Aware and Multi-Scope Feature Fusion

Authors

  • Rui Xu
  • Wei Fan

DOI:

https://doi.org/10.54097/zq0zbx10

Keywords:

Multi-Scale Feature Fusion, Frequency Modulation, Lightweight Network

Abstract

Single Image Super-Resolution (SISR), a fundamental task in computer vision, aims to reconstruct high-quality images from their low-resolution counterparts. To address the limitations of existing methods in recovering high-frequency details and achieving efficient feature modeling, we propose a lightweight and effective Frequency-Aware and Fusion-Modulated Network (FAFMNet). The proposed network jointly enhances local texture representation and global structure modeling by incorporating a Frequency-Aware Modulator (FAM) and a Multi-Scope Fusion Block (MSFB), thereby enabling efficient cross-scale and cross-frequency feature extraction. Specifically, the FAM module models global dependencies in the frequency domain, leveraging low-frequency preservation and high-frequency enhancement strategies to improve sensitivity to structural regions. Meanwhile, the MSFB module aggregates contextual information across multiple receptive fields and utilizes a sparse channel separation mechanism to achieve lightweight multi-scale feature representation. Extensive experiments on several benchmark datasets demonstrate that FAFMNet achieves superior reconstruction performance compared to existing methods while maintaining low parameter count and fast inference speed, validating the effectiveness and practicality of the proposed design.

Downloads

Download data is not yet available.

References

[1] Dong Li, Jia-Bin Huang, Yali Li, Shengjin Wang, and Ming HsuanYang. Weaklysupervisedobject localization with pro gressive domain adaptation. In IEEE Conference on Com puter Vision and Pattern Recognition, pages 3512–3520, 2016.

[2] Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Learning a deep convolutional network for image super-resolution. In European Conference on Computer Vi sion, pages 184–199. Springer, 2014.

[3] Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. Accurate image super-resolution using very deep convolutional net works. In CVPR, pages 1646–1654, 2016. 7.

[4] Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and KyoungMuLee. Enhanceddeepresidualnetworksforsingle image super-resolution. In CVPR Workshops, 2017. 1, 2, 5, 6, 7, 9.

[5] Jie Liu, Jie Tang, and Gangshan Wu. Residual feature dis tillation network for lightweight image super-resolution. In ECCV, pages 41–55, 2020. 1, 6.

[6] Yulun Zhang, Kunpeng Li, Kai Li, Lichen Wang, Bineng Zhong, and Yun Fu. Image super-resolution using very deep residual channel attention networks. In European Confer ence on Computer Vision, pages 286–301, 2018.

[7] J. Li, S. You, and A. Robles-Kelly, “A Frequency Domain Neural Network for Fast Image Super-Resolution,” 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil, 2018, pp. 1–8.

[8] Y. Li, L. Fang, J. Liu, and Y. Zhang, “Multi-Scale Residual Network for Image Super-Resolution,” Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp.

[9] Y. Hui, X. Wang, Y. Gao, Y. Gao, and X. Chen, “MADNet: A Fast and Compact Network for Single Image Super-Resolution,” Proceedings of the 28th ACM International Conference on Multimedia (ACM MM), 2020, pp. 1237–1245.

[10] Eirikur Agustsson and Radu Timofte. Ntire 2017 challenge on single image super-resolution: Dataset and study. In CVPRW, pages 126–135, 2017. 5.

[11] Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In BMVC, pages 1–10, 2012. 5, 6, 7.

[12] Roman Zeyde, Michael Elad, and Matan Protter. On sin gle image scale-up using sparse-representations. In Interna tional conference on curves and surfaces, pages 711–730, 2010. 5, 6, 7.

[13] David Martin, Charless Fowlkes, Doron Tal, and Jitendra Malik. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In ICCV, pages 416–423, 2001. 5, 6, 7.

[14] Jia-Bin Huang, Abhishek Singh, and Narendra Ahuja. Single image super-resolution from transformed self-exemplars. In CVPR, pages 5197–5206, 2015. 1, 5, 6, 7.

[15] Chao Dong, Chen Change Loy, and Xiaoou Tang. Acceler ating the super-resolution convolutional neural network. In ECCV, pages 391–407, 2016. 7.

[16] Wei-Sheng Lai, Jia-Bin Huang, Narendra Ahuja, and Ming Hsuan Yang. Deep laplacian pyramid networks for fast and accurate super-resolution. In CVPR, pages 624–632, 2017. 2, 7.

[17] Zheng Hui, Xinbo Gao, Yunchu Yang, and Xiumei Wang. Lightweight image super-resolution with information multi distillation network. In ACM MM, pages 2024–2032, 2019. 1, 2, 7.

[18] Long Sun, Jiangxin Dong, Jinhui Tang, and Jinshan Pan. Spatially-adaptive feature modulation for efficient image super-resolution. In ICCV, 2023. 3, 8.

[19] Jie Liu, Jie Tang, and Gangshan Wu. Residual feature dis tillation network for lightweight image super-resolution. In ECCVW, pages 41–55, 2020. 1, 2, 7, 8.

Downloads

Published

27-08-2025

Issue

Section

Articles