[an error occurred while processing this directive] [an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]
Information Science and Engineering

Saliency guided enhancement and improved Faster-RCNN for object detection method in remote sensing images

  • Yang LIU , 1 ,
  • Fubin SHI 1 ,
  • Zhujun WANG 1 ,
  • Xiaomiao XU 2
Expand
  • 1. College of Automation,Shenyang Aerospace University,Shenyang 110136,China
  • 2. Military Representative Office,A Rocket Force,Shenyang 110043,China

Received date: 2024-03-29

  Online published: 2025-02-05

Abstract

As one of key tasks in the field of remote sensing image processing,object detection has always been a research hotspot.Although significant progresses have been made in this field,the deep learning methods still face significant challenges in dealing with scale changes and complex backgrounds in remote sensing images,which limits the further improvement of detection accuracy to some extent.To address this issue,an innovative object detection method for remote sensing images was proposed,which integrated a saliency guided image adaptive fusion module and improved Faster RCNN to enhance the accuracy of object detection.Firstly,in the image preprocessing stage,a saliency guided image adaptive fusion module was proposed,which effectively integrated the semantic information of the image and shallow fine-grained details,allowing the model to prioritize the object region while minimizing background interference.Secondly,after introducing MobileNetV3 as the feature extractor of Faster RCNN,an attention enhanced feature pyramid network was proposed,which combined attention with upsampling to further enhance target features and output high-quality feature maps,effectively improving the extraction effect of multi-dimensional features and providing more accurate and rich feature information for subsequent object detection tasks.Furthermore,a multi-scale region proposal network was designed,which can more accurately capture the features of objects of different sizes and shapes,thereby enhancing the expression ability of features and effectively improving the detection accuracy of targets.Finally,experiments on the DIOR and ROSD datasets demonstrated that the proposed network model exhibits higher detection accuracy compared to other advanced methods,fully demonstrating its superiority and effectiveness.

Cite this article

Yang LIU , Fubin SHI , Zhujun WANG , Xiaomiao XU . Saliency guided enhancement and improved Faster-RCNN for object detection method in remote sensing images[J]. Journal of Shenyang Aerospace University, 2024 , 41(6) : 50 -60 . DOI: 10.3969/j.issn.2095-1248.2024.06.006

[an error occurred while processing this directive]
1
廖育荣,王海宁,林存宝,等.基于深度学习的光学遥感图像目标检测研究进展[J].通信学报202243(5):190-203.

2
冯长峰,王春平,付强,等.基于深度学习的光学遥感图像目标检测综述[J].激光与红外202353(9):1309-1319.

3
黄洁,姜志国,张浩鹏,等.基于卷积神经网络的遥感图像舰船目标检测[J].北京航空航天大学学报201743(9):1841-1848.

4
Sharma V K Mir R N.Saliency guided faster-RCNN (SGFr-RCNN) model for object detection and recognition[J].Journal of King Saud University-Computer and Information Sciences202234(5):1687-1699.

5
Zhang G J Lu S J Zhang W.CAD-net:a context-aware detection network for objects in remote sensing imagery[J].IEEE Transactions on Geoscience and Remote Sensing201957(12):10015-10024.

6
Huang W Li G Y Chen Q Q,et al.CF2PN:a cross-scale feature fusion pyramid network based remote sensing target detection[J].Remote Sen-sing202113(5):847.

7
Lin T Y Dollár P Girshick R,et al.Feature pyramid networks for object detection[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Honolulu:IEEE,2017:936-944.

8
Li Z Q Li E Z Xu T Y,et al.Feature alignment FPN for oriented object detection in remote sensing images[J].IEEE Geoscience and Remote Sen-sing Letters202320(2):1-5.

9
Jiang X Z Wu Y H.Remote sensing object detection based on convolution and swin transformer[J].IEEE Access202311(3):38643-38656.

10
Zhang Y Song C L Zhang D W.Small-scale aircraft detection in remote sensing images based on Faster-RCNN[J].Multimedia Tools and Applications202281(13):18091-18103.

11
Luo M Tian Y N Zhang S W,et al.Individual tree detection in coal mine afforestation area based on improved faster RCNN in UAV RGB images[J].Remote Sensing202214(21):5545.

12
Pan Y Y Zhu N Z Ding L,et al.Identification and counting of sugarcane seedlings in the field using improved faster R-CNN[J].Remote Sensing202214(22):5846.

13
Koonce B.MobileNetV3[M]//Convolutional Neural Networks with Swift for Tensorflow.Berkeley:Apress,2021:125-144.

14
Ji Y Z Zhang H J Zhang Z,et al.CNN-based encoder-decoder networks for salient object detection:a comprehensive review and recent advances[J].Information Sciences2021546(2):835-857.

15
Dong Y N Liu Q W Du B,et al.Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification[J].IEEE Transactions on Image Processing202231:1559-1572.

16
Zhu W J Liang S Wei Y C,et al.Saliency optimization from robust background detection[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE,2014:2814-2821.

17
Ren S Q He K M Girshick R,et al.Faster R-CNN:towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence201739(6):1137-1149.

18
Cheng G Han J W.A survey on object detection in optical remote sensing images[J].ISPRS Journal of Photogrammetry and Remote Sensing2016117(6):11-28.

19
Long Y Gong Y P Xiao Z F,et al.Accurate object localization in remote sensing images based on convolutional neural networks[J].IEEE Transactions on Geoscience and Remote Sensing201755(5):2486-2498.

20
Ge Z Liu S T Wang F,et al.YOLOX:exceeding YOLO series in 2021[EB/OL].(2021-08-06)[2023-08-15].

Outlines

/

[an error occurred while processing this directive]