Robust Radiometric Normalization of the Near Equatorial Satellite Images Using Feature Extraction and Remote Sensing Analysis ()
1. Introduction
Radiometric normalization aims to reduce the radiation differences between images by adjusting the color of each image. Radiometric normalization correction on remote sensing imagery has two techniques: absolute radiometric normalization and relative radiometric normalization [1] [2] [3] . The first technique requires data be collected in the same time of imaging through in situ work [4] . The second technique does not require data to be collected in the same time of image capturing [5] [6] . According to the previous works no single approach has a universal application and is able to overcome radiometric normalization because solutions are dependent on locations, applications, and images [7] - [13] . Analysts must therefore be aware of existing procedures, be prepared to use or modify these, or develop alternative procedures [14] . Pseudo invariant features (PIFs) refer to radiometric truth control points that should exhibit no significant change between acquisition dates [12] [13] [15] . Many previous studies have addressed the selection of PIFs to perform relative radiometric normalization [7] [16] . Some researchers performed relative radiometric normalization (RRN) manually, whereas others performed it automatically [17] [18] . Most researchers performed RRN on a remotely sensed image [13] [19] [20] , involved several image bands, and applied regression between images directly. However, a poor result was achieved in terms of finding the most accurate PIFs compared with the result obtained from involving all image bands in the regression [15] [21] [22] [23] [24] [25] . Scenes of the same target area acquired at different times have been nearly impossible to compare without performing image normalization because of variations in atmospheric conditions, look/view angles, or sensor parameters that occur between acquisition time and illumination [26] [27] . Even visual comparison of these images may be difficult [28] .
In early studies, remote sensing imagery was both expensive and difficult to obtain [29] - [34] . However, currently, many images can be obtained from practically any region in the world provided for free by the LANDSAT project. Scott et al. [28] studied two different scenarios in which three and two images were used, respectively. In the study of Hall [18] , a total of six images were used. Yuan and Elvidge [35] compared six different RRN algorithms by using a total of two images. Song et al. [36] employed seven images, and Baisantry et al. [26] used only three. Canty et al. [37] studied two different scenarios in which five and two images were used, respectively.
The most recent study [27] employed only five images. A common measure of performance, which was used by Scott et al. [28] , Hall, [18] , Yuan and Elvidge [35] , and Qian et al. [38] , is the MSE of the values of the PIFs after RRN and their values in the control image. However, the PIFs or no-change points are defined subjectively within the same algorithm that is being evaluated. Moreover, the MSE measure is inconsistent with any of the approaches because none of them propose to obtain the linear regression parameters by optimizing the MSE over the no-change locations. Song et al. [36] proposed an arguably more specific but consistent approach to performance assessment and employed crossed classification results both from the control image to the corrected image and vice versa. This article is organized as follows: section 2 shows the Methodology, Study Area description, dataset collecting. Section 3 demonstrates the datasets processing and analyzing steps, explains the RRN and quantitative assessment method. Section 4 mainly proves the effectiveness of our proposed method and analyzes the RRN performance. Section 5 discusses the RNN performance in different ground features. Finally, section 6 concludes this work. This research will help the researchers and analysts to overcome with the problem of 1) can not process or analysis datasets captured for same study area but in different time and illumination, 2) they can not use different datasets captured by multi-sensor. Analysts will be able to study and investigate different remote sensing applications in tropical areas around the world have these problems to study such as: land use and land cover, change detection, forest and environment monitoring and management and so on.
2. Methodology
In this research, we work on relative radiometric normalizing on images have same features but with different intensity values. The proposed method is combining the RI-SIFT method [20] and integrate with determine intensity values method to calculate the PIFs over each band of the reference and sensed images of each pixel, by inputting both of the reference and sensed images into RI-SIFT method to determine the most accurate locations of CPs in each band of the reference and sensed images. Then it calculated the intensity values of this CPs and this CPs considers as RRN-PIFs in this research. The developed method of finding the PIFs for this research we are called a “PIFs-SIFT” technique. Figure 1 illustrates the processing steps of extracting the RRN-PIFs technique.
2.1. Study Area Description
The study area was at the campus of University Putra Malaysia (UPM). The UPM University is located in Selangor state, Central Peninsular Malaysia close to the capital city, Kuala Lumpur, and next to Malaysia’s administrative capital city, Putrajaya. It is one of the Malaysian research universities. Figure 2 shows the location of the UPM University.
2.2. Dataset LAB Collecting
The datasets were collected during lab work for this research, it was performed
at the Geospatial Information Science Research Center (GISRC) laboratory of Faculty of Engineering in UPM University. The images were collected by using the invented and designed goniometer for this work [20] to simulate the Near Equatorial Satellite system (NEqO) images. Figure 3 shows the used goniometer device.
Laboratory work was conducted to simulate and capture images at night to avoid different reflectance levels coming from the laboratory windows. Seven images were collected, each one with a different illumination intensity than the others. The captured images were used in performing RRN and to simulate the NEqO satellite system. Sample of features captured in these images are soil, stone, cement, vegetation, and rocks represent real-world features in any real location [39] . All the images were captured with the same specifications but different illumination levels. The optical sensor used in this study is an optical Canon SX700H Power Shot camera, and the illumination source is a 150 w QTH. Figure demonstrates the arrangement before image capture. Figure 4 shows laboratory arrangements before image capturing.
3. Dataset Analysis
Most studies that analyzed the relative radiometric correction of multi-temporal images regarded the image captured at noon time as the reference image for normalizing other images. The sun at noon is at the highest altitude in its orbital and illumination degree; all features located in the image exhibit the real reflectance at that time [5] [40] . Therefore, six images were selected as slave images and one image was selected as the reference image for normalizing the six images. The reference image has the highest light intensity value and is considered the image captured at noon. Figure 5 shows the captured images at the GISRC lab of UPM. All slave images were registered with respect to the reference image. The images were registered on the basis of the image coordinate system. The coordinate system is used to place elements in relation to one another, and the user can use it to define elements and position them in relation to one another [40] . In this stage, the origin point (0, 0) at the left upper corner of the reference image was considered. All the images are in JPEG format in RGB color. Grayscale conversion and image compression were performed to significantly reduce
Figure 4. The laboratory arrangements to capture the images.
(a) (b)
Figure 5. Collected images at different illumination level, (a) the reference image, (b) the six sensed images in different illumination.
the processing time and storage requirements. Image compression was used to minimize image sizes based on previous studies [41] [42] .
The next steps applied the proposed PIFs-SIFT method was; First RI-SIFT method was employed to extract the most invariant CPs to any change in illumination, rotation, starching, and scaling (Hayder et al. 2020a). Figures 6-8 show run the RI-SIFT method using programmed Graphic User Interface (GUI) in Matlab software with the thresholds to extract the CPs. Second, the SAD algorithm and an empirical threshold were employed in the RI-SIFT method to extract the most accurate invariant CPs and remove the incorrect matched CPs. In addition, the accurate invariant CPs has invariant intensity. Third, the next step was calculated the value of this CPs to use in RRN as control points of relative
radiometric normalization. The intensity values of these radiometric control points is the true reflectance control points of the reference and slave image bands, the intensity value of CPs calculated using formula below:
(1)
where (x, y) denote the coordinate system of the location to which we wish to assign an intensity value (a point of the grid).
is the intersection of x and y. We let
denote the intensity value obtained from using the following mathematical expression [40] :
Figure 7 shows the CPs and their matching lines in yellow color. It also demonstrates one CP pair as false CPs with an incorrect match, as indicated by the black circle in right side of Figure 7. Therefore, the extracted CPs should be refined to remove the incorrect matches and obtain accurate CPs. However, Figure 8 indicates the reference and slave images after remove the false CPs, from using the SAD algorithm. This step was performed automatically using the GUI.
Figure 8 illustrates the most accurate CPs after removing the false CPs and decreasing the CP number based on the threshold used for the images. The empirical threshold that we used to remove the false CPs was 75 as indicates in Figure 6. Table 1 shows the illumination intensity, empirical threshold, and number of extracted SIFT CPs and refined CPs.
Table 1 shows the decrease in the number of extracted SIFT CPs. The first refinement was conducted between image-1 (slave image) and the reference image. The empirical threshold used to refine the CPs was 75. However, the threshold value for images 2, 3, and 4 was 50. Images 5 and 6 used different thresholds to refine their CPs (i.e. 75 and 100, respectively). The number of extracted CPs largely decreased. First, the SIFT CP number between image-1 and the reference image was 775, but this number decreased to 342 after applying SAD. This condition was similarly observed in the other images. The refined CPs were used in the next stage to extract the brightness value of each CP from the reference and slave images.
Figure 8. Removing false CPs from the reference and slave images.
Table 1. Shows threshold, SIFT CPs, and RI-SIFT-CPs.
3.1. Intensity Values Calculation
After identifying the most accurate CPs locations by using RI-SIFT from the reference and slave images. In this step determines the intensity values of the CPs automatically for each band of the reference and slave images. Calculation of the intensity value of each extracted CPs for all bands of the reference and slave images were based on Equation (1) mentioned above. It was conducted using MatLab environment. The output of this step is shown in Table 2 that contains samples of the intensity values of all bands of the reference and slave images. All the calculated intensity values over the bands were regarded as PIFs to use in performing RRN between the reference and sensed images in the next stage.
3.2. Liner Regression Model
In this stage of the relative radiometric normalization the linear regression was performed between the PIFs of the reference image bands with the corresponding slave image bands in order to find how match the bands in reference and sensed image has intensity equal and/or near to each PIFs in the images. The linear regression was conducted by using Microsoft Excel. The output of the linear regression model was established 18 equations between each reference image bands and corresponding slave image bands. Each equation was used to normalize the sensed image’s band to those in reference image. The eighteen regression functions were obtained after performing linear regression. Table 3 illustrates the 18 transformation functions of linear regression. The Band Math tool under the ENVI software was used to perform the transformation between the bands. The next step was applying layer stacking to obtain the final normalized
Table 2. Intensity values of the reference and slave image bands.
Table 3. Linear Regression transformation Functions.
slave images as RGB. Figure 9 shows the images after normalization
4. Conclusion
Relative radiometric normalization is one of the common problems in processing and analyzing different image captured same the study area but captured in different times of the day such as images obtained from multi-sensor and the NEqO satellite images. The datasets were collected using goniometer in the Lab of UPM University. The proposed technique used the RI-SIFT algorithm to extract correct CPs automatically and then calculate the intensity values of this CPs over the seven images’ bands to extract the PIFs. These PIFs were adopted to perform the relative radiometric normalization. The PIFs in this research exhibit truthful
reflectance of the most invariant features to any changes in stretching, illumination, and rotation in both the reference and sensed image bands. The proposed method shows promising results that can help analysts and researchers to apply it in their research that deals with multi-temporal and multi-sensor and NEqO images. Different thresholds have experimentally tested and used in conducting this study (50 and 70), by followed the proposed method, and it removed the false extracted SIFT CPs to be from 775, 1125, 883, 804, 883 and 681 false pairs to 342, 424, 547, 706, 547, and 469 corrected and matched pairs, respectively.
Declarations
Author Contributions
Conceptualization, HD, SM, NA and NAA; methodology, HD, SM, NA and NAA; software, HD and SM, NA; validation, HD, and NAA; investigation, HD, and NAA; data curation, HD, SM, and NA; writing-original draft preparation, HD, SM, NA. and NAA; visualization, NAA; project administration, NAA. All authors have read and agreed to the published version of the manuscript.
Data Availability Statement
Data available on request due to restrictions, the data presented in this study are available on request from the corresponding author. The data are not publicly available due to it relate to AL-Qasim Green University.
Acknowledgments
Authors would like to acknowledge the insightful contributions of the anonymous reviewers. The authors also would like to express their thankfulness to the AL-Qasim Green University, University Putra Malaysia (Malaysia), Lulea University of Technology (Sweden) for the support provided to accomplish this study.