Calibration and characterization of focal plane hyperspectral imaging systems play an important role in natural scene imagery. Illumination plays a major role during imaging, as both the camera and electronically tunable filter may suffer low transmission at the ends of the visible spectrum, resulting in a low signal to noise ratio. It is important that the spectral characteristics of the imaging system as well as its geometric properties be well characterized and its radiometric performance known. The aim of this article is to identify the main sources of errors in a common design of focal-plane hyperspectral imaging system and devise ways of compensating for these errors. Calibration and characterization of a focal-plane hyperspectral imaging system include nominal wavelength accuracy analysis. This was carried out by capturing images of a mercury vapour lamp to study principal emission lines in the visible spectrum. The linearity of the hyperspectral imaging system was investigated by recording an input-output function. This was accomplished by comparing signals captured by the hyperspectral imaging system and luminance data recorded using a luminance meter. System noise characterization was done by repeated acquisitions of dark noise images captured under identical conditions. Main meridian analysis was accomplished by obtaining sample edge patches from the centre and near-boundary of hyperspectral image and then constructing edge and line spread functions. The final test image analysis involved verifying system calibration, image correction and compensation algorithms. Results show that with proper calibration and characterization of imaging systems, high quality images are obtained and can be used for research works which include hyperspectral image registration and hyperspectral image recognition for natural scenes.
Hyperspectral imaging is a technique which combines spectral and spatial imaging methods. Although the technology was developed for remote sensing it has found uses in medicine [
Illumination plays a major role during imaging, as both the camera and electronically tunable filter may suffer low transmission at the ends of the visible spectrum, resulting in a low signal to noise ratio. It is important that the spectral characteristics of the imaging system as well as its geometric properties be well characterized and its radiometric performance known. This has resulted in increased demand for characterization and calibration methodologies. For scientific research and other applications where accurate light measurement is required, the performance of the imaging system must be checked to ensure reliable data is produced.
Susana Del Pozo et al. [
The present work has the following structure and organization. The materials and methods used for this work are presented in Section two. These include: the hyperspectral imaging system used for acquiring images for this research, image acquisition process, input-output function computed to investigate linearity of the imaging system, analysis of system noise, main meridian analysis and calibration verification tested on Gretag Macbeth colour checker chart hyperspectral images. Results and discussion are presented in Section 3 and the conclusion is given in Section 4.
In this section, materials and experimental methods used for this study are presented.
The system used in this research consist of a Peltier-cooled CCD camera and a liquid crystal tunable filter electronically controlled by computer software built using MATLAB programming Language. The liquid tunable filter is mounted in front of the lens with an infra-red blocking filter (
The camera is a low-noise Peltier-cooled digital camera (Hamamatsu, model C4742-95-12ER, Hamamatsu Photonics K. K., Japan). It has a resolution of 1344 × 1024 pixels and the available exposure times range from 10 ms to 4200 s. It uses digital temperature compensation to reduce noise since it is Peltier-cooled. The intensity response at each pixel is recorded with 12-bit precision. The spectral range is from the ultra-violet to the infra-red regions. The sensor used in the digital camera is a progressive-scan interline CCD with microlens which enables the camera to collect more photons from incoming light. It has an effective area of 8.66 mm × 6.60 mm and sensor cell size 6.45 µm × 6.45 µm (square pixels).
The liquid crystal tunable filter (LCTF) is a VariSpec, model VS-VIS2-10- HC-35-SQ, Cambridge Research and Instrumentation. It is mounted in front of the camera lens. The filter has an aperture of 35 mm and the whole imaging system has a field of view of ±7. The wavelength of peak transmission could be
varied over a range spanning 400 nm - 720 nm with a full width at half-maximum transmission of 10 mm at 550 nm, decreasing to 6 mm at 400 nm and 16 mm at 720 nm.
Analysis was done to determine if the nominal wavelengths selected by the liquid crystal tunable filter and used to capture hyperspectral images are accurate. The experimental set-up involved capturing images of a mercury vapour lamp. Mercury vapour lamps have principal emission lines in the visible spectrum [
The process of obtaining high resolution hyperspectral images involves multiple stages. Images are generally captured by pointing the hyperspectral imaging system (CCD camera with a tunable filter mounted on it) to a scene, adjusting the focus and zoom of the CCD camera, and recording the sequences. The wavelength range used is 400 nm - 720 nm at a 10nm interval hence providing 33 images in each image sequence. Neutral grey reference materials are inserted into the scene and are used for computing the effective spectral radiance and reflectance functions of each pixel in the scene.
Bespoke algorithms are used to automatically determine the exposure time of the imaging system before acquisition so that maximum pixel output is within 80% - 90% of the CCD saturation value. The spectrum of light reflected from the munsell chips are recorded immediately after acquisition by a telespectroradiometer (SpectraColorimeter, PR-650, Photo Research Inc. Chatsworth, California). For natural scene imaging, care was taken not to capture spectral images when there is movement in the scene.
An important property of imaging systems is its linearity in response to incident light. In hyperspectral imaging systems using charge-coupled device (CCD) sensors, the basic function of the CCD is to convert photons carrying image information into an electronic signal [
A transfer function relating the number of photons incident on the sensor and the digital output is determined by a multi-stage process which involves the creation and transfer of charge carriers (electron-hole pairs) in the active pixel regions, followed by conversion of electrons from the charge domain into the voltage domain as an amplified voltage signal. The transfer function results in a linear variation of final digitized output signal in relation to the amount of light incident on the CCD, such that the output signal is equal to the photon input multiplied by a proportionality constant (gain) [
The linearity of a camera system is determined by the CCD itself, as well as other electronic components in the signal processing chain. In effect, any non-linearity indicates a change in the camera’s gain constant with signal level. Quantitative imaging operations rely on absolute signal measurements, and require that there be no significant interdependence between camera gain and signal intensity. Scientific CCD imaging systems exhibit good linearity over a wide signal range but when full well conditions are reached under high illumination intensity, a nonlinear response is usually observed [
A common technique for assessing linearity is based on a graphical plot of measured output signal as a function of exposure time, extending to the full well capacity of the device (the number of electrons held by a potential well or pixel; also referred to as linear full well) [
The linearity of the hyperspectral imaging system was investigated by recording an output-input function using a neutral density wedge, a diffuser, a beam splitter and a quartz-halogen bench lamp. This process involved measuring the signal captured by the hyperspectral imaging system and also recording the luminance using a luminance meter.
The diffuser was positioned over the aperture of the CCD camera while the neutral density wedge was placed in front of the quartz-halogen lamp and acted as a mask having a density which increases exponentially along its length. A 50/50 beam splitter made of two triangular glass prisms was placed between the light source and the hyperspectral imaging system, with the camera capturing half the signal and the luminance meter recording the other half (
Images were captured at fixed wavelengths (450 nm, 550 nm and 650 nm) as the neutral density wedge was adjusted in steps. A total of 24 steps were used ranging from bright illumination to very low light levels. The luminance meter data was recorded simultaneously. The luminance meter data was then corrected for reflection-transmission properties of the beam splitter by recording luminance meter readings from the hyperspectral imaging system position and using a linear regression fit to define a relationship between luminance meter data as seen by the hyperspectral imaging system and the original luminance meter data collected.
The input-output function analysed in the previous section gives an indication of the linearity of the hyperspectral system but it is important to quantify the spatial variation in the sensitivity of the imaging system. In principle, the input-output data could be used for this analysis but this is not trivial, since there is no means of quantifying the spatial uniformity of the light source.
One of the aims of the characterization was to check for systematic variation from image to image in the captured series. This helps to understand the usefulness of averaging replicate images. When averaging images, the noise is assumed to be zero mean Gaussian noise. Low pass filtering of an image or averaging two images may destroy details in the image. In order to avoid such and improve the averaging technique, Mansouri et al. [
Six repeated acquisitions of dark noise images were carried out under identical conditions for aperture setting 5.6 and a focus setting of infinity. A slice was then taken through the centre of each image producing intensity profiles. The slices were taken from the centre for all six images.
The other aim of this work was to analyse the relationship between the camera noise and exposure time. This analysis should give an idea of the contribution of dark current as a function of exposure time. Eight repeated acquisitions of a single wavelength (550 nm) dark noise image under identical conditions were done
for aperture setting 5.6 and a focus setting of infinity. The exposure time ranged from 0.1 s to 30 s. The analog gain factor of the CCD camera was set to zero.
One of the objectives of this study was to investigate the resolution of images produced by the hyperspectral imaging system in the main meridian (horizontal and vertical) at different locations in the field of view of the camera. This was accomplished by obtaining sample edge patches from the centre and near-boundary from the checker board hyperspectral image. Edge and line spread functions were constructed for these near-horizontal and near-vertical hyperspectral edges. The standard deviation from each fit was computed and recorded.
The final image analysis test involved verifying system calibration, image correction and compensation algorithms reported so far. The overall performance of the system was assessed by acquiring and processing images from a GretagMacbeth colour checker chart and then comparing the derived reflectances with those obtained with a telespectroradiometer. Reference Munsell chips N7, N5 and N2.5 were inserted at the edges of the chart (
reflectance functions for each pixel of the corrected image was then computed by normalizing this corrected signal at each pixel against that obtained with the reference Munsell chips inserted in the scene.
The spectral transmittance of the filter when varying the peak wavelength at 10 nm intervals from 400 nm to 720 nm was measured using a monochromator.
As can be seen from
The Gaussian fit of the central region images acquired at the short and middle wavelengths respectively are shown in
deemed accurate for further research work which include hyperspectral image registration and hyperspectral image scene recognition.
Mean signal values with pixel patches of 5 × 5, 20 × 20, and 790 × 870 were used to investigate linearity (
Results show the hyperspectral imaging system is linear for average light levels but the same could not be said about low light levels as the data points were too close together. This can be attributed to the property of the neutral density wedge where the density varies exponentially with length hence no significant
Image location | Line 1peak Wavelength, nm | Line 2 peak Wavelength, nm |
---|---|---|
Centre | 436.6 | 546.9 |
Top right corner | 436.5 | 546.8 |
Top left corner | 436.6 | 546.9 |
Middle up | 436.6 | 546.5 |
difference as the light level reduces. An exponential fit was used to analyse the behaviour of the neutral density wedge (
The intensity profiles are plotted against their respective row or column sizes with one trace below the other (all six).
From
A plot of mean dark noise images against exposure time is given in
A plot of the standard deviation against wavelength for near-horizontal and near- vertical hyperspectral sample edge patches is presented in
Results show no significant difference between the standard deviations for horizontal and vertical edge images sampled from the centre of the image with an average standard deviation of 1.3 pixels. This result is similar with those obtained in previous work using the same hyperspectral imaging system [
A plot showing the ratio of mean signal for yellow-green and orange patches GretagMacbeth colour checker Chart is given in
The root mean square error in the hyperspectral estimates of reflectance across the set of test surfaces was 0.0025. Although some small systematic distortions were present in some regions of the spectrum, the overall accuracy of the
hyperspectral system was sufficient for further research work in natural scene imagery with emphasis on scene recognition.
This article proposes comprehensive methods for the calibration and characterization of focal-plane hyperspectral imaging systems used for natural scene imagery.
The spectral transmittance of the liquid crystal tunable filter shows the shorter wavelength data become noisy after the visible spectrum. This is caused by the sensitivity of the detector inside the monochromator to these wavelengths. This result is acceptable since we are only interested in the visible spectrum. The plot of nominal against actual wavelength peak-transmission values and Gaussian fit of transmittance curves of the liquid crystal tunable filter measured using the monochromator was very encouraging since the standard error of 0.3162 was deemed low.
The nominal wavelength accuracy analysis shows that principal lines have a maximum variation of less than 1 nm and are accurate for further research work in natural scene imagery.
Input-output function characterization shows the hyperspectral imaging system is linear for average light levels but for low light levels, results were inconclusive as the data points were too close together. This was attributed to the property of the neutral density wedge where the density varies exponentially with length; hence no significant difference as the light level reduces. An exponential curve was used to fit the data and results show some form of linearity even for low light levels. This was encouraging since low light level presents a significant problem in hyperspectral imaging.
System noise characterization shows that the fluctuations in repeated images show no systematic variation which implies that an averaged image could be used for all subsequent acquisitions and image correction. A systematic variation normally means there is a problem with the imaging system.
Main meridian analysis results show no significant difference between the standard deviations for horizontal and vertical edge images sampled from the centre of the image with an average standard deviation of 1.3 pixels. The standard deviation for edges obtained from near boundaries had higher values with some reaching 2.1 pixels. Focus setting and vignetting play a major role in determining results at the boundaries. Future work will find ways to tackle this problem.
Finally, the performance of the proposed methods was evaluated by calibration verification of a GretagMacbeth colour checker chart hyperspectral image. The root mean square error in the hyperspectral estimates of reflectance across the set of test surfaces was 0.0025. Results show the overall accuracy of the hyperspectral system was sufficient for further research work in natural scene imagery with emphasis on scene recognition.
The author declares no conflicts of interest regarding the publication of this paper.
Ekpenyong, N.E. (2019) Calibration and Characterization of Hyperspectral Imaging Systems Used for Natural Scene Imagery. Optics and Photonics Journal, 9, 81-98. https://doi.org/10.4236/opj.2019.97009