Evaluating Infrared Thermal Image’s Color Palettes in Hot Tropical Area

The use of Infrared Thermal Scanners proved to be very useful in lots of applications. Using different color palettes, temperatures can be well-represented in the resulting image. However, most color palettes in hot tropical places like the Philippines are unsuitable since the ambient temperature is almost the same as the scanned object or person. This study evaluates twelve (12) known and used color palettes in the market to determine the most suitable for tropical places using the edge/border tracing algorithms Sobel-Feldman and Laplacian. The result shows that color palettes with the most colors produce more noise, making it difficult to distinguish the object scanned from the background. On the other hand, color palettes with three or fewer contrasting colors produce crisp and more detailed results. This study helps developers and researchers efficiently use color combinations suitable for hot weather for an effective thermal scanning and image representation.


Introduction
On March 11, 2020, World Health Organization (WHO) declared COVID-19 a pandemic, citing over 118,000 cases of coronavirus infections in over 100+ countries and places around the world [1]. This means that public health emergency becomes an international concern that makes almost all nation device guidelines, adapt protocols, close borders [2] [3] and boundaries [4], and even making market and supply chain disruption [5].
In these days of uncertainty where the effect of the COVID-19 has been af-fecting all aspects of human lives, safety measures and protocols are necessary to ensure the safety of the public and the frontliners themselves. The Administrative Order No. 2020-0016 issued by the Department of Health, also known as "Minimum Health System Capacity Standards for COVID-19 Preparedness and Response Strategies," suggests physical distancing of at least 1 meter apart at all times [6]. The Inter-Agency Task Force (IATF) adopted these minimum health standards for the Management of Emerging Infectious Disease in almost all its resolutions. Section A-4 of the IATF Resolution No. 13 (2020) states that the Philippine National Police (PNP) was instructed to conduct inspection procedures in checkpoints to observe protocols. This includes inspection of necessary documents and using an infrared thermal scanner to filter possible COVID-19 positive individuals. The same practice has been adopted by the private and government offices and institutions, which was mandated through the guidelines issued by the IATF [7].
IRT's (also known as IR thermal cameras) and Non-Contact IR Thermometer are the only currently viable temperature measurement approaches for mass monitoring infectious diseases such as COVID-19. NCITs are the most popular fever screening, and all IRT's are approved by US Food and Drug Administration [8]. Benefits of using thermal imaging systems include effective mass fever screening, faster than forehead thermal scanner, and accurate skin temperature reading [9]. Although issues on its effectiveness are undeniable [10], IT thermal cameras are still applauded as a quick detector of human temperature. IR Thermal cameras are not perfect, but they can surely help control the spread of the virus [11].
As recommended by the US-FDA in their general guidelines for the preparation of Thermal Imaging Systems (Infrared Thermographic Systems/Thermal Imaging Cameras), the room temperature should be around 20˚C -24˚C and relative humidity of 10% -50% [9]. Almost the same configuration was recommended by a study done by Ghassemi et al. According to their research, the room temperature should be maintained at 18˚C to 24˚C and relative humidity between 10% and 75% [8]. This suggestion is ideal for humid places, and the ambient temperature is cold. However, in hot tropical areas like in the Philippines, the use of IR thermal poses a challenge [12].
The Philippines' climate is usually tropical and maritime, which means it is characterized by high temperature and humidity, and abundant rainfall [13]. The mean annual temperature of the Philippines is 26.60˚C. January is the coolest month at 25.50˚C during January and the warmest month is in May, with an average temperature of 28.3˚C and humidity of 60%. On May 10, 2021, Dagupan City, Pangasinan, reaches a record high heat index or temperature of 51˚C, which could cause health problems such as heat cramps and exhaustion, and heat stroke [14]. Two days following the record high heat index, on May 12, 2021, Dagupan City again reached a heat index of 52˚C at 2 pm [15]. This was followed by another record-high heat index of 53˚C at the same time and loca-tion [16].
The unstableness of temperature in the Philippines poses a significant problem in thermal imaging. The humid subtropical climates in some regions are considered problematic with current technologies [12]. As the air temperature rises, the humidity of the surroundings decreases, making the heat index spike.
The same result was observed by Tran et al. [17) in their study about ambient temperature and relative humidity effects. According to their research, variation in the relative humidity occurred because the air pressure determines the saturation of vapor pressure. This contrasts with the recommendation of the US Food and Drugs Administration in the operation of IR thermal cameras. According to US-FDA, an infrared thermal imaging device should be suitable and set up and operated correctly [9].
This study aims at evaluating currently known color palettes for thermal imaging. The evaluation result is the determination of the most appropriate color palettes that will be suitable for tropical and humid regions like the Philippines.
The result of the study helps developers and researchers efficiently use color combinations ideal for hot weather for an effective thermal scanning and image representation.

Problem in Thermal Imaging in Hot Tropical Area
If the ambient temperature of the surroundings reaches the temperature range of human subjects, rendering the thermal image can be a problem since color differentiation can be more challenging. As stated by the National Library of Medicine of the United States, the average normal body temperature is between 36.1˚C to 37.20˚C, based on some studies. A temperature above 38˚C most often means the person has a fever caused by an illness or infection [18]. For practical clinical purposes, a person is considered febrile (having or showing fever symptoms) when the oral temperature exceeds 37.5˚C [19]. If the temperature of the surrounding area and the human body are almost the same or overlap with each other, this will cause a lot of noise in the image being rendered using color palettes that are available with IR thermal scanners in the market. This is the main problem of this study. This study aims to help developers and other researchers determine the best color palettes for such peculiar conditions of temperature.

Image Capture and Lighting
Capturing thermal images can be in itself a challenge. Research suggests the use of an aerial thermal scanner and artificial-intelligence-enabled Internet-of-Things to safely capture human temperature over a safe distance [20]. Capturing thermal images using UAVs (unmanned aerial vehicles) is also gaining interest [21]. IoT-enabled applications and devices were also used in different studies. This IoT integration includes assessing thermal comforts for people [22] and thermal comforts for building design [23]. In this study, IoT modules were integrated to comprise the thermography setup. These IoT modules help capture thermal images of subjects in an easy-to-setup manner for further edge detection processing.
While some researches on thermography use light to mimic a feeling of warmth [24], subject to the evaluator's perception of virtual reality, light has no direct correlation with thermal scanning [25]. Other researches also suggest that the use of color affects or influence temperature perception, also known as "hueheat perception" [26]. Even using light-emitting diode (LED) light directly with an adjustable correlated thermal color temperature fails to support the correlation of light with skin temperature [27]. Additionally, sunlight does not affect human temperature. The research results show that people who have short exposure (around 30 minutes) to daylight during daytime affect the subject's thermal perception. Still, the subject's skin temperature was not affected by daylight in four different testing rooms [28]. In this research, although the light is present on the thermography setup, the researchers do not consider the effect of the light on the skin temperature being scanned by the infrared thermal scanner.

Color Palettes for Thermal Imaging
Color palettes are a very important aspect of representing temperature values.
Human ability to see clearly in dark or poor visibility areas is very restrained but in thermal imaging, lighting is not a big problem. With the proper color combination, the rendering of thermal images can be very effective and appealing. In a medical sense, color palette selection helps in the detection or recognition process [29]. With color palettes, facial thermal images can be captured and analyzed using mathematical algorithms to extract meaningful features [30].
Choosing a suitable color palette is the key to effective thermal imaging. Switching from different palettes changes the appearance of a scene and highlights critical areas of an image without altering the scanned temperature data. Teledyne FLIR, an imaging company that designs, develops, and manufactures thermal imaging technologies, uses its standard color palettes designed for various environments, purposes, and conditions. Among those palettes include White-Hot, Sepia, Rainbow, Black-Hot, Outdoor, Artic, Iron Gradient [31], Lava, Night Vision, BGY, Electro, and Candy.
However, these color palettes are not optimized in seasonally hot tropical regions like the Philippines. Implementing and setting an IR thermal device/system during this season poses a challenge. This study analyzes each available color palette in the market. In evaluating each color palette, Laplacian and Sobel-Feldman edge detection algorithms will be used.

Methodology
There are 12 color palettes used in this study. Using a color-gradience tool (Figure 1), each known color palette used in thermal imaging was represented. The application is capable of accepting six colors and fills the gradient between Journal of Computer and Communications All of the color palettes are subjected to an edge/border tracing algorithm. This is a mathematical method of determining how the color palettes display the degree of detailedness of the object being scanned. This is very significant because if the surrounding ambient temperature is almost the same as the human being observed, the noise will be visible in the background. Figure 2 shows a sample output using Laplacian and Sobel-Feldman algorithm.
The Laplacian method is an edge/border detection algorithm that can determine if a rendered thermal image can be scientifically outlined. With such, subjective evaluation can be done on the thermal image, using different color palettes, if subjects, i.e., human, etc., can be recognized from the background. The equation was first discovered and introduced by a French mathematician and astronomer, Pierre-Simon Laplace. Laplace's equation states that the sum of the second-order partial derivatives of R, the unknown function, with respect to the Cartesian coordinates, equals zero: The sum on the left is commonly represented by the expression ∇ 2 R, in which the symbol ∇ 2 is called the Laplacian, or the Laplace operator. Journal of Computer and Communications On the other hand, the Sobel-Fieldman operator is also an edge detection algorithm that emphasizes the edges of an image. This computer vision algorithm is used in image processing to extract the object's contour. This works by using two 3 × 3 kernels for ins convolution: These kernels (G x and G y ) can produce a separate measurement of the gradient component for each orientation. These can be combined to find the absolute magnitude of the gradient at each point and the orientation of that gradient using Using this information, gradients direction can also be calculated using To capture thermal images, the researchers created a thermal scanning setup ( Figure 3) that includes an ESP32 electronic board, MLX90640 IR thermal camera, and a 1.44" LCD IPS screen display. During benchmark, the LCD screen display is capable of filling the entire screen in 42.33 milliseconds. This gives the LCD roughly around 24 frames per second.
The setup for the test includes the thermal scanner atop a table, as sown in Figure 4. The experiment was set up in a normal room with fluorescent lighting on top of the thermal scanner at a distance of 76 inches. There is no external lighting in the setup. The object being scanned is 32 inches away from the thermal scanner. Although the temperature of the fluorescent light is higher than the room temperature, it doesn't affect the temperature of the object being scanned. Moreover, the intensity of the light does not affect the operation of the thermal scanner since the thermal scanner can work even in the absence of light.
Although humidity can affect the heat index, humidity is not a factor to be considered in this study. If humidity is to be factored in with the temperature, the heat index can be computed. The heat index, also known as apparent temperature, is what temperature feels like to the human body after relative humidity Journal of Computer and Communications  is mixed with the air temperature [32]. The temperature being captured by a thermal camera is the actual temperature of the body or an object and not the feel of the temperature.

Results and Discussion
Using the color-gradience tool, six key colors, in hex, were used for the gradient generation. From 1 color to another, gradient colors were generated, as shown in Figure 5.
These color gradients were converted into hex equivalent, which was used to generate the color palette based on the values given by the thermal scanner. The code below represents the 103 colors being generated by the application from the six key colors.
Applying this color scale for a given color palette, thermal values from the thermal scanner can be represented. These steps were done to represent all 12 color palettes. Figure 6 shows the representation of thermal values in different color palettes.
Images rendered using color palettes were captured by a smartphone then compiled for subjection to the edge detection algorithms. The edge or border detection algorithms were used to determine the clarity or detailedness of the scanned image while minimizing the noise around it. The evaluation focuses on these two factors to select the most appropriate. Figure 7 shows all 12 palettes after subjection to the Sobel-Feldman algorithm.
After subjecting all color palettes to the Sobel-Feldman algorithm, the result shows that the White-Hot color palette displays less noise in the background and detailed pattern of the scanned hand compared to others. Moreover, layered border-color means varying the detailed temperature of the object being scanned, which is significant to thermal imaging. On the opposite, the Black-Hot color palette shows a clean object while having a consistent minimal noise in the background. Almost similar to Black-Hot is the Outdoor color palette with an additional color rendition for a higher temperature inside the object. Journal of Computer and Communications  The Sepia palette has a clear border, although the background noise can be observed extending in the inner part of the object. Color palettes such as Night Vision and Iron Gradient have distorted or partial completeness, missing 1 to 2 fingers. Most of the color palettes have a noisy background that almost blended with the object. This makes it difficult to differentiate the temperature of the environment and the object being thermally scanned. Although the object is still recognizable, noises are very dominant in the background and the foreground. This observation is most noticeable in the rainbow palette.
With the use of the Laplacian edge tracing algorithm, the same thermal images are subjected. Figure 8 shows the result of the tracing. Consistently, Black-Hot color palettes display an excellent render of the object scanned, showing a clear hand with a consistent background. Additionally, the White-Hot color palette shows solid foreground but a bit distorted background. The Outdoor color palette, which is a color higher compared to Black-Hot, renders almost the same, with additional details on the hotter part of the object. Lava, Iron Gradient, Artic, and Electro shows a bit of a border but are barely visible. Color palettes that comprise more colors blend the foreground and background, and almost no visible trace can be seen.
Black-Hot and White-Hot color palettes both render consistent results on Sobel Feldman and Laplacian edge/border tracing. This consistency of results suggests that both are suitable for tropical weather like the Philippines. Outdoor on temperature but are less traced.
To further clear the image of unwanted noise, gradient magnitude thresholding or lower bound cut-off suppression was done. The high threshold value is set at 0.20 and the low threshold value is set to 0.10.
The presence of noise or incompleteness of the image scanned can be correlated with the number of primary colors used during the generation of key colors. Figure 9 shows that palettes with a minimum number of colors have clearer rendering compared to palettes with more colors.

Conclusions and Recommendation
During the experiment, color palettes were utilized successfully by determining key colors then generating the gradients between them. These gradient colors can be used to represent small details of temperature based on the scanned thermal values of the thermal scanner. With the rendering of thermal values into color representation, thermal images based on palettes can be used for edge/border detection to assess the detailedness of the object scanned scientifically.
Based on the observation with color palettes and their rendering on the Sobel-Feldman algorithm, it is concluded that the more color the palette has, the more noise it generates. Although color shows more borders, the object being scanned is challenging to distinguish. The use of minimal contrasting colors, however, renders a solid, detailed image that is more recognizable.
Using the Laplacian algorithm, the result further supports the findings with the Sobel-Feldman algorithm. While most colored palettes render noisy backgrounds and incomplete images, two-colored palettes, such as the black-hot and white-hot, still render a more solid and detailed image.
The use of minimal contrasting colors to distinguish the object being scanned from the background is therefore recommended to be used in hot tropical areas like the Philippines. The result will greatly help developers of thermal scanners to effectively use appropriate color palettes in their prototypes or products to be used not only in the Philippines but also in other tropical places.
Furthermore, it is recommended that future researchers should improve the capturing of the image to minimize the noise in the background. They should confirm if the noise in the captured image is brought about by the low refresh or frame rate of the screen display.