Next Article in Journal
Suitability Pre-Assessment of in-Sewer Heat Recovery Sites Combining Energy and Wastewater Perspectives
Next Article in Special Issue
The Road to Developing Economically Feasible Plans for Green, Comfortable and Energy Efficient Buildings
Previous Article in Journal
Proton Exchange Membrane Hydrogen Fuel Cell as the Grid Connected Power Generator
Previous Article in Special Issue
Investigation on the Thermal Condition of a Traditional Cold-Lane in Summer in Subtropical Humid Climate Region of China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Thermal Performance Detection Method for Building Envelope Based on 3D Model Generated by UAV Thermal Imagery

1
State Key Laboratory of Subtropical Building Science, South China University of Technology, Guangzhou 510641, China
2
Guangzhou Yuchen Information Technology Co. Ltd., Guangzhou 510641, China
*
Author to whom correspondence should be addressed.
Energies 2020, 13(24), 6677; https://doi.org/10.3390/en13246677
Submission received: 19 November 2020 / Revised: 13 December 2020 / Accepted: 15 December 2020 / Published: 17 December 2020
(This article belongs to the Special Issue Advanced Buildings Thermal Monitoring)

Abstract

:
The evaluation and renovation of existing building envelope has important practical significance for energy conservation and emission reduction in the field of architecture. With the development of digital cities, 3D models with rich temperature information can realize the comprehensive and accurate detection and evaluation of the existing building envelope. However, the 3D model reconstructed from thermal infrared images has only relative temperature distribution and no temperature value of each location, so it is impossible to quantify the extent of the defect from it. To solve this issue, this paper develops a method to establish a 3D point cloud model with temperature information at selected points. The proposed 3D model is generated based on the thermal infrared images acquired by an unmanned aerial vehicle (UAV) equipped with an infrared camera. In the generated 3D thermal infrared model, we can not only get the relative temperature distribution of the building’s full envelope structure, but also obtain the exact temperature value of any selected point. This method has been verified by field measurements and the result shows that the deviation is within 5 °C. In addition to temperature information, the generated 3D model also has spatial and depth information, which can reflect the appearance information and 3D structure of the monitoring target more realistically. Thus, by using this method, it is possible to achieve a comprehensive, accurate, and efficient on-site assessment of the building envelope in the urban area.

1. Introduction

Buildings account for about one third of the global primary energy consumption and one third of the total energy-related greenhouse gas emissions [1], and the thermal performance of building envelopes plays an important role in the overall energy consumption of buildings [2]. At present, in view of the global warming, energy crisis, and environmental pollution, it is of great practical significance to establish a comprehensive system for monitoring and evaluating the thermal performance of existing building envelopes in urban areas in order to reduce the energy consumption of buildings effectively.
High-resolution infrared cameras can provide detailed information about temperature distribution, which can be used to capture thermal anomalies caused by local defects or damage of the buildings and the defect location [3,4,5,6]. In recent years, with the development of infrared equipment, a handheld thermal infrared (TIR) method has been widely used in the field of architecture [7,8,9]. However, due to the narrow parallax of 2D infrared images and the fact that hand-held infrared thermography can only be used in indoor or outdoor lower levels, the TIR method is only applicable to local detection of building envelopes at present. With the help of the existing detection methods, whether TIR method or thermocouple and hot box method, it is difficult to realize the comprehensive detection of the whole enclosure structure of a single building, especially for buildings with a large volume and high number of floors.
With the development of unmanned aerial vehicle (UAV) technology, 3D reconstruction based on UAV data computer vision has gradually become a hot field, and has been widely used in digital cities, robot vision, automatic navigation and obstacle avoidance, equipment detection, and monitoring [10,11,12,13,14]. In the field of architecture, a UAV system equipped with a TIR camera can conveniently check each facade of buildings, which effectively solves the problem of limited data collection in traditional TIR methods. In addition, the establishment of a 3D model with a rich temperature field based on the TIR image obtained by the UAV can reflect the appearance information and 3D structure of the detection target more realistically, which can detect and evaluate the existing building envelope more comprehensively and accurately.
The 3D model is the product of 3D reconstruction from 2D images. At present, the development of 3D reconstruction based on visual images is relatively mature. 3D reconstruction software, including Pix4Dmapper, 3DF Zephyr, and Context Capture, etc., are commonly used. However, there are fewer researches on 3D reconstruction of TIR images. The main difficulties are explained in the following section.
First of all, the TIR image has only one thermal infrared band, and it shows lower spectral resolution, poor contrast, blurred visual effects, and various forms of noise [14]. Therefore, the process of feature points extraction and matching becomes more difficult on TIR images than with visual images. The most commonly used 3D reconstruction is based on the Structure from Motion algorithm (SFM), which calculates 3D information from the time series of 2D images [15,16]. The main process of the SFM algorithm includes feature extraction and matching (SIFT feature detection, SURF feature detection, ORB feature detection, AKAZE feature detection), sparse point cloud reconstruction, dense point cloud reconstruction, and surface reconstruction. The 3D reconstruction algorithm based on TIR images is mainly derived from visible images. In 2013, Pech proposed a method to generate a multi-temporal thermal orthograph from UAV data, which can be used for spatial analysis of temperature distribution. The results showed that SIFT was also suitable for feature detection of low-resolution TIR images [17]. In 2014, Lagüela extracted and generated building geometric models automatically based on thermal infrared oblique photographic images. It was proven that SFM was able to simultaneously deal with visible light images and TIR images to generate 3D building models [18]. In 2015, Behshid Khodaei verified that the digital surface model (DSM) of 3D models generated from TIR images had comparable accuracy to that of visible images, but the DSM generated from TIR images was smoother and had lower-level textures [19]. Therefore, 3D reconstruction based on TIR images has similarities to the algorithm based on visible light images.
Secondly, the purpose of 3D reconstruction based on TIR images is to generate the model reflecting temperature range of buildings, so as to locate and quantify the defective areas. However, different from 2D images, the temperature information of TIR images is lost during the process of 3D modeling. Although Pix4Dmapper software has a process template specially for TIR image modeling, the established 3D model only has the relative temperature information and cannot obtain the temperature value of each pixel. In 2017, E. Maset studied the 3D building reconstruction using TIR images with 3DF Zephyr, and proved that 3DF Zephyr could automatically locate the TIR image sequence taken by a UAV and generate 3D models without any data on image position or camera calibration parameters. However, as the temperature information is represented by the color information before the TIR images were input with 3DF Zephyr, the reconstructed 3D pseudo-color model cannot provide the exact temperature value of each location [20]. In the past two years, Yishuo Huang conducted a number of experiments about 3D building reconstruction based on TIR images. In 2018, he used an infrared thermograph to determine the location of thermal defects. Ground laser scanners (GLS) were used to collect point cloud data of buildings, after that these point clouds were used to reconstruct 3D models of buildings. A mapping model was constructed such that the segmented TIR images can be projected onto the 2D image of the specified 3D building. It was obvious that this method was a combination of a 2D image and a 3D model, but the temperature of the building enclosure can only be read in the 2D image. In another study in 2020, the established 3D model did not have specific temperature information either [21,22]. In 2018, Chen Yingying captured the image of the building by carrying two cameras (a TIR camera and an optical camera) in the UAV simultaneously, and then combined TIR images and optical images to reconstruct the 3D building model efficiently and accurately. Finally, the 3D point cloud model and 3D line segment model of the building were proposed, but it was still unable to read the temperature of each pixel on the model [23].
In order to solve the problem that the temperature of each pixel cannot be read in the 3D model reconstructed from TIR images, this paper aims to develop a method of evaluating the thermal performance of building envelope. The main contribution is to obtain the TIR images of the building envelope by the UAV equipped with an infrared camera, and then establish a 3D point cloud model providing temperature information of any selected points. In addition to temperature information, the generated 3D model also has spatial and depth information, which can reflect the appearance information and 3D structure of the monitoring target more realistically. Thus, by using this method, it is possible to achieve a comprehensive, accurate, and efficient on-site assessment of the building envelope in the urban area.
This paper is outlined as follows. In Section 2, the field experiment and the modeling process of a 3D TIR model with temperature information of each pixel is described. In Section 3, the measurement deviation of the UAV TIR method and the accuracy of the temperature of a selected point on the 3D TIR model are analyzed separately, from which the method proposed in this paper is validated. The results are discussed in Section 4, and some conclusions are introduced in Section 5.

2. Materials and Methods

This section introduces the method of establishing the 3D TIR model based on UAV TIR images, and it mainly includes the image acquisition based on UAV equipped with TIR camera, 3D reconstruction based on TIR images, and 3D model post-processing. The specific modeling process is shown in Figure 1.

2.1. TIR Images Acquired Based on UAV

The main purpose of this section is to obtain the TIR image of the building (take the D2 Conference Center of Guangzhou International Campus of South China University of Technology as an example) through the UAV equipped with TIR camera, which can be used for 3D modeling.

2.1.1. Materials

In the experiment, the UAV, DJI MATRICE 210 RTK V2 with a built- in high-performance RTK module, is used. Under the premise of a smooth network, the UAV can be connected to a 4G network card to achieve high-precision positioning, and there is no need to assume a base station to receive signals on the ground (Figure 2a). The maximum load capacity of the aircraft is 1.23 kg when fully loaded with two batteries, and the maximum cruising range is about 30 min. The TIR camera uses Zenmuse XT (DJI, Shenzhen, China, powered by FLIR, Figure 2b), which is compatible with M210 RTK V2 (DJI, Shenzhen, China). The specific parameters of the camera are shown in Table 1.

2.1.2. Radiometric Temperature Measurements

Based on the radiation temperature measurement method(the surface temperature is measured by measuring the intensity of the infrared signal arriving at the camera), the TIR camera allows the absolute temperature measurement in a complete image array [25]. The measurement principle is shown in Figure 3, and the measured radiation amount is calculated in Equation (1). According to Equation (1), it can be found that many factors affect the measurement accuracy of the real scene, mainly including the reflectivity of the object, emissivity, radiation background temperature, air temperature and humidity, and the distance between the camera and the measured object.
S = τ w i n × ( τ a t m × ε W ( T s c e n e ) + ( 1 ε ) W ( T B k g ) + ( 1 τ a t m ) W ( T a t m ) ) + r w i n W ( T r e f l ) + ( 1 τ w i n r w i n ) W ( T w i n )
where S is the value of the 14-bit digital number in counts, ε is the emissivity of the scene, τ w i n is the transmission coefficient of the window, T w i n indicates the window temperature, r w i n is the reflection of the window, T r e f l indicates the temperature reflected in the window, τ a t m is the transmission coefficient of the atmosphere between the scene and the camera, Tatm indicates the atmospheric temperature, T B k g indicates the background temperature (reflected by the scene), T s c e n e indicates the temperature of the scene, W ( t ) indicates the radiated flux (in units of counts) as function of the temperature of the radiating object.
The TIR cameras compensate for changes of the camera temperature and outputs stable, as well as the normalized 14-bit digital number (DN). It means that a scene with a given temperature will always correspond to a certain digital number in the image. There are two types of 14-bit temperature stable digital numbers: Flux-linear and T-linear. The Zenmuse XT cameras belong to T-linear [27].
The T-linear output data can be configured into one of two different resolution modes by the user: High resolution (0.04 K/digital count) or low resolution (0.4 K/digital count) mode. In this test, high resolution (640 × 512) is used, and the temperature is shown in Equation (2). The measurement accuracy of the advanced temperature measuring plate is up to ±5 °C in an ideal environment.
T s c e n e = 0.04 × S 273.15
where S is the value of the 14-bit digital number in counts, T s c e n e indicates the temperature of the scene in centigrade.

2.1.3. TIR Images Acquisition

To assess the applicability of the proposed method, the D2 Conference Center of Guangzhou International Campus of South China University of Technology (Figure 4a) is taken as an example in the field experiment carried out on 29 September 2020. The camera adopts 45° elevation tilt photography with a flight speed of 2 m/s and a shooting interval of 3 s. The flight is planned for the images to have a forward and a side overlap of 90%, and an average Ground Sampling Distance (GSD) is 30 m. The flight lasts 40 min and a total of 743 images in TIFF format are acquired, as shown in Figure 5.

2.2. 3D Reconstruction Based on TIR Images

This section processes the obtained TIR images preliminarily to obtain a 3D texture model in gray, a digital orthophoto map (DOM), and the map texture.
Pix4Dmapper is a professional photogrammetry software (Pix4D, Switzerland). Based on the SFM algorithm, it can obtain centimeter-level precision 2D maps and 3D models from the ground, a light UAV, or aerial image processing. Since some scholars have verified the feasibility of using Pix4Dmapper for thermal infrared 3D reconstruction [22], this paper uses it for 3D reconstruction directly. As shown in Figure 6, the 743 images collected above are imported into Pix4Dmapper. The thermal camera template is selected to quickly check the images, and a total of 680 valid images are identified. After processing 680 effective images, the DOM (Figure 6c) and a 3D texture model in gray (Figure 7a) are obtained.
In Pix4Dmapper, we can use the color library that comes with the software to perform preliminary rendering of the gray model. However, the model obtained only has a relative temperature distribution with poor visual effects, and cannot provide the temperature value information of each pixel, as shown in Figure 7b.

2.3. Establish the Functional Relationship between Temperature and Gray Value Based on the DOM

This section establishes the functional relationship between temperature and gray value based on the obtained DOM, which can provide a theoretical basis for the establishment of a 3D model with temperature attributes.
In the 3D gray model generated above, there is only the gray value of the color attribute, and the temperature-related DN value in the original data cannot be read. How to use the gray value to retrieve the DN value of each pixel in the gray model is the key issue to establish a 3D model with temperature information at selected points. The DOM is data in .tiff format, and each pixel point in the DOM has a gray value and a DN value at the same time. The texture gives the grayscale interval (0–255) of the gray model. The corresponding relationship between the gray value and DN value of each pixel in the DOM is the same as the relationship between the gray value and DN value of each pixel in the 3D gray model. Therefore, the relationship between temperature and gray value in the 3D model can be established by fitting the functional relationship between DN value and gray value in DOM.
As shown in Figure 8, the DN value of each pixel in the DOM is extracted by ArcGIS (Esri, America) and its distribution statistics is analyzed. The result shows that it is mainly located between 7600 and 8000.
Read 188 gray values (256 values in total) and their corresponding DN values in the above DN value interval, and use the MATLAB fitting tool to perform functional relationship fitting on the relationship between DN value (S) and gray value (g). It shows that the accuracy of linear fitting is the highest, and Equation (3) is obtained:
S = 1.6 × g + 7600
The accuracy of Equation (3) is further analyzed as shown in Figure 9 and the accuracy is higher than 99.5%.
By integrating Equations (2) and (3), the relationship between temperature (Celsius temperature) and gray value is obtained as follows:
T s c e n e = 0.064 × g + 30.85

2.4. Post-Processing of 3D Model Based on FME

A 3D color model with temperature attributes based on the obtained gray model is built in this section, which can not only display the relative temperature distribution of the building envelope in pseudo-color form, but also provide the absolute temperature information at any selected point.
The core purpose of the 3D reconstruction of buildings based on TIR is to show the temperature distribution on the surface of the envelope, so as to quickly locate the defect location and quantify the degree of heat leakage of the defect. The 3D reconstruction based on TIR has been initially realized above, but only the gray-scale model is obtained. As human eyes have an extremely low resolution of grayscale, it is difficult to distinguish the difference in temperature distribution through the gray model. Therefore, it is necessary to perform pseudo-colorization on the gray model for qualitative research. At the same time, it is necessary to retrieve the temperature information in the color model for quantitative evaluation.

2.4.1. 3D Pseudo-Color Texture Model Based on FME

There is no absolute correspondence between temperature and color, and there is no uniform requirement that a fixed color must be used in infrared images to represent a certain temperature. Such correspondence is completely decided by the designer. The color of the 3D model depends on the texture file, so the pseudo-color processing of the gray model requires pseudo-color processing of the map file firstly.
The gray map shown in Figure 10a is stretched by ArcGIS to generate a new color map (as shown in Figure 10b). The new map can be selected randomly in the ArcGIS ribbon library according to user preference. This paper chooses the red-green-blue (R-G-B) rainbow color system commonly used to express temperature. The qualitative relationship between the R-G-B value of the red–green–blue rainbow color system and the temperature is described as follows. When the temperature is lower, the B value is higher, while the R value is smaller, and the color is blue. Furthermore, when the temperature increases, the G value gradually increases and the color is yellowish green. When the temperature continues to rise, the R value is larger and the B value is smaller, and the color is red.
The original gray model is color mapped by FME (Feature Manipulate Engine, Safe Software, Canada) data conversion software, and a 3D texture model is obtained, as shown in Figure 10c. It shows the relative temperature distribution on the outer surface of the building. Compared with Figure 7a,b, the color expression of this model is richer and the temperature information is more intuitive. This model can qualitatively determine the parts with abnormal temperature of the enclosure structure, but the specific temperature values of each part cannot be read, so further processing is still needed.

2.4.2. 3D Pseudo-Color Point Cloud Model Based on FME

Since the minimum unit of the 3D texture model is a surface composed of lines, there are no point elements, while the point cloud model is a 3D model composed of dense points where the attribute information of each pixel can be read. Therefore, in order to read the temperature information of the enclosure surface in the 3D model, it is necessary to establish a 3D dense point cloud model with temperature properties.
As there is no fixed correspondence between temperature and color level, we can directionally adjust a certain channel value of the R-G-B map in Figure 10b and write the temperature value into it. In this way, we can get the temperature value of the selected point by reading its color value of a certain channel. Red-green (R-G) is also a commonly used color system to describe temperature distribution. As shown in Figure 11 in FME, a Raster Expression Evaluator is used to input the Equation (4) into blue channel while keeping red and green unchanged, so that the R-G-B map (Figure 12a) is converted into an R-G map (Figure 12b). Then use FME to map the original gray model with R-G map and convert it to a dense point cloud, as shown in Figure 12c, and a 3D point cloud model is established.
As shown in Figure 13, the R, G, and B values of each pixel can be read out from the generated 3D TIR model, where the “color blue” value is the corresponding temperature value. In this way, we can obtain the exact temperature at any selected point. As its attribute value is still an 8-bit color level value, it can only be an integer from 0 to 255.

3. Validation and Correction

3.1. Validation

To validate the accuracy of the temperature measured by the TIR camera and the point-read temperature of the 3D TIR model, while the UAV is flying to acquire the data, contact measuring points based on thermocouple method are selected on the external surface to record the wall surface temperature, as shown in Figure 14.
There are two measuring points on the exterior window and wall of each orientation, and an aluminum foil measuring point is added on the south facade (the spatial resolution of the thermal infrared image is 3.92 cm, and the size of the aluminum foil plate is 50 × 50 cm, while its location can be accurately found on the image). Due to the low emissivity of aluminum foil (strong alumina 0.2), its own radiation amount is far less than the reflection amount of radiation to the surrounding environment, so aluminum foil is often used to determine the environmental emission temperature in many experiments [16,28,29]. In this paper, the aluminum foil is not only used as a mark point, more significantly, the direction between the TIR temperature and the thermocouple temperature of aluminum foil is taken as the correction value of experimental temperature direction.
Hobo UX120-006m thermocouple recorder (Onset Computer Corporation, USA) and TMC6-HE probe (the measuring range is from 40 °C to 100 °C, and accuracy is ±0.21 °C, Onset Computer Corporation, USA) are used for external surface measuring, and the data recording interval is set as 10 s. To ensure that the recorded temperature data is stable after the wall reaches thermal equilibrium, the counting of the surface measurement points starts at 10 am. The UAV flies at about 12:20. By analyzing the time of the 743 thermal infrared images obtained, it is found that the centralized shooting time of the west, south, east, and north facades are 12:28–12:30, 12:34–12:36, 12:41–12:43, and 12:55–12:57, respectively. The recorded data is drawn as shown in Figure 15, in which the average Hobo measured temperature corresponding to each orientation at the time of UAV shooting is read out.
The verification data consists of two parts. Firstly, to verify the temperature obtained from the UAV equipped with a TIR camera at a distance of 30 m from the measuring point (TIR). Secondly, to verify the pixel temperature value of each measuring point obtained in the 3D TIR model (3D model).
As for the acquisition of TIR temperature, three TIR images are selected in each direction, and the TIR temperature of the corresponding measuring points are read respectively, as shown in Figure 16.
As for the acquisition of 3D TIR model temperature, each measuring point is read in the generated 3D dense point cloud model, as shown in Figure 13. Taking the measured value of Hobo as the real temperature value of the surface, the TIR value and 3D model value are compared with the measured value of Hobo, and Figure 17 is drawn.
It can be seen from Figure 17 that the experimental data have the following rules:
  • TIR temperature values of all orientations are higher than Hobo temperature, and the deviation is within 5 °C, which conforms to the allowable deviation range of thermal infrared equipment.
  • The deviation between the 3D Model value and TIR temperature value is within 1 °C. Since the color scale channel value can only be an integer from 0 to 255, the 3D Model value is the value after the TIR value is rounded. The deviation between them is basically within 0.5 °C, and only 3 of the 16 points are more than 0.5 °C, but also less than 1 °C.
  • The TIR temperature on the west facade is about 4–5 °C higher than the Hobo temperature, which is the largest deviation among the four orientations. The TIR temperature on the south facade is about 2–3 °C higher than the Hobo temperature, and the deviation is the second. The TIR temperatures on the east and north facade are about 0–1 °C higher than the Hobo temperature, and the deviation is the smallest. The largest deviation occurs in the west elevation because the time from camera start-up is the shortest. The longer the stable time of the thermal infrared camera in the environment to be tested (usually 10–20 min), the smaller the deviation is. After the thermal infrared camera is preheated, the first detection facade is the west, so the temperature measurement error is the largest. The shooting order of other directions is south elevation, east elevation, and north elevation, and the error is gradually decreasing.
  • The deviation between the 3D Model value and Hobo temperature basically follows the change rule of the deviation between the TIR temperature and Hobo temperature value. As can be seen from the figure, the deviation of the 3D Model value is even smaller than the deviation of TIR temperature at some points. It means that the generated 3D Model has enough accuracy to provide the temperature of each point for the existing building envelope.

3.2. Correction

According to the above rules, the accuracy of the 3D model proposed in this paper can be verified. The overall deviation within 5 °C is allowable for thermal infrared method, but it is necessary to further correct this deviation for the quantitative study of the degree of heat leakage of the envelope structure and the grading study of defects.
Since the temperature value of the 3D TIR model is converted from a value corresponding to the TIR temperature, so the deviation of the 3D model mainly depends on the deviation of TIR temperature. Therefore, to correct the temperature value in the 3D TIR model, only the TIR temperature value needs to be corrected. Further analysis of the temperature deviation of each direction is put forward. The deviation of the TIR temperature value of each direction is named Δt′, and the average error of all directions is Δt, as shown in the Figure 18 below.
Figure 18 shows that the average deviation of all directions (Δt) is 1.8 °C, and the deviation of aluminum foil is 1.5 °C. It can be seen that the average temperature deviation of all directions is close to the deviation of aluminum foil. In addition, considering the relative stability of aluminum foil with low emissivity, this paper suggests that the temperature deviation of aluminum foil can be used to correct the temperature of the 3D model in the direction with larger deviation in subsequent studies.

4. Results and Discussion

In the generated 3D TIR model (Figure 19), we cannot only get the relative temperature distribution of the building’s full envelope structure, but also obtain the exact temperature value of any selected point. Thus, by using this method, it is possible to achieve a comprehensive, accurate, and efficient on-site assessment of the building envelope.
The result shows that the external walls and windows have a uniform temperature distribution, and the temperature of exterior wall is about 2–3 °C higher than that of window. The roof has the highest temperature. This is because the indoor air conditioning is running at the time of the test and the indoor temperature is much lower than that of outdoor. As the heat transfer coefficient of external windows is higher than that of exterior walls, plus the effect of solar radiation, the temperature of the exterior wall is higher than that of the window. The temperature of the roof is much high than that of the wall because the roof receives more solar radiation.
The generated 3D TIR model really reflects the temperature distribution of the envelope. However, due to the influence of solar radiation heat, thermal defects cannot be accurately judged. In the further study, it should be detected at night to exclude the influence of solar radiation.
Limited by the influence of infrared cameras, the temperature measurement error of the thermal infrared method is large. The measurement accuracy of the advanced temperature measuring plate is up to ±5 °C in an ideal environment. According to the above analysis, only 3 of the 16 measuring points have an error greater than 4 °C, and 13 of the 16 measuring points have an error within 3 °C. It means 81.25% of the measuring points are within 3 °C. In order to improve the accuracy of this method, we should follow the following rules in the further study:
  • After the infrared camera is started, it is stable in the actual measurement environment for 20 min before collecting data;
  • arrange the aluminum foil on the surface of the wall and measure the average surface temperature with the thermocouple method. Use the deviation between the thermal infrared temperature and the thermocouple temperature of the aluminum foil to correct the absolute temperature value in the final 3D TIR model.

5. Conclusions

This study proposes a TIR external evaluation method for the thermal performance of the building’s full envelope structure. We develop a method to establish a 3D point cloud model with temperature information at selected points. The proposed 3D model is generated based on the thermal infrared images acquired by the UAV equipped with an infrared camera, and the temperature value of each point is recovered based on the relationship between color value and temperature value. Thus, in the generated 3D TIR model, we can not only get the relative temperature distribution of the building’s full envelope structure, but also obtain the exact temperature value of any selected point.
The temperature accuracy of the generated 3D TIR model is within 5 °C, and 81.25% of the measuring points are within 3 °C, which is allowable for the thermal infrared method. In the further research, this method should be verified and corrected by a large number of field measurements at night to exclude the influence of solar radiation. To improve the results of this new method, we will control camera stabilization time the distance between the UAV and buildings. Furthermore, we will arrange the aluminum foil on the surface of the wall and measure its average surface temperature with the thermocouple method to correct the temperature of the 3D TIR model.

Author Contributions

Conceptualization, H.Z. and X.Z.; methodology, H.Z.; software, X.W.; validation, H.Z. and X.Z.; formal analysis, H.Z. and J.Y.; project administration, L.Z.; investigation, H.Z.; writing—original draft preparation, H.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by State Key Laboratory of Subtropical Building Science, South China University of Technology (NO. 2018A050501007).

Acknowledgments

The helpful comments of Ao Chen, Yong Pan is greatly appreciated. The help of drone pilot Hanming Den, Yiming Chen and the volunteers Sisi Chen, Zichuan Nie are greatly appreciated.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pachauri, R.; Reisinger, A. Climate Change 2014: Synthesis Report. Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. J. Roman. Stud. 2014, 4, 85–88. [Google Scholar]
  2. International Energy Agency. Energy Performance Certification of Buildings: A Policy Tool to Improve Energy Efficiency; International Energy Agency: Paris, France, 2008. [Google Scholar]
  3. O’Grady, M.; Lechowska, A.A.; Harte, A.M. Application of infrared thermography technique to the thermal assessment of multiple thermal bridges and windows. Energy Build. 2018, 168, 347–362. [Google Scholar] [CrossRef] [Green Version]
  4. O’Grady, M.; Lechowska, A.A.; Harte, A.M. Infrared thermography technique as an in-situ method of assessing heat loss through thermal bridging. Energy Build. 2017, 135, 20–32. [Google Scholar] [CrossRef] [Green Version]
  5. British Standards Institution. Condition Monitoring and Diagnostics of Machines. Thermography. General Procedures; British Standards Institution: London, UK, 2008. [Google Scholar]
  6. Fokaides, P.A.; Kalogirou, S.A. Application of infrared thermography for the determination of the overall heat transfer coefficient (U-Value) in building envelopes. Appl. Energy 2011, 88, 4358–4365. [Google Scholar] [CrossRef]
  7. Kylili, A.; Fokaides, P.A.; Christou, P.; Kalogirou, S.A. Infrared thermography (IRT) applications for building diagnostics: A review. Appl. Energy 2014, 134, 531–549. [Google Scholar] [CrossRef]
  8. Balaras, C.A.; Argiriou, A.A. Infrared thermography for building diagnostics. Energy Build. 2002, 34, 171–183. [Google Scholar] [CrossRef]
  9. Jeong, H.; Kwon, G.-R.; Lee, S.-W. Deterioration Diagnosis of Solar Module Using Thermal and Visible Image Processing. Energies 2020, 13, 2856. [Google Scholar] [CrossRef]
  10. Mouget, A.; Lucet, G. Photogrammetric Archaeological Survey with UAV. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2014, II-5, 251–258. [Google Scholar] [CrossRef] [Green Version]
  11. Messina, G.; Modica, G. Applications of UAV Thermal Imagery in Precision Agriculture: State of the Art and Future Research Outlook. Remote Sens. 2020, 12, 1491. [Google Scholar] [CrossRef]
  12. Martínez-Carricondo, P.; Agüera-Vega, F.; Carvajal-Ramírez, F. Use of UAV-Photogrammetry for Quasi-Vertical Wall Surveying. Remote Sens. 2020, 12, 2221. [Google Scholar] [CrossRef]
  13. Kim, B.G. 3-D Model-based UAV Path Generation for Visual Inspection of the Dome-type Nuclear Containment Building. J. KIBIM 2016, 6, 1–8. [Google Scholar] [CrossRef] [Green Version]
  14. Hallermann, N.; Morgenthal, G. Unmanned aerial vehicles (UAV) for the assessment of existing structures. In Proceedings of the Iabse Symposium Report, Kolkata, India, 24–27 September 2013. [Google Scholar]
  15. Sabato, A.; Niezrecki, C.; Niezrecki, C.; Meyendorf, N.G.; Gath, K. Use of infrared imaging for structure from motion assessment of heat loss in buildings. In Proceedings of the Smart Structures and NDE for Energy Systems and Industry 4.0, Denver, CO, USA, 4–5 March 2019. [Google Scholar]
  16. Hoegner, L.; Stilla, U. Automatic 3D reconstruction and texture extraction for 3D building models from thermal infrared image sequences. In Proceedings of the 12th Quantitative Infrared Thermography Conference (QIRT), Gdansk, Poland, 4–8 July 2016. [Google Scholar]
  17. Pech, K.; Stelling, N.; Karrasch, P.; Maas, H.G. Generation of multitemporal thermal orthophotos from UAV data. ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2013, XL-1/W2, 305–310. [Google Scholar] [CrossRef] [Green Version]
  18. Lagüela, S.; Díaz-Vilario, L.; Roca, D.; Armesto, J. Aerial oblique thermographic imagery for the generation of building 3D models to complement Geographic Information Systems. In Proceedings of the 2014 Quantitative InfraRed Thermography, Bordeaux, France, 7–11 July 2014. [Google Scholar]
  19. Khodaei, B.; Samadzadegan, F.; Dadras Javan, F.; Hasani, H. 3d Surface Generation From Aerial Thermal Imagery. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2015, XL-1-W5, 401–405. [Google Scholar] [CrossRef] [Green Version]
  20. Maset, E.; Fusiello, A.; Crosilla, F.; Toldo, R.; Zorzetto, D. Photogrammetric 3d Building Reconstruction From Thermal Images. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2017, IV-2/W3, 25–32. [Google Scholar] [CrossRef] [Green Version]
  21. Shull, P.J.; Hsu, K.-T.; Chiang, C.-H.; Huang, Y. Combining the 3D model generated from point clouds and thermography to identify the defects presented on the facades of a building. In Proceedings of the Nondestructive Characterization and Monitoring of Advanced Materials, Aerospace, Civil Infrastructure, and Transportation XII, Denver, CO, USA, 5–8 March 2018. [Google Scholar]
  22. Sabato, A.; Puliti, M.; Niezrecki, C.; Fromme, P.; Su, Z. Combined infrared imaging and structure from motion approach for building thermal energy efficiency and damage assessment. In Proceedings of the Health Monitoring of Structural and Biological Systems IX, SPIE Smart Structures + Nondestructive Evaluation, Online Only, CA, USA, 27 April–8 May 2020. [Google Scholar]
  23. Kong, Y.; Chen, Y.; Henry, L. Stitching image using RDHW based on multivariate student’s distribution (Conference Presentation). In Proceedings of the Situation Awareness in Degraded Environments, Orlando, FL, USA, 17–18 April 2018. [Google Scholar]
  24. FLIR. Zenmuse_XT_User_Manual_v1.2_cn.pdf; FLIR: Wilsonville, OR, USA, 2016. [Google Scholar]
  25. FLIR. UAS_Radiometry_Technical_Note; FLIR: Wilsonville, OR, USA, 2016; Available online: www.flir.com/suas (accessed on 7 November 2019).
  26. Heinly, J.; Schönberger, J.L.; Dunn, E.; Frahm, J.M. Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset). In Proceedings of the Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015. [Google Scholar]
  27. FLIR. Advanced Radiometry Application Note; FLIR: Wilsonville, OR, USA, 2014. [Google Scholar]
  28. Zhao, X.; Luo, Y.; He, J. Analysis of the Thermal Environment in Pedestrian Space Using 3D Thermal Imaging. Energies 2020, 13, 3674. [Google Scholar] [CrossRef]
  29. Patel, D.; Schmiedt, J.E.; Röger, M.; Hoffschmidt, B. Approach for external measurements of the heat transfer coefficient (U-value) of building envelope components using UAV based infrared thermography. In Proceedings of the 2018 Quantitative InfraRed Thermography, QIRT Council. Berlin, Germany, 25–29 June 2018; pp. 25–29. [Google Scholar]
Figure 1. Reconstruction process of the 3D model.
Figure 1. Reconstruction process of the 3D model.
Energies 13 06677 g001
Figure 2. Images of (a) the unmanned aerial vehicle (UAV) (M210 RTK V2), and (b) the thermal infrared sensor (Zenmuse XT).
Figure 2. Images of (a) the unmanned aerial vehicle (UAV) (M210 RTK V2), and (b) the thermal infrared sensor (Zenmuse XT).
Energies 13 06677 g002
Figure 3. Principles of radiation measurement [26,27].
Figure 3. Principles of radiation measurement [26,27].
Energies 13 06677 g003
Figure 4. Images of (a) the building to be tested, (b) the operation panel of the UAV.
Figure 4. Images of (a) the building to be tested, (b) the operation panel of the UAV.
Energies 13 06677 g004
Figure 5. The images acquired.
Figure 5. The images acquired.
Energies 13 06677 g005
Figure 6. Images of (a) the flight plan, (b) the digital surface model (DSM), and (c) the digital orthophoto map (DOM).
Figure 6. Images of (a) the flight plan, (b) the digital surface model (DSM), and (c) the digital orthophoto map (DOM).
Energies 13 06677 g006
Figure 7. Images of (a) the 3D model in gray, and (b) the 3D model in color in Pix4Dmapper.
Figure 7. Images of (a) the 3D model in gray, and (b) the 3D model in color in Pix4Dmapper.
Energies 13 06677 g007
Figure 8. DN (digital number) value distribution statistics.
Figure 8. DN (digital number) value distribution statistics.
Energies 13 06677 g008
Figure 9. The accuracy of the fitting function.
Figure 9. The accuracy of the fitting function.
Energies 13 06677 g009
Figure 10. Images of (a) the gray map, (b) the color map in red-green-blue (R-G-B) and (c) the 3D model in R-G-B.
Figure 10. Images of (a) the gray map, (b) the color map in red-green-blue (R-G-B) and (c) the 3D model in R-G-B.
Energies 13 06677 g010
Figure 11. Write temperature into blue channel.
Figure 11. Write temperature into blue channel.
Energies 13 06677 g011
Figure 12. Images of (a) the color map in R-G-B, (b) the color map in R-B, and (c) the 3D model in R-B.
Figure 12. Images of (a) the color map in R-G-B, (b) the color map in R-B, and (c) the 3D model in R-B.
Energies 13 06677 g012
Figure 13. The 3D thermal infrared (TIR) model.
Figure 13. The 3D thermal infrared (TIR) model.
Energies 13 06677 g013
Figure 14. Thermocouple measuring points.
Figure 14. Thermocouple measuring points.
Energies 13 06677 g014
Figure 15. The temperature value of the wall surface measured by thermocouple.
Figure 15. The temperature value of the wall surface measured by thermocouple.
Energies 13 06677 g015
Figure 16. TIR temperature of the wall surface.
Figure 16. TIR temperature of the wall surface.
Energies 13 06677 g016
Figure 17. Comparison of temperature by thermocouple, thermal infrared, and 3D model.
Figure 17. Comparison of temperature by thermocouple, thermal infrared, and 3D model.
Energies 13 06677 g017
Figure 18. Temperature deviations of all orientations.
Figure 18. Temperature deviations of all orientations.
Energies 13 06677 g018
Figure 19. Images of (a) west in the 3D TIR model, (b) south in the 3D TIR model.
Figure 19. Images of (a) west in the 3D TIR model, (b) south in the 3D TIR model.
Energies 13 06677 g019
Table 1. FLIR Zenmuse XT parameters [24].
Table 1. FLIR Zenmuse XT parameters [24].
NotationDescription
Size103 × 74 × 102
Weight270 g
Resolution640 × 512 (High)
Temperature range−25 to 135 °C
Spectral range7.5 to 13.5 µm
Output TypeJPEG (8 bit)/TIFF (14 bit)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zheng, H.; Zhong, X.; Yan, J.; Zhao, L.; Wang, X. A Thermal Performance Detection Method for Building Envelope Based on 3D Model Generated by UAV Thermal Imagery. Energies 2020, 13, 6677. https://doi.org/10.3390/en13246677

AMA Style

Zheng H, Zhong X, Yan J, Zhao L, Wang X. A Thermal Performance Detection Method for Building Envelope Based on 3D Model Generated by UAV Thermal Imagery. Energies. 2020; 13(24):6677. https://doi.org/10.3390/en13246677

Chicago/Turabian Style

Zheng, Haichao, Xue Zhong, Junru Yan, Lihua Zhao, and Xintian Wang. 2020. "A Thermal Performance Detection Method for Building Envelope Based on 3D Model Generated by UAV Thermal Imagery" Energies 13, no. 24: 6677. https://doi.org/10.3390/en13246677

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop