Next Article in Journal
Mycoremediation as a Potentially Promising Technology: Current Status and Prospects—A Review
Previous Article in Journal
A Traceable Spectral Radiation Model of Radiation Thermometry
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Photogrammetry-Based 3D Textured Point Cloud Models Building and Rock Structure Estimation

1
Department of Civil Engineering, Dalian Maritime University, Dalian 116026, China
2
State Key Laboratory of Hydraulics and Mountain River Engineering, College of Water Resource & Hydropower, Sichuan University, Chengdu 610065, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2023, 13(8), 4977; https://doi.org/10.3390/app13084977
Submission received: 24 February 2023 / Revised: 2 April 2023 / Accepted: 13 April 2023 / Published: 15 April 2023
(This article belongs to the Topic Geotechnics for Hazard Mitigation)

Abstract

:
Trace lines on the outcrop of a rock mass are usually the primary data source for the estimation of rock structure. It is important to obtain the data of trace lines precisely. Photogrammetry is well suited to finish this task. However, this is mainly conducted by commercial software, and not every researcher has easy access to the method of digital photogrammetry. This study aims to provide researchers with a low-cost method of building a photogrammetry-based textured 3D point cloud model (FMBPM) and display the applicability of the method to estimating the rock structure of rock masses. In the FMBPM, a digital single-lens reflex camera with a prime lens and a total station are the necessary hardware employed to capture images and measure the coordinates of feature points. A coordinate transformation means of converting model coordinates to physical coordinates was introduced. A program for calculating a joint orientation based on the coordinates of inflection points on the trace line of the joint was developed. A section of a rock slope was selected as a case to show the procedures and the practicability of the FMBPM. The textured 3D point cloud model of the rock slope was successfully built, and the rock structure of the rock slope was analyzed using the joint disk model generated based on the trace lines extracted from the point cloud model. The results show that: (1) the precision of the point coordinates of the textured 3D point cloud model could achieve 3.96 mm, taking the data of the total station as the reference; (2) the rock structure of the slope is good, according to the value of the rock quality designation; (3) the new method is applicable in engineering practices.

1. Introduction

The mechanical and hydraulic properties of rock masses are very complex, considering the existence of joints [1]. Rock structure directly reflects the development of joints, and it is an essential index in rock mass classification systems, such as RMR, Q, and RMi [2]. The geometrical parameters of joints, such as size, orientation, density, and spacing, significantly influence the rock structure of a rock mass [3,4]. Due to the lightproof characteristic of rock masses, most of the parameters are inferred according to the information of joints on outcrops rather than directly measured or observed. Trace lines are the intersection lines of joints and an exposed surface of a rock mass, and they are usually the primary data source for the estimation of rock structure [5]. Consequently, it is essential to obtain the data of trace lines precisely.
There are two main methods to obtain the data of trace lines: contact field investigations and non-contact remote sensing investigations [6]. A geological compass and a tape are the main measuring equipment in a contact field investigation, and the investigation results of joints can be acquired immediately. The method is applicable when the number of joints is small and the site of joints can be easily reached by surveyors. In recent years, rock engineering has become so large that many areas of rock exposures are manually inaccessible. Yet, the detailed rock structure information of the inaccessible areas is also urgently needed to ensure the stability of the engineering. Consequently, remote sensing techniques are being used increasingly, which permits a safe, fast, comprehensive, and accurate acquisition of information on inaccessible rock exposures and increases engineer safety. Digital photogrammetry and laser scanning are two main methods of remote sensing techniques related to rock engineering, both of which can generate high-precision 3D point clouds of research objects [7,8,9,10]. Laser scanning methods generate a point cloud model using time-of-flight technology [11]. In comparison, digital photogrammetry methods calculate the spatial coordinates of a point based on its planar geometric position in different photographs. Many studies related to rock structure extracting and geological hazard analysis have been conducted based on the two methods. Chen et al. [6] presented a method for evaluating the development of the joints on rock tunnel faces based on a 3D point cloud model obtained by photogrammetry. Kaminski et al. [12] estimated the dynamics and sizes of landslides by comparing digital terrain models, which are generated photogrammetrically from stereo pairs of images. Cheng et al. [13] demonstrated the effectiveness of Unmanned Aerial Vehicle photogrammetry in the remote sensing and assessment of landslide behavior through a case study of a landslide that occurred in Guizhou, China. Nappo et al. [14] provided a tool for the semi-automatic damage assessment of roads in landslide-affected areas to support the risk analysis and planning of mitigation measures based on photogrammetry. Buyer et al. [15] determined the block size and shape distributions according to a textured digital surface model of an investigated outcrop. Menegoni et al. [16] detected joints on the surface of a rock slope based on digital photogrammetry and a remotely piloted aircraft system. Liu et al. [5] searched the dangerous parts of a rock slope using block theory based on photogrammetry. Lato et al. [17] established an online shared repository of photogrammetry data and light detection and ranging (LiDAR) for researchers. Sturzenegger et al. [18] investigated the applicability of photogrammetry and LiDAR to the derivation of joint intensity, mean trace length, and block size.
Compared with laser scanning, photogrammetry has the advantages of lower equipment cost and better portability [19,20]. However, the process of generating point cloud models is conducted by commercial software, in most studies, after rock mass photographs are collected; thus, not every researcher has easy access to the method of digital photogrammetry. This study aims to provide researchers with a low-cost method of building a photogrammetry-based textured 3D point cloud model (FMBPM) of the exposures of rock masses and to illustrate the applicability of the method to estimating the rock structure of rock masses. The paper is organized as follows: (1) the primary geological conditions of a rock slope at the study site are introduced, a section of which is selected to display the processes and to verify the applicability of the FMBPM; (2) the processes of collecting photographs and generating textured 3D point cloud models are proposed; (3) a coordinate transformation means of converting model coordinates to physical coordinates is supplied; (4) the accuracy of the textured 3D point cloud model is verified, and trace lines of the model are extracted; (5) a joint disk model is built for estimating the rock structure of the section of the rock slope.

2. The Point Cloud Model Generating for the Study Site

The study site is located in Dalian City, Liaoning Province, northeast of China. The city has plenty of rain, sunshine, and lush vegetation. The risk of rockfalls is the primary potential geological disaster influencing the stability of the study site. A rock slope at the site is adjacent to the Fengcai road and faces the Longwangtang reservoir (Figure 1), a section of which was selected as the case study to illustrate the processes of the FMBPM and to verify the applicability of the FMBPM to rock structure estimation. The studied area of the slope covers a rectangular region with dimensions of approximately 29 m in length and 7 m in height. The joints in the slope are well-developed, and the rock structure of the slope is generally blocky.
A NIKON D7100 digital single-lens reflex camera with a 35 mm lens and a South NTS-362R total station were employed to capture images and to measure the coordinates of feature points. The maximum pixel value of the NIKON D7100 is 24,000,000 (4000 in height and 6000 in width). The precision of the distance measurement of the total station is ±(3 + 2 × 10 − 6D) mm. D is the distance between the total station and a measuring point, and it is not greater than 30 m in this case. Therefore, the precision of the distance is less than 3.6 mm in theory. The accuracy of angle measurement is 2 s, which means the error of the coordinates of a measuring point is theoretically less than 0.291 mm when D is less than 30 m.
Digital photogrammetry calculates the spatial coordinates of a point based on its planar geometric positions in different photographs. Hence, the same feature point of the slope should be presented in at least two images. A total of 194 images of the slope were taken from different camera positions. The textured 3D point cloud model of the slope was generated by Meshroom, which is a free, open-source 3D reconstruction software (https://alicevision.org/#meshroom, accessed on 20 December 2021). The pipeline of photogrammetry of Meshroom was used. The processes of generating textured 3D point cloud models of study subjects from images in the pipeline are highly automatic. The steps related to image processing, such as feature extracting, image matching, feature matching, meshing, and texturing, were all done automatically. Users can modify the degree of fineness of a 3D point cloud model; the finer the point cloud model, the longer it takes to generate. The textured 3D point cloud model of the study site includes 3,566,492 vertices and 7,127,652 faces, and it took about 15 h to create the model. The CPU model of the computer is an Intel(R) Core(TM) i7-9700 with 3.00 GHz, and the graphics card model is Nvidia Quadro P1000 (4 GB). It is worth noting that the surface of the rock slope where it is not directly covered by vegetation can be modeled by adding camera positions (Figure 2). The covered part of the surface must be exposed in images taken from the added camera positions. Figure 3 is the 2D and 3D comparison image of rock structure identification.

3. Coordinate Transformation

It should be noted that in Meshroom, only the relative positions of points are accurate, rather than the physical coordinates; therefore, point cloud models built by Meshroom must be scaled and rotated before conducting measurements. Meshlab is open-source software for processing and editing 3D point cloud models (https://www.meshlab.net/#download, accessed on 12 January 2022), and it provides a series of tools for editing, cleaning, healing, inspecting, rendering, texturing, and converting meshes. The postprocessing of coordinate transformation and trace line extraction were finished in Meshlab after the textured 3D point cloud model had been built in Meshroom.
The coordinates of at least four feature points on the slope should be measured simultaneously in Meshlab and in the field (denoted as CF and CT, respectively) to obtain the transformation matrix. CF can be directly extracted in Meshlab, but CT needs to be measured with a total station in the field. The processes of the transformation can be summarized by Equation (1).
T r a n m a t = [ R S T O 1 ]
In Equation (1), Tranmat is a 4-by-4 matrix, which represents the total transformation of the 2 sets of paired points; R is a 3-by-3 matrix representing the rotation transformation; S is a scalar, which represents the scale factor; T is a 3-by-1 matrix, which signifies the translation; O is a 1-by-3 zero matrix. The matrixes of R and T, and the scale factor of S can be solved according to CF and CT, which are the coordinates of two sets of paired points (Equations (2) and (3)). Each set of the points can be represented by a 4-by-3 matrix. The Nth row in the matrixes consists of the coordinates of the Nth point (N is not greater than 4).
C F = [ x F 1 y F 1 z F 1 x F 2 y F 2 z F 2 x F 3 y F 3 z F 3 x F 4 y F 4 z F 4 ]
C T = [ x T 1 y T 1 z T 1 x T 2 y T 2 z T 2 x T 3 y T 3 z T 3 x T 4 y T 4 z T 4 ]
The centroids of CF and CT can be calculated by Equations (4) and (5), respectively. The mean values of each set of coordinates should be translated to the origin of its own coordinate system; this can be done by subtracting from the point coordinates of the centroid. Equations (6) and (7) correspond to this process.
C F C E N 1 j = 1 4 i = 1 4 C F i j
C T C E N 1 j = 1 4 i = 1 4 C T i j
C F C i j = C F i j [ C F C E N C F C E N C F C E N C F C E N ] i j
C T C i j = C T i j [ C T C E N C T C E N C T C E N C T C E N ] i j
In Equations (4)–(7), j ranges from 1 to 3; CFCEN and CTCEN are the mean values of CF and CT, respectively; CFC and CTC are the coordinate matrixes of CF and CT, respectively, after translation to the origin of their own respective coordinate system. The scale factor can be calculated by Equations (8)–(10).
S F = ( 1 4 i = 1 4 j = 1 3 C F C i j 2 ) 0.5
S T = ( 1 4 i = 1 4 j = 1 3 C T C i j 2 ) 0.5
S = S T S F
In Equations (8)–(10), SF and ST are the size factors of CF and CT, respectively.
C F C S i j = C F C i j S F
C T C S i j = C T C i j S T
In Equations (11) and (12), CFCS and CTCS are the matrixes normalized by size factors of CF and CT, respectively. The rotation matrix of R can be computed by Equations (13) and (14) [21].
H = C F C S T C T C S
R = ( H T H ) 0.5 H 1
In Equations (13) and (14), H is a temporary matrix for the calculation of R. The translation matrix is calculated by Equations (15) and (16).
W i j = C T i j ( S k = 1 3 ( R j k C F T k i ) ) T
T j 1 = 1 4 i = 1 4 W i j
In Equations (15) and (16), W is a temporary translation matrix for the calculation of T. The coordinates of point cloud models generated by Meshroom can be converted to a physical size according to the transformation matrix of Tranmat in Meshlab. The corresponding MATLAB code for the calculation of Tranmat is provided in Appendix A. The four control points on the slope for the calculation of Tranmat are shown in Figure 4. Because Tranmat is a 4-by-4 matrix, the coordinates of a point in Meshroom should be modified to the form of (x, y, z, 1) before conducting the transformation. The textured 3D point cloud model of the rock slope at the physical scale is shown in Figure 4.

4. The Accuracy Verification of the 3D Point Cloud Model

The accuracy of the textured 3D point cloud model includes two aspects: length accuracy and angle accuracy. The exposed surface of the slope fluctuates obviously. It is inconvenient to conduct measurements with a compass and a tape; therefore, the accuracy verification is conducted with a total station. The length accuracy is verified directly by comparing the distance between two points obtained by Meshlab and the total station. The angle accuracy is verified by comparing the orientations of joints obtained by the two methods. The orientations are calculated according to the normal vectors of the joint planes, which can be solved by at least three non-collinear points. Taking Figure 5 as an example, P1, P2, and P3 are the inflection points of a joint, and they are non-collinear. A fitting plane (shown as a blue dash circle in Figure 5) can be obtained by the least square method with the coordinates of the three inflection points, and then the normal vector (n (xn, yn, zn)) of the fitting plane can be calculated. The dip and dip direction (corresponding to β and α, respectively, in Figure 5) of the fitting plane can be inferred based on the normal vector of n. The dip direction is defined as the angle between north and the horizontal projection of the normal vector, which ranges from 0 to 360. The dip is the dihedral angle between the horizontal plane and the joint, which runs from 0 to 90.
As can be seen from the above introduction, the measurement accuracy of the total station is vital for the accuracy verification of the textured 3D point cloud model. An outdoor experiment was carried out to obtain the actual measurement accuracy of the total station and to verify the applicability of the calculation method of joint orientations. The main equipment used in the experiment included a total station, tripod, compass, tape, vernier caliper, and measuring pad. Seven reflective stickers were attached to the measuring pad, denoted as A, B, C, D, E, F, and G. Figure 6 displays the main equipment used in the experiment. The outdoor experiment was conducted as the following steps:
(1)
Identify the specific model and brand of the total station to be tested and make sure that it is properly calibrated and in good working condition.
(2)
Choose a suitable outdoor site for the experiment, taking into account factors such as the terrain, weather conditions, and availability of reference points.
(3)
Set up the total station at a fixed position and level it carefully. Use a tripod and make sure that the instrument is stable and properly oriented.
(4)
Place the measuring pad at a known distance from the total station and mark it clearly with a reflective target or prism.
(5)
Take multiple measurements of the measuring pad using the total station, varying the horizontal and vertical angles and the distance. Record the measurements carefully and accurately, taking into account any sources of error or uncertainty.
(6)
Repeat the measurements at different times of day or under different weather conditions to assess the effect of environmental factors on the accuracy of the total station.
(7)
Compare the measured distances and angles with the actual values of the measuring pad obtained from a reference source with a vernier caliper.
(8)
Calculate the errors and uncertainties in the measurements and analyze the results to determine the actual measurement accuracy of the total station under the given conditions.
The measuring pad was placed 10 m away from the total station in the directions of east, west, south, and north. In the direction of west, 4 different distances of 10 m, 30 m, 50 m, and 100 m were selected. A total of seven different combinations of direction and distance were employed to verify the accuracy of the total station. Table 1 shows the results of the outdoor experiment. From the table, the following points can be drawn. First, the absolute values of the dip direction differences for the 2 measuring methods range from 0.20 to 1.90 degrees, and the mean value at the distance of 10 m is 0.69 degrees. The value generally rises following the increase of the measuring distance. Second, the absolute values of the dip differences range from 0.08 to 1.25 degrees, and the mean value of 10 m is 0.315 degrees. The value is smaller compared with the data of the dip direction difference at the same distance. The same trend of the value with distance can also be observed here. Third, the absolute values of the distance differences range from 0.32 to 1.33 mm, and the mean value at 10 m is 0.51 mm. The value basically increases following the rise of the measuring distance. Fourth, because the distance between the slope surface and the total station is not greater than 30 m, the absolute values of the differences of the dip direction, dip, and distance are not higher than 1.19, 0.83 degrees, and 0.82 mm, respectively (taking the largest error values at the distances of 10 and 30 m). The results mean that the accuracy of the total station is high enough as the reference for verifying the accuracy of the 3D point cloud model, and the method of calculating the orientations of joints according to the coordinates of points is applicable.
The coordinates of a total of 30 feature points (corresponding to the numbers 1 to 30) on the slope (see Figure 4) were measured in Meshlab (after conducting the coordinate transformation) and in the field simultaneously. Feature points 1 to 4 are control points that were used for calculating the transformation matrix, while feature points 5 to 30 were employed for the accuracy verification of the 3D point cloud model. The mean value of the distances of the feature points 5 to 30 between the 2 sets of coordinates is 3.96 mm. Table 2 and Table 3 list the length and the angle accuracy verification results, respectively, for the 3D point cloud model. As can be seen from the 2 tables, the absolute values of the length, dip, and dip direction differences calculated based on the 2 sets of coordinates are 1.57 mm, 0.38 degrees, and 0.42 degrees, respectively; therefore, the accuracy of the textured 3D point cloud model is high enough for the engineering application. It should be noted that the accuracy listed above is taking the coordinates obtained by the total station as a reference. The real accuracy of a textured 3D point cloud model is controlled by the following factors: the accuracy of the total station, the number and the quality of the images of the rock mass, the grid density of the point cloud, and the fineness of the texture of the rock mass.

5. The Rock Structure Analysis for the Rock Slope

Rock structure is a composite indicator for reflecting the development of joints in a rock mass, which can be evaluated by joint spacing, density, orientation, and size. In most cases, this information has to be inferred according to the trace lines exposed on the surface of a rock mass. Trace lines are the intersection lines of joints and the surface of a rock mass. Trace lines can be clearly identified in point cloud models. The study involved a manual process of extracting trace lines by identifying multiple inflection points along a single trace line, connecting them, and obtaining the final trace line. Joint models, which simulate the development of joints in rock masses, can be built based on this information. No obvious difference between the strike length and the dip length of joints was observed by Robertson [22] through analyzing a mass of joint data collected in the field. This finding suggests that joints are approximately equidimensional. Baecher et al. [23] developed a joint disk model, in which joints are simplified into equidimensional planar disks. Due to its good applicability, the joint disk model is widely used in the aspects of simulating the mechanical and hydraulic behavior of rock masses [24,25,26,27].
The geometry of joint disks in a model is mainly governed by three parameters: orientation, diameter, and density. Because the number of joints in a rock mass is often very large, the parameters of the joints used in a model are generated by the group. Four main steps are needed to build a joint disk model for a rock mass. First, joints collected on the outcrop of the rock mass are divided into different groups. Second, joint density is calculated according to the relative position of joints and sampling windows on the outcrop. Third, the diameters of joint disks are inferred based on the distribution of the trace lengths. Fourth, the orientations of joint disks are generated on the basis of the joint density and the orientation distribution of joints on the outcrop. It should be noted that all the steps are executed based on the data of joints collected on the outcrop, and steps 2 to 4 are carried out by the joint group.
A total of 2993 traces on the rock slope were artificially extracted from the textured 3D point cloud model in Meshlab. The study involved a manual process of extracting trace lines by identifying multiple inflection points along a single trace line, connecting them, and obtaining the final trace line. The software currently cannot automatically discriminate between lines and areas in 3D point cloud models, and this work was done manually instead. It is preferred that joints be automatically extracted and identified in the future. The lengths of the traces range from 0.01 to 12.16 m. Figure 7 shows the distribution of the traces on the slope. Each of the traces consists of dozens of inflection points, the coordinates of which are the basis of the joint parameter calculation. The orientation (including the dip and dip direction) of a joint can be inferred based on at least three non-collinear points on the joint.
Joints were grouped according to their orientations. The orientation is composed of two parameters: dip and dip direction. Fuzzy C-means was used to execute the grouping when the number of joint sets ranged from 2 to 8 [28]. The number of joint sets was determined according to a simplified Xie–Beni index, shown as Equation (17) [29]. The index has the advantages of simple programming, high precision, and good practicability [26]. The number of joint sets that minimize the index is the optimum number of joint sets.
S X B K = i = 1 N v j = 1 K I i v j ( arccos | x i x v j + y i y v j + z i z v j | ) 2 min v j v l ( arccos | x v j x v l + y v j y v l + z v j z v l | ) 2
where SXBK is the simplified Xie–Beni set validity index when the N joints are divided into K sets. (xi, yi, zi) are coordinates of the unit normal vector of joint i. (xvj, yvj, zvj) and (xvl, yvl, zvl) are coordinates of the unit normal central vectors of sets vj and vl, respectively. Iivj is a Boolean value, which is equal to 1 if the joint i belongs to the set vj; otherwise, it is equal to 0. Joints were grouped into three sets. Figure 8 is the poles diagram of the grouping results for the 2993 traces. One pole represents the orientation of one joint, and the angle between the pole and North represents the dip direction, while the distance between the pole and the circle center represents the magnitude of the dip. Because the surface of a rock mass is opaque, the joint density and diameters of joint disks were inferred using 3D topographic sampling windows, which allow consideration of joint traces within buffer zones [18]. Due to the fact that extracted traces in the 3D point cloud model are three-dimensional curves, and the actual slope surface is also a three-dimensional surface, the buffer zone method is adopted in this paper for trace information statistics. This method converts the linear boundary of the circular measuring window into a surface boundary, counts the trace information within and intersecting with the buff zone boundary, and then calculates the distribution parameters of the joint diameter and density. Finally, a joint disk model can be generated based on these parameters. Figure 9 shows the traces of joints by the set and the employed 3D topographic sampling windows. Because the dimension of the studied slope is greater in the horizontal direction, several topographic sampling windows were placed at different locations of the slope (shown as Figure 9), and the average results were used. The area density (ρA) and the mean trace length of joints (lt) in a sampling window were inferred with Equations (18) and (19) [30].
ρ A = m 0.5 π d c 2
l t = π d c n 4 m
where m is the number of joint endpoints inside a circular sampling window; n is the number of joint intersections with the circular scanline; dc is the diameter of the circular sampling window. The mean diameter of joint disks was estimated with Equation (20) [31].
E ( d i 2 ) = 1.5 E ( l t 2 )
where di is the diameter of a joint disk. The volume density of joints (ρA) was inferred with Equation (21) [32].
ρ v = ρ A E ( d i ) sin ( γ )
where γ is the angle between a topographic sampling window and the mean joint plane. The number of joint disks in each of the joint sets can be determined according to the volume density. The orientation and diameter distributions of the joint disks are shown in Figure 10. The parameters of the joint disk model built for the rock slope are listed in Table 4. The space distribution of the joint disks in each joint set and the final joint disk model are shown in Figure 11.
The rock quality designation (RQD), which is defined as the percentage of the lengths of intact rock core pieces that are not shorter than 0.1 m, of the rock slope was calculated according to the joint disk model. A total of 300 equally spaced boreholes were drilled in the joint disk model, with 100 boreholes distributed on each of the planes of xy, yz, and zx. Figure 12 displays the layout of the boreholes in the model. The lengths of core pieces between two adjacent joints on the borehole lines were measured to calculate the value of RQD. Figure 13 shows the distribution of the lengths of intact rock core pieces. The average value of RQD is equal to 97.05%. According to Figure 12 and Figure 13 and Table 4, the following points can be concluded. (1) The joints in set 1 are generally subhorizontal, with the mean dip value of 14.7°, while the joints in sets 2 and 3 are nearly vertical, with the mean dip values of 76.6° and 81.5°, respectively. (2) The sizes of the joints in set 1 are the largest in all 3 joint sets, with a mean length of 0.67 m. (3) The rock structure of slope is good, according to the value of RQD. (4) The method of photogrammetry-based rock structure analysis proposed in this study is applicable in real rock engineering.
Despite the promising results of this methodology in the study of rock mass structure, there are several limitations that need to be addressed. A main limitation is the computational resources required to generate 3D point cloud models, which can be a bottleneck when dealing with large outcrops. Additionally, the accuracy of the method heavily depends on the number photos used to generate 3D texture models, which can be a challenging task in some field scenarios. Furthermore, the generated joint models can only provide information about the geometry of the joints, and not their mechanical properties, which are crucial for slope stability analysis. To overcome these limitations, there are several approaches that can be taken. Firstly, we suggest improving the hardware configuration of the computer. Additionally, if feasible, a large rock outcrop can be divided into several smaller models. Secondly, we recommend using unmanned aerial vehicles to capture more photos to solve the issue of insufficient photo data. Moreover, unmanned aerial vehicles can overcome some limitations of certain field conditions, such as inaccessibility or safety concerns. Finally, we recommend conducting indoor mechanical experiments to obtain the mechanical parameters of joints. If conducting mechanical experiments is difficult, the mechanical parameters of joints can be obtained from geological reports.

6. Summary and Conclusions

A low-cost method of obtaining photogrammetry-based, textured, 3D point cloud models was provided with two open-source software programs, Meshroom and Meshlab. A coordinate transformation means of converting model coordinates to physical coordinates was introduced, and the corresponding computer code was supplied. The length accuracy and angle accuracy of a textured 3D point cloud model obtained with the method were verified, taking the data of a total station as the reference. The accuracy of the total station was illustrated by an outdoor experiment. A section of a rock slope located in Dalian city was selected as the case study to represent the processes of textured 3D point cloud model building and the applicability of the method to rock structure estimation. The findings are summarized as follows.
(1)
The accuracy of the total station is enough as a reference for verifying the accuracy of the 3D point cloud model. The accuracy of the point coordinates of the 3D point cloud model could achieve 3.96 mm. The accuracy of the dip, dip direction, and length are 0.315 degrees, 0.69 degrees, and 0.51 mm, respectively, at a distance of 10 m.
(2)
The accuracy of the 3D point cloud model is high enough for engineering applications, taking the coordinates obtained by the total station as a reference. The accuracies of the length, dip, and dip direction are 1.57 mm, 0.38 degrees, and 0.42 degrees, respectively.
(3)
The method of building a photogrammetry-based 3D point cloud model is applicable. A total of 2993 joint traces of the rock slope were successfully extracted, and the rock structure was estimated with a joint disk model built according to the traces.
(4)
The rock structure of the slope is good, according to the value of the rock quality designation. The joints of the slope can be grouped into three sets. The joints in set 1 are generally subhorizontal, with a mean dip value of 14.7°, while the joints in sets 2 and 3 are nearly vertical, with mean dip values of 76.6° and 81.5°, respectively.

Author Contributions

Methodology, T.L.; Writing—review & editing, J.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Natural Science Foundation of China grant number No. U19A2098. The APC was funded by No. U19A2098.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank Zheng Hongchun and Han Ju for their contributions to the data collection and revision processes.

Conflicts of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Appendix A

function [Tranformation_matrix ] = Transformation_Matrix(C_From, C_To)
% C_From is a 4-by-3 row vector. Coordinates of reference points in Meshroom.
% C_To is a 4-by-3 row vector. Coordinates of reference points measured by a total station.
% Tranformation_matrix is a 4*4 matrix. It is used for transforming
% coordinates from Meshroom to Meshlab.
A_From = mean(C_From);
A_To = mean(C_To);
C_From_MN = C_From-A_From;
C_To_MN = C_To-A_To;
sFrom = sqrt(sum(C_From_MN(:).^2)/4);
sTo = sqrt(sum(C_To_MN(:).^2)/4);
s = sTo/sFrom; % Scale factor
C_From_MN = C_From_MN/sFrom;
C_To_MN = C_To_MN/sTo;
H = C_From_MN’*C_To_MN;
R = (H’*H)^0.5*inv(H);
A = s*R;
theory_To = (A*C_From’)’;
T = mean(C_To - theory_To);
Tranformation_matrix(4, 4) = 1;
for i = 1:3
    for j = 1:3
         Tranformation_matrix(i, j) = A(i, j);
    end
end
Tranformation_matrix(1:3, 4) = T’;
Tranformation_matrix(4, 1:3) = [0, 0, 0];
End

References

  1. Wu, X.; Jiang, Y.; Gong, B.; Guan, Z.; Deng, T. Shear performance of rock joint reinforced by fully encapsulated rock bolt under cyclic loading condition. Rock Mech. Rock Eng. 2019, 52, 2681–2690. [Google Scholar] [CrossRef]
  2. Tzamos, S.; Sofianos, A. A correlation of four rock mass classification systems through their fabric indices. Int. J. Rock Mech. Min. Sci. 2007, 44, 477–495. [Google Scholar] [CrossRef]
  3. Bahaaddini, M.; Sharrock, G.; Hebblewhite, B.K. Numerical investigation of the effect of joint geometrical parameters on the mechanical properties of a nonpersistent jointed rock mass under uniaxial compression. Comput. Geotech. 2013, 49, 206–225. [Google Scholar] [CrossRef]
  4. Ban, L.; Zhu, C.; Qi, C.; Tao, Z. New roughness parameters for 3D roughness of rock joints. Bull. Eng. Geol. Environ. 2019, 78, 4505–4517. [Google Scholar] [CrossRef]
  5. Liu, T.; Deng, J.; Zheng, J.; Zheng, L.; Zhang, Z.; Zheng, H. A new semi-deterministic block theory method with digital photogrammetry for stability analysis of a high rock slope in China. Eng. Geol. 2017, 216, 76–89. [Google Scholar] [CrossRef]
  6. Chen, J.Y.; Huang, H.W.; Zhou, M.L.; Chaiyasarn, K. Towards semi-automatic discontinuity characterization in rock tunnel faces using 3D point clouds. Eng. Geol. 2021, 291, 106232. [Google Scholar] [CrossRef]
  7. Deb, D.; Hariharan, S.; Rao, U.M.; Ryu, C.-H. Automatic detection and analysis of discontinuity geometry of rock mass from digital images. Comput. Geosci. 2008, 34, 115–126. [Google Scholar] [CrossRef]
  8. Fujii, Y.; Fodde, E.; Watanabe, K.; Murakami, K. Digital photogrammetry for the documentation of structural damage in earthen archaeological sites: The case of Ajina Tepa, Tajikistan. Eng. Geol. 2009, 105, 124–133. [Google Scholar] [CrossRef] [Green Version]
  9. Fujii, Y.; Shogaki, T.; Miyakawa, M. Photogrammetric documentation and non-invasive investigation of a stone dry dock, the Yokosuka arsenal dry dock no. 1, Japan. Eng. Geol. 2018, 234, 122–131. [Google Scholar] [CrossRef]
  10. Guo, J.; Liu, S.; Zhang, P.; Wu, L.; Zhou, W.; Yu, Y. Towards semi-automatic rock mass discontinuity orientation and set analysis from 3D point clouds. Comput. Geosci. 2017, 103, 164–172. [Google Scholar] [CrossRef]
  11. Sturzenegger, M.; Stead, D. Close-range terrestrial digital photogrammetry and terrestrial laser scanning for discontinuity characterization on rock cuts. Eng. Geol. 2009, 106, 163–182. [Google Scholar] [CrossRef]
  12. Kaminski, M.; Zientara, P.; Krawczyk, M. Electrical resistivity tomography and digital aerial photogrammetry in the research of the “Bachledzki Hill” active landslide–in Podhale (Poland). Eng. Geol. 2021, 285, 106004. [Google Scholar] [CrossRef]
  13. Cheng, Z.; Gong, W.P.; Tang, H.M.; Juang, C.H.; Deng, Q.; Chen, J.; Ye, X. UAV photogrammetry-based remote sensing and preliminary assessment of the behavior of a landslide in Guizhou, China. Eng. Geol. 2021, 289, 106172. [Google Scholar] [CrossRef]
  14. Nappo, N.; Mavrouli, O.; Nex, F.; Van, C.; Gambillara, R.; Michetti, A.M. Use of UAV-based photogrammetry products for semi-automatic detection and classification of asphalt road damage in landslide-affected areas. Eng. Geol. 2021, 294, 106363. [Google Scholar] [CrossRef]
  15. Buyer, A.; Aichinger, S.; Schubert, W. Applying photogrammetry and semiautomated joint mapping for rock mass characterization. Eng. Geol. 2020, 264, 105332. [Google Scholar] [CrossRef]
  16. Menegoni, N.; Giordan, D.; Perotti, C.; Tannant, D. Detection and geometric characterization of rock mass discontinuities using a 3D high-resolution digital outcrop model generated from RPAS imagery-Ormea rock slope, Italy. Eng. Geol. 2019, 252, 145–163. [Google Scholar] [CrossRef]
  17. Lato, M.; Kemeny, J.; Harrap, R.M.; Bevan, G. Rock bench: Establishing a common repository and standards for assessing rockmass characteristics using LiDAR and photogrammetry. Comp. Geosci. 2013, 50, 106–114. [Google Scholar] [CrossRef]
  18. Sturzenegger, M.; Stead, D.; Elmo, D. Terrestrial remote sensing-based estimation of mean trace length, trace intensity and block size/shape. Eng. Geol. 2011, 119, 96–111. [Google Scholar] [CrossRef]
  19. Laribi, A.; Walstra, J.; Ougrine, M.; Seridi, A.; Dechemi, N. Use of digital photogrammetry for the study of unstable slopes in urban areas: Case study of the El Biar landslide, Algiers. Eng. Geol. 2015, 187, 73–83. [Google Scholar] [CrossRef]
  20. Mora, P.; Baldi, P.; Casula, G.; Fabris, M.; Ghirotii, M.; Mazzioni, E.; Pesci, A. Global positioning systems and digital photogrammetry for monitoring of mass movements: Application to the Ca’ di Malta landslide (northern Apennines, Italy). Eng. Geol. 2003, 68, 103–121. [Google Scholar] [CrossRef]
  21. Kabsch, W. A Solution for the Best Rotation to Relate Two Sets of Vectors. Acta. Cryst. A 1976, 32, 922–923. [Google Scholar] [CrossRef]
  22. Robertson, A. The interpretation of geological factors for use in slope theory. In Planning Open Pit Mines: Proceedings of the Symposium on the Theoretical; SAIMM: Johannesburg, South Africa, 1970; pp. 55–71. [Google Scholar]
  23. Baecher, G.B.; Lanney, N.S.; Einstein, H.H. Statistical descriptions of rock properties and sampling. In Proceedings of the 18th US Symposium on Rock Mechanics (USRMS), Golden, CO, USA, 22–24 June 1977; OnePetro: Richardson, TX, USA, 1977. [Google Scholar]
  24. Lei, Q.; Latham, J.P.; Tsang, C.F. The use of discrete fracture networks for modelling coupled geomechanical and hydrological behaviour of fractured rocks. Comput. Geotech. 2017, 85, 151–176. [Google Scholar] [CrossRef]
  25. Liu, T.; Zheng, J.; Deng, J. A new iteration clustering method for rock discontinuity sets considering discontinuity trace lengths and orientations. Bull. Eng. Geol. Environ. 2021, 80, 413–428. [Google Scholar] [CrossRef]
  26. Liu, T.; Jiang, A.; Deng, J.; Zheng, J.; Zhang, Z. A new multiple-factor clustering method considering both box fractal dimension and orientation of joints. J. Rock Mech. Geotech. Eng. 2021, 14, 366–376. [Google Scholar] [CrossRef]
  27. Zhang, W.; Lan, Z.; Ma, Z.; Tan, C.; Que, J.; Wang, F. Determination of statistical discontinuity persistence for a rock mass characterized by non-persistent fractures. Int. J. Rock Mech. Min. Sci. 2020, 126, 104177. [Google Scholar] [CrossRef]
  28. Hammah, R.E.; Curran, J.H. Fuzzy cluster algorithm for the automatic identification of joint sets. Int. J. Rock Mech. Min. Sci. 1998, 35, 889–905. [Google Scholar] [CrossRef]
  29. Ma, G.; Xu, Z.; Zhang, W.; Li, S. An enriched K-means clustering method for grouping joints with meliorated initial centers. Arab. J. Geosci. 2015, 8, 1881–1893. [Google Scholar] [CrossRef]
  30. Mauldon, M.; Dunne, W.M.; Rohrbaugh, M.B. Circular scanlines and circular windows: New tools for characterizing the geometry of fracture traces. J. Struct. Geol. 2001, 23, 247–258. [Google Scholar] [CrossRef]
  31. Nie, Z.; Chen, J.; Zhang, W.; Chun, T. A new method for three-dimensional fracture network modelling for trace data collected in a large sampling window. Rock Mech. Rock Eng. 2019, 53, 1145–1161. [Google Scholar] [CrossRef]
  32. Warburton, P.M. A stereological interpretation of joint trace data. Int. J. Rock Mech. Min. Sci. Geomech. Abstr. 1980, 17, 181–190. [Google Scholar] [CrossRef]
Figure 1. Location of the study site.
Figure 1. Location of the study site.
Applsci 13 04977 g001
Figure 2. Positions of the camera and total station. (Note that the coordinate origin and coordinate system of the study area can be determined after setting up the total station).
Figure 2. Positions of the camera and total station. (Note that the coordinate origin and coordinate system of the study area can be determined after setting up the total station).
Applsci 13 04977 g002
Figure 3. Rock structure identification 2D and 3D comparison image.
Figure 3. Rock structure identification 2D and 3D comparison image.
Applsci 13 04977 g003
Figure 4. Textured 3D point cloud model of the rock slope at the physical scale.
Figure 4. Textured 3D point cloud model of the rock slope at the physical scale.
Applsci 13 04977 g004
Figure 5. Relationship between the normal vector of a joint and its corresponding orientation.
Figure 5. Relationship between the normal vector of a joint and its corresponding orientation.
Applsci 13 04977 g005
Figure 6. Main equipment used in the outdoor experiment.
Figure 6. Main equipment used in the outdoor experiment.
Applsci 13 04977 g006
Figure 7. Trace lines extracted from the textured 3D point cloud model.
Figure 7. Trace lines extracted from the textured 3D point cloud model.
Applsci 13 04977 g007
Figure 8. Poles diagram of the grouping results of the 2993 traces.
Figure 8. Poles diagram of the grouping results of the 2993 traces.
Applsci 13 04977 g008
Figure 9. Traces of joints shown by set and the employed 3D topographic sampling windows.
Figure 9. Traces of joints shown by set and the employed 3D topographic sampling windows.
Applsci 13 04977 g009
Figure 10. Parameters of the three joint sets used in the joint disk model. (a) Poles diagram of the joint disk orientations used in the joint disk model. (b) Diameter distributions of the three joint sets used in the joint disk model.
Figure 10. Parameters of the three joint sets used in the joint disk model. (a) Poles diagram of the joint disk orientations used in the joint disk model. (b) Diameter distributions of the three joint sets used in the joint disk model.
Applsci 13 04977 g010
Figure 11. Joint disk models of the rock slope.
Figure 11. Joint disk models of the rock slope.
Applsci 13 04977 g011
Figure 12. Layout of the boreholes in the joint disk model.
Figure 12. Layout of the boreholes in the joint disk model.
Applsci 13 04977 g012
Figure 13. Distribution of the lengths of intact rock core pieces of the joint disk model.
Figure 13. Distribution of the lengths of intact rock core pieces of the joint disk model.
Applsci 13 04977 g013
Table 1. Results of the outdoor experiment for the accuracy verification of the total station.
Table 1. Results of the outdoor experiment for the accuracy verification of the total station.
No.1234567
Distance between the total station and the measuring pod (m)101010103050100
Orientation obtained by compass (°)Dip direction 277993192285274313
Dip53535451505054
Orientation calculated from coordinates (°)Dip direction277.2010.1993.78192.59286.09275.90314.88
Dip52.6353.6754.1451.0850.8350.5555.25
Distances obtained by vernier caliper (mm)AB174.62
BC178.54
CD246.22
DE175.02
EF173.64
FA240.10
AG211.66
GD217.22
CG215.44
GF209.22
Distances calculated from coordinates (mm)AB174.39174.58174.03174.59173.92174.11172.47
BC178.32177.82179.29178.43178.30178.02176.86
CD245.71246.10245.32246.45246.28244.90249.10
DE175.01174.88174.83174.90174.89175.24175.44
EF173.23173.27173.63173.19173.08172.57173.98
FA239.96240.31239.07241.05239.90240.12239.61
AG212.09212.62210.08212.70211.36211.44213.91
GD217.07217.09217.77217.10217.42216.48216.26
CG214.79213.35216.82215.17215.27214.66215.01
GF208.78209.78208.04208.93208.40209.00207.49
Absolute values of orientation differences (°)Dip direction 0.201.190.780.591.091.901.88
Dip 0.370.670.140.080.830.551.25
Absolute values of distance differences (mm)AB0.230.040.590.030.700.512.15
BC0.220.720.750.110.240.521.68
CD0.510.120.900.230.061.322.88
DE0.010.140.190.120.130.220.42
EF0.410.370.010.450.561.070.34
FA0.140.211.030.950.200.020.49
AG0.430.961.581.040.300.222.25
GD0.150.130.550.120.200.740.96
CG0.652.091.380.270.170.780.43
GF0.440.561.180.290.820.221.73
Mean value (mm)0.320.530.820.360.340.561.33
Table 2. Results of the length accuracy verification for the textured 3D point cloud model.
Table 2. Results of the length accuracy verification for the textured 3D point cloud model.
No.Start Point Series NumberEndpoint Series NumberLength Calculated Based on Coordinates Extracted from Meshlab (m)Length Calculated Based on Coordinates Extracted from Total Station (m)Absolute Value of Difference of Two Lengths (mm)
151820.998621.00021.6
261920.947320.94660.7
372021.056421.05640.0
48217.53967.54050.9
59226.33636.33892.6
610235.56855.56533.2
711247.22917.22860.5
812257.29487.29321.6
9132611.567411.56931.9
1014279.89539.89361.7
1115286.66016.66373.7
1216294.35434.35460.3
1317304.66184.66011.7
Mean value 1.57
Table 3. Results of the angle accuracy verification for the textured 3D point cloud model.
Table 3. Results of the angle accuracy verification for the textured 3D point cloud model.
No.Point Series NumbersOrientation Calculated Based on Coordinates Extracted from Meshlab (°)Orientation Calculated Based on Coordinates Obtained from Total Station (°)Absolute Value of Difference of Two Orientations (°)
DipDip DirectionDipDip DirectionDipDip Direction
15, 6, 768.2157.267.7157.50.50.3
210, 11, 1268.7203.168.4203.70.30.6
315, 16, 1786.5157.286.7157.20.20.0
418, 19, 2078.9342.379.6341.80.70.5
521, 22, 2371.2153.571.4152.80.20.7
Mean value 0.380.42
Table 4. Parameters used in the joint disk model of the rock slope.
Table 4. Parameters used in the joint disk model of the rock slope.
Joint Set SeriesVolume Density (m−3)Orientation
(Fisher Distribution)
Diameter
(Lognormal Distribution)
Dip Direction (°)Dip (°)KFMean Value (m)Variance (m2)
13.02335.614.712.00.671.28
27.86179.476.67.10.380.22
33.9990.181.58.10.310.12
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, T.; Deng, J. Photogrammetry-Based 3D Textured Point Cloud Models Building and Rock Structure Estimation. Appl. Sci. 2023, 13, 4977. https://doi.org/10.3390/app13084977

AMA Style

Liu T, Deng J. Photogrammetry-Based 3D Textured Point Cloud Models Building and Rock Structure Estimation. Applied Sciences. 2023; 13(8):4977. https://doi.org/10.3390/app13084977

Chicago/Turabian Style

Liu, Tiexin, and Jianhui Deng. 2023. "Photogrammetry-Based 3D Textured Point Cloud Models Building and Rock Structure Estimation" Applied Sciences 13, no. 8: 4977. https://doi.org/10.3390/app13084977

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop