Next Article in Journal
Effects of Fe(III) Oxide Mineralogy and Phosphate on Fe(II) Secondary Mineral Formation during Microbial Iron Reduction
Next Article in Special Issue
Geological Mapping Using Drone-Based Photogrammetry: An Application for Exploration of Vein-Type Cu Mineralization
Previous Article in Journal
Quantitative Analyses of Urinary Uranium by µ-PIXE
Previous Article in Special Issue
Monitoring and Controlling Saturation Zones in Heap Leach Piles Using Thermal Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Systematic Review of Machine Learning Applications in Mining: Exploration, Exploitation, and Reclamation

Department of Energy Resources Engineering, Pukyong National University, Busan 48513, Korea
*
Author to whom correspondence should be addressed.
Minerals 2021, 11(2), 148; https://doi.org/10.3390/min11020148
Submission received: 8 December 2020 / Revised: 20 January 2021 / Accepted: 27 January 2021 / Published: 31 January 2021

Abstract

:
Recent developments in smart mining technology have enabled the production, collection, and sharing of a large amount of data in real time. Therefore, research employing machine learning (ML) that utilizes these data is being actively conducted in the mining industry. In this study, we reviewed 109 research papers, published over the past decade, that discuss ML techniques for mineral exploration, exploitation, and mine reclamation. Research trends, ML models, and evaluation methods primarily discussed in the 109 papers were systematically analyzed. The results demonstrated that ML studies have been actively conducted in the mining industry since 2018, mostly for mineral exploration. Among the ML models, support vector machine was utilized the most, followed by deep learning models. The ML models were evaluated mostly in terms of their root mean square error and coefficient of determination.

1. Introduction

Humans learn from their day-to-day lives owing to their ability to think; for example, they can learn from an education or from their thoughts and memories. However, computers learn through algorithms, unlike humans. This is called machine learning (ML). ML uses computer algorithms to simulate human learning and allows computers to identify and acquire knowledge from the real world, thereby improving the performance of certain tasks based on the newly acquired knowledge. Precisely, ML is defined as follows: “A computer program is said to learn from experience E corresponding to certain class of tasks T and performance measure P, if its performance at tasks T, as measured by P, improves with experience E” [1]. Although initial concepts of ML originated in the 1950s, ML was considered as an independent field in the 1990s [1]. ML algorithms are used in the fields of computer [2,3], health [4], environment [5], medicine [6,7], energy [8], and services [9].
Smart mining is being considered in the mining industry. Smart mining technology is the introduction of cutting-edge information and communication technologies, such as Internet of Things (IoT), big data, mobile, artificial intelligence (AI), augmented reality, and virtual reality, in the field of mineral resource development [10]. Because of the development of smart mining technologies, a large amount of data is being produced, collected, and shared in real time. The availability of various data—such as drilling data, data received from sensors, and measurement data—development of AI techniques, advancement of computation skills of computers, and ML have gathered attention to data science in the mining field.
Various projects are being implemented to apply ML at mining sites. To obtain additional gold deposits from the Red Lake mine in Canada, geologists at Goldcorp used IBM’s Watson Artificial Intelligence Supercomputer to interpret the exploration data and then discover new minerals [11,12]. Manufacturers of heavy equipment for construction and mining, such as Komatsu and NVIDIA, implemented joint projects to help identify workers and equipment at mining sites. The technologies developed can identify inefficient equipment and keep workers safe [13]. Newtrax, a company that provides safety and operational management system services in underground mines, and IVADO, a Canadian artificial intelligence research institute, are collaborating on pilot projects to collect big data from sensors installed in mining equipment, analyze data via ML to predict when mining equipment has failed and requires maintenance [14,15].
In [16,17,18,19], ML applications have been reviewed for mineral processing as well as soft computing technology in exploration, digitalization trends in the mining industry, and automation in the mining sector. However, the study lacks a systematic review of ML applications in mining, which includes mineral exploration, exploitation, and mine reclamation.
Therefore, this study systematically reviews the methods used by ML research projects and their implementations in the mining field. The ML research trends, ML models and ML model evaluation metrics used in research projects are mainly examined. It should be noted that the ML research projects for mineral processing were not considered in this study because their reviews were already reported in the literature [16].

2. Methods for Systematic Review

A systematic literature review (often referred to as systematic review) facilitates the identification, evaluation, and interpretation of all the available research related to a particular research question, subject, or a phenomenon [20]. The review intends to provide solutions to research related questions.
In this study, research questions were initially organized to define the scope and overall objectives of the analysis. Subsequently, a search method was designed to efficiently find research papers related to the research questions, which was followed by the establishment of standards to select suitable studies from the search results. Later, the abstract and results of the papers were examined to find their relevance in the research field. The process was followed by the data extraction from the paper to distinguish and structure the related information as follows:
-
RQ 1: What are the ML research trends in the mining industry (yearly, publication sources, detailed application fields)?
-
RQ 2: Which ML models were used in your research (data type, large data, model usage frequency, detailed application in the field)?
-
RQ 3: How did you evaluate the ML models (model evaluation data, evaluation metrics, quantification of the evaluation results by models)?
The primary purpose of this review was to report the current status of ML usage in the mining sector. Research questions were selected according to the purpose. RQ 1 aimed at describing the trends in ML research in the mining field. Comprehensively, it referred to the current status of the yearly thesis publication and their detailed applications in the field. RQ 2 classified the ML model used in the study. Specifically, it referred to the learning data type, utilization of a large amount of data, and usage frequency of the model and its detailed application in the field. RQ 3 analyzed the evaluation of ML models. In detail, it referred to ML model evaluation data, evaluation metrics, and evaluation results by the model.

2.1. Search Method

We used Google and Scopus as search engines. We derived search keywords related to the subject of this review: mine, mineral, machine learning, deep learning, open-pit, underground mine. The keywords, machine learning and deep learning, were used to find papers that use ML and deep learning methods among various research methods. The rest of the keywords defined the field. To analyze research trends of the past decade, only the research projects that were conducted between January 2011 and September 2020 were considered. We secured 264 candidate papers using the described method.

2.2. Selection Criteria

Published papers can be considered to have met the criteria of originality, high influence, and high standards. This is because such manuscripts are reviewed by experts and then revised accordingly before publication. Therefore, we have chosen published papers. The selection criteria were as follows: (1) research papers; (2) full-text; (3) mineral processing exclusion. These criteria were chosen because of the following reasons: only research papers were used to analyze current status of ML, and full-text enabled an accurate analysis of the content of the paper. The mineral processing was excluded because a few recent studies had reviewed and published on the subject of ML applications in mineral processing [16].
The search results database included 263 papers. Because of the first criterion, the number of related papers decreased to 251. The second criterion decreased the number to 249. After three steps, 109 papers were selected, as shown in Figure 1.

3. Results

3.1. RQ 1: ML Research Trends in the Mining Industry

3.1.1. Publication Year

To examine the research trends, we decided to inspect the publication year of the research papers as an initial step. Figure 2 shows the distribution of research from January 2011 to September 2020. It exhibits an intense upward trend for the last three years. It can be observed that 51 out of 109 papers were studied before 2018. The number of studies conducted in 2018, 2019, and September 2020 were 18, 28, and 12, respectively. In 2018, the number of articles published were three times higher than the previous year. Research conducted in the last three years accounted for approximately 53% of the total research conducted in the last ten years.

3.1.2. Publication Source

Several research papers have been published in various journals. Table 1 summarizes the details of the publications in top journals along with the number of papers published. The highest number of papers were found in Natural Resources Research, Ore Geology Reviews, Applied Sciences, followed by others.

3.1.3. Detailed Fields of Application

We analyzed the fields involving active research. For the classification of work, a technical map of the mining sector was created. The first stage included three stages of the mining process, which were exploration, exploitation, and reclamation. Each item was classified in detail. The second stage consisted of mineral exploration and targeting, and mine planning and evaluation under the exploration phase. The exploitation phase was classified as drilling and blasting, equipment management, geotechnical management, and mine safety. The reclamation phase was divided into land cover (monitoring) and mine hazard (assessment). In the third stage, we added related fields under the second stage item. Using 109 papers, we divided the mining field into 34 fields, as shown in Figure 3.
In the first stage of classification of the mining process, 59 studies were conducted in the exploitation stage (shown in Figure 4). Figure 5 shows the research status of the items in the third stage of classification. A total of eleven studies related to mineral prospectivity modeling and mapping in the field of exploration, ten studies related to ground vibration prediction in the field of exploitation, and six studies related to soil and water pollution in the stage of reclamation were conducted.
The research status of each field was examined as the elements of second stage. In the field of mineral exploration and targeting, a geochemical anomaly detection [21] study that uses the exploration data to detect geochemical abnormalities was conducted. Geological mapping [22,23,24] studies were conducted using the characteristics of rocks. A mineral analysis [25,26,27,28,29,30,31] was conducted using drilling data or samples. A mineral prospectivity modeling and mapping [32,33,34,35,36,37,38,39,40,41,42] study was performed to evaluate the potential of minerals using the exploration data.
In the areas of mine planning and evaluation, research on cost estimation was performed [43,44] to predict mine operation expenses and mine planning [45,46,47] to optimize the mine design. Reserve estimation [48,49] research was conducted that considered the reserves and economic values required for mine operations.
In the drilling and blasting items, air overpressure prediction [50,51], backbreak prediction [52,53,54], flyrock prediction [55,56,57,58], flyrock prediction and air overpressure prediction [59], ground vibration prediction [60,61,62,63,64,65,66,67,68,69], and rock fragmentation estimation [70] were performed to investigate the changes in the barometric pressure, vibration, monument, and earthquake created while drilling and blasting. A damage prediction [71,72] study was conducted, wherein the damage caused to the surrounding residential areas by a blasting from an open-pit mine was predicted [71].
In the equipment management category, a fault diagnosis [73,74] study that diagnosed equipment defects was performed. Haulage operations [75,76,77,78,79] and navigation [80] studies were conducted to optimize the transportation means, such as trucks and loaders, and to indicate the travelling mode of equipment, respectively. Predictive maintenance [81] study was performed to enhance the mine operation efficiency by predicting the equipment failure.
In the ground management category, a pillar stability prediction [82] technique predicted the stability of underground mine columns. Rockburst prediction [83,84,85] was performed to classify and predict the explosion of rocks by using the characteristics and time data of the exploded rocks. Slope management [86,87,88,89,90] studies were conducted to predict the slope deformation of the mine and to evaluate its stability. The waste backfill design [91,92,93] predicted the design and strength of the backfill.
In the mine safety item, a study on the drainage control [94,95,96,97] was conducted to predict the groundwater level or the inflow of mines. Dust control studies evaluated and predicted the air quality of mines [98,99,100]. A study predicted the occurrence of an earthquake [101,102] by considering the time data of the increasing seismic activity in coal mines. A gas control [103,104,105] study was conducted to predict the generation of hazardous gases in mines. There were studies on occupational safety [106,107] that detected the equipment and predicted accident probabilities, thereby preventing accidents and facilitating the designing of suitable ventilations [108].
In the area of land surface detection, change detection [109,110,111,112,113] and land cover mapping [114,115,116,117] studies were performed to detect the land surface that changed during mine operation, and to classify the surface composition, respectively.
In the mine risk assessment section, an environmental assessment [118] study assessed and classified the geographical environmental quality. Several studies were conducted to assess and map the risk of landslides [119,120] and mine subsidence [121,122,123]. A study was conducted to predict and evaluate soil and water pollution [124,125,126,127,128,129] caused by the mine operation.

3.2. RQ 2: ML Models

3.2.1. Data set type

Several data sets have been used in ML studies. The data were acquired either from publicly available open-sources or individually in the case of private data. Therefore, the data were classified into the data that can be acquired directly used in the field, the data that must be acquired in the field, followed by a laboratory processing, and can later be used publicly. Open-source data sets used are publicly available or are private in nature (such as RapidEye, NASA, and Minto) [2]. In a study, research was conducted using various data. Therefore, the total number of data utilization was 121. The highest number of used data was 57, which were acquired from an open source (Figure 6).

3.2.2. Big Data

Big data is typically from 1 terabyte to 1 petabyte of data and comprises structured data (e.g., tables of numbers) and unstructured data (e.g., photos and documents) [130]. In other words, it is a technology that utilizes a lot of data. ML algorithms, by definition, improve their performances with access to additional data [8]. Therefore, data influences the research involving ML. A large amount of data is beneficial and can be applied to varying sites and laboratories. Therefore, we considered studies that had discussions or comments on big data. Table 2 presents the number of studies that include or mention big data in their manuscripts.

3.2.3. ML Models

Based on the selected paper, the ML model was classified. In a particular study, studies used various models to compare models. As a result of analyzing the studies, the total number of models used was found to be 255. The models were categorized into a total of 12 types: deep learning, ensemble, clustering, dimensionality reduction, genetic algorithms, neural network, bayesian, decision tree, instance based, regression, support vector machine (SVM), and gaussian process. Figure 7 represents the classification details of ML technique. Figure 8 indicates the usage frequency of ML models in the study. The most frequently used models were SVM (n = 58), deep leaning (n = 56) and ensemble (n = 56) (Figure 8). Figure 9 shows the distribution of the ML technologies; a minimum of three model categories are based on each of the technologies.

3.2.4. ML Model Used for Specific Purposes in Mining

We compared stage two items in mining with 12 ML models and examined the usage frequencies of models in each field. In mineral exploration and targeting, ensemble and decision tree methods were extensively used in mine planning and evaluation. Deep learning was primarily used in drilling and blasting, equipment management, ensemble in geotechnical management, and mine safety. In several cases, SVMs were used in land cover monitoring and mine hazard assessment. In the third stage of mining process, ensemble, deep learning, and SVM methods were used in the exploration stage, exploitation stage, and reclamation stage, respectively (Figure 10).

3.3. RQ 3: ML Model Evaluation

3.3.1. Model Evaluation Data

Data were required to evaluate the performance of ML models. After training an ML model, data were provided to evaluate the accuracy of the model; these data include training data for realizing ML, validation data, and test data. Validation data are used for verification purposes to select the most suitable model among all ML models. Test data are used to determine how well the selected ML model works [131]. The data used to evaluate the model were used in 75 studies (Figure 11). Finally, to measure the performance of the model, evaluation metrics were utilized.

3.3.2. Model Evaluation Metrics

Evaluation metrics are used to compare and evaluate the developed ML model and various statistical techniques. The evaluation indices depend on the purpose of the ML model. ML models used for classification (e.g., prediction of ore production and crusher utilization [76] and prediction of flyrock in open-pit blasting operations [57]) are generally evaluated in terms of the receiver operating characteristic/area under the curve (AUC) or confusion matrix. Models associated with regression (e.g., to estimate the cost of a mine, the cost is estimated using various variables such as the capacity of the mine and the distance from the railroad [43,44]) are generally evaluated in terms of the mean squared error (MSE), mean absolute error (MAE), or coefficient of determination (R) [2]. However, several studies have used similar evaluation metrics without considering the purpose of the ML model, as shown in Figure 12. A total of 30 evaluation matrices were used: coverage, negative predict value, positive predict value, specificity, sensitivity, support, Pearson correlation, relative absolute error, MSE, mean absolute difference, least mean square, fractional error, error, corresponding to relative errors, rank probability skill score, root mean square error (RMSE), MAE, F-measure, recall, precision, F1-score, AUC, kappa, accuracy, R, multivariate adaptive regression spline, variant allelic frequencies, median absolute error, mean absolute percentage error, and root relative squared error.
A total of 34 studies used RMSE, making it the method with the highest number of applications, followed by the R, accuracy, MAE, and AUC. An ideal prediction is represented by R = 1.0, RMSE and MAE = 0, and AUC = 1.0 [132]. The evaluation metrics results of each ML model of five evaluation indicators used in several studies were summarized using Boxplot (shown in Figure 13, Figure 14, Figure 15, Figure 16 and Figure 17). This enabled us to analyze the overall evaluation metrics of ML techniques. In terms of RMSE, deep learning performed best with an average of 0.000608 calculated based on 34 studies, followed by the SVM and ensemble models. However, the model that exhibited the worst performance was deep learning. Based on the 35 papers using R, SVM performed best with an average of 0.996, followed by ensemble and deep learning. Based on the 25 studies wherein the evaluation index was accuracy, SVM performed best with an average of 1.0, followed by ensemble and deep learning. Based on the 22 papers considering MAE, deep learning exhibited the best performance with an average of 0.009, followed by SVM and regression. In the 11 papers considering AUC, the best-performing model was ensemble with an average of 0.96, followed by Bayesian and decision tree.

4. Conclusions

Systematic reviews were conducted to examine the current trends in ML research related to the mining industry and analyze previous studies in the specific subject areas. The review provides an overview of the research conducted so far and assistance for future research.
The answers for research questions are summarized as follows:
-
Several studies have been conducted since 2018, and the highest number of studies have been conducted in the drilling and blasting items in the exploitation stage.
-
The research was conducted using the open-source data predominantly. Ensemble, deep learning, and SVM were extensively used in the fields of exploration, exploitation, and reclamation, respectively.
-
The ML model was evaluated using test data, and the evaluation metrics used were RMSE, R, accuracy, MAE and AUC.
Since 2018, several studies have been conducted on ML techniques in the mining industry, demonstrating the increased attention ML-related research has been receiving. In addition, the fact that research is being actively conducted in the fields of drilling and blasting shows that a large amount of corresponding data is now available. We employed open-source data that are relatively easy to obtain. Open-source data based on ML techniques can be easily accessed by researchers. An ML model can be effectively selected by considering the research purpose to improve the performance of the model. Ensemble, deep learning, and SVM are commonly used because these models can be configured in various manners according to their purpose. To evaluate the performance of the ML model, an evaluation index can be selected according to the objective of the study. If the aim is to reduce error, you can choose RMSE and MAE; to evaluate accuracy, accuracy and AUC; to compare model performances, R.

Author Contributions

Conceptualization, Y.C.; Methodology, Y.C.; Software, D.J.; Validation, D.J.; Formal Analysis, D.J.; Investigation, Y.C.; Resources, Y.C.; Data Curation, D.J.; Writing—Original Draft Preparation, D.J.; Writing—Review & Editing, Y.C.; Visualization, D.J.; Supervision, Y.C.; Project Administration, Y.C.; Funding Acquisition, Y.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the KETEP grant funded by the Korea Government’s Ministry of Trade, Industry and Energy (project no. 20182510102370).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Michalski, R.S.; Carbonell, J.G.; Mitchell, T.M. Machine Learning: An Artificial Intelligence Approach; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  2. Malhotra, R. A systematic review of machine learning techniques for software fault prediction. Appl. Soft Comput. 2015, 27, 504–518. [Google Scholar] [CrossRef]
  3. Handelman, G.S.; Kok, H.K.; Chandra, R.V.; Razavi, A.H.; Huang, S.; Brooks, M.; Lee, M.J.; Asadi, H. Peering Into the Black Box of Artificial Intelligence: Evaluation Metrics of Machine Learning Methods. Am. J. Roentgenol. 2019, 212, 38–43. [Google Scholar] [CrossRef] [PubMed]
  4. Spasić, I.; Nenadic, G. Clinical Text Data in Machine Learning: Systematic Review. JMIR Med. Inform. 2020, 8, e17984. [Google Scholar] [CrossRef] [PubMed]
  5. Bellinger, C.; Jabbar, M.S.M.; Zaiane, O.; Osornio-Vargas, A.R. A systematic review of data mining and machine learning for air pollution epidemiology. BMC Public Heal. 2017, 17, 1–19. [Google Scholar] [CrossRef] [Green Version]
  6. Senders, J.T.; Staples, P.C.; Karhade, A.V.; Zaki, M.M.; Gormley, W.B.; Broekman, M.; Smith, T.R.; Arnaout, O. Machine Learning and Neurosurgical Outcome Prediction: A Systematic Review. World Neurosurg. 2018, 109, 476–486e1. [Google Scholar] [CrossRef]
  7. Palaniappan, R.; Sundaraj, K.; Ahamed, N.U. Machine learning in lung sound analysis: A systematic review. Biocybern. Biomed. Eng. 2013, 33, 129–135. [Google Scholar] [CrossRef]
  8. Mosavi, A.; Salimi, M.; Ardabili, S.F.; Rabczuk, T.; Shamshirband, S.; Varkonyi-Koczy, A.R. State of the Art of Machine Learning Models in Energy Systems, a Systematic Review. Energies 2019, 12, 1301. [Google Scholar] [CrossRef] [Green Version]
  9. Portugal, I.; Alencar, P.S.C.; Cowan, D. The use of machine learning algorithms in recommender systems: A systematic review. Expert Syst. Appl. 2018, 97, 205–227. [Google Scholar] [CrossRef] [Green Version]
  10. Choi, Y.; Lee, H.W. Trends in Mineral Resources Development Technology Using Artificial Intelligence. ITFIND 2020, 1935, 13–24. [Google Scholar]
  11. MINING. Goldcorp partners with IBM to hunt for exploration targets at Red Lake. 2017. Available online: www.mining.com/goldcorppartners-ibm-hunt-exploration-targets-red-lake/ (accessed on 15 February 2019).
  12. CIM Magazine. Revving up. 2018. Available online: magazine.cim.org/en/technology/revving-up-en/ (accessed on 15 February 2019).
  13. Forbes. NVIDIA and Komatsu Partner on AI-Based Intelligent Equipment for Improved Safety and Efficiency. 2017. Available online: www.forbes.com/sites/tiriasresearch/2017/12/12/nvidia-and-komatsu-partner-on-ai-based-intelligent-equipment/#63ad3365665b (accessed on 15 February 2019).
  14. Mining Magazine. NEWTRAX. 2018. Available online: www.miningmagazine.com/partners/partner-content/1332132/the-future-of-mining-isunderground (accessed on 15 February 2019).
  15. Newtrax. Newtrax Makes the Cover of Mining Magazine’s ’The Future of Mining’ Issue. 2018. Available online: www.newtrax.com/miningmagazine-cover-future-of-mining/ (accessed on 15 February 2019).
  16. McCoy, J.; Auret, L. Machine learning applications in minerals processing: A review. Miner. Eng. 2019, 132, 95–109. [Google Scholar] [CrossRef]
  17. Ali, D.; Frimpong, S. Artificial intelligence, machine learning and process automation: Existing knowledge frontier and way forward for mining sector. Artif. Intell. Rev. 2020, 53, 6025–6042. [Google Scholar] [CrossRef]
  18. Jang, H.; Topal, E. A review of soft computing technology applications in several mining problems. Appl. Soft Comput. 2014, 22, 638–651. [Google Scholar] [CrossRef]
  19. Barnewold, L.; Lottermoser, B.G. Identification of digital technologies and digitalisation trends in the mining industry. Int. J. Min. Sci. Technol. 2020, 30, 747–757. [Google Scholar] [CrossRef]
  20. Keele, S. Guidelines for Performing Systematic Literature Reviews in Software Engineering: Technical Report Ver. 2.3; EBSE Technical Report. EBSE-200; EBSE: Durham, UK, 2007; p. 6. [Google Scholar]
  21. Zhang, S.; Xiao, K.; Carranza, E.J.M.; Yang, F.; Zhao, Z. Integration of auto-encoder network with density-based spatial clustering for geochemical anomaly detection for mineral exploration. Comput. Geosci. 2019, 130, 43–56. [Google Scholar] [CrossRef]
  22. Beretta, F.; Rodrigues, A.L.; De Lemos, P.R.; Costa, J.F.C.L. Automated lithological classification using UAV and machine learning on an open cast mine. Appl. Earth Sci. 2019, 128, 79–88. [Google Scholar] [CrossRef]
  23. Bérubé, C.L.; Olivo, G.R.; Chouteau, M.; Perrouty, S.; Shamsipour, P.; Enkin, R.J.; Morris, W.A.; Feltrin, L.; Thiémonge, R. Predicting rock type and detecting hydrothermal alteration using machine learning and petrophysical properties of the Canadian Malartic ore and host rocks, Pontiac Subprovince, Québec, Canada. Ore Geol. Rev. 2018, 96, 130–145. [Google Scholar] [CrossRef]
  24. Schneider, S.; Melkumyan, A.; Murphy, R.J.; Nettleton, E. Classification of Hyperspectral Imagery Using GPs and the OAD Covariance Function with Automated Endmember Extraction. In Proceedings of the 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence, Washington, DC, USA, 7–9 November 2011. [Google Scholar]
  25. Schnitzler, N.; Ross, P.-S.; Gloaguen, E. Using machine learning to estimate a key missing geochemical variable in mining exploration: Application of the Random Forest algorithm to multi-sensor core logging data. J. Geochem. Explor. 2019, 205, 106344. [Google Scholar] [CrossRef]
  26. Acosta, I.C.C.; Khodadadzadeh, M.; Tusa, L.; Ghamisi, P.; Gloaguen, R. A Machine Learning Framework for Drill-Core Mineral Mapping Using Hyperspectral and High-Resolution Mineralogical Data Fusion. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2019, 12, 4829–4842. [Google Scholar] [CrossRef]
  27. Rahman, A.; Shahriar, S.; Timms, G.; Lindley, C.A.; Davie, A.B.; Biggins, D.; Hellicar, A.; Sennersten, C.; Smith, G.; Coombe, M. A machine learning approach to find association between imaging features and XRF signatures of rocks in underground mines. In 2015 IEEE SENSORS; IEEE: Piscataway, NJ, USA, 2015; pp. 1–4. [Google Scholar]
  28. Rahman, A.; Timms, G.; Shahriar, S.; Sennersten, C.; Davie, A.; Lindley, C.A.; Hellicar, A.D.; Smith, G.; Biggins, D.; Coombe, M. Association Between Imaging and XRF Sensing: A Machine Learning Approach to Discover Mineralogy in Abandoned Mine Voids. IEEE Sens. J. 2016, 16, 4555–4565. [Google Scholar] [CrossRef]
  29. Hood, S.B.; Cracknell, M.J.; Gazley, M.F. Linking protolith rocks to altered equivalents by combining unsupervised and supervised machine learning. J. Geochem. Explor. 2018, 186, 270–280. [Google Scholar] [CrossRef]
  30. Díez-Pastor, J.-F.; Jorge-Villar, S.E.; Arnaiz-González, Á.; García-Osorio, C.; Díaz-Acha, Y.; Campeny, M.; Bosch, J.; Melgarejo, J.C. Machine learning algorithms applied toRaman spectra for the identification of variscite originating from the mining complex of Gavà. J. Raman Spectrosc. 2020, 51, 1563–1574. [Google Scholar] [CrossRef]
  31. Kaplan, U.E.; Topal, E. A New Ore Grade Estimation Using Combine Machine Learning Algorithms. Minerals 2020, 10, 847. [Google Scholar] [CrossRef]
  32. Yeomans, C.M.; Shail, R.K.; Grebby, S.; Nykänen, V.; Middleton, M.; Lusty, P.A. A machine learning approach to tungsten prospectivity modelling using knowledge-driven feature extraction and model confidence. Geosci. Front. 2020, 11, 2067–2081. [Google Scholar] [CrossRef]
  33. Li, S.; Chen, J.; Xiang, J. Applications of deep convolutional neural networks in prospecting prediction based on two-dimensional geological big data. Neural Comput. Appl. 2019, 32, 2037–2053. [Google Scholar] [CrossRef]
  34. Sun, T.; Chen, F.; Zhong, L.; Liu, W.; Wang, Y. GIS-based mineral prospectivity mapping using machine learning methods: A case study from Tongling ore district, eastern China. Ore Geol. Rev. 2019, 109, 26–49. [Google Scholar] [CrossRef]
  35. Zhang, N.; Zhou, K.; Li, N. Back-propagation neural network and support vector machines for gold mineral prospectivity mapping in the Hatu region, Xinjiang, China. Earth Sci. Inform. 2018, 11, 553–566. [Google Scholar] [CrossRef]
  36. Granek, J.; Haber, E. Data mining for real mining: A robust algorithm for prospectivity mapping with uncertainties. In Proceedings of the 2015 SIAM International Conference on Data Mining, Vancouver, BC, Canada, 30 April–2 May 2015; Society for Industrial & Applied Mathematics (SIAM): Philadelphia, PA, USA, 2015; pp. 145–153. [Google Scholar]
  37. Carranza, E.J.M.; Laborte, A.G. Data-driven predictive mapping of gold prospectivity, Baguio district, Philippines: Application of Random Forests algorithm. Ore Geol. Rev. 2015, 71, 777–787. [Google Scholar] [CrossRef]
  38. Xiong, Y.; Zuo, R.; Carranza, E.J.M. Mapping mineral prospectivity through big data analytics and a deep learning algorithm. Ore Geol. Rev. 2018, 102, 811–817. [Google Scholar] [CrossRef]
  39. Carranza, E.J.M.; Laborte, A.G. Random forest predictive modeling of mineral prospectivity with small number of prospects and data with missing values in Abra (Philippines). Comput. Geosci. 2015, 74, 60–70. [Google Scholar] [CrossRef]
  40. Zuo, R.; Carranza, E.J.M. Support vector machine: A tool for mapping mineral prospectivity. Comput. Geosci. 2011, 37, 1967–1975. [Google Scholar] [CrossRef]
  41. Tessema, A. Mineral Systems Analysis and Artificial Neural Network Modeling of Chromite Prospectivity in the Western Limb of the Bushveld Complex, South Africa. Nat. Resour. Res. 2017, 26, 465–488. [Google Scholar] [CrossRef]
  42. Rodríguez-Galiano, V.; Sanchez-Castillo, M.; Chicaolmo, M.; Chica-Rivas, M. Machine learning predictive models for mineral prospectivity: An evaluation of neural networks, random forest, regression trees and support vector machines. Ore Geol. Rev. 2015, 71, 804–818. [Google Scholar] [CrossRef]
  43. Guo, H.; Nguyen, H.; Vu, D.-A.; Bui, X.-N. Forecasting mining capital cost for open-pit mining projects based on artificial neural network approach. Resour. Policy 2019, 101474. [Google Scholar] [CrossRef]
  44. Nourali, H.; Osanloo, M. A regression-tree-based model for mining capital cost estimation. Int. J. Min. Reclam. Environ. 2020, 34, 88–100. [Google Scholar] [CrossRef]
  45. Ajak, A.D.; Lilford, E.; Topal, E. Application of predictive data mining to create mine plan flexibility in the face of geological uncertainty. Resour. Policy 2018, 55, 62–79. [Google Scholar] [CrossRef]
  46. Paduraru, C.; Dimitrakopoulos, R. Responding to new information in a mining complex: Fast mechanisms using machine learning. Min. Technol. 2019, 128, 129–142. [Google Scholar] [CrossRef] [Green Version]
  47. Khorolskyi, A.O.; Hrinov, V.; Mamaikin, O.; Demchenko, Y. Models and methods to make decisions while mining production scheduling. Min. Miner. Depos. 2019, 13, 53–62. [Google Scholar] [CrossRef] [Green Version]
  48. Asa, E. Machine learning characterization of a two-seam coal deposit. J. Min. Sci. 2011, 47, 761–770. [Google Scholar] [CrossRef]
  49. Ming, J.; Zhang, L.; Sun, J.; Zhang, Y. Analysis models of technical and economic data of mining enterprises based on big data analysis. In Proceedings of the 2018 IEEE 3rd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), Chengdu, China, 20–22 April 2018; pp. 224–227. [Google Scholar]
  50. Nguyen, H.; Bui, X.-N. Predicting Blast-Induced Air Overpressure: A Robust Artificial Intelligence System Based on Artificial Neural Networks and Random Forest. Nat. Resour. Res. 2019, 28, 893–907. [Google Scholar] [CrossRef]
  51. Hasanipanah, M.; Shahnazar, A.; Amnieh, H.B.; Armaghani, D.J. Prediction of air-overpressure caused by mine blasting using a new hybrid PSO–SVR model. Eng. Comput. 2017, 33, 23–31. [Google Scholar] [CrossRef]
  52. Khandelwal, M.; Monjezi, M. Prediction of Backbreak in Open-Pit Blasting Operations Using the Machine Learning Method. Rock Mech. Rock Eng. 2012, 46, 389–396. [Google Scholar] [CrossRef]
  53. Sari, M.; Ghasemi, E.; Ataei, M. Stochastic Modeling Approach for the Evaluation of Backbreak due to Blasting Operations in Open Pit Mines. Rock Mech. Rock Eng. 2013, 47, 771–783. [Google Scholar] [CrossRef]
  54. Jang, H.; Topal, E.; Kawamura, Y. Decision support system of unplanned dilution and ore-loss in underground stoping operations using a neuro-fuzzy system. Appl. Soft Comput. 2015, 32, 1–12. [Google Scholar] [CrossRef]
  55. Guo, H.; Zhou, J.; Koopialipoor, M.; Armaghani, D.J.; Tahir, M.M. Deep neural network and whale optimization algorithm to assess flyrock induced by blasting. Eng. Comput. 2021, 37, 173–186. [Google Scholar] [CrossRef]
  56. Amini, H.; Gholami, R.; Monjezi, M.; Torabi, S.R.; Zadhesh, J. Evaluation of flyrock phenomenon due to blasting operation by support vector machine. Neural Comput. Appl. 2011, 21, 2077–2085. [Google Scholar] [CrossRef]
  57. Manoj, K.; Monjezi, M. Prediction of flyrock in open pit blasting operation using machine learning method. Int. J. Min. Sci. Technol. 2013, 23, 313–316. [Google Scholar] [CrossRef]
  58. Lu, X.; Hasanipanah, M.; Brindhadevi, K.; Amnieh, H.B.; Khalafi, S. ORELM: A Novel Machine Learning Approach for Prediction of Flyrock in Mine Blasting. Nat. Resour. Res. 2020, 29, 641–654. [Google Scholar] [CrossRef]
  59. Monjezi, M.; Khoshalan, H.A.; Varjani, A.Y. Prediction of flyrock and backbreak in open pit blasting operation: A neuro-genetic approach. Arab. J. Geosci. 2012, 5, 441–448. [Google Scholar] [CrossRef]
  60. Fang, Q.; Nguyen, H.; Bui, X.-N.; Nguyen-Thoi, T. Prediction of Blast-Induced Ground Vibration in Open-Pit Mines Using a New Technique Based on Imperialist Competitive Algorithm and M5Rules. Nat. Resour. Res. 2020, 29, 791–806. [Google Scholar] [CrossRef]
  61. Chandar, K.R.; Sastry, V.R.; Hegde, C. A Critical Comparison of Regression Models and Artificial Neural Networks to Predict Ground Vibrations. Geotech. Geol. Eng. 2016, 35, 573–583. [Google Scholar] [CrossRef]
  62. Zhang, X.; Nguyen, H.; Bui, X.-N.; Tran, Q.-H.; Nguyen, D.-A.; Bui, D.T.; Moayedi, H. Novel Soft Computing Model for Predicting Blast-Induced Ground Vibration in Open-Pit Mines Based on Particle Swarm Optimization and XGBoost. Nat. Resour. Res. 2020, 29, 711–721. [Google Scholar] [CrossRef]
  63. Mulaba-Bafubiandi, A.F.; Tartibu, L.K. A Predictive Approach for Vibration Analysis in Underground Mining Operation. In Proceedings of the 2019 6th International Conference on Soft Computing & Machine Intelligence (ISCMI), Johannesburg, South Africa, 19–20 November 2019; pp. 101–105. [Google Scholar]
  64. Xu, S.; Li, Y.; Liu, J.; Zhang, F. Optimization of blasting parameters for an underground mine through prediction of blasting vibration. J. Vib. Control. 2019, 25, 1585–1595. [Google Scholar] [CrossRef]
  65. Nguyen, H.; Drebenstedt, C.; Bui, X.-N.; Bui, D.T. Prediction of Blast-Induced Ground Vibration in an Open-Pit Mine by a Novel Hybrid Model Based on Clustering and Artificial Neural Network. Nat. Resour. Res. 2020, 29, 691–709. [Google Scholar] [CrossRef]
  66. Nguyen, H. Support vector regression approach with different kernel functions for predicting blast-induced ground vibration: A case study in an open-pit coal mine of Vietnam. SN Appl. Sci. 2019, 1, 283. [Google Scholar] [CrossRef] [Green Version]
  67. Nguyen, H.; Bui, X.-N.; Moayedi, H. A comparison of advanced computational models and experimental techniques in predicting blast-induced ground vibration in open-pit coal mine. Acta Geophys. 2019, 67, 1025–1037. [Google Scholar] [CrossRef]
  68. Shang, Y.; Nguyen, H.; Bui, X.-N.; Tran, Q.-H.; Moayedi, H. A Novel Artificial Intelligence Approach to Predict Blast-Induced Ground Vibration in Open-Pit Mines Based on the Firefly Algorithm and Artificial Neural Network. Nat. Resour. Res. 2020, 29, 723–737. [Google Scholar] [CrossRef]
  69. Nguyen, H.; Bui, X.-N.; Bui, H.-B.; Cuong, D.T. Developing an XGBoost model to predict blast-induced peak particle velocity in an open-pit mine: A case study. Acta Geophys. 2019, 67, 477–490. [Google Scholar] [CrossRef]
  70. Hasanipanah, M.; Amnieh, H.B.; Arab, H.; Zamzam, M.S. Feasibility of PSO–ANFIS model to estimate rock fragmentation produced by mine blasting. Neural Comput. Appl. 2018, 30, 1015–1024. [Google Scholar] [CrossRef]
  71. Zhou, J.; Shi, X.; Li, X. Utilizing gradient boosted machine for the prediction of damage to residential structures owing to blasting vibrations of open pit mining. J. Vib. Control. 2016, 22, 3986–3997. [Google Scholar] [CrossRef]
  72. Jang, H.; Topal, E.; Kawamura, Y. Unplanned dilution and ore loss prediction in longhole stoping mines via multiple regression and artificial neural network analyses. J. S. Afr. Inst. Min. Met. 2015, 115, 449–456. [Google Scholar] [CrossRef]
  73. D’Angelo, T.; Mendes, M.; Keller, B.; Ferreira, R.; Delabrida, S.; Rabelo, R.; Azpurua, H.; Bianchi, A. Deep Learning-Based Object Detection for Digital Inspection in the Mining Industry. In Proceedings of the 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 16–19 December 2019; pp. 633–640. [Google Scholar]
  74. Zhang, Y.; Ma, X.; Zhang, Y.; Yang, J. Support vector machine of the coal mine machinery equipment fault diagnosis. In Proceedings of the 2013 IEEE International Conference on Information and Automation (ICIA), Yinchuan, China, 26–28 August 2013; IEEE: Piscataway, NJ, USA, 2013; pp. 1141–1146. [Google Scholar]
  75. Ristovski, K.; Gupta, C.; Harada, K.; Tang, H.-K. Dispatch with Confidence. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; ACM: New York, NY, USA, 2017; pp. 1981–1989. [Google Scholar]
  76. Baek, J.; Choi, Y. Deep Neural Network for Ore Production and Crusher Utilization Prediction of Truck Haulage System in Underground Mine. Appl. Sci. 2019, 9, 4180. [Google Scholar] [CrossRef] [Green Version]
  77. Baek, J.; Choi, Y. Deep Neural Network for Predicting Ore Production by Truck-Haulage Systems in Open-Pit Mines. Appl. Sci. 2020, 10, 1657. [Google Scholar] [CrossRef] [Green Version]
  78. Xue, E.; Sun, W.; Liang, R. A new method of real time dynamic forecast of truck link travel time in open mines. J. Chin. Coal Soc. 2012, 37, 1418–1422. [Google Scholar]
  79. Sun, X.; Zhang, H.; Tian, F.; Yang, L. The Use of a Machine Learning Method to Predict the Real-Time Link Travel Time of Open-Pit Trucks. Math. Probl. Eng. 2018, 2018, 1–14. [Google Scholar] [CrossRef] [Green Version]
  80. Mansouri, S.S.; Kanellakis, C.; Georgoulas, G.; Nikolakopoulos, G. Towards MAV Navigation in Underground Mine Using Deep Learning. In Proceedings of the 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), Kuala Lumpur, Malaysia, 12–15 December 2018; pp. 880–885. [Google Scholar]
  81. Vayenas, N.; Peng, S. Reliability analysis of underground mining equipment using genetic algorithms. J. Qual. Maint. Eng. 2014, 20, 32–50. [Google Scholar] [CrossRef]
  82. Ding, H.; Li, G.; Dong, X.; Lin, Y. Prediction of Pillar Stability for Underground Mines Using the Stochastic Gradient Boosting Technique. IEEE Access 2018, 6, 69253–69264. [Google Scholar] [CrossRef]
  83. Zhou, J.; Li, X.; Mitri, H.S. Classification of Rockburst in Underground Projects: Comparison of Ten Supervised Learning Methods. J. Comput. Civ. Eng. 2016, 30, 04016003. [Google Scholar] [CrossRef]
  84. Zhou, J.; Li, X.; Shi, X. Long-term prediction model of rockburst in underground openings using heuristic algorithms and support vector machines. Saf. Sci. 2012, 50, 629–644. [Google Scholar] [CrossRef]
  85. He, M.; E Sousa, L.R.; Miranda, T.F.S.; Zhu, G. Rockburst laboratory tests database—Application of data mining techniques. Eng. Geol. 2015, 185, 116–130. [Google Scholar] [CrossRef]
  86. Du, S.; Feng, G.-R.; Wang, J.; Feng, S.; Malekian, R.; Li, Z. A New Machine-Learning Prediction Model for Slope Deformation of an Open-Pit Mine: An Evaluation of Field Data. Energies 2019, 12, 1288. [Google Scholar] [CrossRef] [Green Version]
  87. Bui, X.-N.; Nguyen, H.; Choi, Y.; Nguyen-Thoi, T.; Zhou, J.; Dou, J. Prediction of slope failure in open-pit mines using a novel hybrid artificial intelligence model based on decision tree and evolution algorithm. Sci. Rep. 2020, 10, 1–17. [Google Scholar] [CrossRef] [PubMed]
  88. Lv, P.; Wu, S.; Jin, W. Real-Time Monitoring and Prediction Method to Slope Displacement in Transition from Open Pit to Underground. Electr. J. Geotech. Eng. 2015, 20, 9649–9656. [Google Scholar]
  89. Qi, C.; Tang, X. A hybrid ensemble method for improved prediction of slope stability. Int. J. Numer. Anal. Methods Geomech. 2018, 42, 1823–1839. [Google Scholar] [CrossRef]
  90. Jiang, S.; Lian, M.; Lu, C.; Gu, Q.; Ruan, S.; Xie, X. Ensemble Prediction Algorithm of Anomaly Monitoring Based on Big Data Analysis Platform of Open-Pit Mine Slope. Complexity 2018, 2018, 1–13. [Google Scholar] [CrossRef]
  91. Qi, C.; Chen, Q.; Fourie, A.; Zhang, Q. An intelligent modelling framework for mechanical properties of cemented paste backfill. Miner. Eng. 2018, 123, 16–27. [Google Scholar] [CrossRef]
  92. Lu, X.; Zhou, W.; Ding, X.; Shi, X.; Luan, B.; Li, M. Ensemble Learning Regression for Estimating Unconfined Compressive Strength of Cemented Paste Backfill. IEEE Access 2019, 7, 72125–72133. [Google Scholar] [CrossRef]
  93. Qi, C.; Chen, Q.; Dong, X.; Zhang, Q.; Yaseen, Z.M. Pressure drops of fresh cemented paste backfills through coupled test loop experiments and machine learning techniques. Powder Technol. 2020, 361, 748–758. [Google Scholar] [CrossRef]
  94. Hasan, A.N.; Twala, B. Improving single classifiers prediction accuracy for underground water pump station in a gold mine using ensemble techniques. In Proceedings of the IEEE EUROCON 2015-International Conference on Computer as a Tool (EUROCON), Salamanca, Spain, 8–11 September 2015; pp. 1–7. [Google Scholar]
  95. Hasan, A.N.; Twala, B.; Marwala, T. Moving towards accurate monitoring and prediction of gold mine underground dam levels. In Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China, 6–11 July 2014; pp. 2844–2849. [Google Scholar]
  96. Wei, W.; Shi, L.; Lu, X.; Zhang, F. Prediction of Mine Water Inflow Based on Support Vector Machine. In Proceedings of the 2011 Workshop on Digital Media and Digital Content Management, Hangzhou, China , 15–16 May 2011; pp. 326–329. [Google Scholar] [CrossRef]
  97. Zhao, D.; Wu, Q.; Cui, F.; Xu, H.; Zeng, Y.; Cao, Y.; Du, Y. Using random forest for the risk assessment of coal-floor water inrush in Panjiayao Coal Mine, northern China. Hydrogeol. J. 2018, 26, 2327–2340. [Google Scholar] [CrossRef]
  98. Jo, B.W.; Khan, R.M.A. An Internet of Things System for Underground Mine Air Quality Pollutant Prediction Based on Azure Machine Learning. Sensors 2018, 18, 930. [Google Scholar] [CrossRef] [Green Version]
  99. Bui, X.-N.; Lee, C.W.; Nguyen, H.; Bui, H.-B.; Long, N.Q.; Le, Q.-T.; Nguyen, V.-D.; Nguyen, N.-B.; Moayedi, H. Estimating PM10 Concentration from Drilling Operations in Open-Pit Mines Using an Assembly of SVR and PSO. Appl. Sci. 2019, 9, 2806. [Google Scholar] [CrossRef] [Green Version]
  100. Qi, C.; Zhou, W.; Lu, X.; Luocd, H.; Pham, B.T.; Yaseen, Z.M. Particulate matter concentration from open-cut coal mines: A hybrid machine learning estimation. Environ. Pollut. 2020, 263, 114517. [Google Scholar] [CrossRef] [PubMed]
  101. Boullé, M. Predicting Dangerous Seismic Events in Coal Mines under Distribution Drift. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, Gdansk, Poland, 11–14 September 2016; pp. 221–224. [Google Scholar]
  102. Geng, Y.; Su, L.; Jia, Y.; Han, C. Seismic Events Prediction Using Deep Temporal Convolution Networks. J. Electr. Comput. Eng. 2019, 2019, 1–14. [Google Scholar] [CrossRef] [Green Version]
  103. Sikora, M.; Krzystanek, Z.; Bojko, B.; Śpiechowicz, K. Application of a hybrid method of machine learning for description and on-line estimation of methane hazard in mine workings. J. Min. Sci. 2011, 47, 493–505. [Google Scholar] [CrossRef]
  104. Meng, Q.; Ma, X.; Zhou, Y. Application of the PSO-SVM model for coal mine safety assessment. In Proceedings of the 2012 8th International Conference on Natural Computation, Chongqing, China, 29–31 May 2012; pp. 393–397. [Google Scholar]
  105. Zhang, C.; Fu, Y.; Deng, F.; Wei, B.; Wu, X. Methane Gas Density Monitoring and Predicting Based on RFID Sensor Tag and CNN Algorithm. Electron. 2018, 7, 69. [Google Scholar] [CrossRef] [Green Version]
  106. Bewley, A.; Upcroft, B. Background Appearance Modeling with Applications to Visual Object Detection in an Open-Pit Mine. J. Field Robot. 2016, 34, 53–73. [Google Scholar] [CrossRef] [Green Version]
  107. Gernand, J. Machine Learning Classification Models for More Effective Mine Safety Inspections. Adv. Manuf. 2014. [Google Scholar] [CrossRef]
  108. Kashnikov, A.; Levin, L.Y. Applying machine learning techniques to mine ventilation control systems. In Proceedings of the 2017 XX IEEE International Conference on Soft Computing and Measurements (SCM), St. Petersburg, Russia, 24–26 May 2017; pp. 391–393. [Google Scholar]
  109. Petropoulos, G.P.; Partsinevelos, P.; Mitraka, Z. Change detection of surface mining activity and reclamation based on a machine learning approach of multi-temporal Landsat TM imagery. Geocarto Int. 2013, 28, 323–342. [Google Scholar] [CrossRef]
  110. He, D.; Le, B.T.; Xiao, D.; Mao, Y.; Shan, F.; Ha, T.T.L. Coal mine area monitoring method by machine learning and multispectral remote sensing images. Infrared Phys. Technol. 2019, 103, 103070. [Google Scholar] [CrossRef]
  111. Maxwell, A.; Strager, M.; Warner, T.; Zégre, N.; Yuill, C. Comparison of NAIP orthophotography and RapidEye satellite imagery for mapping of mining and mine reclamation. GIScience Remote Sens. 2014, 51, 301–320. [Google Scholar] [CrossRef]
  112. Demirel, N.; Emil, M.K.; Duzgun, H.S. Surface coal mine area monitoring using multi-temporal high-resolution satellite imagery. Int. J. Coal Geol. 2011, 86, 3–11. [Google Scholar] [CrossRef]
  113. Vasuki, Y.; Yu, L.; Holden, E.-J.; Kovesi, P.; Wedge, D.; Grigg, A.H. The spatial-temporal patterns of land cover changes due to mining activities in the Darling Range, Western Australia: A Visual Analytics Approach. Ore Geol. Rev. 2019, 108, 23–32. [Google Scholar] [CrossRef]
  114. Maxwell, A.E.; Warner, T.A. Differentiating mine-reclaimed grasslands from spectrally similar land cover using terrain variables and object-based machine learning classification. Int. J. Remote Sens. 2015, 36, 4384–4410. [Google Scholar] [CrossRef] [Green Version]
  115. Mukherjee, J.; Mukhopadhyay, J.; Chakravarty, D.; Aikat, S. A Novel Index to Detect Opencast Coal Mine Areas from Landsat 8 OLI/TIRS. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2019, 12, 891–897. [Google Scholar] [CrossRef]
  116. Li, X.; Chen, W.; Cheng, X.; Wang, L. A Comparison of Machine Learning Algorithms for Mapping of Complex Surface-Mined and Agricultural Landscapes Using ZiYuan-3 Stereo Satellite Imagery. Remote Sens. 2016, 8, 514. [Google Scholar] [CrossRef] [Green Version]
  117. Maxwell, A.; Warner, T.; Strager, M.; Conley, J.; Sharp, A. Assessing machine-learning algorithms and image- and lidar-derived variables for GEOBIA classification of mining and mine reclamation. Int. J. Remote Sens. 2015, 36, 954–978. [Google Scholar] [CrossRef]
  118. Jiang, X.; Lu, W.-X.; Zhao, H.-Q.; Yang, Q.-C.; Chen, M. Quantitative evaluation of mining geo-environmental quality in Northeast China: Comprehensive index method and support vector machine models. Environ. Earth Sci. 2014, 73, 7945–7955. [Google Scholar] [CrossRef]
  119. Su, Q.; Zhang, J.; Zhao, S.; Wang, L.; Liu, J.; Guo, J. Comparative Assessment of Three Nonlinear Approaches for Landslide Susceptibility Mapping in a Coal Mine Area. ISPRS Int. J. Geo-Information 2017, 6, 228. [Google Scholar] [CrossRef] [Green Version]
  120. Luo, X.; Lin, F.; Zhu, S.; Yu, M.; Zhang, Z.; Meng, L.; Peng, J. Mine landslide susceptibility assessment using IVM, ANN and SVM models considering the contribution of affecting factors. PLoS ONE 2019, 14, e0215134. [Google Scholar] [CrossRef]
  121. Lee, S.; Park, I. Application of decision tree model for the ground subsidence hazard mapping near abandoned underground coal mines. J. Environ. Manag. 2013, 127, 166–176. [Google Scholar] [CrossRef]
  122. Bui, D.T.; Shahabi, H.; Shirzadi, A.; Chapi, K.; Pradhan, B.; Pourghasemi, H.R.; Khosravi, K.; Panahi, M.; Bin Ahmad, B.; Lee, S. Land Subsidence Susceptibility Mapping in South Korea Using Machine Learning Algorithms. Sensors 2018, 18, 2464. [Google Scholar] [CrossRef] [Green Version]
  123. Li, P.; Tan, Z.; Yan, L.; Deng, K. Time series prediction of mining subsidence based on a SVM. Min. Sci. Technol. (China) 2011, 21, 557–562. [Google Scholar] [CrossRef]
  124. Aryafar, A.; Gholami, R.; Rooki, R.; Ardejani, F.D. Heavy metal pollution assessment using support vector machine in the Shur River, Sarcheshmeh copper mine, Iran. Environ. Earth Sci. 2012, 67, 1191–1199. [Google Scholar] [CrossRef]
  125. Betrie, G.D.; Tesfamariam, S.; Morin, K.A.; Sadiq, R. Predicting copper concentrations in acid mine drainage: A comparative analysis of five machine learning techniques. Environ. Monit. Assess. 2012, 185, 4171–4182. [Google Scholar] [CrossRef] [PubMed]
  126. Boente, C.; Albuquerque, M.T.D.; Gerassis, S.; Rodríguez-Valdés, E.; Gallego, J.R. A coupled multivariate statistics, geostatistical and machine-learning approach to address soil pollution in a prototypical Hg-mining site in a natural reserve. Chemosphere 2019, 218, 767–777. [Google Scholar] [CrossRef] [PubMed]
  127. Betrie, G.D.; Sadiq, R.; Tesfamariam, S.; Morin, K.A. On the Issue of Incomplete and Missing Water-Quality Data in Mine Site Databases: Comparing Three Imputation Methods. Mine Water Environ. 2014, 35, 3–9. [Google Scholar] [CrossRef]
  128. Manca, G.; Cervone, G. The case of arsenic contamination in the Sardinian Geopark, Italy, analyzed using symbolic machine learning. Environmetrics 2013, 24, 400–406. [Google Scholar] [CrossRef]
  129. Betrie, G.D.; Sadiq, R.; Morin, K.A.; Tesfamariam, S. Uncertainty quantification and integration of machine learning techniques for predicting acid rock drainage chemistry: A probability bounds approach. Sci. Total. Environ. 2014, 490, 182–190. [Google Scholar] [CrossRef]
  130. IBM. Analytics: The Real-World Use of Big Data. Available online: http://www.informationweek.com/pdf_whitepapers/approved/1372892704_analytics_the_real_world_use_of_big_data.pdf (accessed on 10 June 2019).
  131. Kuhn, M.; Johnson, K. Applied Predictive Modeling, 1st ed.; Springer: New York, NY, USA, 2013; Volume 26, p. 67. ISBN 978-1-4614-6848-6. [Google Scholar]
  132. Willmott, C.J. Some Comments on the Evaluation of Model Performance. Bull. Am. Meteorol. Soc. 1982, 63, 1309–1313. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Flow chart of the selection process.
Figure 1. Flow chart of the selection process.
Minerals 11 00148 g001
Figure 2. Publications per year (January 2011–September 2020).
Figure 2. Publications per year (January 2011–September 2020).
Minerals 11 00148 g002
Figure 3. Research application fields.
Figure 3. Research application fields.
Minerals 11 00148 g003
Figure 4. Number of studies based on the study of application fields.
Figure 4. Number of studies based on the study of application fields.
Minerals 11 00148 g004
Figure 5. Detailed graph presenting the number of publications.
Figure 5. Detailed graph presenting the number of publications.
Minerals 11 00148 g005
Figure 6. Data set type.
Figure 6. Data set type.
Minerals 11 00148 g006
Figure 7. Classification of ML techniques. ANN: artificial neural network, CNN: convolutional neural network, DNN: deep neural network, RNN: recurrent neural network, DBSCAN: density-based spatial clustering of applications with noise, YOLO: you only look once, MLPNN: multiple-layer perceptron neural network, CART: classification and regression tree, ID3: iterative dichotomiser 3, QUEST: quick unbiased efficient statistical tree algorithms.
Figure 7. Classification of ML techniques. ANN: artificial neural network, CNN: convolutional neural network, DNN: deep neural network, RNN: recurrent neural network, DBSCAN: density-based spatial clustering of applications with noise, YOLO: you only look once, MLPNN: multiple-layer perceptron neural network, CART: classification and regression tree, ID3: iterative dichotomiser 3, QUEST: quick unbiased efficient statistical tree algorithms.
Minerals 11 00148 g007
Figure 8. Usage frequencies of ML models.
Figure 8. Usage frequencies of ML models.
Minerals 11 00148 g008
Figure 9. Distribution of the detailed ML model usage.
Figure 9. Distribution of the detailed ML model usage.
Minerals 11 00148 g009
Figure 10. Mining applications underpinned by ML models.
Figure 10. Mining applications underpinned by ML models.
Minerals 11 00148 g010
Figure 11. Model evaluation based on the data set type.
Figure 11. Model evaluation based on the data set type.
Minerals 11 00148 g011
Figure 12. Studies employing different performance measurements(RAE: relative absolute error; MSE: mean squared error, MAD: mean absolute difference, LMSE: least mean square, RPSS: rank probability skill score, RMSE: root mean square error, MAE: mean absolute error, AUC: area under the curve, R: coefficient of determination, MARE: multivariate adaptive regression spline, VAF: variant allelic frequencies, MEDAE: median absolute error, MAPE: mean absolute percentage error, RRSE: root relative squared error).
Figure 12. Studies employing different performance measurements(RAE: relative absolute error; MSE: mean squared error, MAD: mean absolute difference, LMSE: least mean square, RPSS: rank probability skill score, RMSE: root mean square error, MAE: mean absolute error, AUC: area under the curve, R: coefficient of determination, MARE: multivariate adaptive regression spline, VAF: variant allelic frequencies, MEDAE: median absolute error, MAPE: mean absolute percentage error, RRSE: root relative squared error).
Minerals 11 00148 g012
Figure 13. Box plots for RMSE.
Figure 13. Box plots for RMSE.
Minerals 11 00148 g013
Figure 14. Box plots for R.
Figure 14. Box plots for R.
Minerals 11 00148 g014
Figure 15. Box plots for accuracy.
Figure 15. Box plots for accuracy.
Minerals 11 00148 g015
Figure 16. Box plots for MAE.
Figure 16. Box plots for MAE.
Minerals 11 00148 g016
Figure 17. Box plots for AUC.
Figure 17. Box plots for AUC.
Minerals 11 00148 g017
Table 1. Summary of top publications.
Table 1. Summary of top publications.
Publication NameNumber of Research Papers
Natural Resources Research7
Ore Geology Reviews6
Applied Sciences3
Acta Geophysica2
Computers & Geosciences2
Engineering with Computers2
Environmental Earth Sciences2
IEEE Access2
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2
International Journal of Remote Sensing2
Journal of Geochemical Exploration2
Journal of Mining Science2
Journal of Vibration and Control2
Resources Policy2
Rock Mechanics and Rock Engineering2
Sensors2
Table 2. Big data technologies.
Table 2. Big data technologies.
Big Data TechnologiesNumber of StudiesStudies
Yes9[32,36,38,45,49,76,77,87,92]
No100Other studies
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jung, D.; Choi, Y. Systematic Review of Machine Learning Applications in Mining: Exploration, Exploitation, and Reclamation. Minerals 2021, 11, 148. https://doi.org/10.3390/min11020148

AMA Style

Jung D, Choi Y. Systematic Review of Machine Learning Applications in Mining: Exploration, Exploitation, and Reclamation. Minerals. 2021; 11(2):148. https://doi.org/10.3390/min11020148

Chicago/Turabian Style

Jung, Dahee, and Yosoon Choi. 2021. "Systematic Review of Machine Learning Applications in Mining: Exploration, Exploitation, and Reclamation" Minerals 11, no. 2: 148. https://doi.org/10.3390/min11020148

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop