Does expert judgement is important in mining industry?: A systematic literature review study


  • Siti Noraishah Ismail Faculty of Industrial Sciences and Technology, College of Computing and Applied Sciences, Universiti Malaysia Pahang, Malaysia
  • Azizan Ramli Faculty of Industrial Sciences and Technology, Universiti Malaysia Pahang, Malaysia
  • Hanida Abdul Aziz Faculty of Industrial Sciences and Technology, College of Computing and Applied Sciences, Universiti Malaysia Pahang, Malaysia



Delphi technique, Mining disaster, Mining industry, Meta-Analyses, Systematic literature review


The Delphi technique is used to achieve consensus from a panel of experts on particular issues by several series or rounds. Previous scholars widely used Delphi in social science studies, business, healthcare, education and many more. However, there is a lack of systematic review on the contribution of Delphi in the engineering and technology field of research. Thus, the aims of this systematic literature review (SLR) are to investigate the contribution of Delphi in solving problems for the past 11 years in the mining industry and to understand the future outlook of Delphi in the Malaysian mining industry. By applying the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), 37 selected papers were identified with three main themes and 24 subthemes created using thematic analysis. Based on the findings, the most highlighted contribution of Delphi came from Theme 3: Delphi’s derivatives (50.0%), followed by Theme 1: Mine lifecycle (12.5%), and Theme 2: Analysis of Delphi (37.5 %). In conclusion, an SLR could hopefully increase awareness among mining players to use Delphi in solving their problems which cannot be solved by machinery or tools in achieving a consensus among experts.

Author Biographies

Siti Noraishah Ismail, Faculty of Industrial Sciences and Technology, College of Computing and Applied Sciences, Universiti Malaysia Pahang, Malaysia

Siti Noraishah Ismail is a lecturer in Faculty of Chemical and Process Engineering Technology, Universiti Malaysia Pahang (UMP). She graduated her Master degrees at UMP majoring in MSc Mining with Mineral Technology and MSc Petroleum Engineering at Universiti Teknologi Malaysia (UTM). She completed her undergraduate in B.Eng Chemical (Gas Engineering) in UTM. Currently she is pursuing her PhD in Occupational Safety and Health in UMP.

Azizan Ramli, Faculty of Industrial Sciences and Technology, Universiti Malaysia Pahang, Malaysia

Azizan Ramli is a Senior Lecturer at the Faculty of Industrial Sciences and Technology, Universiti Malaysia Pahang (UMP). He graduated his doctoral study in Universiti Kebangsaan Malaysia. His interest in Environmental Management has given him the opportunity to further his studies at Universiti Putra Malaysia and has obtained a Master of Environment. He also completed his undergraduate study at University of Okayama, Japan in 1994.

Hanida Abdul Aziz, Faculty of Industrial Sciences and Technology, College of Computing and Applied Sciences, Universiti Malaysia Pahang, Malaysia

Dr. Hanida Abdul Aziz is a Senior Lecturer at the Faculty of Industrial Sciences and Technology, Universiti Malaysia Pahang (UMP). Her current research activities fall into process safety management (PSM) and risk management area. In PSM research, the main interests are to develop the PSM aid-tools including PSI system, PHA system and many more.


Abdul Shukor, S., & Hussain, S. (2019). Factors Influencing the Effective Leadership Succession Planning: Study on A Malaysian GLC. KnE Social Sciences, 3(1), 24–43.

Ahmed, M. F., Alam, L., Mohamed, C. A. R., Mokhtar, M. Bin, & Ta, G. C. (2018). Health risk of polonium 210 ingestion via drinking water: An experience of Malaysia. International Journal of Environmental Research and Public Health, 15(10), 1–19.

Aigbavboa, C. (2015). A Delphi technique approach of identifying and validating subsidised low-income housing satisfaction indicators. OTMC Conference, 1–10

Alvarez-García, B., & Fernández-Castro, A. S. (2018). A comprehensive approach for the selection of a portfolio of interdependent projects. An application to subsidized projects in Spain. Computers and Industrial Engineering, 118(May 2017), 153–159.

Asghari, M., Nassiri, P., Monazzam, M. R., Golbabaei, F., & Arabalibeik, H. (2017). Weighting Criteria and Prioritizing of Heat stress indices in surface mining using a Delphi Technique and Fuzzy AHP-TOPSIS Method. Journal of Environmental Health Science & Engineering, 1–11.

Anh, K. (2018). How do local communities adapt to climate changes along heavily damaged coasts ? A Stakeholder Delphi study in Ky Anh (Central Vietnam. Environment, Development and Sustainability, 20(2), 749–767.

Bammer, G., McDonald, D., & Deane, P. (2013). Research integration using dialogue methods (p. 165). ANU Press

Barve, A., & Muduli, K. (2013). Modelling the challenges of green supply chain management practices in Indian mining industries. Journal of Manufacturing Technology Management, 24(8), 1102–1122.

Barron, F. H., & Barrett, B. E. (1996). The efficacy of SMARTER - Simple Multi-Attribute Rating Technique Extended to Ranking. Acta Psychologica, 93(1–3), 23–36.

Basu, A., Phipps, S., Long, R., Essegbey, G., & Basu, N. (2015). Identification of Response Options to Artisanal and Small-Scale Gold Mining ( ASGM ) in Ghana via the Delphi Process. International Journal of Environmental Research and Public Health., 11345–11363.

Brady, S. R. (2015). Utilizing and Adapting the Delphi Method for Use in Qualitative Research. International Journal of Qualitative Methods, 14(5), 160940691562138.

Chand, P., Thakkar, J. J., & Ghosh, K. K. (2020). Analysis of supply chain sustainability with supply chain complexity, inter-relationship study using delphi and interpretive structural modeling for Indian mining and earthmoving machinery industry. Resources Policy, 68(February), 101726.

Chen, R. H., Lin, Y., & Tseng, M. L. (2015). Multicriteria analysis of sustainable development indicators in the construction minerals industry in China. Resources Policy, 46, 123–133.

Chong, T., Yi, S., & Heng, C. (2017). Application of set pair analysis method on occupational hazard of coal mining. Safety Science, 92, 10–16.

Cui K, Shen F, Han B, et al., (2018). Establishment and application of an index system for prevention of coal workers’ pneumoconiosis: a Delphi and analytic hierarchy process study in four state-owned coal enterprises of China.Occupational and Environmental Medicine, 75, 654-660

Custer, R. L., Scarcella, J. A., & Stewart, B. R. (1999). The modified Delphi technique: A rotational modification. Journal of Vocational and Technical Education, 15(2), 1-10

De Luca, E., Sena, B., Cataldi, S., & Fusillo, F. (2021). A Delphi survey of health education system and interprofessional nurse’ role. Nurse Education Today, 99(January), 104779.

Dotsenko, S., Makshanov, A., & Popovich, T. (2014). Application of Aggregated Indices Randomization Method for Prognosing the Consumer Demand on Features of Mobile Navigation Applications Sergey Dotsenko, Andrey Makshanov, Tatiana Popovich. 8(May), 803–806

Düzgün, H. S., & Leveson, N. (2018). Analysis of soma mine disaster using causal analysis based on systems theory (CAST). Safety Science, 110(August), 37–57.

El-Gazzar, R., Hustad, E., Olsen, D.H., (2016). Understanding cloud computing adoption issues: a Delphi study approach. Journal Systems and Software, 118, 64–84. https://doi. org/10.1016/J.JSS.2016.04.061

Francini-filho, R. B., Cordeiro, M. C., Omachi, C. Y., Rocha, A. M., Bahiense, L., Garcia, G. D., Tschoeke, D., Almeida, M. G. De, Rangel, T. P., Cherene, B., Oliveira, V. De, Almeida, D. Q. R. De, Menezes, R., Mazzei, E. F., Joyeux, J., Rezende, C. E., Thompson, C. C., & Thompson, F. L. (2019). Science of the Total Environment, 697(August), 134038.

Frejowski, A., & Kabiesz, J. (2020). Criteria for Assessing the Longevity of Hard Coal Mines. 65, 433–452. Archives of Mining Sciences, 65, 3, 433-452.

Flostrand, A., Pitt, L., & Bridson, S. (2020). The Delphi technique in forecasting– A 42-year bibliographic analysis (1975–2017). Technological Forecasting and Social Change, 150(November 2019), 119773.

Geng, H., Chen, F., Wang, Z., Liu, J., & Xu, W. (2017). Environmental management zoning for coal mining in mainland China based on ecological and resources conditions. Environmental Monitoring and Assessment, 189(5), 1–9.

Ghadernejad, S., Jafarpour, A., & Ahmadi, P. (2018). Application of an integrated decision-making approach based on FDAHP and PROMETHEE for selection of optimal coal seam for mechanization ; A case study of the Tazareh coal mine complex , Iran. International Journal Mining & Geo-Engineering (IJMGE), Vol. 53, Issue 1 15-23.

Guan, Y., Shao, C., Gu, Q., Ju, M., & Huang, X. (2016). Study of a comprehensive assessment method of the environmental quality of soil in industrial and mining gathering areas. Stochastic Environmental Research and Risk Assessment, 30(1), 91–102.

Gui Fu, Ziqi Zhao, Chuanbo Hao and Qiang Wu (2019). The Accident Path of Coal Mine Gas Explosion Based on 24Model: A Case Study of the Ruizhiyuan Gas Explosion Accident. Processes, 7, 73; https://doi:10.3390/pr7020073

Gyllencreutz, L., Rådestad, M. and Saveman, B.-I. (2020). Templates for handling multi-agency collaboration activities and priorities in mining injury incidents: a Delphi study. International Journal of Emergency Services, Vol. 9 No. 3, 257-271.

Haron, H., Jamil, N. N., & Ramli, N. M. (2020). Western and Islamic Values and Ethics: Are They Different? Journal of Governance and Integrity, 4(1), 12–28.

Hasanuzzaman, & Bhar, C. (2019). Development of a framework for sustainable improvement in performance of coal mining operations. Clean Technologies and Environmental Policy, 21(5), 1091–1113.

Herrera-franco, G., Erazo, K., & Mora-frank, C. (2021). Evaluation of a Paleontological Museum as Geosite and Base for Geotourism . A Case Study. 1208–1227.

Holey EA, Feeley JL, Dixon J, Whittaker VJ. (2007). An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Medical Research Methodology, 7:52

Hsueh, S., Sun, Y., & Yan, M. (2019). Conceptualization and Development of a DFuzzy Model for Low-Carbon Ecocities. Sustainability. 11, 5833; doi:10.3390/su11205833

Ismail, S. N., Ramli, A., & Aziz, H. A. (2021). Influencing factors on safety culture in mining industry: A systematic literature review approach. Resources Policy, 74(May), 102250.

Jafarpisheh, R., Karbasian, M., & Asadpour, M. (2020). A hybrid reliability-centered maintenance approach for mining transportation machines: a real case in Esfahan. International Journal of Quality and Reliability Management, 38(7), 1550–1575.

Journal, S. A., & December, I. E. (2017). Risk Modelling Of Heavy Mobile Equipment To Determine Optimum Replacement. South African Journal of Industrial Engineering, Vol. 28(4), 66-79. Doi:

Kavakl, N. (2015). Evaluation of mining investment projects with a new software. Arabian Journal of Geosciences, 8(8), 6353–6362.

Kailiponi, P. (2010). Analyzing evacuation decisions using multi-attribute utility theory (MAUT). Procedia Engineering, 3, 163–174.

Kamarudin, D., Zakaria, H., & Azit, A. (2020). Different Ethical Perspectives Justifying Reasonings Behind a Person’s Actions: A Case Study on a Private Institution in Malaysia. Journal of Governance and Integrity, 3(2), 9–16.

Keyvanfar, A., Shafaghat, A., Ismail, N., & Mohamad, S. (2021). Multifunctional retention pond for stormwater management : A decision-support model using Analytical Network Process ( ANP ) and Global Sensitivity Analysis ( GSA ). Ecological Indicators, 124(November 2020), 107317.

Khoshandam, L., Amirteimoori, A., & Matin, R. K. (2014). Marginal rates of substitution in the presence of non-discretionary factors: A data envelopment analysis approach. Measurement: Journal of the International Measurement Confederation, 58, 409–415.

Komsiyah, S., Wongso, R., & Pratiwi, S. W. (2019). Applications of the fuzzy ELECTRE method for decision support systems of cement vendor selection. Procedia Computer Science, 157, 479–488.

Kong, D., Liu, S., & Xiang, J. (2018). China Economic Review Political promotion and labor investment efficiency, 273–293.

Lamers, R. E. D., Cuypers, M., Garvelink, M. M., de Vries, M., Bosch, J. L. H. R., & Kil, P. J. M. (2016). Development of a decision aid for the treatment of benign prostatic hyperplasia: A four stage method using a Delphi consensus study. Patient Education and Counseling, 99(7), 1249–1256.

Lanke, A. A., Hoseinie, S. H., & Ghodrati, B. (2016). Mine production index (MPI)-extension of OEE for bottleneck detection in mining. International Journal of Mining Science and Technology, 26(5), 753–760.

Lear, H. (2020). Nursing study abroad trip preparation: Finding consensus through a Delphi technique. Nurse Education Today, 90(April), 104443.

Lehmann, B. (2021). Formation of tin ore deposits: A reassessment. Lithos, 402–403, 105756., D., Koopialipoor, M., & Armaghani, D. J. (2021). A Combination of Fuzzy Delphi Method and ANN-based Models to Investigate Factors of Flyrock Induced by Mine Blasting. Natural Resources Research, 30(2), 1905–1924.

Lemmen, C., Woopen, C., & Stock, S. (2021). Systems medicine 2030: A Delphi study on implementation in the German healthcare system. Health Policy, 125(1), 104–114.

Li, Y., Wu, X., Luo, X., Gao, J., & Yin, W. (2019). Impact of safety attitude on the safety behavior of coal miners in China. Sustainability (Switzerland), 11(22).

Lin, S. S., Shen, S. L., Zhou, A., & Xu, Y. S. (2021). Risk assessment and management of excavation system based on fuzzy set theory and machine learning methods. Automation in Construction, 122, 103490.

Liu, R., Cheng, W., Yu, Y., & Xu, Q. (2018). International Journal of Industrial Ergonomics Human factors analysis of major coal mine accidents in China based on the HFACS-CM model and AHP method. International Journal of Industrial Ergonomics, 68(February), 270–279.

Luo, B., Zhang, J., & Li, Z. (2019). Service Risk Evaluation of the General Contract for Coal Mine Production and Operation : Case Study at Shendong Jinjie Coal Mine in China. Hindawi Mathematical Problems in Engineering. Vol. 2019, Article ID 7845756, 12 pages Research

Lyra, M. G. (2019). The Extractive Industries and Society Challenging extractivism : Activism over the aftermath of the Fundão disaster. The Extractive Industries and Society, 6(3), 897–905.

Lyu, F., Zheng, C., Wang, H., Nie, C., Ma, X., Xia, X., Zhu, W., Jin, X., Hu, Y., Sun, Y., Zhu, Y., Kuwabara, S., Cortese, R., Maqbool Hassan, K., Takai, K., Paredes, I., Webere, R., Turk, M.,Kimura, J., & Jiang, J. (2020). Establishment of a clinician-led guideline on the diagnosis and treatment of Hirayama disease using a modified Delphi technique. Clinical Neurophysiology, 131(6), 1311–1319.

McKenna, H. P. (1994). The Delphi technique: a worthwhile research approach for nursing? Journal of Advanced Nursing, 19(6), 1221–1225.

Mikaeil, R., Gharahasanlou, E. J., & Jafarpour, A. (2020). Ranking and Evaluating the Coal Seam Mechanization Based on Geological Conditions. Geotechnical and Geological Engineering, 38(3), 3307–3329.

Morisson, C. De, Neumann, R., Ramalho, A., Evangelista, H., Heilbron, M., Cristine, C., Neto, A., Paravidini, G., & Souza, D. (2019). Applied Geochemistry Sm – Nd and Sr isotope fingerprinting of iron mining tailing deposits spilled from the failed SAMARCO Fundão dam 2015 accident at Mariana, SE-Brazil. Applied Geochemistry, 106(April), 34–44.

Mulliner, E., Malys, N., & Maliene, V. (2016). Comparative analysis of MCDM methods for the assessment of sustainable housing affordability. Omega (United Kingdom), 59, 146–156.

Nan, J., Liu, C., & Liu, Y. (2019). A Predictive Model of Mining Collapse Extent and Its Application. 2019. Hindawi Advances in Civil Engineering Volume 2019, Article ID 5184287, 10 pages

Noraishah, S., Ramli, A., & Abdul, H. (2021). Research trends in mining accidents study: A systematic literature review. Safety Science, 143(April), 105438.

Pons, D. J. (2016). Pike River Mine Disaster:Systems-Engineering and Organisational Contributions. Safety 2016, 2, 21;

Rayens MK, Hahn EJ. Building consensus using the policy Delphi method. Policy, Politics, & Nursing Practice, 1(4):308e15.

Saffari, A., Sereshki, F., Ataei, M., & Ghanbari, K. (2017). Presenting an engineering classification system for coal spontaneous combustion potential. International Journal of Coal Science & Technology, 4(2), 110–128.

Sakai, N., Alsaad, Z., Thuong, N. T., Shiota, K., Yoneda, M., & Ali Mohd, M. (2017). Source profiling of arsenic and heavy metals in the Selangor River basin and their maternal and cord blood levels in Selangor State, Malaysia. Chemosphere, 184, 857–865.

Sajari, A., Haron, H., & Ismail, I. (2019). Effectiveness of Quality of Chief Integrity Officer. Ethical Climate, 3(1), 50–68.

Sanusi, M. S. M., Ramli, A. T., Hashim, S., & Lee, M. H. (2021). Radiological hazard associated with amang processing industry in Peninsular Malaysia and its environmental impacts. Ecotoxicology and Environmental Safety, 208, 111727.

Sanusi, M. S. M., Ramli, A. T., Hassan, W. M. S. W., Lee, M. H., Izham, A., Said, M. N., Wagiran, H., & Heryanshah, A. (2017). Assessment of impact of urbanisation on background radiation exposure and human health risk estimation in Kuala Lumpur, Malaysia. Environment International, 104, 91–101.

Sarman, M., Nazer, N. S. M., Desa, K. M., Husin, A., Sulaiman, N., & Huzairy, A. (2019). Anthropogenic geoasset exploration in bukit besi for geotourism development: A preliminary study. Sains Malaysiana, 48(11), 2483–2491.

Seam, T. C. (2020). Study on Intelligent Identification Method of Coal Pillar Stability in Fully Mechanized Caving Face of Thick Coal Seam. Energies, 13, 305; doi:10.3390/en13020305

Setyono, R. P., & Sarno, R. (2020). Comparative method of supplier selection in ABC mining company. Indonesian Journal of Electrical Engineering and Computer Science 19(2), 890–899.

Sexmo, E., Gold, T., Zaruma, M., Loor-oporto, O., & Herrera-franco, G. (2020). Quantitative and Qualitative Assessment of the “El Sexmo” Tourist Gold Mine (Zaruma, Ecuador) as A Geosite and Mining Site. Resources, 9, 28; doi:10.3390/resources9030028

Shahbudin, N. R., & Kamal, N. A. (2021). Establishment of material flow analysis (MFA) for heavy metals in a wastewater system. Ain Shams Engineering Journal, 12(2), 1407–1418.

Shang, D., Yin, G., Li, X., Li, Y., Jiang, C., Kang, X., Liu, C., & Zhang, C. (2015). Analysis for Green Mine (phosphate) performance of China: An evaluation index system. Resources Policy, 46, 71–84.

Shao, L., 2019. Geological disaster prevention and control and resource protection in mineral resource exploitation region. February, 142–146. Doi: 10.1093/ijlct/ctz003. International Journal of Low-Carbon Technologies, 14, 142–146. doi:10.1093/ ijlct/ctz003. Hindawi Advances in Civil Engineering Volume 2019, Article ID 1269537, 10 pages Doi: 10.1155/2019/1269537.

Spinelli T. The Delphi decision-making process. J Psychol 1983; 113(1):73-80

Stitt-Gohdes, W.L. & Crews, T.B. (2004). The Delphi technique: A research strategy for career and technical education. Journal of career and technical education, 20(2):55-67.

Sun, W., & Xue, Y. (2019). An Improved Fuzzy Comprehensive Evaluation System and Application for Risk Assessment of Floor Water Inrush in Deep Mining. Geotechnical and Geological Engineering, 37(3), 1135–1145.

Supriyono, H., & Sari, C. P. (2018). Developing decision support systems using the weighted product method for house selection. AIP Conference Proceedings, 1977(June 2018).

Tohar, S. Z., & Yunus, M. Y. M. (2020). Mineralogy and BCR sequential leaching of ion-adsorption type REE: A novelty study at Johor, Malaysia. Physics and Chemistry of the Earth, 120, 102947.

Turner-Carrión, M.; Carrión-Mero, P.; Turner-Salamea, I.; Morante-Carballo, F.; Aguilar-Aguilar, M.; Zambrano-Ruiz, K.; Berrezueta, E. A Mineralogical Museum as a Geotourism Attraction: A Case Study. Minerals, 11, 582.

Van der Vaart, R., Witting, M., Riper, H., Kooistra, L., Bohlmeijer, E.T., Van Gemert- Pijnen, L.J., 2014. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry 14 (1), 355. 014-0355-z

Wan Husain, W. A. F. (2020). Insights: the Conceptual Framework for Buiding the World Class Good Governance Ethics. Journal of Governance and Integrity, 4(1), 1–5.

Wu, X. Q., Zuo, X. Q., & Fang, Y. M. (2011). Evaluation of reclamation land productivity in mining districts. Transactions of Nonferrous Metals Society of China (English Edition), 21(SUPPL. 3), s717–s722.

Xiao, W., Xu, J., & Lv, X. (2019). Establishing a georeferenced spatio-temporal database for Chinese coal mining accidents between 2000 and 2015. Geomatics, Natural Hazards and Risk, 10(1), 242–270.

Xu Q, Xu K (2018) Mine safety assessment using gray relational analysis and bow tie model. PLoS ONE, 13(3): e0193576. https://doi. org/10.1371/journal.pone.0193576

Yang, Z., Li, W., Pei, Y., Qiao, W., & Wu, Y. (2018). Classification of the type of eco-geological environment of a coal mine district: A case study of an ecologically fragile region in Western China. Journal of Cleaner Production, 174, 1513–1526.

Zawacki-Richter, O., 2009. Research areas in distance education: a Delphi study. The International Review of Research in Open and Distributed Learning, 10 (3). https://

Zhang, Y., Li, X., Wang, S., Guo, J., & Lv, G. (2020). A Multi-objective Zoning Framework for Mineral Resources Development and Management: A Case Study in Henan Province, China. Natural Resources Research, 29(5), 3103–3119.

Zhu, W., Yao, N., & Yan, J. (2018). International Journal of Disaster Risk Reduction Exploring the determinants of disaster coverage: Evidence from coal mine disasters coverage in China. International Journal of Disaster Risk Reduction, 31(August), 856–861.




How to Cite

Ismail, S. N., Ramli, A. ., & Abdul Aziz, H. (2022). Does expert judgement is important in mining industry?: A systematic literature review study. Journal of Governance and Integrity, 5(2).



JGI Vol. 5 Issue 2, July 2022