Cover
Vol. 26 No. 1 (2026)

Published: July 28, 2026

Pages: 52-66

Research Article

A Comparative Analysis of Neural Networks, Decision Trees, and Ensemble Methods for Soil Classification

Abstract

Soil classification is a significant tool for the interpretation of soil properties and the selection of the appropriate parameters to express soil types in geotechnical engineering applications. In this paper, a comparative analysis on the prediction of soil classification using different soil parameters via Neural Network, Decision Tree, and Ensemble classifier algorithms in the machine learning tool box of MATLAB is conducted. The data is classified into 14 sets of input parameters according to the parameters of the Unified Soil Classification System (USCS), which is a standard system in practice for classifying soils based on their physical properties and their engineering behavior. The input parameters of the USCS, Passing No. 4 Sieve, Passing No. 200 Sieve, Gravel, Sand, Fines, Liquid Limit, Plastic Limit and Plasticity Index, are specified within the certain ranges to generate a synthetic data base including 478 data for the purpose of training and testing. Five Neural Network models (Medium, Trilayered, Bilayered, Narrow and Wide), three Decision Tree models (Fine, Medium, Coarse) and three Ensemble models (Boosted Trees, Bagged Trees, RUSBoosted Trees) are tested for the different test split ratios (10, 20, and 30). The results show that the Neural Network models proposed in this study have the highest prediction capability, with a classification accuracy of up to 100 % for some variable sets, and can classify soils automatically and precisely based on the soil index properties. Among the individual models, WNN and NNN generally showed the best performance for all variable sets. The Ensemble models presented high prediction capability with respect to generalization. Among the DT models, although they are fast, they presented relatively lower accuracy than the other models, especially the Coarse Tree model. This study can be used as a reference for the future development of automated soil classification systems and can offer practical suggestions for the selection of machine learning models for geotechnical engineering problems.

References

  1. B. M. Das and K. Sobhan, Principles of Geotechnical Engineering, 7th ed. Stamford, CT, USA: Cengage Learning, 2006.
  2. K. Terzaghi, R. B. Peck, and G. Mesri, Soil Mechanics in Engineering Practice, 3rd ed. New York, NY, USA: John Wiley & Sons, 1996.
  3. R. D. Holtz, W. D. Kovacs, and T. C. Sheahan, An introduction to geotechnical engineering (P. 733). Englewood Cliffs, NJ: Prentice-hall, 1981.
  4. M. A. Shahin, M. B. Jaksa, and H. R. Maier, “Artificial neural network applications in geotechnical engineering,” Australian Geomechanics, vol. 36, no. 1, pp. 49-62, 2001.
  5. M. A. Shahin, M. B. Jaksa, and H. R. Maier, “State of the art of artificial neural networks in geotechnical engineering,” Electronic Journal of Geotechnical Engineering, vol. 13, Bundle A, pp. 1–26, 2008.
  6. H. Moayedi, M. Mosallanezhad, A. S. A. Rashid, W. A. W. Jusoh and M. A. Muazu, “A systematic review and metaanalysis of artificial neural network application in geotechnical engineering: theory and applications,” Neural Computing and Applications, vol. 32, pp. 495-518, 2020. https://doi.org/10.1007/s00521-019-04109-9
  7. M. A. Shahin, M. B. Jaksa, and H. R. Maier, “Recent advances and future challenges for artificial neural systems in geotechnical engineering applications,” Advances in Artificial Neural Systems, vol. 2009, Art. no. 308239, 2009. https://doi.org/10.1155/2009/308239
  8. A. T. C. Goh, “Back-propagation neural networks for modeling complex systems,” Artificial Intelligence in Engineering, vol. 9, no. 3, pp. 143-151, 1995. https://doi.org/10.1016/0954-1810(94)00011-S
  9. I. Yilmaz and O. Kaynar, “Multiple regression, ANN (RBF, MLP) and ANFIS models for prediction of swell potential of clayey soils,” Expert Systems with Applications, vol. 38, no. 5, pp. 5958-5966, 2011. https://doi.org/10.1016/j.eswa.2010.11.027
  10. J. R. Quinlan, “Induction of decision trees,” Machine Learning, vol. 1, no. 1, pp. 81-106, 1986. https://doi.org/10.1007/BF00116251
  11. G. James, D. Witten, T. Hastie, and R. Tibshirani, An Introduction to Statistical Learning: With Applications in R, 2nd ed. New York, NY, USA: Springer, 2021. https://doi.org/10.1007/978-1-0716-1418-1
  12. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. New York, NY, USA: Springer, 2009. https://doi.org/10.1007/978-0-387-84858-7
  13. C. M. Bishop, Pattern Recognition and Machine Learning, 1st ed. New York, NY, USA: Springer, 2006.
  14. L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5-32, 2001. https://doi.org/10.1023/A:1010933404324
  15. Y. Freund and R. E. Schapire, “A decision-theoretic generalization of on-line learning and an application to boosting,” Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119-139, 1997. https://doi.org/10.1006/jcss.1997.1504
  16. J. H. Friedman, “Greedy function approximation: A gradient boosting machine,” Annals of Statistics, vol. 29, no. 5, pp. 1189-1232, 2001. https://doi.org/10.1214/aos/1013203451
  17. T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, pp. 785-794, 2016. https://doi.org/10.1145/2939672.2939785
  18. C. Reale, K. Gavin, L. Librić, and D. Jurić-Kaćunić, “Automatic classification of fine-grained soils using CPT measurements and artificial neural networks,” Advanced Engineering Informatics, vol. 36, pp. 207-215, 2018. https://doi.org/10.1016/j.aei.2018.04.003
  19. G. H. Erharter, S. Oberhollenzer, A. Fankhauser, R. Marte, and T. Marcher, “Learning decision boundaries for cone penetration test classification,” Computer-Aided Civil and Infrastructure Engineering, vol. 36, no. 4, pp. 489-503, 2021. https://doi.org/10.1111/mice.12662
  20. P. Zhang, Y. F. Jin, and Z. Y. Yin, “Machine learningbased uncertainty modelling of mechanical properties of soft clays relating to time-dependent behavior and its application,” International Journal for Numerical and Analytical Methods in Geomechanics, vol. 45, no. 11, pp. 1588-1602, 2021. https://doi.org/10.1002/nag.3215
  21. W. Zhang and A. T. C. Goh, “Multivariate adaptive regression splines and neural network models for prediction of pile drivability,” Geoscience Frontiers, vol. 7, no. 1, pp. 45-52, 2016. https://doi.org/10.1016/j.gsf.2014.10.003
  22. B. T. Pham, M. D. Nguyen, K. T. T. Bui, I. Prakash, K. Chapi, and D. T. Bui, “A novel artificial intelligence approach based on multi-layer perceptron neural network and biogeography-based optimization for predicting coefficient of consolidation of soil,” CATENA, vol. 173, pp. 302-311, 2019. https://doi.org/10.1016/j.catena.2018.10.004
  23. R. Chen, P. Zhang, H. Wu, Z. Wang, and Z. Zhong, “Prediction of shield tunneling-induced ground settlement using machine learning techniques,” Frontiers of Structural and Civil Engineering, vol. 13, no. 6, pp. 1363-1378, 2019. https://doi.org/10.1007/s11709-019-0561-3
  24. H. Nguyen, X. N. Bui, Q. H. Tran, and N. L. Mai, “A new soft computing model for estimating and controlling blastproduced ground vibration based on hierarchical K-means clustering and Cubist algorithms,” Applied Soft Computing, vol. 77, pp. 376-386, 2019. https://doi.org/10.1016/j.asoc.2019.01.042
  25. D. T. Bui, H. Moayedi, M. Gör, A. Jaafari, and L. K. Foong, “Predicting slope stability failure through machine learning paradigms,” ISPRS International Journal of GeoInformation, vol. 8, no. 9, Art. no. 395, 2019. https://doi.org/10.3390/ijgi8090395
  26. A. Sridharan and H. B. Nagaraj, “Compressibility behaviour of remoulded, fine-grained soils and correlation with index properties,” Canadian Geotechnical Journal, vol. 37, no. 3, pp. 712-722, 2000. https://doi.org/10.1139/t99-128
  27. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
  28. H. Wang, X. Wang, J. F. Wellmann, and R. Y. Liang, “A Bayesian unsupervised learning approach for identifying soil stratification using cone penetration data,” Canadian Geotechnical Journal, vol. 56, no. 8, pp. 1184-1205, 2019. https://doi.org/10.1139/cgj-2017-0709