Cover
Vol. 24 No. 1 (2024)

Published: February 29, 2024

Pages: 48-56

Review Article

Microstructural Images Segmentation Techniques: A Review

Zainab A. Ibrahim 1 Nathera A. Saleh 1 Murtadha A. Jabbar 1
1 Department of Mechanical Engineering, College of Engineering, University of Basrah, Basrah, Iraq
History
  • Received: October 16, 2023
  • Revised: November 12, 2023
  • Accepted: November 16, 2023
  • Available Online: February 15, 2024
DOI

https://doi.org/10.33971/bjes.24.1.6

Abstract

Image segmentation is the process of automatically dividing an image into distinct, meaningful, and non-overlapping regions. The quality of the segmentation process determines the efficiency of other image processing tasks. Analyzing microstructural images is crucial since the mechanical properties are strongly dependent on the microstructural phases’ statistics. These images are considered one of the most difficult and challenging images to deal with due to their special characteristics, such as the convergence in pixels intensity values, overlapping in colors, boundaries and textures in phase regions, infinite shapes of grains and colonies, etc. As there is no generic technique suitable to be used with all microstructures, this work reviews techniques that have been effectively used and recommended to be employed in metallurgical research, with a brief description of their principles, advantages, and disadvantages, and discusses their applicability. The major aim of this work is to spare time and effort searching for and experimenting with all the available methods for future researchers.

Keywords

References

  1. B. Desai, U. Kushwaha, S. Jha, and M. S. Nmims, “Image Filtering-Techniques Algorithms and Applications”, Ores, GIS Science, Vol. 7, No. 11, pp. 970-975, 2020.
  2. N. Dey, Advancements in Applied Metaheuristic Computing, IGI Global, 2018. ISBN13: 9781522541516
  3. B. Jin, L. Cruz and N. Gonçalves, “Deep Facial Diagnosis: Deep Transfer Learning from Face Recognition to Facial Diagnosis”, IEEE, IEEE Access, Vol. 8, pp. 123649123661, 2020.
  4. M. Zhao, Q. Liu, R. Jha, R. Deng, T. Yao, A. MahadevanJansen, M.J. Tyska, B.A. Millis, Y. Huo, “Voxel Embed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning”, In Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 12, pp. 437-446. Springer International Publishing, 2021.
  5. A. Rosochowski and L. Olejnik, Microstructure Evolution in Metal Forming Processes, Woodhead Publishing, ISBN: 9780857090744, 2012.
  6. M. A. Jabbar, “Effect of Retained Austenite on Mechanical Properties of Low Alloy Steel Using Artificial Neural Networks”, Ph.D. thesis, Mechanical Engineering Department, College of Engineering, University of Basrah, 2010.
  7. P. Erdely, P. Staron, E. Maawad, N. Schell, J. Klose, H. Clemens, S. Mayer, “Design and control of microstructure and texture by thermomechanical processing of a multiphase TiAl alloy”, Materials & Design, Vol. 131, pp. 286296, 2017. https://doi.org/10.1016/j.matdes.2017.06.030
  8. X. Liu, “Microstructural Characterization of Pearlitic and Complex Phase Steels Using Image Analysis Methods”, Ph.D. thesis, Metallurgy and Materials Science, School of Engineering, University of Birmingham, 2014.
  9. S. L. Shrestha, A. J. Breen, P. Trimby, G. Proust, S. P. Ringer, J. M. Cairney, “An automated method of quantifying ferrite microstructures using Electron back scatter diffraction (EBSD) data”, Ultramicroscopy, Vol. 137, pp. 40-47, 2014.
  10. J. Komenda, “Automatic recognition of complex microstructures using the Image Classifier”, Materials Characterization, Vol. 46, No. 2-3, pp. 87-92, 2001.
  11. M. Boniardi and A. Casaroli, Steel metallurgy Vol. I, Gruppo Lucefin Research & Development, ISBN:9788890983719, 2017.
  12. S. K. Abdulateef, M. D. Salman, “A Comprehensive Review of Image Segmentation Techniques”, Iraqi Journal for Electrical and Electronic Engineering, Vol. 17, No. 2, 2021. https://doi.org/10.37917/ijeee.17.2.18
  13. Y. Yu, C. Wang, Q. Fu, R. Kou, F. Huang, B. Yang, T. Yang, M. Gao, “Techniques and Challenges of Image Segmentation: A Review”, Electronics, Vol. 12, No. 5, 2023. https://doi.org/10.3390/electronics12051199
  14. N. J. Wala’a, J. M. Rana, “A Survey on Segmentation Techniques for Image Processing”, Iraqi Journal for Electrical and Electronic Engineering, Vol. 17, No. 2, pp.73-93, 2021. https://doi.org/10.37917/ijeee.17.2.10
  15. J. Acharya, S. Gadhiya, and K. Raviya, “Segmentation techniques for image analysis: A review”, International Journal of Computer Science and Management Research, Vol. 2, No. 1, pp. 2278-733, 2013.
  16. C. Amza, “A review on neural network-based image segmentation techniques”, The Gateway Leicester, pp. 123, 2012.
  17. C. R. Gonzalez and R. Woods, Digital Image Processing, Pearson, ISBN 10: 1-292-22304-9, 2007.
  18. J. M. Sosa, D. E. Huber, B. Welk, H. L. Fraser, “Development and application of MIPARTM: a novel software package for two- and three-dimensional microstructural characterization”, Integrating Materials and Manufacturing Innovation, Vol. 3, No. 1, pp. 123-140, 2014. https://doi.org/10.1186/2193-9772-3-10
  19. ASTM Standard, Test Method for Determining Volume Fraction by Systematic Manual Point Count, ASTM E562 standard, 2011.
  20. A. Campbell, P. Murray, E. Yakushina, S. Marshall, W. Ion, “New methods for automatic quantification of microstructural features using digital image processing”, Materials & Design, Vol. 141, pp. 395-406, 2018.
  21. Image Processing Toolbox: User's Guide (r2020a), The MathWorks Inc. https://www.mathworks.com/help/images/index.html
  22. S. Gupta, J. Sarkar, M. Kundu, N. R. Bandyopadhyay, S. Ganguly, “Automatic recognition of SEM microstructure and phases of steel using LBP and random decision forest operator”, Measurement, Vol. 151, 2020.
  23. P. Singh, R. S. Chadha “A new approach to image segmentation”, International Journal of Advanced Research in Computer Science and Software Engineering, Vol. 3, No. 4, 2013.
  24. J. Gola, D. Britz, T. Staudt, M. Winter, A. S. Schneider, M. Ludovici, F. Mücklich, “Advanced microstructure classification by data mining methods”, Computational Materials Science, Vol. 148, pp 324-335, 2018.
  25. J. Gola, J. Webel, D. Britz, A. Guitar, T. Staudt, M. Winter, F. Mücklich, “Objective microstructure classification by support vector machine (SVM) using a combination of morphological parameters and textural features for low carbon steels”, Computational Materials Science, Vol. 160, Pp186-196, 2019.
  26. D. Naik, H. Sajid, R. Kiran, “Texture-Based Metallurgical Phase Identification in Structural Steels: A Supervised Machine Learning Approach”, Metals, Vol. 9, No. 5, 2019.
  27. A. Fuchs, “Application of Microstructural Texture Parameters to Diffusional and Displacive Transformation Products”, Ph.D. thesis, Metallurgy and Materials Science, School of Engineering, University of Birmingham, 2005.
  28. D. O. Fernandes, C. T. M. Anflor, J. N. V. Goulart, B. Baranoğlu, “Nodular Cast Iron GGG40, 60, 70 Mechanical Characterization from Bars and Blocks Obtained from Brazilian Foundry”, Metals, Vol. 12, No. 7, 2022.
  29. A. Glasbey, G. W. Horgan, “Encyclopaedia of Environmetrics: Image Analysis”, A.H. El-Shaarawi and W.W. Piegorsch, pp. 1023-1025, 2001.
  30. L. Rauch, J. Kusiak, “Edge Detection and Filtering Approach Dedicated to Microstructure Images Analysis”, Computer Methods in Materials Science, Vol. 7, pp. 305310, 2007.
  31. P. Sakthivel, V. Suresh, P. Suresh, and N. Mahalakshmi. “Microstructure Anlaysis and Enhancement of Nodular Cast Iron Using Digital Image Processing Method”, International Journal of Research in Engineering and Technology, Vol. 4, No. 4, pp. 101-106, 2015.
  32. S. R. Biswal, T. Sahoo, S. Sahoo, “Prediction of grain boundary of a composite microstructure using digital image processing: A comparative study”, Materials Today: Proceedings, Vol. 41, pp. 357-362, 2021.
  33. A. Choudhury, S. Pal, R. Naskar, A. Basumallick, “Computer vision approach for phase identification from steel microstructure”, Engineering Computations, Vol. 36, Issue 6, pp. 1913-1933, 2019.
  34. M. Müller, G. Stanke, U. Sonntag, D. Britz, F. Mücklich, “Segmentation of Lath Like Structures via Localized Identification of Directionality in a Complex Phase Steel”, Metallography Microstructure and Analysis, Vol.9, pp. 709-720, 2020.
  35. L. Chen, M. Jiang, J. Chen, “Image segmentation using iterative watersheding plus ridge detection”, 16th IEEE International Conference on Image Processing (ICIP), pp. 4033-4036, 2009.
  36. F. Meyer, “Topographic distance and watershed lines”, Signal Processing, Vol. 38, Issue 1, pp.113-125,1994.
  37. A. R. Durmaz, M. Müller, B. Lei, A. Thomas, D. Britz, E. A. Holm, P. Gumbsch, “A deep learning approach for complex microstructure inference”, Nature communications, Vol. 12, Issue 1, 2021.
  38. C. Wang, D. Shi, S. Li, “A study on establishing a microstructure-related hardness model with precipitate segmentation using deep learning method”, Materials, Vol. 13, 2020. https://doi.org/10.3390/ma13051256
  39. T. M. Ostormujof, R. R. P. P. R. Purohit, S. Breumier, N. Gey, M. Salib, L. Germain, “Deep Learning for automated phase segmentation in EBSD maps. A case study in Dual Phase steel microstructures”, Materials Characterization, Vol. 184, 2022.
  40. S. M. Azimi, D. Britz, M. Engstler, M. Fritz, F. Mücklich, “Advanced Steel Microstructural Classification by Deep Learning Methods”, Scientific Reports, Vol. 8, Issue 1, 2018. https://doi.org/10.1038/s41598-018-20037-5
  41. D. S. Bulgarevich, S. Tsukamoto, T. Kasuy, M. Demura, M. Watanabe, “Pattern recognition with machine learning on optical microscopy images of typical metallurgical microstructures”, Scientific Reports, Vol. 8, Issue 1,2018.
  42. F. Ajioka, Z. L. Wang, T. Ogawa, Y. Adachi, “Development of high accuracy segmentation model for microstructure of steel by deep learning”, ISIJ International, Vol. 60, Issue 5, pp. 954-959, 2020.
  43. L. Ryde, “Application of EBSD to analysis of microstructures in commercial steels”, Materials Science and Technology, Vol. 22, Issue 11, pp. 1297-1306, 2006.
  44. S. Tang, Z. Y. Liu, G. D. Wang, R. D. K. Misra, “Microstructural Evolution and Mechanical Properties of High Strength Microalloyed Steels: Ultrafast Cooling (UFC) versus Accelerated Cooling (ACC)”, Materials Science and Engineering: A, Vol. 580, pp. 257-265, 2013.
  45. N. Isasti, D. Jorge-Badiola, M. L. Taheri, P. Uranga, “Phase Transformation Study in Nb-Mo Microalloyed Steels Using Dilatometry and EBSD Quantification”, Metallurgical and materials transactions A, Vol. 44, pp. 3552-3563, 2013.
  46. S. Zaefferer, P. Romano, F. Friedel, “EBSD as a tool to identify and quantify bainite and ferrite in low alloyed AlTRIP steels”, Journal of Microscopy, Vol. 230, Issue 3, pp. 499-508, 2008.
  47. K. Zhu, D. Barbier, T. Iung, “Characterization and quantification methods of complex BCC matrix microstructures in advanced high strength steels”, Journal of Materials Science, Vol. 48, Issue 1, pp. 413-423, 2013.
  48. F. Zhang, A. Ruimi, D. P. Field, “Phase Identification of Dual-Phase (DP980) Steels by Electron Backscatter Diffraction and Nanoindentation Techniques”, Microscopy Society of America, Microscopy and Microanalysis, Vol. 22, Issue 1, pp. 99-107, 2016.
  49. P. T. Pinard, A. Schwedt, A. Ramazani, U. Prahl, S. Richter, “Characterization of dual-phase steel microstructure by combined submicrometer EBSD and EPMA carbon measurements”, Microscopy Society of America, Microscopy and Microanalysis, Vol. 19, Issue 4, pp. 996-1006, 2013.