1887
Volume 73, Issue 2
  • E-ISSN: 1365-2478

Abstract

Abstract

Lithology classification is a fundamental aspect of reservoir classification. Due to the limited availability of core samples, computational modelling methods for lithology classification based on indirect measurements are required. The main challenge for standard clustering methods is the complex vertical dependency of sedimentological sequences as well as the spatial coupling of well logs. Machine learning methods, such as recurrent neural networks, long short‐term memory and bidirectional long short‐term memory, can account for the spatial correlation of the measured data and the predicted model. Based on these developments, we propose a novel approach using two distinct models: a self‐attention‐assisted bidirectional long short‐term memory model and a multi‐head attention‐based bidirectional long short‐term memory model. These models consider spatial continuity and adaptively adjust the weight in each step to improve the classification using the attention mechanism. The proposed method is tested on a set of real well logs with limited training data obtained from core samples. The prediction results from the proposed models and the benchmark one are compared in terms of the accuracy of lithology classification. Additionally, the weight matrices from both attention mechanisms are visualized to elucidate the correlations between depth steps and to help analyse how these mechanisms contribute to improved prediction accuracy. The study shows that the proposed multi‐head attention‐based bidirectional long short‐term memory model improves classification, especially for thin layers.

© 2025 European Association of Geoscientists & Engineers. © 2024 European Association of Geoscientists & Engineers.
Loading

Article metrics loading...

/content/journals/10.1111/1365-2478.13618
2025-01-26
2026-01-17

  • From This Site

    /content/journals/10.1111/1365-2478.13618
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Al‐Anazi, A. & Gates, I.D. (2010) On the capability of support vector machines to classify lithology from well logs. Natural Resources Research, 19(2), 125–139.
     [Google Scholar]
  2. An, B., Lyu, J., Wang, Z., Li, C., Hu, C., Tan, F., Zhang, R., Hu, Y. & Chen, C. (2020) Repulsive attention: Rethinking multi‐head attention as Bayesian inference. arXiv. https://doi.org/10.48550/arXiv:2009.09364.
  3. Bahdanau, D., Cho, K., & Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. CoRR, abs/1409.0473.
  4. Baldwin, J.L., Bateman, R.M. & Wheatley, C.L. (1990) Application of a neural network to the problem of mineral identification from well logs. Log Analyst, 3(5), 279–293.
     [Google Scholar]
  5. Benaouda, D., Wadge, G., Whitmarsh, R., Rothwell, R. & MacLeod, C. (1999) Inferring the lithology of borehole rocks by applying neural network classifiers to downhole logs: an example from the ocean drilling program. Geophysical Journal International, 136(2), 477–491.
     [Google Scholar]
  6. Bressan, T.S., de Souza, M.K., Girelli, T.J. & Junior, F.C. (2020) Evaluation of machine learning methods for lithology classification using geophysical data. Computers & Geosciences, 139, 104475.
     [Google Scholar]
  7. Busch, J.M., Fortney, W.G. & Berry, L.N. (1987) Determination of lithology from well logs by statistical analysis. SPE Formation Evaluation, 2(4), 412–418.
     [Google Scholar]
  8. Chai, X., Nie, W., Lin, K., Tang, G., Yang, T., Yu, J. & Cao, W. (2022) An open‐source package for deep‐learning‐based seismic facies classification: benchmarking experiments on the SEG 2020 Open Data. IEEE Transactions on Geoscience and Remote Sensing, 60, 1–19.
     [Google Scholar]
  9. Chaudhari, S., Mithal, V., Polatkan, G. & Ramanath, R. (2021) An attentive survey of attention models. ACM Transactions on Intelligent Systems and Technology, 12(5), 1–32.
     [Google Scholar]
  10. Chiu, C.‐C. & Raffel, C. (2017) Monotonic chunkwise attention. arXiv. https://doi.org/10.48550/arXiv:1712.05382.
  11. Chorowski, J., Bahdanau, D., Serdyuk, D., Cho, K. & Bengio, Y. (2015) Attention‐based models for speech recognition. arXiv. https://doi.org/10.48550/arXiv:1506.07503.
  12. Cohen, J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.
     [Google Scholar]
  13. Corina, A.N. & Hovda, S. (2018) Automatic lithology prediction from well logging using kernel density estimation. Journal of Petroleum Science and Engineering, 170, 664–674.
     [Google Scholar]
  14. Delfiner, P., Peyret, O. & Serra, O. (1987) Automatic determination of lithology from well logs. SPE Formation Evaluation, 2(3), 303–310.
     [Google Scholar]
  15. Dev, V.A. & Eden, M.R. (2019) Formation lithology classification using scalable gradient boosted decision trees. Computers & Chemical Engineering, 128, 392–404.
     [Google Scholar]
  16. Dong, S., Wang, Z. & Zeng, L. (2016) Lithology identification using kernel Fisher discriminant analysis with well logs. Journal of Petroleum Science and Engineering, 143, 95–102.
     [Google Scholar]
  17. dos Santos, D.T., Roisenberg, M. & dos Santos Nascimento, M. (2022) Deep recurrent neural networks approach to sedimentary facies classification using well logs. IEEE Geoscience and Remote Sensing Letters. 19, 3001405.
     [Google Scholar]
  18. Ellis (2007) Well logging for earth scientists. Dordrecht: Springer Netherlands.
     [Google Scholar]
  19. Elsayed, G.F., Kornblith, S. & Le, Q.V. (2019) Saccader: Improving accuracy of hard attention models for vision. arXiv. https://doi.org/10.48550/arXiv:1908.07644.
  20. Gabriel, R.A., Park, B.H., Mehdipour, S., Bongbong, D.N., Simpson, S. & Waterman, R.S. (2023) Leveraging a natural language processing model (transformers) on electronic medical record notes to classify persistent opioid use after surgery. Anesthesia & Analgesia, 137(3), 714–716.
     [Google Scholar]
  21. Grana, D., Azevedo, L. & Liu, M. (2020) A comparison of deep machine learning and Monte Carlo methods for facies classification from seismic data. Geophysics, 85(4), WA41–WA52.
     [Google Scholar]
  22. Graves, A., Fernández, S. & Schmidhuber, J. (2005) Bidirectional LSTM networks for improved phoneme classification and recognition. In: International conference on artificial neural networks. Cham: Springer, pp. 799–804.
  23. Greff, K., Srivastava, R.K., Koutník, J., Steunebrink, B.R. & Schmidhuber, J. (2016) LSTM: A search space odyssey. IEEE Transactions on Neural Networks and Learning Systems, 28(10), 2222–2232.
     [Google Scholar]
  24. Hall, B. (2016) Facies classification using machine learning. The Leading Edge, 35(10), 906–909.
     [Google Scholar]
  25. Hochreiter, S. & Schmidhuber, J. (1997) Long short‐term memory. Neural Computation, 9(8), 1735–1780.
     [Google Scholar]
  26. Imamverdiyev, Y. & Sukhostat, L. (2019) Lithological facies classification using deep convolutional neural network. Journal of Petroleum Science and Engineering, 174, 216–228.
     [Google Scholar]
  27. India, M., Safari, P. & Hernando, J. (2019) Self multi‐head attention for speaker recognition. arXiv. https://doi.org/10.48550/arXiv:1906.09890.
  28. Jaikla, C., Devarakota, P., Auchter, N., Sidahmed, M. & Espejo, I. (2019) FaciesNet: machine learning applications for facies classification in well logs. In: Conference on neural information processing systems, Vancouver. AAPG, pp. 8–14.
  29. Jiang, C., Zhang, D. & Chen, S. (2021) Lithology identification from well log curves via neural networks with additional geological constraint. Geophysics, 86(5), 1–77.
     [Google Scholar]
  30. Joseph, L.P., Deo, R.C., Prasad, R., Salcedo‐Sanz, S., Raj, N. & Soar, J. (2023) Near real‐time wind speed forecast model with bidirectional LSTM networks. Renewable Energy, 204, 39–58.
     [Google Scholar]
  31. Kakouei, A., Masihi, M., Sola, B.S. & Biniaz, E. (2014) Lithological facies identification in Iranian largest gas field: a comparative study of neural network methods. Journal of the Geological Society of India, 84, 326–334.
     [Google Scholar]
  32. Leite, V.R., Silva, P.M.C., Gattass, M. & Silva, A.C. (2013) Analysis of ensemble methods applied to lithology classification from well logs. In: 13th international congress of the Brazilian Geophysical Society & EXPOGEF, Rio de Janeiro, Brazil, 26–29 August 2013 Houston, TX: Society of Exploration Geophysicists and Brazilian Geophysical Society, pp. 949–952.
  33. Li, S., Zhou, K., Zhao, L., Xu, Q. & Liu, J. (2022) An improved lithology identification approach based on representation enhancement by logging feature decomposition, selection and transformation. Journal of Petroleum Science and Engineering, 209, 109842.
     [Google Scholar]
  34. Lin, J., Li, H., Liu, N., Gao, J. & Li, Z. (2021) Automatic lithology identification by applying LSTM to logging data: a case study in X tight rock reservoirs. IEEE Geoscience and Remote Sensing Letters, 18(8), 1361–1365.
     [Google Scholar]
  35. Lin, Z., Feng, M., Santos, C.N.d., Yu, M., Xiang, B., Zhou, B. & Bengio, Y. (2017) A structured self‐attentive sentence embedding. arXiv. https://doi.org/10.48550/arXiv:1703.03130.
  36. Maiti, S., Tiwari, R.K. & Kümpel, H. (2010) Neural network modelling and classification of lithofacies using well log data: a case study from KTB borehole site. Geophysical Journal of the Royal Astronomical Society, 169(2), 733–746.
     [Google Scholar]
  37. Nasim, M.Q., Maiti, T., Srivastava, A., Singh, T. & Mei, J. (2022) Seismic facies analysis: a deep domain adaptation approach. IEEE Transactions on Geoscience and Remote Sensing, 60, 1–16.
     [Google Scholar]
  38. Nava, L., Carraro, E., Reyes‐Carmona, C., Puliero, S., Bhuyan, K., Rosi, A., Monserrat, O., Floris, M., Meena, S.R., Galve, J.P., et al,. (2023) Landslide displacement forecasting using deep learning and monitoring data across selected sites. Landslides, 20(10), 2111–2129.
     [Google Scholar]
  39. Noh, K., Kim, D. & Byun, J. (2023) Explainable deep learning for supervised seismic facies classification using intrinsic method. IEEE Transactions on Geoscience and Remote Sensing, 61, 1–11.
     [Google Scholar]
  40. Ouadfeul, S.‐A. & Aliouane, L. (2012) Lithofacies classification using the multilayer perceptron and the self‐organizing neural networks. In: Neural information processing, Proceedings of the 19th International Conference, ICONIP 2012, Doha, Qatar, November 12‐15, 2012, Part V. Cham: Springer, pp. 737–744.
  41. Pradhan, A. & Mukerji, T. (2022) Consistency and prior falsification of training data in seismic deep learning: application to offshore deltaic reservoir characterization. Geophysics, 87(3), N45–N61.
     [Google Scholar]
  42. Qin, C., Zhang, A., Zhang, Z., Chen, J., Yasunaga, M. & Yang, D. (2023) Is ChatGPT a general‐purpose natural language processing task solver? arXiv. https://doi.org/10.48550/arXiv:2302.06476.
  43. Ren, Q., Zhang, H., Zhang, D., Zhao, X. & Yu, X. (2023) Enhancing seismic facies classification using interpretable feature selection and time series ensemble learning model with uncertainty assessment. IEEE Transactions on Geoscience and Remote Sensing, 61, 4506813.
     [Google Scholar]
  44. Rogers, S.J., Fang, J.H., Karr, C.L. & Stanley, D.A. (1992) Determination of lithology from well logs using a neural network. AAPG Bulletin, 76, 731–739.
     [Google Scholar]
  45. Rush, A.M., Chopra, S. & Weston, J. (2015) A neural attention model for abstractive sentence summarization. arXiv. https://doi.org/10.48550/arXiv:1509.00685.
  46. Schuster, M. & Paliwal, K.K. (1997) Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11), 2673–2681.
     [Google Scholar]
  47. Sebtosheikh, M.A., Motafakkerfard, R., Riahi, M.‐A., Moradi, S. & Sabety, N. (2015) Support vector machine method, a new technique for lithology prediction in an Iranian heterogeneous carbonate reservoir using petrophysical well logs. Carbonates and Evaporites, 30(1), 59–68.
     [Google Scholar]
  48. Sharma, S., Kiros, R. & Salakhutdinov, R. (2015) Action recognition using visual attention. arXiv. https://doi.org/10.48550/arXiv:1511.04119.
  49. Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S. & Zhang, C. (2018) Disan: directional self‐attention network for RNN/CNN‐free language understanding. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). https://doi.org/10.1609/aaai.v32i1.11941
     [Google Scholar]
  50. Silva, A.A., Neto, I. A.L., Misságia, R.M., Ceia, M.A., Carrasquilla, A.G. & Archilha, N.L. (2015) Artificial neural networks to support petrographic classification of carbonate‐siliciclastic rocks using well logs and textural information. Journal of Applied Geophysics, 117, 118–125.
     [Google Scholar]
  51. Song, S., Mukerji, T. & Hou, J. (2021) Bridging the gap between geophysics and geology with generative adversarial networks. IEEE Transactions on Geoscience and Remote Sensing, 60, 1–11.
     [Google Scholar]
  52. Tao, C., Gao, S., Shang, M., Wu, W., Zhao, D., & Yan, R. (2018). Get The Point of My Utterance! Learning Towards Effective Responses with Multi‐Head Attention Mechanism. Proceedings of the Twenty‐Seventh International Joint Conference on Artificial Intelligence, 4418–4424. https://doi.org/10.24963/ijcai.2018/614
     [Google Scholar]
  53. Talarico, E., Leão, W. & Grana, D. (2021) Comparison of recursive neural network and Markov chain models in facies inversion. Mathematical Geosciences, 53(3), 395–413.
     [Google Scholar]
  54. Tian, M., Omre, H. & Xu, H. (2021) Inversion of well logs into lithology classes accounting for spatial dependencies by using hidden Markov models and recurrent neural networks. Journal of Petroleum Science and Engineering, 196, 107598.
     [Google Scholar]
  55. Tian, M. & Verma, S. (2022) Recurrent neural network: application in facies classification. In Advances in subsurface data analytics. Amsterdam: Elsevier, pp. 65–94.
  56. Urbanowicz, R.J. & Moore, J.H. (2015) Exstracs 2.0: description and evaluation of a scalable learning classifier system. Evolutionary Intelligence, 8, 89–116.
     [Google Scholar]
  57. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł. & Polosukhin, I. (2017) Attention is all you need. In: Advances in neural information processing systems, Cambridge, MA: MIT Press. pp. 5998–6008.
  58. Wang, W., Yang, N., Wei, F., Chang, B. & Zhou, M. (2017) Gated self‐matching networks for reading comprehension and question answering. In Proceedings of the 55th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg, PA: Association for Computational Linguistics, pp. 189–198.
  59. Wolf, M. & Pelissier‐Combescure, J. (1982) Faciolog‐automatic electrofacies determination. In: SPWLA 23rd Annual Logging Symposium. OnePetro.
  60. Wrona, T., Pan, I., Gawthorpe, R.L. & Fossen, H. (2018) Seismic facies analysis using machine learning. Geophysics, 83(5), O83–O95.
     [Google Scholar]
  61. Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., & Bengio, Y. (2015) Show, attend and tell: neural image caption generation with visual attention. Proceedings of the 32nd International Conference on International Conference on Machine Learning, 37, pp. 2048‐2057.
  62. You, J., Zhao, J., Huang, X., Zhang, G., Chen, A., Hou, M. & Cao, J. (2023) Explainable convolutional neural networks driven knowledge mining for seismic facies classification. IEEE Transactions on Geoscience and Remote Sensing.
  63. Zhao, L., Zou, C., Chen, Y., Shen, W., Wang, Y., Chen, H. & Geng, J. (2021) Fluid and lithofacies prediction based on integration of well‐log data and seismic inversion: a machine‐learning approach. Geophysics, 86(4), M151–M165.
     [Google Scholar]
  64. Zhou, K., Zhang, J., Ren, Y., Huang, Z. & Zhao, L. (2020) A gradient boosting decision tree algorithm combining synthetic minority oversampling technique for lithology identification. Geophysics, 85(4), WA147–WA158.
     [Google Scholar]
/content/journals/10.1111/1365-2478.13618
Loading
Attention mechanism‐assisted recurrent neural network for well log lithology classification
Geophysical Prospecting 73, 628 (2025); https://doi.org/10.1111/1365-2478.13618
/content/journals/10.1111/1365-2478.13618
/content/journals/10.1111/1365-2478.13618
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Inversion; Logging; Reservoir geophysics

Most Cited This Month Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error