1887
Volume 73, Issue 8
  • E-ISSN: 1365-2478

Abstract

ABSTRACT

This research presents an innovative framework for lithology detection that combines domain adaptation, an Actor–Critic reinforcement learning (RL) architecture and Transformer‐based sequence modelling to enhance log interpretation reliability in complex depositional environments. The study first reviews conventional petrophysical characterization methods using wireline measurements, noting their limitations in dealing with varied lithofacies distributions and non‐stationary formation properties. Subsequently, it emphasizes the superior capabilities of neural networks, particularly the Transformer architecture, in analysing temporal measurement sequences. The multi‐head attention mechanism in Transformers effectively models contextual relationships within depth‐dependent logging signals, which is vital for stratigraphic interpretation. The proposed framework incorporates the Actor–Critic reinforcement paradigm, where the policy network (Actor) generates lithofacies predictions, and the value network (Critic) evaluates prediction quality. This dual‐network setup promotes iterative policy refinement through feedback, enhancing classification consistency and computational efficiency. Moreover, recognizing the potential for domain shifts in logging campaigns, the framework includes parameter transfer mechanisms to facilitate knowledge distillation from source to target domains. This ability to adapt across projects significantly boosts model robustness and deployment feasibility in diverse reservoirs. Experimental validation on multiple well‐log datasets shows that the combined Transformer architecture, RL, and transfer strategies outperform traditional machine learning and standalone deep learning models. Quantitative results reveal improvements in prediction accuracy, cross‐well generalizability and domain adaptation efficiency in novel geological environments.

© 2025 European Association of Geoscientists & Engineers. © 2025 European Association of Geoscientists & Engineers.
Loading

Article metrics loading...

/content/journals/10.1111/1365-2478.70083
2025-10-20
2025-11-09

  • From This Site

    /content/journals/10.1111/1365-2478.70083
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Ali, M., H.Changxingyue, N.Wei, et al. 2024. “Optimizing Seismic‐Based Reservoir Property Prediction: A Synthetic Data‐Driven Approach Using Convolutional Neural Networks and Transfer Learning With Real Data Integration.” Artificial Intelligence Review58, no. 1: 31.
     [Google Scholar]
  2. Ali, M., P.Zhu, R.Jiang, et al. 2024. “Data‐Driven Lithofacies Prediction in Complex Tight Sandstone Reservoirs: A Supervised Workflow Integrating Clustering and Classification Models.” Geomechanics and Geophysics for Geo‐Energy and Geo‐Resources10, no. 1: 1–23.
     [Google Scholar]
  3. Alomari, A., N.Idris, A. Q. M.dSabri, and I.Alsmadi. 2022. “Deep Reinforcement and Transfer Learning for Abstractive Text Summarization: A Review.” Computer Speech & Language71: 101276.
     [Google Scholar]
  4. Ashraf, U., A.Anees, H.Zhang, M.Ali, H. V.Thanh, and Y.Yuan. 2024. “Identifying Payable Cluster Distributions for Improved Reservoir Characterization: A Robust Unsupervised ML Strategy for Rock Typing of Depositional Facies in Heterogeneous Rocks.” Geomechanics and Geophysics for Geo‐Energy and Geo‐Resources10, no. 1: 131.
     [Google Scholar]
  5. Ashraf, U., H.Zhang, H. V.Thanh, et al. 2024. “A Robust Strategy of Geophysical Logging for Predicting Payable Lithofacies to Forecast Sweet Spots Using Digital Intelligence Paradigms in a Heterogeneous Gas Field.” Natural Resources Research33, no. 4: 1741–1762.
     [Google Scholar]
  6. Bhatnagar, S., R. S.Sutton, M.Ghavamzadeh, and M.Lee. 2009. “Natural Actor–Critic Algorithms.” Automatica45, no. 11: 2471–2482.
     [Google Scholar]
  7. de Amorim, L. B. V., G. D. C.Cavalcanti, and R. M. O.Cruz. 2023. “The Choice of Scaling Technique Matters for Classification Performance.” Applied Soft Computing133: 109924.
     [Google Scholar]
  8. Fu, G., J.Yan, K.Zhang, H.Hu, and F.Luo. 2017. “Current Status and Progress of Lithology Identification Technology.” Progress in Geophysics32, no. 1: 26–40.
     [Google Scholar]
  9. Gruetzemacher, R., and D.Paradice. 2022. “Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research.” ACM Computing Surveys (CSUR)54, no. 10s: 1–35.
     [Google Scholar]
  10. Junru, S., W.Qiong, L.Muhua, J.Zhihang, Z.Ruijuan, and W.Qingtao. 2023. “Decentralized Multi‐Task Reinforcement Learning Policy Gradient Method With Momentum Over Networks.” Applied Intelligence53, no. 9: 10365–10379.
     [Google Scholar]
  11. Kumar, T., N. K.Seelam, and G. S.Rao. 2022. “Lithology Prediction From Well Log Data Using Machine Learning Techniques: A Case Study From Talcher Coalfield, Eastern India.” Journal of Applied Geophysics199: 104605.
     [Google Scholar]
  12. Li, H., and H.He. 2023. “Multiagent Trust Region Policy Optimization.” IEEE Transactions on Neural Networks and Learning Systems35, no. 9: 12873–12887.
     [Google Scholar]
  13. Li, J., L.Wu, W.Lü, et al. 2022. “Lithology Classification Based on Set‐Valued Identification Method.” Journal of Systems Science and Complexity35, no. 5: 1637–1652.
     [Google Scholar]
  14. Li, Z., S.Deng, Y.Hong, Z.Wei, and L.Cai. 2024. “A Novel Hybrid CNN–SVM Method for Lithology Identification in Shale Reservoirs Based on Logging Measurements.” Journal of Applied Geophysics223: 105346.
     [Google Scholar]
  15. Lin, J., H.Li, N.Liu, J.Gao, and Z.Li. 2020. “Automatic Lithology Identification by Applying LSTM to Logging Data: A Case Study in X Tight Rock Reservoirs.” IEEE Geoscience and Remote Sensing Letters18, no. 8: 1361–1365.
     [Google Scholar]
  16. Liu, H., Y.Wu, Y.Cao, et al. 2020. “Well Logging Based Lithology Identification Model Establishment Under Data Drift: A Transfer Learning Method.” Sensors20, no. 13: 3643.
     [Google Scholar]
  17. Martinez‐Millana, A., J. M.Hulst, M.Boon, et al. 2018. “Optimisation of Children Z‐Score Calculation Based on New Statistical Techniques.” PLoS ONE13, no. 12: e0208362.
     [Google Scholar]
  18. Mishra, A., A.Sharma, and A. K.Patidar. 2022. “Evaluation and Development of a Predictive Model for Geophysical Well Log Data Analysis and Reservoir Characterization: Machine Learning Applications to Lithology Prediction.” Natural Resources Research31, no. 6: 3195–3222.
     [Google Scholar]
  19. Sun, Y., S.Pang, J.Zhang, and Y.Zhang. 2023. “DRSN‐GAF: Deep Residual Shrinkage Network (DRSN) for Lithology Classification Through Well Logging Data Transformed by Gram Angle Field.” IEEE Geoscience and Remote Sensing Letters21: 1–5.
     [Google Scholar]
  20. Sun, Y., S.Pang, Y.Zhang, and J.Zhang. 2024. “Application of the Dynamic Transformer Model With Well Logging Data for Formation Porosity Prediction.” Physics of Fluids36, no. 3: 036620.
     [Google Scholar]
  21. Sun, Y., J.Zhang, Z.Yu, Y.Zhang, and Z.Liu. 2023. “The Bidirectional Gated Recurrent Unit Network Based on the Inception Module (Inception‐BiGRU) Predicts the Missing Data by Well Logging Data.” ACS Omega8, no. 30: 27710–27724.
     [Google Scholar]
  22. Sun, Y., J.Zhang, and Y.Zhang. 2024. “Adaboost Algorithm Combined Multiple Random Forest Models (Adaboost‐RF) Is Employed for Fluid Prediction Using Well Logging Data.” Physics of Fluids36, no. 1: 016602.
     [Google Scholar]
  23. Tian, M., B.Li, H.Xu, D.Yan, Y.Gao, and X.Lang. 2021. “Deep Learning Assisted Well Log Inversion for Fracture Identification.” Geophysical Prospecting69, no. 2: 419–433.
     [Google Scholar]
  24. Van Erven, T., and P.Harremos. 2014. “Rényi Divergence and Kullback–Leibler Divergence.” IEEE Transactions on Information Theory60, no. 7: 3797–3820.
     [Google Scholar]
  25. Wang, J., J.Cao, J.Fu, and H.Xu. 2022. “Missing Well Logs Prediction Using Deep Learning Integrated Neural Network With the Self‐Attention Mechanism.” Energy261: 125270.
     [Google Scholar]
  26. Wang, N., X.Meng, X.Meng, and F.Shao. 2022. “Convolution‐Embedded Vision Transformer With Elastic Positional Encoding for Pansharpening.” IEEE Transactions on Geoscience and Remote Sensing60: 1–9.
     [Google Scholar]
  27. Yu, Z., Y.Sun, J.Zhang, Y.Zhang, and Z.Liu. 2023. “Gated Recurrent Unit Neural Network (GRU) Based on Quantile Regression (QR) Predicts Reservoir Parameters Through Well Logging Data.” Frontiers in Earth Science11: 1087385.
     [Google Scholar]
  28. Zhang, J., Y.He, Y.Zhang, W.Li, and J.Zhang. 2022. “Well‐Logging‐Based Lithology Classification Using Machine Learning Methods for High‐Quality Reservoir Identification: A Case Study of Baikouquan Formation in Mahu Area of Junggar Basin, NW China.” Energies15, no. 10: 3675.
     [Google Scholar]
  29. Zhu, Q., L.Zhu, Z.Wang, et al. 2025. “Hybrid Triboelectric‐Piezoelectric Nanogenerator Assisted Intelligent Condition Monitoring for Aero‐Engine Pipeline System.” Chemical Engineering Journal519: 165121.
     [Google Scholar]
  30. Zhu, Z., K.Lin, A. K.Jain, and J.Zhou. 2023. “Transfer Learning in Deep Reinforcement Learning: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence45, no. 11: 13344–13362.
     [Google Scholar]
/content/journals/10.1111/1365-2478.70083
Loading
Hybrid Transferable Deep Reinforcement Learning and Transformer Architecture for Enhanced Lithology Identification From Well‐Logging Data
Geophysical Prospecting 73, e70083 (2025); https://doi.org/10.1111/1365-2478.70083
/content/journals/10.1111/1365-2478.70083
/content/journals/10.1111/1365-2478.70083
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): deep reinforcement learning—transfer learning (DRL–TL)‐Transformer; lithology prediction; logging parameters; machine learning; transfer deep reinforcement learning

Most Cited This Month Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error