1887
Volume 37, Issue 9
  • ISSN: 0263-5046
  • E-ISSN: 1365-2397

Abstract

Abstract

Deep learning continues to receive increasing attention from researchers and has been successfully applied to many domains. This paper further extends the work from Zabihi Naeini and Prindle (2018) by adopting and examining two classes of Machine Learning techniques and their applications in geoscience with a pragmatic view. These are Transfer Learning and Automated Machine Learning or Auto-ML (Feurer and Klein, 2015). Although machine learning (ML) is known to be most efficient and accurate when trained on a large volume of data, there are cases in practice where ML methods are also implemented with limited available data. In such cases ML algorithms are less efficient in generalising to new data and it is where Transfer Learning can add value. This is shown in an automatic petrophysical interpretation task where Transfer Learning is compared with training from scratch given a new geological area of interest, i.e., a set of wells in a different area. We show the efficiency of Transfer Learning in obtaining a model that generalizes successfully for the new wells investigated.

Loading

Article metrics loading...

/content/journals/10.3997/1365-2397.n0060
2019-09-01
2024-04-25
Loading full text...

Full text loading...

References

  1. Bergstra, J., Yamins, D. and Cox, D.
    [2013]. Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms, SCIPY
    [Google Scholar]
  2. Feurer, M. and Klein, A.
    [2015]. Efficient and robust automated machine learning, Advances in Neural Information Processing Systems. Advances in Neural Information Processing Systems, 28.
    [Google Scholar]
  3. Sarkar, D., Ghosh, T. and Bali, R.
    [2018]. Hands-On Transfer Learning with Python. Packt Publishing, 1.
    [Google Scholar]
  4. Guyon, I. and Sun-Hosoya, L.
    [2019]. Analysis of the Auto-ML Challenge Series 2015–2018. Automated Machine Learning, Methods, Systems, Challenges, Springer Series on the Challenges in Machine Learning, 177–219.
    [Google Scholar]
  5. Jin, H., and Song, Q.
    [2018]. Auto-Keras: An Efficient Neural Architecture Search. arXiv:1806.10282.
    [Google Scholar]
  6. Khoshgoftaar, T.M. and Weiss, K.
    [2016]. A survey of transfer learning, Journal of Big Data.
    [Google Scholar]
  7. Mendoza, H. and Klein, A.
    [2016]. Towards automatically-tuned neural networks. ICML Workshop on Auto-ML, 58–65.
    [Google Scholar]
  8. Pedregosa, F.
    [2011]. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
    [Google Scholar]
  9. Pham, H., and Guan, M.Y.
    [2018]. Efficient Neural Architecture Search via Parameter Sharing. arXiv:1802.03268.
    [Google Scholar]
  10. Yang, L. and Hannek, S.
    [2013]. A theory of transfer learning with applications to active learning. Machine Learning, 161–189.
    [Google Scholar]
  11. Yang, Q.
    [2008]. An Introduction to Transfer Learning, Advanced Data Mining and Applications, ADMA 2008. Lecture Notes in Computer Science, 5139.
    [Google Scholar]
  12. Zabihi, Naeini E. and Prindle, K.
    [2018]. Machine learning and learning from machines. The Leading Edge, 886–893.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.3997/1365-2397.n0060
Loading
/content/journals/10.3997/1365-2397.n0060
Loading

Data & Media loading...

  • Article Type: Research Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error