1887

Abstract

Summary

Use of metrics are key in application of machine learning in any domain. Good metrics allow us to assess performance of algorithms, gain insight into the behaviour of models and understand the impact of model and parameter choices as well as data and feature selections. Shared metrics allow research and engineering communities share knowledge and communicate effectively at a high level, helping progress and reproducibility.

In applying ML in the subsurface, the first port of call is to use standard ML performance metrics such as accuracy, f1_score and r2 score. These metrics are well know but generic. In some cases they provide effective performance indicators, more so in classification tasks. However they generally don't provide much insight into why model is achieving a particular level of performance, or measure performance in terms of expected or acceptable subsurface behaviour.

In this workshop session, we aim to further the discussion on why development of a common set of meaningful subsurface metrics is important for the our community. We highlight some of the gotchas and shortcomings with typical metrics used in machine learning classification and regression tasks and we propose some potentially routes forward.

Loading

Article metrics loading...

/content/papers/10.3997/2214-4609.201901976
2019-06-03
2020-06-05
Loading full text...

Full text loading...

References

  1. Powers, D.M.W
    [2011] Evaluation: From Precision, Recall and F-measure to ROC, Informedness, Markedness and Correlation. Journal of Machine Learning Technologies ISSN: 2229-3981 & ISSN: 2229-399X, Volume 2, Issue 1, 2011, pp-37–63
    [Google Scholar]
  2. Kvalseth, T.O.
    [1985] Cautionary Note about R2. The American Statistician, Vol. 39, No. 4, Part1 (Nov., 1985), pp. 279–285
    [Google Scholar]
  3. AgileScientific
    [2018] How good is What?Blog Post. https://ageo.co/howgood
    [Google Scholar]
http://instance.metastore.ingenta.com/content/papers/10.3997/2214-4609.201901976
Loading
/content/papers/10.3997/2214-4609.201901976
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error