1887
Volume 41, Issue 10
  • ISSN: 0263-5046
  • E-ISSN: 1365-2397

Abstract

Abstract

MDIO offers a technical solution for storing and retrieving energy data in the cloud and on-premises. As an open-source framework, it incorporates high-resolution, multi-dimensional arrays that accurately represent wind resources and seismic data for multiple applications. By utilising the Zarr format, MDIO ensures efficient chunked storage and parallel I/O operations, facilitating easy data interaction in diverse infrastructures. This paper covers MDIO’s application in renewable energy (wind simulations), predictive analytics, and seismic imaging and interpretation, aiming to provide a robust technical platform for researchers navigating the evolving energy landscape.

Loading

Article metrics loading...

/content/journals/10.3997/1365-2397.fb2023084
2023-10-01
2026-02-14
Loading full text...

Full text loading...

References

  1. Abma, R. and Kabir, N. [2006]. “3D interpolation of irregular data with a POCS algorithm,” Geophysics, 71, E91–E97.
    [Google Scholar]
  2. Sansal, A., Kainkaryam, S., Lasscock, B. and Valenciano, A. [2023]. “MDIO: Open-source format for multidimensional energy data,” The Leading Edge, 42, 465–473.
    [Google Scholar]
  3. Barré, M., Walley, S., Savajol, V., Deng, J., Rhodes, C., van Welden, A., Endresen, P., Storm-Olsen, M. and James, A. [2022]. Implementation of cloud-ready technology designed to address longstanding data interoperability and accessibility issues through the use of a comprehensive semi-automated seismic interpretation workflow. Paper presented at the SEG/AAPG International Meeting for Applied Geoscience and Energy, Houston, Texas, USA. https://doi.org/10.1190/image2022-3743148.1.
    [Google Scholar]
  4. Dask Development Team [2016]. Dask: Library for dynamic task scheduling. Retrieved from https://dask.org.
    [Google Scholar]
  5. Equinor [2023]. “segyio: Fast Python library for SEGY files.” March 28, 2023. https://github.com/equinor/segyio.
    [Google Scholar]
  6. Google Cloud [2023]. “Request rate and access distribution guidelines”, accessed March 21, 2023. https://cloud.google.com/storage/docs/request-rate.
    [Google Scholar]
  7. The HDF Group [1997–2023]. Hierarchical Data Format, version 5, 1997–2023. https://www.hdfgroup.org/HDF5.
    [Google Scholar]
  8. Miles, A., jakirkham, Bussonnier, M., Moore, J., Papadopoulos Orfanos, D., Fulton, A., Bourbeau, J., Lee, G., Patel, Z., Bennett, D., Rocklin, M., AWA BRANDON AWA, Chopra, S., Abernathey, R., Sales de Andrade, E., Kristensen, M. R. B., Durant, M., Schut, V., Dussin, R. and Bell, R. [2023]. zarr-developers/zarr-python: v2.14.1 (v2.14.1). Zenodo. https://doi.org/10.5281/zenodo.7633154.
    [Google Scholar]
  9. Lindstrom, P. [2014].”Fixed-rate compressed floating-point arrays.” IEEE Transactions on Visualization and Computer Graphics, 20(12), 2674–2683.
    [Google Scholar]
  10. Maitin-Shepard, J. and Leavitt, L. [2022]. TensorStore for High-Performance, Scalable Array Storage. Retrieved from https://ai.googleblog.com/2022/09/tensorstore-for-high-performance.html.
    [Google Scholar]
  11. MatteoRavasi and IvanVasconcelos [2021]. An open-source framework for the implementation of large-scale integral operators with flexible, modern high-performance computing solutions: Enabling 3D Marchenko imaging by least-squares inversion, Geophysics, 86, WC177–WC194.
    [Google Scholar]
  12. OSDU [2023]. Seismic DDMS OpenZGY Gitlab page, https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-zgy, accessed March 21, 2023.
    [Google Scholar]
  13. Rocklin, M. [2015]. Dask: Parallel Computation with Blocked algorithms and Task Scheduling.Proceedings of the 14th Python in Science Conference.
    [Google Scholar]
  14. Skamarock, W. C., Klemp, J. B., Dudhia, J., Gill, D. O., Liu, Z., Berner, J., Wang, W., Powers, J. G., Duda, M. G., Barker, D. M. and Huang, X.-Y. [2019]. A Description of the Advanced Research WRF Version 4. NCAR Tech. Note NCAR/TN-556+STR, 145 pp. https://doi.org/10.5065/1dfh-6p97.
    [Google Scholar]
  15. Unidata [2021]. NetCDF, version 4.8.1. Unidata, https://doi.org/10.5065/D6H70CW6.
    [Google Scholar]
  16. Warren, C., Kainkaryam, S., Lasscock, B., Sansal, A., Govindarajan, S. and Valenciano, A. [2023]. “Toward generalized models for machine-learning-assisted salt interpretation in the Gulf of Mexico,” The Leading Edge42, 390–396.
    [Google Scholar]
  17. Yann, C.“lz4.” lz4. github. io/lz4 [2011].
    [Google Scholar]
  18. Yann, C. and Kucherawy, M. [2018]. Zstandard Compression and the application/zstd Media Type. No. rfc8478. 2018.
    [Google Scholar]
/content/journals/10.3997/1365-2397.fb2023084
Loading
/content/journals/10.3997/1365-2397.fb2023084
Loading

Data & Media loading...

  • Article Type: Research Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error