Is it time to swish? Comparing activation functions in solving the Helmholtz equation using PINNS

References

1. Alkhalifah, T., Song, C., Waheed, U. and Hao, Q.
   [2020] Wavefield solutions from machine learned functions that approximately satisfy the wave equation. In: 82nd EAGE Annual Conference & Exhibition, 2020. European Association of Geoscientists & Engineers, 1–5.
   [Google Scholar]
2. Cao, Y., Fang, Z., Wu, Y., Zhou, D.X. and Gu, Q.
   [2019] Towards understanding the spectral bias of deep learning. arXiv preprint arXiv:1912.01198.
   [Google Scholar]
3. Haghighat, E. and Juanes, R.
   [2021] SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks. Computer Methods in Applied Mechanics and Engineering, 373, 113552.
   [Google Scholar]
4. Pratt, R.G.
   [1999] Seismic waveform inversion in the frequency domain, Part 1: Theory and verification in a physical scale model. Geophysics, 64(3), 888–901.
   [Google Scholar]
5. Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F., Bengio, Y. and Courville, A.
   [2019] On the spectral bias of neural networks. In: International Conference on Machine Learning. PMLR, 5301–5310.
   [Google Scholar]
6. Ramachandran, P., Zoph, B. and Le, Q.V.
   [2017] Searching for activation functions. arXiv preprint arXiv:1710.05941.
   [Google Scholar]
7. Song, C., Alkhalifah, T. and Waheed, U.B.
   [2021] Solving the frequency-domain acoustic VTI wave equation using physics-informed neural networks. Geophysical Journal International, 225, 846–859.
   [Google Scholar]
8. Waheed, U., Haghighat, E., Alkhalifah, T., Song, C. and Hao, Q.
   [2020] Eikonal solution using physics-informed neural networks. In: 82nd EAGE Annual Conference & Exhibition, 2020. European Association of Geoscientists & Engineers, 1–5.
   [Google Scholar]