Scalable machine learning solution for commercial scale three dimensional geophysical inversions
Bibliographic record
Abstract
Scalable machine learning solution for commercial scale three dimensional geophysical inversionsSouvik Mukherjee1, Santi Adavani2*, Alan Morgan3, William N. Barkhouse4, Ronald S. Bell4, Peter G. Lelievre5, Colin G. Farquharson61EmPact-AI, USA, 2*RocketML, now at S2 Labs, USA, 3Bell Geospace, USA, 4Drone Geoscience, USA, 5Mt. Allison University, Canada, 6Memorial University, CanadaAbstractApplication of artificial intelligence (AI) and machine learning (ML) based workflows and methodologies for geophysical data processing, imaging, and interpretation are active focus areas in industry and academia. While much progress has been made to demonstrate applicability in many use cases, key bottle neck for widespread commercial use has been the prohibitively high computational cost involved in applying the method for large scale three dimensional inverse problems.Key changes to the form of the simulated input data used for training and the corresponding design of the architecture of the hidden layers enable approximately O(n) (where n is the number of layers in the network) reduction in the computational complexity of the training architecture. Combined with multi-GPU Distributed Deep Learning (DDL) algorithms optimized specifically for training large scale ML data, this results in significant improvements in resolution of inversion results relative to conventional least squares imaging, while computational efficiency improves by order of magnitude compared to several commonly used open-source ML architectures and platforms.When deployed for inversion of dense, closely spaced high resolution handheld magnetometer data collected over a buried pipe in a field in Texas, the resolved three-dimensional geometry and location using the new algorithm showed over 6-fold improvement compared to conventional three-dimensional least squares inversion. When applied to an 18-fold larger data set collected by a drone-based magnetometer over a field in California, the buried complex metallic pipe like structure was resolved using little over 2 days of compute time. Similar exercise undertaken in google collab GPU platform using state-of-the-art google tensorflow would have taken 3 – 6 months to complete, suggesting a 50 – 100-fold improvement in computational efficiency.The method was also benchmarked against Los Alamos National Laboratory’s (LANL) open-source seismic full waveform inversion (FWI) dataset. LANL trained 24000 seismic data sets simulated from various 2D velocity models using 32 P100 Tesla GPU machines in 2 hours. When inferenced on 6000 previously unseen test models, the root mean square error (RMSE) in the inverted normalized velocity models was 0.018. The current workflow on the same data set achieved a comparable RMSE of 0.012 on 6000 unseen test models after training 24000 models in 50 minutes using just 4 GPU (V100) machines, achieving nearly 20-fold improvement in computational efficiency.In addition to magnetic and seismic data, the method is being developed for applications to electromagnetic and full tensor gravity gradiometer (FTG) data. Given the significant improvements in resolution and computational efficiency, it is expected that successful ground truth based field trials of AI based geophysical data inversion has the potential to unlock several new application areas while dramatically improving the business impact of such applications in existing ones.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.003 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.002 | 0.002 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.008 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".