Applying Deep Learning to Clear-Sky Radiance Simulation for VIIRS with Community Radiative Transfer Model—Part 2: Model Architecture and Assessment
Bibliographic record
Abstract
A fully connected “deep” neural network algorithm with the Community Radiative Transfer Model (FCDN_CRTM) is proposed to explore the efficiency and accuracy of reproducing the Visible Infrared Imaging Radiometer Suite (VIIRS) radiances in five thermal emission M (TEB/M) bands. The model was trained and tested in the nighttime global ocean clear-sky domain, in which the VIIRS observation minus CRTM (O-M) biases have been well validated in recent years. The atmosphere profile from the European Centre for Medium-Range Weather Forecasts (ECMWF) and sea surface temperature (SST) from the Canadian Meteorology Centre (CMC) were used as FCDN_CRTM input, and the CRTM-simulated brightness temperatures (BTs) were defined as labels. Six dispersion days’ data from 2019 to 2020 were selected to train the FCDN_CRTM, and the clear-sky pixels were identified by an enhanced FCDN clear-sky mask (FCDN_CSM) model, which was demonstrated in Part 1. The trained model was then employed to predict CRTM BTs, which were further validated with the CRTM BTs and the VIIRS sensor data record (SDR) for both efficiency and accuracy. With iterative refinement of the model design and careful treatment of the input data, the agreement between the FCDN_CRTM and the CRTM was generally good, including the satellite zenith angle and column water vapor dependencies. The mean biases of the FCDN_CRTM minus CRTM (F-C) were typically ~0.01 K for all five bands, and the high accuracy persisted during the whole analysis period. Moreover, the standard deviations (STDs) were generally less than 0.1 K and were consistent for approximately half a year, before they significantly degraded. The validation with VIIRS SDR data revealed that both the predicted mean biases and the STD of the VIIRS observation minus FCDN_CRTM (V-F) were comparable with the VIIRS minus direct CRTM simulation (V-C). Meanwhile, both V-F and V-C exhibited consistent global geophysical and statistical distribution, as well as stable long-term performance. Furthermore, the FCDN_CRTM processing time was more than 40 times faster than CRTM simulation. The highly efficient, accurate, and stable performances indicate that the FCDN_CRTM is a potential solution for global and real-time monitoring of sensor observation minus model simulation, particularly for high-resolution sensors.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.002 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.002 | 0.001 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".