CSC-RS: Leveraging cloud-native serverless computing for large-scale remote sensing data processing
Bibliographic record
Abstract
The rapid growth in the volume of remote sensing (RS) image data necessitates efficient computational methods to handle large-scale datasets. Traditional RS image processing methods, although effective for small datasets, face significant challenges when scaled up. In this research, we present a novel cloud-native serverless computing framework for RS data processing (CSC-RS), which integrates traditional parallel techniques with modern serverless computing technology. We demonstrate our 5 design principles and the architecture of CSC-RS, then introduce the three-level parallel structure for RS processing acceleration. As for implementation, CSC-RS has a high-performance RS processing core optimized with vectorization and shared memory parallelization techniques. By encapsulating these core functions within a cloud-based serverless wrapper, the framework flies onto the cloud, achieving higher scalability, efficiency, and resource utilization. We validated CSC-RS through a case study of extracting potential sandstorm sources in the middle reaches of the Yarlung Zangbo River over the past 30 years. Results demonstrate significant improvements in processing speed and scalability. CSC-RS was 8.04 times faster than the original unoptimized processing program in this case study. These improvements not only enhance the technical capabilities of remote sensing applications but also provide valuable insights for local sandstorm management and ecological protection. • Leverage a cloud-native serverless computing approach. • Introduce a three-level hybrid parallel structure for acceleration. • Applicable and efficient for complex and large-scale remote sensing processing. • Validated in a real-world case study and support ecological protection.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.001 | 0.000 |
| Open science | 0.002 | 0.003 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".