MétaCan
Menu
Back to cohort
Record W7001635507

A Journey to the Edge of the Solar System with an AI navigator

2023· dissertation· en· W7001635507 on OpenAlexaboutno aff

Bibliographic record

VenueUVic’s Research and Learning Repository (University of Victoria) · 2023
Typedissertation
Languageen
FieldPhysics and Astronomy
TopicAstro and Planetary Science
Canadian institutionsnot available
Fundersnot available
KeywordsConvolutional neural networkSet (abstract data type)BrightnessDeep learningSkyArtificial neural networkEnhanced Data Rates for GSM EvolutionRange (aeronautics)Data set
DOInot available

Abstract

fetched live from OpenAlex

I present a deep learning method of searching for solar system objects (SSOs) in wide-field survey imaging data including trans-Neptunian objects (TNOs). Artificially generated sources are added to mosaic images taken with the Canada-France-Hawaii telescope (CFHT) MegaCam instrument to create the convolutional neural network (CNN) training set. The CFHT MegaCam data images are a time series of observations, and the location of the artificial SSO changes between images, in a way that is consistent with a heliocentric Keplarian orbit. The imaging characteristics of the artificial sources were found to be highly similar to those of real SSOs, with rates of sky motion consistent with TNOs. My deep learning approach is based on the detection of moving sources within 64×64-pixel sub-image pairs extracted from the time series of large-format mosaic astronomical imaging data. Each image pair extracted from the training images has been labelled with the presence or absence of a moving source, along with the source location and brightness measured in magnitudes. The labelled sub-images were fed into ImageNet algorithms to train classification models and regression models separately. The algorithm assigns a model-dependent probability that a particular sub-image contains an SSO. The probability threshold required to assert that an SSO has been detected is set based on the evaluation of retrieval and precision of the model and the requirements of the experiment. This thesis evaluates the capabilities of the range of deep learning models and determines which one is most effective in the detection of artificial SSOs. The MobileNet model was selected as the most efficient for this problem space. A trained classification model derived from the MobileNet model retrieved 91% of sub-images with a moving source with a 90% precision on test data sets. A separate regression model then predicted the location of the moving source with a mean absolute error of ±1.5 pixels for sources with SNR > 17 (m_r < 23 in my data set). Although the retrieval rate is high, due to the scarcity of real SSOs in imaging data, the precision achieved (90% of false positives rejected) results in a substantial number of false positives. Further data processing on the candidate list is required to improve the purity of the result. To improve sample purity, I investigated two post-processing approaches: • With the classification-filtered sub-images and their regression-measured locations in sky coordinates, each detected source was grouped with nearby detected sources as SSOs exhibit nearly linear sky motion for the duration of the observed time series. Any group of linear source tracks, detected in at least 1/3rd of the images, was considered a candidate detection. This approach achieves an effective detection limit (more than 50% of artificial sources in the data are detected) at SNR=7.2, and the source purity of the sample was greater than 99% in this case. However, the required combinatorics of this approach (NxN comparison) make it computationally slow, and the high SNR required for detection resulted in very few ‘real’ candidates being proposed. • I also investigate a ‘scoring’ approach for candidate selection. My CNN classification model output is a model-dependent probability that a particular sub-image contains a moving source. Each sub-image was given a score derived by scaling the classification model probability assigned to that sub-image. A sub-image was then determined to hold a candidate object if its score exceeded a given threshold (determined by the desired purity of the sample). With this approach, I achieved an effective detection limit (50% of artificial sources in the data are detected) at SNR=3.4 and discovered a number of real SSOs within the test data set. Visual inspection of 1800 scoring-based candidates revealed approximately 200 visibly bright real (not from the artificial source list) SSO candidates. I tested trained models on test sets from different sky regions and found that our models did not learn from the backgrounds or shapes of TNOs, but rather detected the motion of TNOs. I found that deep-learning object detection algorithms can aid in the discovery of TNOs and SSOs. When combined with a scoring approach, my algorithm provides a capability that is similar to that achieved with more classical approaches without making assumptions of motion rates of the SSOs and without requiring any substantive data engineering. The CNN approach to SSO detection is very promising and should be pursued in the development of future SSO discovery software pipelines.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.002
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.007
Threshold uncertainty score0.021

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0010.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0010.001
Scholarly communication0.0020.003
Open science0.0010.002
Research integrity0.0010.003
Insufficient payload (model declined to judge)0.0060.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.018
GPT teacher head0.262
Teacher spread0.244 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueUVic’s Research and Learning Repository (University of Victoria)Same topicAstro and Planetary ScienceFrench-language works237,207