Deep Learning at a Distance: Remotely Working to Surveil Sharks
Notice bibliographique
Résumé
Abstract In the months following the novel Coronavirus pandemic outbreak, the world has seen an immediate and unprecedented global shift towards remote learning and working. In the academic field specifically, it has fundamentally shifted how the process of learning happens. Throughout the summer of 2020, we had the opportunity to observe how doing research remotely would affect the complicated dynamics of working in a cross-disciplinary team. Our project centered around utilizing machine learning technologies to detect sharks in videos taken from drones, as well as a few possible applications of this technology. Traditionally, a project such as this would involve weekly in-person meetings, with in-person collaboration opportunities on such things as developing our Neural Network computational model, designing user interfaces, and discussing shark behaviors with domain experts such as marine biologists. However, due to the circumstances of the pandemic, we had to make do with weekly online Zoom meetings, as well as figuring out how to collaborate with each other to do the technical aspects of this project remotely. Our team of engineering students comes from a variety of backgrounds including computer science, software engineering, biomedical engineering, and marine biology. The project itself incorporates the use of drones to collect video footage, Machine Learning to process the images, and marine biology in order to analyze the behavior of sharks in their natural habitat in a noninvasive way. Collaboration with a team of marine biologists specializing in sharks at a different university was essential, but our inability to meet with them in person imposed a significant hurdle. Working remotely with a team of this size and range of skills was a learning process during which we overcame numerous logistical, technical, and personal obstacles. In the end, however, we succeeded in developing a system that is capable of locating objects of interest in the video footage and to assign those objects to categories such as shark, seal, tuna, boat, surfer, paddleboarder, swimmer, and others. This system is the basis for a front-end to be used by marine biologists in the behavior of sharks and other marine life: whereas in the past, marine biology students would spend endless hours watching drone video footage to identify snippets of interest, they can now focus on the behavior analysis of the animals. Although the immediate results of this project were obtained in the identification of sharks, work is underway to expand this to other domains. While object recognition has been studied and applied widely, our specific situation involving drones flying over water posed additional challenges such as the presence of glare, waves, and foam. Further challenges are the identification of relatively small objects at varying depths in the water, viewed from a moving object (the drone) at different heights, speeds, and angles. From a technical perspective, the use of a centralized database, advanced labeling software, sophisticated Machine Learning tools, and powerful cloud computing facilities allowed us to do meaningful work during this time while keeping ourselves organized and productive. Though we could not physically meet each other or any sharks, this summer project was an invaluable learning experience with innovation in the application of Artificial Intelligence to show for it.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,000 | 0,001 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,000 | 0,000 |
| Bibliométrie | 0,000 | 0,001 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,000 | 0,001 |
| Science ouverte | 0,001 | 0,003 |
| Intégrité de la recherche | 0,000 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,011 | 0,001 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; les deux têtes enseignantes s’accordent sur ce qui est montré ici.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».