MétaCan
Menu
Back to cohort

Real-Time Jaywalking Detection and Notification System using Deep Learning and Multi-Object Tracking

2022· article· en· W4320029434 on OpenAlex
Sifatul Mostafi, Weimin Zhao, Sittichai Sukreep, Khalid Elgazzar, Akramul Azim

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueGLOBECOM 2022 - 2022 IEEE Global Communications Conference · 2022
Typearticle
Languageen
FieldComputer Science
TopicVideo Surveillance and Tracking Methods
Canadian institutionsOntario Tech University
Fundersnot available
KeywordsComputer scienceObject detectionArtificial intelligenceComputer visionDeep learningTrajectorySegmentationVideo trackingReal-time computingObject (grammar)Tracking systemTracking (education)Path (computing)Component (thermodynamics)Motion (physics)Computer networkKalman filter

Abstract

fetched live from OpenAlex

Jaywalking refers to pedestrians walking or crossing in a roadway that is not dedicated to pedestrians. Due to illegal jaywalking, every year a lot of accidents happen worldwide that cause a significant amount of death and other physical injuries. Real-time jaywalking detection and notification systems can contribute to protecting vulnerable road users and increasing road safety. Many computer vision-based image processing techniques have been proposed to detect jaywalking including deep learning, motion path analysis, motion object segmentation, trajectory forecasting and position localization. However, these techniques are designed and evaluated for a single road area and have limited notification capability. In this paper, we propose a real-time multi-object tracking approach for jaywalking detection and notification that can be applied in multiple road areas simultaneously. We use the state-of-the-art deep learning model YOLOv4 and the multi-object tracking algorithm DeepSORT for real-time object detection and tracking, respectively. The notification component incorporates a novel vehicle-region pair matching algorithm based on the proximity of vehicles to the monitored region. Performance evaluation shows that our proposed approach can effectively detect jaywalking with 100% accuracy and provide push notifications to nearby vehicles in real-time.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.974
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0030.000
Scholarly communication0.0010.001
Open science0.0020.002
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.054
GPT teacher head0.322
Teacher spread0.268 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it