MétaCan
Menu
Back to cohort

Federated Deep Reinforcement Learning for Task Scheduling in Heterogeneous Autonomous Robotic System

2022· article· en· W4315629633 on OpenAlex
Tai Manh Ho, Mohamed Cheriet

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueGLOBECOM 2022 - 2022 IEEE Global Communications Conference · 2022
Typearticle
Languageen
FieldComputer Science
TopicIoT and Edge/Fog Computing
Canadian institutionsÉcole de Technologie Supérieure
Fundersnot available
KeywordsReinforcement learningComputer scienceDistributed computingQueueScheduling (production processes)Queueing theoryDynamic priority schedulingRobotTask (project management)Two-level schedulingFair-share schedulingJob shop schedulingArtificial intelligenceReal-time computingMathematical optimizationComputer networkQuality of serviceEngineering

Abstract

fetched live from OpenAlex

In this paper, we investigate the problem of task scheduling in automated warehouses with hetero-geneous autonomous robotic systems. We formulate the task scheduling for a heterogeneous autonomous robots (HAR) system in each warehouse as a queueing control optimization problem in which we aim to minimize the queue length of tasks that are waiting to be processed. We propose a deep reinforcement learning (DRL) based approach that employs the proximal policy optimization (PPO) to achieve an optimal task scheduling policy. We then propose a federated learning based algorithm to improve the performance of the PPO agents. The simulation results fully demonstrate the performance improvement of our proposed algorithm in terms of average queue length compared to the distributed learning algorithm.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.969
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.002
Science and technology studies0.0030.000
Scholarly communication0.0010.000
Open science0.0040.004
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.036
GPT teacher head0.277
Teacher spread0.241 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it