Cyber Discovery evaluation : published 13 August 2021
Bibliographic record
Abstract
The government's National Cyber Security Strategy 2016 set aside 1.9 billion to drive forward the UK cyber security agenda and ensure that the UK is secure and resilient to cyber threats Among other initiatives, it recognised the importance of identifying and training young people to enter the cyber security profession and pledged to develop a "selfstanding skills strategy that builds on existing work to integrate cyber security into the education system" Participation 23,636 students registered for Cyber Discovery in Year One, growing to 27,903 in Year Two and 35,941 students in Year Three.This dropped slightly to 28,232 in Year Four, perhaps due to the impact of school closures during the COVID-19 pandemicThe proportion of girls registered for Assess reached a third in Years Three (32%) and Four (33%), compared to a quarter (25%) in Year Two and about a fifth (21%) in Year One.The increase in female participants is largely due to the programme being expanded to 13-year-olds, where a higher rate of female participants was driven by targeted marketing campaigns Cyber Discovery engaged a greater proportion of ethnic minority participants than sit computer science school exams Participation tended to be highest in the less deprived areas and in the South of England EngagementThose taking part tended to do so as they felt it would be enjoyable and useful.Improving skills was important, with both qualitative and quantitative evidence showing that career consideration was not a major motivating factor In the first three years, 590 students took part in the Elite phase and completed SANS professional level 6-day training courses in Years Two and Three.89 Elite participants achieved GIAC certification in Year Two (93% pass rate) and 124 in Year Three (89% pass rate) Participants reported that their experiences of the programme were strengthened by being part of a group, having access to support and guidance, and the extension of the programme during the pandemic.Demands on students' time, particularly for those sitting exams, were a barrier.During school closures, a minor theme from qualitative research was that access to a suitable computer and internet connection was an additional barrier Club Leaders and students found the platform engaging, user-friendly and intuitive.They found the level of challenge appropriate and often welcomed being pushed.A minor theme was that it was sometimes too challenging if students did not have the required soft skills and interest in cyber security Cyber careersStudents generally had a very positive view of cyber careers, with most agreeing that they were important for society (94%), suitable for someone like them (80%), and open to anyone regardless of background (66%) Students were more likely to get information on cyber security careers from Cyber Discovery than from other sources, and after taking part most felt they understood the requirements for pursuing a cyber career Survey data suggested that the programme increased skills in computer science and cyber security.There was no evidence that it increased interest in cyber security as a study subject or as a career -this may be due to study methodology or increased knowledge leading some participants to realise that they did not wish to pursue cyber further.Equally, it may reflect the initial objective of the programme which was to engage an elite cohort of most talented young people, rather than appeal to a wider audience Additional outcomesFor industry experts, outcomes centred around the potential for recruitment, including the opportunity to meet talented students and raise awareness of cyber security roles Club Leaders and industry experts generally felt it was possible that the programme could contribute towards longer-term impact and closing the cyber security skills gap Club Leaders were split as to whether Cyber Discovery needed to be linked to the curriculum.A common theme was that content enhanced the curriculum and met the needs of students seeking to broaden their knowledge and skills 10 -least deprived 14% 14%Source: Management Information.Analysis of school postcodes shows that in terms of levels of deprivation, Cyber Discovery engaged similar schools in Years Three and Four.In both years, schools were
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.001 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.003 | 0.003 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.002 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.031 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".