{"id":"W4200099029","doi":"10.22148/001c.30704","title":"Annotation Guidelines for Narrative Levels","year":2021,"lang":"en","type":"article","venue":"Journal of Cultural Analytics","topic":"Topic Modeling","field":"Computer Science","cited_by":0,"is_retracted":false,"has_abstract":true,"ca_institutions":"University of Toronto","funders":"","keywords":"Narrative; CLARITY; Rule of thumb; Focus (optics); Set (abstract data type); Computer science; Sentence; Narrative criticism; Linguistics; Narrative history; Natural language processing; Philosophy; Programming language","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":true,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.01056137,0.001585745,0.0007061344,0.005413448,0.003373227,0.005214389,0.002548462,0.003234737,0.06105232],"category_scores_gemma":[0.05135808,0.001714436,0.001071403,0.003346609,0.002169243,0.007533392,0.004765513,0.004086288,0.0426774],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.002331013,"about_ca_system_score_gemma":0.003855285,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.006419937,"about_ca_topic_score_gemma":0.009851269,"domain_scores_codex":[0.9888975,0.004857085,0.002652958,0.001257773,0.001875256,0.000459547],"domain_scores_gemma":[0.9481453,0.01813577,0.001863034,0.006317526,0.02454161,0.0009968068],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"theoretical_or_conceptual","study_design_scores_codex":[0.0003414368,0.0001266553,0.001441531,0.002672443,0.0000347355,0.0005915522,0.02199416,0.001121484,0.01345447,0.2086916,0.5679057,0.1816243],"study_design_scores_gemma":[0.00002321475,0.00002411258,0.0005092261,0.0008945873,0.00002078967,0.000323375,0.002023082,0.002433375,0.005545256,0.04540408,0.942726,0.00007280251],"study_design_candidate":"theoretical_or_conceptual","study_design_consensus":null,"genre_codex":"methods","genre_gemma":"methods","genre_scores_codex":[0.004316503,0.0006955012,0.8556529,0.005185537,0.001717839,0.003011379,0.0292581,0.02076765,0.07939458],"genre_scores_gemma":[0.02110609,0.0006005858,0.9048599,0.001634712,0.0003185415,0.005489312,0.02683716,0.01020974,0.02894402],"genre_candidate":"methods","genre_consensus":"methods","teacher_disagreement_score":0.06105232,"threshold_uncertainty_score":0.2042404,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.2161367933206888,"score_gpt":0.3983666380430037,"score_spread":0.1822298447223149,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}