{"id":"W4249697146","doi":"10.32920/14639091","title":"Comparative Evaluation of a Novel Concept Design Method","year":2021,"lang":"en","type":"preprint","venue":"","topic":"Design Education and Practice","field":"Engineering","cited_by":0,"is_retracted":false,"has_abstract":true,"ca_institutions":"Toronto Metropolitan University","funders":"","keywords":"Creativity; Novelty; Cohesion (chemistry); Computer science; Ranking (information retrieval); Design methods; Engineering design process; Task (project management); Artificial intelligence; Psychology; Systems engineering; Engineering; Social psychology","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.001595469,0.0001466401,0.0003073213,0.00007044012,0.00001302688,0.00004568333,0.0001216599,0.0001410008,0.002051137],"category_scores_gemma":[0.000175968,0.0001538732,0.00006139303,0.0001212202,0.00001449039,0.00009318523,0.0000439355,0.0002971555,0.00001172316],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00009945402,"about_ca_system_score_gemma":0.0004152508,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00004161433,"about_ca_topic_score_gemma":0.000005615965,"domain_scores_codex":[0.9986574,0.000465407,0.0002672439,0.000181168,0.0003419345,0.00008684622],"domain_scores_gemma":[0.9984215,0.0005744664,0.0001022486,0.000287929,0.0005731333,0.00004065695],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"simulation_or_modeling","study_design_gemma":"simulation_or_modeling","study_design_scores_codex":[0.00000387638,0.00007653647,7.152857e-7,0.00005396378,0.0001913168,1.220331e-7,0.005731318,0.9768775,0.007456609,0.0004072844,0.004341118,0.004859603],"study_design_scores_gemma":[0.0002920475,0.000007813458,0.0001176742,0.00004961875,0.0002181422,0.000003072741,0.001866529,0.9379038,0.05855703,0.0001812895,0.0006338024,0.0001691438],"study_design_candidate":"simulation_or_modeling","study_design_consensus":"simulation_or_modeling","genre_codex":"methods","genre_gemma":"methods","genre_scores_codex":[0.001069988,0.0007035379,0.9536448,0.0000556691,0.0009088684,0.000466394,0.000007690715,0.00008377239,0.04305924],"genre_scores_gemma":[0.4744895,0.00001876784,0.5250086,0.0000368089,0.00004871265,0.00008665372,0.00005534994,0.00001420886,0.0002414569],"genre_candidate":"methods","genre_consensus":"methods","teacher_disagreement_score":0.4734195,"threshold_uncertainty_score":0.9988611,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.3690678548188531,"score_gpt":0.4660755710955153,"score_spread":0.09700771627666227,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}