MétaCan
Menu
Retour à la cohorte
Enregistrement W6925515292 · doi:10.17605/osf.io/yk35t

Face Puzzle Study 4 Preregistration

2022· other· en· W6925515292 sur OpenAlexaboutno aff

Notice bibliographique

RevueOpen Science Framework · 2022
Typeother
Langueen
DomaineMedicine
ThématiqueReproductive Biology and Fertility
Établissements canadiensnon disponible
Organismes subventionnairesnon disponible
Mots-clésFacial expressionNeurotypicalEmotion classificationBoredomEveryday lifeSet (abstract data type)Affective scienceFacial Action Coding SystemStimulus (psychology)Jealousy

Résumé

récupéré en direct d'OpenAlex

Identifying a person’s emotions through their facial expressions is necessary in helping us navigate social interactions. Some individuals, such as those with autism spectrum disorder (ASD), have difficulties in accurately identifying emotions from faces. These difficulties affect everyday interactions and contribute to the diagnostic phenotype. Facial emotion recognition (FER) tasks have been developed in an attempt to measure facial expression recognition abilities in both neurotypical and psychiatric populations in order to assess and quantify potential impairments. These tasks are also useful in retesting participants undergoing social skills or other training in order to track any improvements. FER tests to date often suffer from two limitations. First, stimulus sets used in established FER tasks are often limited to basic emotions (happiness, sadness, anger, disgust, fear, and surprise; plus neutral expressions as baseline), and add no or only few complex emotions (e.g., jealousy and boredom (Montagne et al., 2007)). Using only basic emotions to quantify FER abilities could potentially result in reduced external validity of the tasks by not accounting for the wide array of more complex emotions encountered in everyday life. Second, FER tasks often use static images of emotional faces, which do not capture naturalistic and dynamic aspects facial emotion recognition. Previously, the Face Puzzle tasks addressed these limitations by utilizing dynamic video stimuli featuring 15 actors portraying a wider variety of emotions to more closely approximate real life facial emotion recognition. (Kliemann et al., 2013). This stimulus set consisted of 25 videos of emotional facial expressions, with 5 basic (angry, happy, disgusted, fearful, surprised) and 20 complex emotions (interested, amused, aggrieved, troubled, jealous, enthusiastic, apologetic, disappointed, relieved, expectant, bored, compassionate, contemptuous, pardoning, embarrassed, wistful, furious, content, confident, doubtful), for a total of 11 positive and 14 negative emotions. In an initial validation study the Face Puzzle tasks showed good internal consistency, consistent external validity and sensitivity to impaired FER in adult individuals with ASD. Originally, the stimuli and task were designed in German, leaving it an open question whether intended emotion expressions and respective labels are valid in the English language, and thus whether the task is valid for use in English as well. The overall aim of this project is thus to validate the stimulus set and task design for the English language. In Study 1 of this project, believability, valence and arousal of video stimuli were rated and a new set of validated video stimuli was established (see Study 1 preregistration for details on the process; resulting emotion items are compassionate, bored, wistful, surprised, relieved, envious, furious, worried, enthusiastic, expectant, disgusted, angry, happy, forgiving, doubtful, content, embarrassed, disappointed, interested, fearful, confident, apologetic, contemptuous, amused, and touched). In Study 2, we determined construct validity of the items combined into the new Face Puzzle explicit task. The outcome of the procedure (see Study 2 for details) fell short of the original aim of a Cronbach’s alpha of 0.7 (Tavakol & Dennick, 2011) with a value of 0.683. It is possible that at least two factors might be relevant to evaluate this result. First, task performance in the Face puzzle task may be influenced by verbal intelligence and/or education levels. Second, we did not measure other emotional face processing or other social cognitive functioning tasks in online subjects or compared it to atypical social cognitive populations, such as autism, making it challenging to evaluate performance and external validity on the Face Puzzle task. To address these issues, we will conduct Study 3 (see details on preregistration for Study 3) and 4 as follows: In order to assess whether these results are reliable, we will conduct an item analysis to determine the construct validity of the explicit task using a set of non-mTurk participants and including a sample with reported difficulties in social cognition in general, and facial emotion recognition in specific (Lozier et al., 2014). Internal consistency will then be measured by calculating Cronbach’s alpha. We expect to find a high internal consistency (> 0.7) when conducting the task with non-mTurk participants (Hypothesis 1). In this study, we will also assess the English version of the Face Puzzle explicit task’s sensitivity to atypical social cognition. To this end, we will compare performance (accuracy and reaction times) of individuals with ASD to a matched (age, gender, IQ) neurotypical control group. We expect to find group effects in accuracy, reaction times, and composite measures (reaction time over % accuracy) as follows: Accuracy: We expect higher accuracies on the Face Puzzle explicit task for the NT than ASD participants (Hypothesis 2a). Reaction times: We expect faster reaction times on the Face Puzzle explicit task for NT than ASD participants (Hypothesis 2b). Composite measures: We expect lower composite measures of reaction time and accuracy (reaction time over % accuracy for correct items to yield accuracy-adjusted response times) for NT than ASD participants (Hypothesis 2c). We will also assess relation of Face Puzzle performance to other social cognitive tasks: Here, we expect that performance on the Face Puzzle explicit task to positively correlate with performance on the Reading the Mind in the Eyes Test (RMET; Baron-Cohen et al., 2001a; Hypothesis 3a), the Penn Emotion Recognition Test (ER-40; Kohler et al., 2003; Hypothesis 3b), and the Bell Lysaker Emotion Recognition Task (BLERT; Bell et al. 1997; Hypothesis 3c). Regarding the relationship with intellectual functioning, we expect performance on the Face Puzzle explicit task to either show no relation to the verbal subscale of the Kaufman Brief Intelligence Test, 2nd edition (KBIT-2; Kaufman & Kaufman, 2004; Hypothesis 4a) or a weak positive correlation (Hypothesis 4b). Regarding the relationship with autistic traits, we expect performance on the Face Puzzle explicit task to show a negative correlation with the Autism Quotient (AQ; Baron-Cohen et al., 2001b; Hypothesis 5a) for both ASD and NT groups, measured per group. We also expect a negative correlation with the Ritvo Autism Asperger’s Diagnostic Scale (RAADS-R; Ritvo et al., 2011; Hypothesis 5b) for the ASD group. Regarding the relationship with alexithymia, we expect performance on the Face Puzzle explicit task to show a negative correlation with performance on the Toronto Alexithymia Scale (TAS; Bagby et al., 1986; Hypothesis 6) across both groups.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Étiquettes directes de modèles (non validées)

Étiquettes de catégorie et de devis d'étude par modèle, issues des rondes d'étiquetage. C'est une sortie machine, non validée, et le désaccord entre modèles est livré comme donnée. Aucun devis ici n'est encore validé contre MEDLINE.

BrasCatégoriesDevis d'étudeConfiance
gemmaMétarecherche
Domaine: Reproductibilité · Genre: Protocole
Porte sur le système de recherche canadien: non · Porte sur un sujet canadien: non
Sans objethigh
gptScience ouverte
Domaine: non disponible · Genre: Protocole
Porte sur le système de recherche canadien: non · Porte sur un sujet canadien: non
Autre devishigh
modèles en désaccordL'accord compare des ensembles de catégories et des devis identiques entre les bras.

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,002
score de la tête « metaresearch » (Gemma)0,001
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesCharge utile insuffisante (le modèle a refusé de juger)
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: Sans objet
GenreSignal candidat: Autre · Signal consensuel: Autre
Score de désaccord entre enseignants0,224
Score d'incertitude au seuil0,981

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0020,001
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0000,001
Études des sciences et des technologies0,0000,001
Communication savante0,0000,000
Science ouverte0,0020,001
Intégrité de la recherche0,0000,001
Charge utile insuffisante (le modèle a refusé de juger)0,0200,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,051
Tête enseignante GPT0,394
Écart entre enseignants0,343 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Étiqueté directement par 2 modèles lisant le dossier complet.

MétarechercheScience ouverte

Les modèles divergent sur des parties de cette classification; chaque voix est préservée dans la section en fin de page.

Devis d'étudeSans objet · Autre devis
DomaineReproductibilité
GenreProtocole

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations0
Publié2022
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueOpen Science FrameworkMême sujetReproductive Biology and FertilityCatégorieMétarechercheTravaux en français237 207