MétaCan
Menu
Back to cohort
Record W6962632967 · doi:10.17605/osf.io/v748q

Replication of Stellar, Gordon, Anderson, Piff, McNeil, & Keltner (2018; Study 3)

2024· other· en· W6962632967 on OpenAlexaboutno aff

Bibliographic record

VenueOpen Science Framework · 2024
Typeother
Languageen
Field
Topic
Canadian institutionsnot available
Fundersnot available
KeywordsStrengths and weaknessesReplication (statistics)HumilityTraitPerspective (graphical)MediationNarcissism

Abstract

fetched live from OpenAlex

We are completing a direct replication of Awe and Humility (Stellar, et. al) as part of a group project for our Research Methods in Social Psychology course at McGill University. In the initial study they hypothesized, “We predicted that compared with a neutral control condition, momentary experiences of awe will lead to a more balanced disclosure of one’s personal strengths and weakness” which we also will be aiming to falsify with our additional question predicting that there will be a negative relationship between high levels of trait narcissism and behaviourally measured state humility levels after exposure to awe-inducing stimuli as compared to non-narcissistic trait possessing individuals. Replication Overview: The experimental manipulation of awe will be induced by using a standardized video induction. Participants’ state humility is assessed by a behavioral measure: the number of strengths and weaknesses listed, as well as the ratio between the two. Replication Methods The replication methods used in this study are identical to the methods used in the original Stellar et al. study. The participants are randomly assigned by the Qualtrics computer program to one of two conditions where they will watch a video that is two minutes in length. Control: a nonemotional video intended to elicit only feelings of relaxation and calmness in participants. Experimental: a perspective from Earth zooming out into the cosmos, should elicit awe in participants. After the video, participants will write for two minutes about their strengths and weaknesses, starting with their strengths. They are instructed to imagine that they would discuss these strengths and weaknesses with someone they just met. There will be a visible timer counting down from two minutes to zero while they write. Participants are then asked to rank the extent to which they feel happiness, fear, awe, wonder, and amazement from 1 (not at all) to 7 (very much). After the data is collected, two coders who are blind to participant conditions will read through the responses and count the number of strengths and weaknesses as well as the balance. Additional Hypothesis Methods: We are conducting a direct replication, so there will be no deviations from the original study. The only addition to the original study will be the NPI and follow-up analysis. The materials relevant to our additional question will only be presented to participants after they have completed the measures from the direct replication. Participants will complete steps one to three from the original research methods. Afterwards, they will complete a narcissistic personality inventory (NPI) After the data is collected, two coders who are blind to participant conditions will read through the responses and count the number of strengths and weaknesses as well as the balance. The data will be sorted into narcissistic and non-narcissistic categories based on their scores on the NPI for both treatment and control groups. Analysis: For the direct replication portion of the study, we will directly follow the analysis outlined in the Stellar paper where they first removed participants that met the criteria for exclusion. They log transformed each of their dependent variables (number of strengths, number of weaknesses) which were both positively skewed, they calculated the balance between the two and then log transformed that data as well to meet the assumptions of normality. After, they conducted independent samples t-tests to compare the balance of disclosing strengths vs weaknesses between awe and neutral conditions. They then conducted a multiple regression analysis with awe and happiness as independent variables that predict humility, controlling for condition (awe and control). Analysis of our Additional Research Question: Data Transformation: We will follow the same procedure as performed in initial study by Stellar, first seeing if any participants meet criteria for exclusion and then we will perform a log transformation on each of our DVs, if our data is positively skewed to ensure the assumption of normality is met. For our balance we will be calculating the difference between number of strengths and weaknesses and then likely log transforming those values. This ensures our data is normally distributed in order to conduct our multivariant analysis of variance (MANOVA). Key Effects: We will be conducting a two-way MANOVA to examine 2 factors: Awe Treatment Control Narcissism Narcissistic Non-Narcissistic We will be studying the effects these factors have on our three dependent variables quantifying our state humility: Number of Strengths Number of Weaknesses The Difference between the number of Strengths and Weaknesses We chose to do a two-way MANOVA rather than multiple two-way ANOVAs to control for familywise error rate that we would encounter in conducting multiple two-way ANOVAs. We will be testing for a main effect of inducing awe, main effect of narcissism, and an interaction effect between inducing awe and narcissism across all dependent variables simultaneously. If our hypothesis is correct, the interaction effect will be significant, this would suggest the impact of awe on humility is impacted by levels of trait narcissism. If the two-way MANOVA indicates significant main effects or interactions we will follow up with univariate ANOVAs for each DV (number of strengths, number of weaknesses, and balance). This will help clarify which specific variables contributed to the multivariate effect. If the interaction is significant in our MANOVA or univariate ANOVAs we will conduct simple main effects analyses for both factors to explore how one factor affects the DVs at each level of the other factor. In the cases where the univariate ANOVAs show significant main effects or interactions, we will perform post-hoc tests to make pairwise comparisons between levels and determine which specific groups differ from each other. We will use Tukey’s Honest Significant Difference (HSD) test to control for multiple comparisons, minimizing the risk of Type I error. Since we’re analyzing both the simple main effects and conducting post-hoc tests, we will report effect sizes using partial eta squared to provide insight into the magnitude of the effects. Target Sample: N = 100 Recruiting participants from SONA - McGill Psychology Human Participant Pool Our study will be completed on a computer within a lab setting.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.007
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Scholarly communication, Open science, Insufficient payload (model declined to judge)
Consensus categoriesInsufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Other · Consensus signal: Other
Teacher disagreement score0.045
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0070.002
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.007
Science and technology studies0.0000.002
Scholarly communication0.0020.001
Open science0.0090.003
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0070.034

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.072
GPT teacher head0.406
Teacher spread0.334 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreOther

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueOpen Science FrameworkFrench-language works237,207