MétaCan
Menu
Retour à la cohorte
Enregistrement W7155649466 · doi:10.5281/zenodo.19770511

How to Conquer Artificial Intelligence: A Structured Workshop on Causal Hypothesis Generation (Planning-ness 2015)

2015· article· W7155649466 sur OpenAlexaboutno aff
Scott Porter, Aliza Pollack

Notice bibliographique

RevueZenodo (CERN European Organization for Nuclear Research) · 2015
Typearticle
Langue
DomaineComputer Science
ThématiqueCognitive Science and Mapping
Établissements canadiensnon disponible
Organismes subventionnairesnon disponible
Mots-clésIntuitionCausal inferenceSession (web analytics)Strengths and weaknessesInferenceIntersection (aeronautics)

Résumé

récupéré en direct d'OpenAlex

About Planning-ness:Planning-ness was a unique "un-conference" for creative thinkers and strategists that ran from 2009 to 2016. Its core philosophy was built on interdisciplinary cross-pollination, frequently inviting experts from domains entirely outside of advertising to provide fresh perspectives on problem-solving. The idea was that participants could borrow mental models from fields ranging from thermodynamics to poetry and apply them to the domain of planners (which in advertising world is the term for strategists who are responsible for responsible for understanding the consumer, the market, and the brand). Organized in partnership with the Account Planning Group of Canada (APG Canada) for the 2015 Toronto edition, the event prioritized "doing" over "observing." Every session followed a "How To" format, requiring a workshop component where participants could immediately apply new frameworks to practical challenges.Workshop Summary:This session explored the intersection of human intuition and machine intelligence, addressing the strengths and weaknesses that both humans and the AI algorithms available at the time brought to the table. The workshop focused on how to elicit information from human stakeholders in ways that are useful for future modeling—specifically causal search. We walked all attendees through a structured hypothesis generation approach using examples heavily influenced by the "sprinkler model" found in Judea Pearl’s Causality: Models, Reasoning, and Inference (2000).Following the introduction, participants were divided into eight groups to put these principles into practice. Each group selected an outcome they cared about and mapped out potential causes (both direct and indirect) and side effects. This provided a practical demonstration of how to push beyond the human tendency to stop at a single potential explanation and generate the kinds of inputs that would be useful for next steps.With the set of potential inputs that might matter, participants were prepared to plan out data collection and experiments that might be necessary for them to answer causal questions their team was interested in solving. The structured approach helped them to make sure not to leave out important variables for alternate explanations that could be later used by causal search and causal inference algorithms.Workshop Framework: The "Rules" for Human Elicitation:To ensure the session moved beyond standard brainstorming, we utilized an iterative, four-step process for hypothesis generation (detailed with a visual build per step on Slides 19–23). Moderators prompted participants to switch cognitive gears to the next step once they had spent a particular amount of time or had exhausted ideas for the current step.Step 1: Start with the outcome you hope to change.Step 2: For every hypothesized variable, add at least two causes. This forces the mind to move past the first "obvious" explanation and consider alternative causal paths.Step 3: For every hypothesized variable, add at least one side effect. These are additional outcomes that could potentially occur but are unintended or secondary to the variables they are related to (we used side effect more broadly to mean any unintended or secondary outcome instead of limited to bad outcomes).Step 4: Find at least two items on the board that share a common cause, and add that cause. This step is helps uncover latent variables and identifying confounders that influence multiple parts of the system.Steps 2 to 4 were repeated, resulting in a robust, multi-layered causal map.This workshop is a practical application of the first steps in the methodology presented in 10.5281/zenodo.19612598

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,002
score de la tête « metaresearch » (Gemma)0,004
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesMéta-épidémiologie (sens strict), Études des sciences et des technologies, Communication savante, Charge utile insuffisante (le modèle a refusé de juger)
Catégories consensuellesCharge utile insuffisante (le modèle a refusé de juger)
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: aucune
GenreSignal candidat: Empirique · Signal consensuel: aucune
Score de désaccord entre enseignants0,969
Score d'incertitude au seuil1,000

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0020,004
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0010,002
Études des sciences et des technologies0,0030,000
Communication savante0,0080,001
Science ouverte0,0020,002
Intégrité de la recherche0,0000,001
Charge utile insuffisante (le modèle a refusé de juger)0,0020,007

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,193
Tête enseignante GPT0,314
Écart entre enseignants0,122 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; les deux têtes enseignantes s’accordent sur ce qui est montré ici.

Devis d'étudeSans objet
Domainenon disponible
GenreEmpirique

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations0
Publié2015
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueZenodo (CERN European Organization for Nuclear Research)Même sujetCognitive Science and MappingTravaux en français237 207