How to Conquer Artificial Intelligence: A Structured Workshop on Causal Hypothesis Generation (Planning-ness 2015)
Notice bibliographique
Résumé
About Planning-ness:Planning-ness was a unique "un-conference" for creative thinkers and strategists that ran from 2009 to 2016. Its core philosophy was built on interdisciplinary cross-pollination, frequently inviting experts from domains entirely outside of advertising to provide fresh perspectives on problem-solving. The idea was that participants could borrow mental models from fields ranging from thermodynamics to poetry and apply them to the domain of planners (which in advertising world is the term for strategists who are responsible for responsible for understanding the consumer, the market, and the brand). Organized in partnership with the Account Planning Group of Canada (APG Canada) for the 2015 Toronto edition, the event prioritized "doing" over "observing." Every session followed a "How To" format, requiring a workshop component where participants could immediately apply new frameworks to practical challenges.Workshop Summary:This session explored the intersection of human intuition and machine intelligence, addressing the strengths and weaknesses that both humans and the AI algorithms available at the time brought to the table. The workshop focused on how to elicit information from human stakeholders in ways that are useful for future modeling—specifically causal search. We walked all attendees through a structured hypothesis generation approach using examples heavily influenced by the "sprinkler model" found in Judea Pearl’s Causality: Models, Reasoning, and Inference (2000).Following the introduction, participants were divided into eight groups to put these principles into practice. Each group selected an outcome they cared about and mapped out potential causes (both direct and indirect) and side effects. This provided a practical demonstration of how to push beyond the human tendency to stop at a single potential explanation and generate the kinds of inputs that would be useful for next steps.With the set of potential inputs that might matter, participants were prepared to plan out data collection and experiments that might be necessary for them to answer causal questions their team was interested in solving. The structured approach helped them to make sure not to leave out important variables for alternate explanations that could be later used by causal search and causal inference algorithms.Workshop Framework: The "Rules" for Human Elicitation:To ensure the session moved beyond standard brainstorming, we utilized an iterative, four-step process for hypothesis generation (detailed with a visual build per step on Slides 19–23). Moderators prompted participants to switch cognitive gears to the next step once they had spent a particular amount of time or had exhausted ideas for the current step.Step 1: Start with the outcome you hope to change.Step 2: For every hypothesized variable, add at least two causes. This forces the mind to move past the first "obvious" explanation and consider alternative causal paths.Step 3: For every hypothesized variable, add at least one side effect. These are additional outcomes that could potentially occur but are unintended or secondary to the variables they are related to (we used side effect more broadly to mean any unintended or secondary outcome instead of limited to bad outcomes).Step 4: Find at least two items on the board that share a common cause, and add that cause. This step is helps uncover latent variables and identifying confounders that influence multiple parts of the system.Steps 2 to 4 were repeated, resulting in a robust, multi-layered causal map.This workshop is a practical application of the first steps in the methodology presented in 10.5281/zenodo.19612598
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,002 | 0,004 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,000 | 0,000 |
| Bibliométrie | 0,001 | 0,002 |
| Études des sciences et des technologies | 0,003 | 0,000 |
| Communication savante | 0,008 | 0,001 |
| Science ouverte | 0,002 | 0,002 |
| Intégrité de la recherche | 0,000 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,002 | 0,007 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; les deux têtes enseignantes s’accordent sur ce qui est montré ici.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».