MétaCan
Menu
Back to cohort
Record W7043393226

State of the art practice: Are we ready for Systemic Design Toolkits?

2018· other· en· W7043393226 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueOCAD University Open Research Repository (OCAD University) · 2018
Typeother
Languageen
Field
Topic
Canadian institutionsnot available
Fundersnot available
KeywordsField (mathematics)Session (web analytics)State (computer science)Set (abstract data type)Panel discussionVariety (cybernetics)
DOInot available

Abstract

fetched live from OpenAlex

Authors and Panelists: Peter Jones (OCAD), Stefanos Monastiridis (Namahn), Alex Ryan (MaRS), Vanessa Toye (MaRS), Kristel Van Ael (Namahn), Philippe Vandenbroeck (shiftN)
\n
\nEmpathy-Driven
\nSocial Innovation
\nChangemakers
\nCo-Design
\nTransdisciplinary
\nYouth Empowerment
\nEducation systems
\n
\nAt the RSD5 symposium in Toronto (2016), Namahn and shiftN presented the first version of their Systemic Design toolkit and assessed its fit to practice in the conference workshop. Since then, the original authors have collaborated with Peter Jones (OCADU) and Alex Ryan (MaRS Discovery District) for continued development of the toolkit towards a mature version, ready for general use.
\n
\nA panel session was presented at the RSD7 Symposium in Torino to present the release version of the toolkit.
\n
\nWhy a Systemic Design Toolkit?
\n
\nAfter 7 years of RSD symposia, we believed some concern could arise that the field might be too dominated by academic studio-led methods and projects. We had not seen a movement toward pragmatic practice development, applying the learning from RSD to preferred methods and guidelines. With this collaborative methods toolkit, we wish to offer the Systemic Design community a set of thinking-and-doing instruments.
\n
\nChanging a system requires the involvement of the actors within the system. We need their knowledge, capabilities and motivation to initiate and foster systemic change. This toolkit establishes a common understanding and language, enabling dialogue among the actors and other stakeholders, including a diverse designer team. It offers methods and hands-on tools for co-analysis of complex challenges, co-design of advanced concepts, and co-creation of systemic solutions.
\n
\nThe methods and tools build upon the research of prominent systems thinkers and design thinkers such as Russell Ackoff, Donella Meadows and Christopher Alexander. The methods in the toolkit are explained by their prominent theories.
\n
\nThe tools have been continuously improved during project work for clients and academic teaching by the authors. Many cases are available from the authors’ work in healthcare, government, and industry to demonstrate the fit of methods to these applications.
\n
\nGuidelines and Underlying Principles
\n
\nThe toolkit was developed with the following principles in mind:
\n
\n• Participatory: “No single profession, group or organization can successfully address today’s societal challenges alone” (Sharon Matthias and Jess McMullin, RSD6). The application of Systemic Design demands the participation of stakeholders across existing social systems boundaries. Unlike other disciplines of design, Systemic Design has no model of the end user or consumer. It only has participants, who may live in different social systems that must be understood.
\n
\n• Anticipatory: All systems change leads us to a design for futures, but we must always ask “whose future?” The worldviews, goal and values of participants in multiple future contexts must be included and represented through foresight-led systemic design methods that enable stakeholders with variety of temporal reasoning capacities to equally contribute to future systems design.
\n
\n• Externalising Knowledge: A common understanding can only truly be achieved if the underlying thinking process is shared by all. The toolkit makes the underlying theoretical concepts and design decisions explicit. The (Nonaka and Takeuchi) SECI knowledge model (Socialization, Externalization, Combination, Internalization) explains the diffusion of knowledge and uptake of new practices.
\n
\n• Presence Producing: Systemic Design is practiced through engaging activities that produce an intense feeling of “here and now” (Piotr Michura and Stan Ruecker, RSD6). During these activities, the participants challenge and shift the system boundaries towards new forms.
\n
\n• Empowering: The Systemic Design activities aim to help the participants to collectively make sense of the challenge and provide them with plans of action they can carry out in the systems they are ordinarily entangled in. The activities transform them into agents of change in their daily field of action.
\n
\n• Multi-level and Multi-perspective: The design process supported by the toolkit is distinguished by continuous modulation between levels of abstraction by alternately ‘zooming out’ of the system and ‘zooming in’ on the stakeholders.
\n
\n• Formative Contexts: The toolkit doesn’t aim to offer a well-defined sequence of methods but rather a grammar that allows the designers to bring the Systemic Design vocabulary (the methods and tools) together in a way that makes sense for a given project. The order of activities depends on the context of application and social dynamics of the moment, a process of designing for formative contexts (Ciborra, 2002).
\n
\n• Open-ended: Consequently, unlike other disciplines of design, Systemic Design is not bound to a specific outcome, be it a product or a service, or the creation of a single solution. Systemic Design aims at identifying, developing and stimulating interventions to change and self-adapt the system on the way.
\n
\nPanel Proposal
\n
\nA panel discussion was proposed to accomplish 3 aims: To announce the toolkit as a new resource included in the SDA membership launch, to share the toolkit in an open dialogue about its use and value, and to encourage dialogue about the state of the art of practice.
\n
\nThe panel follow consisted of brief presentations from the authors, who self-moderated an interactive discussion with the audience to engage people in the following questions:
\n
\n• What makes the toolkit state of the art? What are the relevant criteria in practice to qualify a systemic design toolkit?
\n
\n• What other toolkits or “methods collections” exist today in the intersection of design and systems thinking? Are these actually state of the art or improved legacies?
\n
\n• What are the key practice areas in which the toolkit will be of value? Where will we see it deployed earliest?
\n
\n• How do we intend to enhance and update the toolkit? What feedback from the practice are we looking for?
\n
\n• Do we even need a toolkit? What are the alternatives to a structured methods collection?
\n
\nFuture Development
\n
\nAs a system of practice, the Systemic Design Toolkit is in its initial stages of development and use and is expected to continue in a dynamic state of constant evolution, incorporating ideas, theories and approaches from other contributors. To that end, the core team represented by the authors agreed to engage in a long-term collaboration aimed at sustainable bringing this body of knowledge to a higher level.
\n
\nREFERENCES
\n
\nCiborra, C. (2002). The Labyrinths of Information: Challenging the Wisdom of Systems. Oxford University Press.
\n
\nJones, P. (2014). Systemic design principles for complex social systems. In G. Metcalf (ed.), Social Systems and Design, Volume 1 of the Translational Systems Science Series, pp 91-128. Springer Japan.
\n
\nMatthias, S, & McMullin, J. (2017). Systemic Maturity Models and Multi-organization collaborations: the ACMHI Mentally Healthy Campus Maturity Model. Proceedings of RSD6 Symposium, Oslo, Norway.
\n
\nMichura, P, & Ruecker, S. (2017). Design as production of presence – systemic approach to re- designing novelty. Proceedings of RSD6 Symposium, Oslo, Norway.
\n
\nNonaka, L., Takeuchi, H., & Umemoto, K. (1996). A theory of organizational knowledge creation.
\nInternational Journal of Technology Management, 11(7-8), 833-845.
\n
\nVan Ael, K, & Vandenbroeck, P. (2016). Towards a Systemic Design Toolkit. Workshop and Proceedings of RSD5 Symposium, Toronto.
\n
\nVandenbroeck, P. (2014). Working with Wicked Problems. King Baudouin Foundation, Brussels.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies, Open science, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Other · Consensus signal: Other
Teacher disagreement score0.354
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0040.001
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0030.004
Science and technology studies0.0020.003
Scholarly communication0.0000.002
Open science0.0080.002
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0000.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.145
GPT teacher head0.350
Teacher spread0.205 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it