MétaCan
Menu
Back to cohort
Record W2053615882 · doi:10.1002/bult.2006.1720320510

The confluence of research and practice in information architecture

2007· article· en· W2053615882 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
aboutThe title or abstract carries a Canadian signal from the geographic lexicon.

Bibliographic record

VenueBulletin of the American Society for Information Science and Technology · 2007
Typearticle
Languageen
FieldComputer Science
TopicInformation Architecture and Usability
Canadian institutionsWestern University
Fundersnot available
KeywordsArchitectureSummitComputer scienceField (mathematics)Data scienceWorld Wide WebSociologyVisual artsGeographyArt

Abstract

fetched live from OpenAlex

If you have tried your hand at information architecture (IA) — designing navigation schemes, creating wireframes, planning usability studies — then you will know how challenging the work is. If you have attended the Information Architecture Summit — the seventh edition of this annual conference was recently held in Vancouver — then you will know that information architects are a smart, creative and enthusiastic lot. And if you have worked with information architects then you will have respect for how, and how well, they grapple with tortuous information problems in all their real-world complexity. You will also know that IA is characterized by its practice; not by its research. Indeed, there is no discernable body of IA research. Of course there is a great deal of relevant research, as can be said of any area. However, this relevant research is scattered across many disciplines and over numerous journals, using various names and taking multiple forms. Seldom does it establish an explicit connection to IA, let alone describe itself as IA research. In light of the field's history, the lack of a formal body of research is not surprising. IA was conceived, defined and developed by practitioners. True, it has roots in established fields with their own research literature, primarily library and information science, human-computer interaction and information retrieval, among others. But IA has also evolved, liberally integrating new concepts and methods as it seeks to expand and enrich the practice. Even so, IA can look more familiar than new, at least from the outside. To some it seems little more than applied librarianship. To others it is merely a user-centered approach to hypertext retrieval systems. To critics it is simply old wine in new bottles. But those who have engaged themselves in the practice and with the practitioner community come away convinced that IA is something new and valuable. A synthesis, yes, but one that is sufficiently unique and compelling that IA should be considered a distinct and important field. As part of its evolution, IA has consciously set out to establish intellectual, social and cultural foundations. There are books, mailing lists, conferences, workshops and a professional organization, the Information Architecture Institute (iainstitute.org). And there has been some research, a special issue of JASIST being the most notable example. However, IA research is still an ad-hoc affair. But this picture is changing. There is increasing recognition that not only does IA offer rich research opportunities, but also that without a research community the growth and maturation of the field will be constrained. With these thoughts in mind the 2006 IA Summit introduced a peer-reviewed research stream. The intention was two-fold: to facilitate the slow process of developing a research community and to establish a fruitful dialogue between researchers and practitioners. A call for papers was released to solicit research contributions, and a committee was established to review the submissions. The final conference program included 45 presentations, four panel discussions and a half dozen birds-of-a-feather sessions, or BOFs. Research was present throughout. In all, eight research papers were accepted for the proceedings. There was also a panel discussion about defining a research agenda and a research-themed BOF. All of the research sessions were well attended, each attracting between 50 and 150 people. (Total Summit attendance was over 550, the highest to-date.) Just as important, the presentations generated many questions and much hallway discussion. Although research was only a small part of the program, it was visible and valued. It was also thoroughly integrated into the conference, not shuffled off to one side under a sign saying “researchers over here, everyone else over there.” I spoke with many people during the conference about the research stream and followed up with others via email. The general consensus was that research had been successfully added to the program. Still, the Summit is a practitioner-driven event. Research should continue to be a vital and vibrant part of the proceedings — only a small part. Overall, it was widely agreed that IA, as a whole, must develop a research community, formulate a research agenda and facilitate the conversation between researchers and practitioners. The Summit can play an important role in achieving these goals. But there were caveats as well. Although the conference benefited from a coordinated research presence, it was also clear that the mix between research and practice and between researcher and practitioner could be improved. Some worried that research might limit itself to next-generation document retrieval problems, which would be at odds with the trend to expand IA beyond its retrieval-centric origins and even beyond the digital realm. Perhaps the most common concerns were that research not be defined as something done by and for academics and that academics not view the Summit as yet another publishing venue for promotion and tenure purposes. Throughout this article I have used the term researcher instead of academic. To some, these are synonymous. But this false synonymy was consciously disregarded when planning the Summit. The call for papers was explicit on this point — research could be submitted by anyone so long as it met certain standards of quality, clarity, validity and originality. Attracting academic researchers was certainly one of the goals, but the broader and long-term goal was developing a research community that will be intellectually, socially and culturally engaged with IA's practitioner core. Toward these goals we have taken one more step, one of many. The next IA Summit will be held in Las Vegas in March 2007. The call for research papers will be published later this spring. The submission deadline will be in the fall, probably early November. Complete details will be available on the conference website (www.iasummit.org).

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.009
metaresearch head score (Gemma)0.004
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.914
Threshold uncertainty score0.997

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0090.004
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.003
Science and technology studies0.0000.006
Scholarly communication0.0000.001
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.013
GPT teacher head0.318
Teacher spread0.305 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it