MétaCan
Menu
← Back to cohort

Developments in the evidence‐based health care debate – 2004

2004· article· en· W1581972098 on OpenAlexaboutno aff
A. Miles, Joseph E Grey, Andreas Polychronis, Nicholas C. Price, C Melchiorri

Bibliographic record

VenueJournal of Evaluation in Clinical Practice · 2004
Typearticle
Languageen
FieldHealth Professions
TopicHealth Sciences Research and Education
Canadian institutionsnot available
Fundersnot available
KeywordsArgument (complex analysis)ConvictionNothingHealth careIntuitionEpistemologySociologyLibrary sciencePolitical scienceLawMedicinePhilosophyComputer science

Abstract

fetched live from OpenAlex

In the preceding seven annual thematic editions (Miles et al. 1997, 1998, 1999, 2000, 2001, 2002, 2003) we have been specifically concerned to stimulate intensive debate on the concept and methodologies of evidence-based medicine (EBM) and to provide learned commentaries on their implications. It is to this very substantial body of scholarly discourse that we now add the contents of the current eighth thematic issue where new perspectives from a wide range of international sources will be seen to contribute further arguments to the ongoing debate. Given the large volume of literature submitted to the Journal on EBM on a continuous basis, the editorial decision has been taken to bring the publication of an annual thematic edition to a close in favour of the publication of a Forum on EBM within each successive issue of the Journal. In this way, a more rapid dissemination of learned argument will be achieved above what is possible through a once yearly edition. In the seventh thematic edition (see Miles et al. 2003), Gupta (2003), writing from McMaster University, Canada, contributed for the first time an important perspective to the EBM debate: its ethical dimension. We argued that the ethical position espoused by the EBM protagonists represented nothing more than the results of an attempt secondarily to formalize a primarily unstructured intuition based on an absolute and fundamentally unreasoned conviction that their position is ‘closest to the truth’. In illustration of our point we commissioned four learned commentaries on Gupta's essay (Gupta 2003) and invited the eminent health philosopher Michael Loughlin to contribute additionally to the debate. The reader is referred to the individual commentaries in review of the arguments advanced (Miettinen 2003; Norman 2003; Shahar 2003; Couto 2003; Loughlin 2003) and it is in answer to her commentators that Gupta has contributed the first paper of the present thematic edition (Gupta 2004). While Gupta (2004) raises many important points in the manner of a Riposte, her paper largely re-iterates her previously adopted position (Gupta 2003) and, indeed, raises more questions than it answers. Chief among these is, perhaps, ‘. . . how can EBM provide evidence of its effectiveness and respond to this basic ethical and scientific challenge laid out by Shahar?’. Sadly, the fact remains that no such evidence currently exists and neither have the EBM protagonists appeared remotely concerned to work towards properly designed trials which might provide an answer to such a fundamentally important question. Gupta (2004) asks why, despite a significant body of scholarship having emerged through the Journal of Evaluation in Clinical Practice and elsewhere, which has challenged every dimension of EBM from its theoretical structure to its practice, EBM has been received uncritically or indeed been enthusiastically endorsed by so many practitioners? We do not agree with Gupta's contention that EBM has been well received by the majority of clinicians. On the contrary, the debate on EBM has been characterized by a stark polarity of opinion and it has been to the intensive study of such differences in medical thinking that the eight thematic editions of the Journal have been dedicated. Nevertheless, we find Gupta's discussion of the sociological, psychological and ethical issues impacting on clinicians’ opinions of EBM interesting and worthy of further study. We note Gupta's observation that throughout the history of scholarship many influential thinkers have had the intellectual integrity to revise previous ideas in order to respond to legitimate criticism and we endorse absolutely her suggestion that the leaders of the EBM movement can – and must – follow in this tradition and that as a direct function of such an approach EBM could make an important contribution to future medical practice. Only properly designed studies, rather than appeals to biological plausibility and probabilistic reasoning, will indicate whether EBM can. In the three papers which follow, two physicians and a surgeon document their thinking on the current status of EBM within clinical and academic medicine. In the first of these, Porta (2004) notes the deepening dichotomy between EBM and ‘common sense-based medicine’ and that EBM has so far failed to provide ‘the mother of all evidence’, that is, that it does more good than harm. His observation that the EBM protagonists have, in taking upon themselves the authority to define what exactly constitutes evidence and what does not, have contributed to what might be termed the ‘vigour’ of the debate to date, will find agreement among a great many colleagues. Indeed, Porta (2004) notes that the EBM acolytes have caricatured practising colleagues as ‘grubby underlings’, hopeless at applying the latest ‘evidence-based’ literature while clinicians have, in due measure, felt monitored by ‘nerds’ who ‘spend their time sipping coffee while talking to computers instead of patients’. Porta's potted history, as it were, of the rise of EBM is extraordinarily accurate. When the EBM movement was instituted, the basic concepts, he notes, all sounded rather sensible, but then epidemiologists, statisticians and librarians saw power befalling them as they trotted unexplored avenues towards number crunching. His reflection on the principal elements in the development of the EBM movement continues and is followed by a meditation on the nature of ‘common sense medicine’ in juxtaposition to the classical position of ‘evidence-based medicine’. For Porta (2004), both ‘common sense medicine’ and ‘evidence-based medicine’ are but two faces of the same painstaking clinical process which should, rather than engaging in a cockfight benefitting less-qualified individuals entering the medical field – managers, lawyers and the lay press – stand together against such forces. Porta (2004) is in our view right in asserting that as clinical research continues to produce results of relevance for transfer into daily practice it will increasingly assist common sense. Learning from experience is, as Porta (2004) notes, the process which leads to maturity and the addition of collective experience gained through some of the methodologies of EBM has the potential to provide major benefits. For Rosenfeld (2004), EBM was initially empowering and liberating but quickly became a rigid dogma within a constricting, conflicting, insensitive religion preached by the few and meant to be followed blindly by the masses. She does not seek to defend the previous era, as it were, of ‘faith-based medicine’, where ‘pearls handed down from authoritarian figures’, ‘beloved texts’ and personal clinical experience formed the basis of the clinical practice of many doctors. On the contrary, she affirms the absolute necessity to integrate clinical evidence with clinical expertise on the basis that without such integration EBM devalues the needs of individual patients and shifts clinical practice, as Tonelli (2000) has emphasized, away from the care of individuals towards the care of populations, with the potential to lead to unintended and untoward consequences. But she also recognizes the very real potential for the practise of clinical medicine to become ‘cookbook’ in nature and that this possibility has become more and not less likely in recent years as a consequence of the activities of ‘secretive organisations’ such as the Cochrane Group and the organizers of Best Evidence. She rightly calls for information on the identity of the people involved in and directing these organizations and notes that these bodies produce conclusions which, following publication, then become codified into recommendations and practice guidelines. Her observation that medicine has returned in many ways to the former ‘faith-based’ position is an important one and she recognizes that colleagues are being urged increasingly to practise medicine according to the authority of those practitioners of EBM who are regarded as ‘approved’ and ‘acceptable’. Michelson (2004) brings yet more perspectives to the relationship of EBM to ‘common sense’. Michelson's original proposition published within the British Medical Journal (Michelson 2003) and expanded upon here was concerned with theories of causation and association. He used a simple example drawn from orthopaedic surgery, namely, that when he hits his finger accidentally with a hammer, his finger hurts and that an injury sustained through a power drill hurts more. How many times, he asks, does he have to do this before he can claim that he has sufficient evidence causally to link the hammer blow to the finger pain and what would he employ as a control? The obvious answer to this question is, he asserts, ‘one’ with no need for a control and the answer to the question: ‘why don’t we need a randomised controlled trial?’ is: ‘common sense’. He makes the point that in the enthusiasm for generating ‘association-based evidence’ for treating various medical conditions, the potential for recognizing causation as a basis of decision making in diagnosis and treatment has been ignored. We agree with Michelson (2004) that this is an important issue because, as he says, if there are valid, verifiable physical reasons for a relationship between an action and its result, then conducting a randomized controlled trial is a wasteful use of resources. Michelson's exposition of the nature of ‘common sense’ in medical practice is closely in agreement with that advanced by Porta (2004) and indeed by us and his examples are particularly compelling. Michelson (2004) does not imply that the use of common sense in clinical medicine in any way precludes the responsibility of the clinician continuously to search the literature for studies relevant to his practice but that the use of common sense simply puts this activity into perspective. Indeed, we agree that the chain of reasoning between statistical results in clinical studies and direct clinical application contains so many assumptions that a great deal of clinical judgement is required in the appropriate use of such information. As Michelson (2004) emphasizes, it is not that we should not attempt continuously to improve our existing and accumulating knowledge but rather that we should acknowledge the limits of pure reasoning based on clinical studies and appreciate that common sense will have, inevitably, a valuable role to play in the care of patients ‘who live in the real world, rather than in our models’. In his review entitled ‘The doctor, his patient and the computerized evidence-based guideline’, the Editor's Choice, Lipman (2004) contributes a particularly incisive and important article to the EBM debate. His paper explores some of the issues raised by the finding in a randomized controlled trial that general practitioners taking part in the study failed to employ a computerized evidence-based guideline, nor did it have any impact on patient outcomes. Lipman (2004) notes that general practitioners are expected to make an initial decision on every problem patients may present and that it is integral to the nature of general practice that psychological and social problems are addressed in addition to the purely biomedical ones. The computerized trial representing the intervention in the study imposed an external, largely biomedical agenda that superseded that of the patient. This, in turn, disrupted the normal pattern of general practice consultations and was therefore comprehensively ignored. Lipman (2004) is clear, as are we, that the reductionist assumptions underlying the construction of evidence-based guidelines from systematic reviews and related sources leads to inflexible recommendations on the management of patients. As part of his consideration, Lipman (2004) interestingly reviews the distinction made by anthropologists and sociologists between scientifically defined disease states and the culturally constructed experience of illness in illustration of the ‘very stuff’ of general practice. He is, however, clear that the question is not whether general practitioners need to use research evidence in their practice but how to ensure that it is used effectively, judiciously and with compassion. Usefully he reminds us of the motto of The Royal College of General Practitioners UK which is Cum Scientia Caritas and believes that the implementation of the research agenda promoted by guidelines committees and their ‘assorted apparatus of quality frameworks, guidelines and computerized flow charts’ elevates Scientia into the prime purpose of clinical practice while removing control of it from clinicians. As part of this process Caritas is relegated, he feels, into second place and into a position where it might be seen as conflicting with Scientia. This would be, he believes, as do we, a disastrous position but general practitioners may well be forced into a position of implementing such policies as part of the pressures and incentives that currently abound in modern health services. In conclusion, Lipman (2004) is clear that whatever the arguments about the epistemologically flawed and reductionist view of evidence for practice and guidelines implementation, the fundamental issue is whether clinical management is to be informed by evidence or directed by it. He argues that it is only by taking control of the use of evidence that general practitioners – and other clinicians – can safeguard the essentially humane nature of their vocation. We turn in detail to practice guidelines and audits of adherence to them later in this issue but proceed now to considerations of evidence-based nursing, evidence-based practice in the multidisciplinary primary care setting and evidence-based physiotherapy. In the paper which follows Geanellos (2004), writing from the University of Western Sydney, Australia, is concerned with the concept of nursing-based evidence as a means of moving beyond ‘evidence-based practice’ in mental health nursing. As she points out, a significant body of knowledge and practice in this field is derived from the disciplines of psychiatry, pharmacology and the behavioural sciences which favour knowledge developed using quantitative methodologies and which thus ‘fit’ more easily within the concept of evidence-based clinical practice. Since the place of qualitative research in clinical decision making has typically been dismissed by EBM, Geanellos (2004) argues against the classical model of evidence-based practice in mental health nursing specifically because this field is primarily concerned with human experiences of illness and human relationships and these by their nature do not lend themselves easily to quantitative analysis and description. Using examples drawn from nursing she demonstrates how qualitative research is indispensable to mental health nursing but is clear that this fact does not of itself preclude the need for quantitative approaches. Indeed, she recognizes that the two-fold interest of mental health nursing: the work of nurses with patients and the explication of phenomena which inform practice, require diverse knowledge and thus diverse research strategies. It is the knowledge deriving from the research driven by this conceptual base that she describes as nursing-based evidence and she argues convincingly in our view that it provides a means of articulating mental health nursing's distinct contribution to the health care of people with mental illnesses and thus directly advances understanding and development in this field. Hancock & Easen (2004) continue the nursing theme in a paper focussed on a discussion of evidence-based practice as an incomplete model of the relationship between theory and professional work. Their paper explores the realities of nurses’ clinical decision making through a discussion of current practice in the extubation of patients following cardiac surgery, with a consideration of the implications of current practice for both nurse education and the continued development of clinical nursing practice. The authors note that nurses are increasingly expected to practise their profession under a system of health care that embraces the ideals of EBM but are clear that embracing these ideals may be unrealistic in a field which at its core is devoted to human caring and where the ideals of EBM may ultimately lead to ‘dehumanising practice’. Specifically, they worry that the core concept of EBM involves ‘data speaking for themselves’ but reply by emphasizing that ‘the facts never speak for themselves’ and that an interpretive role for the professional using an evidential knowledge base is essential to good clinical practice. The authors do not set out to debate the fundamentals of EBM as a system of health care delivery rooted in scientifically derived knowledge. That much has been done elsewhere (see Miles et al. 1997, 1998, 1999, 2000, 2001, 2002, 2003). But they do argue that its restricted focus ignores the realities of routine clinical practice and that in the field of human caring there is a multiplicity of factors affecting the application of knowledge into practice and that in its neglect of these factors evidence-based practice appears an incomplete model of the relationship between theory and professional practice and, as such, needs re-thinking. The implementation of given models of evidence-based practice raises questions, as O’Donnell (2004) points out, in relation to the attitudes and skills of the different professional groups within health care towards ‘evidence’ and it is to an examination of the attitudes and knowledge of primary care professionals towards evidence-based practice (EBP) that this author turns. Her paper is important because it is the first study systematically to elicit the views of six different key professional groups working within primary care about evidence-based practice. Interestingly, while all the professional groups studied were generally supportive of EBP, the author was able to identify some significant differences between them. General practitioners, for example, were less likely to agree that they had the skills necessary to undertake literature reviews or appraise evidence compared to nurses and public health facilitators and typically tended to consult a narrower range of journals than other groups. Of additional interest was the observation that nurses and public health practitioners were the only groups to have any understanding of the terms associated with qualitative research and of some significance was the finding that public health practitioners were the least likely to view guidelines or protocols developed by others as the best source of evidence for primary care. Many of the observations that O’Donnell has been able to make from her study have been made previously by other study Her through its systematic to our accumulating knowledge in this In a of our analysis of professional attitudes towards evidence-based practice, we turn to the paper by et al. (2004) who their of attitudes towards evidence-based practice following their to an evidence-based using opinion In their were randomized by of work to two groups. The intervention received an evidence-based on of literature and The control received a on the management of common to in both groups were at and at and Interestingly, that they primarily on and as sources of information to inform their practice and that professional practice should be based on the best evidence and that practice should if evidence that it should Many of the however, in the of professional journals and in opinion leaders for key of knowledge and journals and research were as and the of the between the control and intervention was The authors that opinion leaders in can have the potential to attitudes to and that have attitudes to EBP, they the and skills necessary to it within their clinical work. they of education should the needs of in this at an individual and in order to these use of evidence The paper in this the issue of an understanding of EBM in a study of skills in and use of For and his et al. writing from University in understanding basic of EBM may to its implementation into clinical practice. Their study skills in EBM and related these to the use of information and practice of questions on terms in evidence-based literature one was to working within a in the study were additionally about the to which they various information skills of of scientific literature and the to which they evidence-based practice in their clinical practice. The of to the was at and for all doctors. Interestingly, only a very were able to define and all terms but the majority of interest in more. an understanding of the In terms of the of information source typically by the the study that the was that of colleagues and scientific journals when the for clinical with the Cochrane being the least information Indeed, of the had never the Cochrane of the Cochrane and of such as at typically had more academic than and a much in with the of evidence-based practice. The study was able to that to knowledge of key terms associated with EBM and that this may therefore a to the implementation of models of EBM into practice. Clinical practice guidelines have been the of intensive international debate as to their within clinical medical practice and as through which research evidence may be into routine clinical practice. thematic editions of the Journal have the of guidelines from a multiplicity of perspectives and in the current issue we present two papers which specifically at and facilitators to In the first and her et al. writing from the Medical and facilitators in the of adherence to guidelines for the management of disease As part of a study to the of an intervention on adherence to the focus groups at three Medical with primary care and in an to identify key and facilitators to The by the authors in the use of the guidelines was an in the quality and of care while the a of of the guidelines to the care of any one individual the of guidelines and the associated with patients. The sources of on use by the study professional colleagues and major journals and the of use was to be very much a personal practice The second paper of this has been contributed from University and the University of by and her colleagues et al. and on an examination of the by in the use of a multidisciplinary for management of the of As these authors point out, the of is and is by a major in quality of for those patients that following The of guidelines evidence for management therefore has clinical significance and the authors in this the development of a multidisciplinary for management by professionals representing organizations involved with The of the to implementation is interesting and the conclusions to the need for for implementation are The function is one of the through which adherence to practice guidelines and clinical recommendations can be and and in a particularly article (2004) provides a systematic review of published audits from general practice in the This which contains much of interest and relevance to of the quality of care within primary care in is followed by two further devoted to an of evidence-based for people et al. and a study of the issues of in of the management of disease et al. contributed by The Royal College of of papers this of the thematic issue which we have to a discussion of and in practice of relevance to the EBM debate. In the first (2004) contributes some on the and of clinical As he notes, the clinical trial has to be as the source of medical knowledge and his paper out to the of this to a analysis in order to upon its significance in the of medical (2004) current on the basic of the evidence by clinical trials with conflicting observations their current application in medical practice and he the trials of present research in to his (2004) is clear that the assumptions the of clinical trials are based on an of absolute and and his paper contains much that is at once both and In the paper which and his colleagues et al. are concerned with the of randomized clinical trials as methodologies in medical research and the of these study to provide on the effectiveness of as they are used in the of clinical practice. Their study was designed to the effectiveness of a in the routine clinical management of the and but also the understanding in the of their studies and how a more and much was developed above what had been initially and how it is possible to to treatment through their The approach by these can the by randomized controlled trials and has the additional to whether the expected are from the trial to the general We agree that their is an important development in the of following initial and studies play an important role in medical and health particularly in terms of the of information for the and of randomized clinical trials as and et al. they can be and In their the authors on studies that are used specifically to randomized controlled In

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.076
metaresearch head score (Gemma)0.121
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.924
Threshold uncertainty score0.403

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0760.121
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0050.009
Science and technology studies0.0070.034
Scholarly communication0.0350.017
Open science0.0050.012
Research integrity0.0330.033
Insufficient payload (model declined to judge)0.0060.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.648
GPT teacher head0.716
Teacher spread0.068 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
DomainMethods
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations50
Published2004
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Evaluation in Clinical Practice→Same topicHealth Sciences Research and Education→French-language works237,207→