Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
According to Health Canada, the proportion of Canadians aged 65 and over rose from 4.8% in 1921 to 12.3% in 1998.1 This cohort is projected to grow further before reaching a plateau at more than 20% of the population by the year 2026. This trend is not unique; similar predictions have been made for both industrialized and non-industrialized countries worldwide.2 Not surprisingly, a great deal of effort has been expended attempting to predict the impact of this demographic drift on the provision of health care.3 Less examined, however, has been the effect of this trend on health care providers themselves. Already in Ontario, Canada, however, one in four family practitioners and one in three specialists are over 55 years of age.4 While the rate of physicians' retirements has been increasing, these older physicians are going to become an ever-more-valuable resource as the ratio of physicians to population declines.5 Most of the medical education research that has used age as an independent variable has been performed in the context of physician-review programs. This literature suggests that aging induces cognitive changes in the way that diagnosticians approach clinical cases. There are discrepant findings, however, in terms of whether clinical performance improves or declines with aging. In this paper we systematically examine the small amount of evidence available in medical education that highlights the issue of aging and attempt to reconcile contradictory findings by drawing on the much larger psychological literature on pre-senile aging. Finally, we identify some of the specific implications for continuing education. Method Medline, ERIC, and the Research and Development Resource Base in Continuing Medical Education were used to search for articles focused on physicians' competence, physician assessment, and continuing competence. “Age” was used as a keyword in all searches and articles were included if they made reference to the relationship between age and performance. After a series of articles had been identified, the reference lists were examined and experts in this field were consulted to find relevant papers that had been missed. In parallel, a similar search was performed using PsychLit to identify articles that focused on age-related changes in cognitive processing. Articles were excluded if they focused on clinical conditions unless they allowed insight into the psychological mechanisms affected by pre-senile aging. Results The Negative Relationship between Age and Performance Since the 1970s, physician review programs have begun to flourish. Much of this work has been performed in Canada,6,7 but other countries, including England8,9 and the United States10,11 have also turned to assessments of this type as a way to ensure physicians' competence and advocate performance enhancement. While it is only one example of a variety of strategies that have been implemented, the Physician Review and Enhancement Program (PREP), based at McMaster University, typifies programs of this nature by using a battery of assessment tools to evaluate the abilities of practicing physicians.12,13 The process has evolved over the years, but the current battery consists of a multiple-choice-question test of medical knowledge, encounters with four standardized patients, and chart-stimulated recall. Skills evaluated with the standardized-patient encounters include communication, diagnosis, and data gathering. During chart-stimulated recall, the physician's own charts are reviewed and used as the basis for discussion between the assessors and the physician being assessed. This phase is meant to test problem solving, patient-management skills, and record-keeping practices. PREP evaluations are currently based primarily on referrals received from quality assurance committees operating within the College of Physicians and Surgeons of Ontario (CPSO),14 but during the validation phase of the program PREP also evaluated a criterion group of randomly selected physicians.15 Attempting to identify predictors of competence, Norman et al. entered a series of variables into a regression analysis and discovered that age was most predictive of three variables (the other two being Canadian versus foreign education and certification status) that significantly predicted performance.15 Older physicians performed less well than did younger physicians. Further (unpublished) analyses of these data confirm that this negative relationship is not an artifact of including CPSO-referred physicians in the study sample; the correlation between age and performance was stronger in the criterion group (r = -.50) than in the CPSO-referred group (r = -.36). More recent work shows this trend is not directly linked to neuropsychological impairments. Turnbull et al. administered a neuropsychological test battery on 27 physicians at the end of the regular PREP testing.14 The correlation between age and performance was strong (r = -.57) and became even stronger after removing from the analysis the 13 physicians who scored in the moderate-to-severe range on any of the neuropsychological tests (r = -.80). This inverse relationship between age and competence is consistent with previous work by McAuley and Henderson,16 who audited the practices of 391 randomly selected physicians, and with Norcini et al.'s17 analysis of the knowledge bases of practicing internists using the American Board of Internal Medicine's (ABIM) recertification exam, as well as with more recent work by Sample et al.,18 who examined patient-management skills using a computer-based case simulation. A problematic omission, however, if remediation is to be effective, is an answer to what is causing this inverse relationship. One possibility, supported by the work of Day et al.,19 is that older practicing physicians are less likely than are their younger colleagues to have up-to-date knowledge bases. Scores achieved on the ABIM recertification examination increased as the time since residency decreased when questions tested medical knowledge that had changed over the preceding 30 years, but showed no effect of the time since residency when questions tested medical knowledge that had been stable over the same period of time. While this is a seemingly straightforward explanation for the inverse relationship observed between age and competence, it does not appear to be sufficient. More recent work by Caulford et al.20 suggests that the nature of the problems encountered by failing physicians extends beyond a reduced tendency to assimilate new knowledge. Using the written reports generated for the PREP program, two assessors were asked to identify the specific deficiencies noted for each physician's performance. These deficiencies were categorized as problems of knowledge, history taking, problem solving, physical examination, patient management, communication skills, and record keeping. In addition to knowledge deficits, however, the identified deficiencies occurred across all eight categories of problems. Interestingly, for reasons that will become clear shortly, the most prevalent errors identified within many of the categories tended to be errors that would be expected to correlate with premature closure; the interviews tended to be abrupt with many interruptions, history taking was not comprehensive, data gathering was incomplete, important management strategies were not considered, and important details were left out of patient records. These results could, understandably, lead to pessimism regarding the ability of older physicians to practice medicine. However, there is an aspect of diagnostic practice that has been shown to improve with age, thereby yielding (a) further insight into the psychological mechanism whereby competence declines and (b) optimism regarding the potential to tailor continuing education efforts to the specific abilities/deficiencies of individual clinicians. The Positive Relationship between Age and Preliminary Diagnostic Accuracy The inverse relationship between age and performance seems counter-intuitive given the emphasis that most educators place on experience. Physicians who have been practicing longer have more experience and, as a result, should be better positioned to make accurate diagnostic decisions. This claim is especially central to the nonanalytic instance-based frameworks that have been proposed as models of medical knowledge.21 These frameworks argue that diagnosis is based, in part, on a rapid and unconscious matching of current patients to previous clinical encounters.22 The greater the number of cases one has seen, the more prior examples one should have available to draw upon. Consistent with this framework, diagnostic accuracy in the context that would be expected to elicit decisions based primarily on nonanalytic processes has been shown to increase with age. To examine the influence of experience on the generation of diagnostic hypotheses based solely on contextual factors, Hobus et al.23 presented research participants with short case histories consisting of a patient's picture, previous disease history, and presenting complaint. Family doctors produced 36% more correct hypotheses (12.11/32) than did medical students (8.88/32). When this procedure was repeated with 28 physicians whose years of experience ranged from four to 32, a strong positive correlation was found between experience and diagnostic accuracy (r = .68).24 This is noteworthy because previous work has shown that the accuracy of the first hypothesis is predictive of the accuracy of the final diagnosis,25 and a negative correlation has been observed between “accuracy” and “time required to raise diagnostic hypotheses.”26 These findings run counter to those mentioned in the preceding section. Physicians' diagnostic skills seem to improve with age, at least when the diagnostic information available is minimal. The important question then becomes “Why are older physicians more likely to be labeled incompetent by physician-assessment programs when they are better at generating diagnostic hypotheses based on contextual information alone?” A potential explanation is that as individuals age, nonanalytic diagnostic strategies remain strong (allowing the positive relationship between years of experience and accuracy of early hypotheses), but the use of analytic confirmation strategies declines (causing older physicians to score less well when dealing with conflicting data within comprehensive patient descriptions). A less complicated answer to the question posed would be that older physicians are better diagnosticians, but they (a) exert less effort toward the testing procedures utilized in review programs, or (b) have deteriorated testmanship skills as a result of having been out of school longer than younger colleagues. These possibilities seem unlikely. First, given the threat of losing a license to practice medicine, any physician who is called to a PREP review has tremendous motivation to perform at his or her highest level (even though the physician is unlikely to be happy doing so). Second, Day et al.19 observed that older physicians perform just as well as younger physicians on examinations as long as the questions are directed at knowledge that has not changed since they were trained. Still, the general point remains that age is confounded with many other variables when studied in the context of physicians' performances. To avoid these complications, the rest of this paper examines this issue by reviewing the psychology literature on aging in the hope that it will yield insight into (a) diagnostic decision making, (b) medical expertise, and (c) remediation strategies that might be considered for failing physicians. To set the context, a brief review of the literature on diagnostic expertise is first presented. Models of Diagnostic Reasoning Beginning in the late 1970s, thanks in large part to the work of Elstein, Shulman, and Sprafka,27 researchers in the field of medical education began to switch their views of diagnostic expertise from one in which problem-solving skills were emphasized to one in which the mental representation of medical knowledge became to et was the of diagnostic that when with a new physicians a set of hypotheses that they use to test the data presented. While this in the it on which frameworks of knowledge representation were important between these models is that of analytic and nonanalytic knowledge In reviewing the and that to any one correct will likely be as a number of have that many of knowledge are available to as independent of information that be during have proposed that the of a mental representation changes as expertise that diagnosticians become by of their to on prior To however, models of diagnostic expertise have not changes in the of knowledge that might the in performance physician review programs Hobus and suggests that physicians with more experience are better positioned to of the of a clinical that are expected to accurate nonanalytic processing. is however, for these hypotheses to be as by the that the experts in Hobus et study generated the correct diagnosis only of the time. diagnosticians avoid on this type of of research on aging and however, that nonanalytic becomes in to a in the analytic of knowledge. in In the literature on there is general that performance are but that the not in all to older when is tested directly with to all presented in a age are observed participants to information that is in continuing to deal with participants might be asked to a series of also the of In and to perform well on less as and on tests of as these participants are not to use their for studied but are given a and asked to the When the is included in a preceding study both and are likely to use to the even though older not having the in the This between and tests of suggests that age-related to be of analytic nonanalytic remains however, versus tests of not of one the using an process or a of having the in the study a result, a procedure with which the of analytic and nonanalytic processes be by conditions that place these processes in to one the by and A series of be presented to and in a way that a to the first in the be The might be with both and but if is presented with of the time it is participants will to the when the is presented. After a participants are shown a series of that are to be for a might be one and presented the and asked participants to the they had been asked to study during of the The should to based on nonanalytic to the of a However, should be as a only when the correct answer is not In this and are in to each other and be with a in which both are in with during Older are less likely than are younger to with the in the but more likely than are younger to with the in the these results that older are to the but are less to of the analytic of This is consistent with many other evidence from the medical be found in a recent study of medical expertise that the performance of practicing physicians with that of using This with the results of this into question whether the effect of and might be to age across level of at least in part, because older to their decisions on to analytic to specific to a greater than younger Reasoning One argue that the age-related in analytic observed using is a of the clinical that diagnosticians but cognitive research on abilities and has to similar have shown that of the most way a to an age-related of effect of Day et that age is not to competence on knowledge questions a medical example of the of knowledge. The aspect of that is most relevant to this review is the ability to first by that are thereby a clinical physician might have more correct first than less but there will be cases (the of cases to Hobus et in which the will to to other aging tendency to this might for the competence observed by review programs. have that older have more than one and to test cognitive in and by using the This test the of four that A was first to identify three that a and then to the same for a of and were but older individuals tended to make a greater number of errors than did younger performance with the number of errors on the thereby that older were less to to new problem than were younger Further work with the by and suggests that this to might at least in part, to the age-related in in the previous section. in the medical education literature also suggests that older physicians are by the information they early on in a case the information that is likely to set the context in which nonanalytic processes et presented diagnosticians with clinical cases that were of two and the in which the consistent with each diagnosis were presented within the patient's written data that clinical information that is presented in a case history is more in medical diagnosis than that presented Interestingly, however, the two that be considered to have a level of expertise and the effect was larger within the group of older Finally, it has been shown that older have a greater tendency to experience into problem trend that would be expected if older more on nonanalytic knowledge and for presented problems from two and of Using as an one of the that were toward the one and each participants the of the and the of the were then by the to the from those to the age showed a toward as more and The amount of was not with but it was with older were more than Finally, it should be noted that older to have more than younger The of this larger when the or of and when based on the being is older to a greater on the context within which the thereby further the that older are more by knowledge. one and colleagues have shown that it is to the final of a when the final is from the context are with than when it is not has considered the The of the is greater in the than in the of whether the is or would be to not point out that some age-related including those in of the patients might be to declines in declines across the at a rate to that of many cognitive In of the age-related in tests performed on individuals aged to years be by in the performance of younger on cognitive is more to that of older when is to the that is by the and the performance of patients is when the of is However, age-related does not from the hypothesis that older to more on nonanalytic processing. the or a on the of to in this it is that the from practicing a age-related in thereby their impact on or To study this a number of researchers have asked experts and of to perform that the required to in the of had a group of and a group of of by the found negative age-related in both but no between age and and asked and to perform a series of in which more than one had to be performed the showed an age effect and showed an expertise but only one showed the in have found similar More and have studied the of aging and expertise in a called These an age expertise but only when were included in the analysis to when the analysis was performed solely on the data from of This that only as by and will one to age-related in but it should be noted that the age of the in and was years less than the age of any of the thereby that the effect of expertise in performance might be an for the that the is this with the that most physicians are not experts using and might in which physicians whose skills are be and The current paper systematically reviewed the medical education literature that has used age as an independent first conflicting findings physician-review a strong negative correlation between performance and age, Hobus and observed an strong positive correlation physicians to perform a diagnostic in which only contextual information was One of these findings that to be supported by much of the psychological literature on aging is that analytic to with age nonanalytic remains Further work to be performed to test this more directly within a medical context, but research on and across the is consistent with this The implications of this include the to improve remediation efforts by toward the specific of physician performance that with age. this and other implications in more however, we should be clear regarding what is not by this First, the work in this paper does not In one of the more findings in aging research is that the across the individuals to increase with age, thereby that strong individual the performance to be many older individuals perform at to those of their younger colleagues. decisions regarding continuing competence should be made at the individual level than Second, the competence problems as a result of analytic should not be as evidence for the of nonanalytic diagnostic the Norman et have shown that nonanalytic to problem be to analytic The problem when these nonanalytic are not by analytic of clinical cases. Finally, changes in the of analytic and nonanalytic processes should not be to be the only to the performance of older might be that older physicians are less likely to up-to-date with the medical as Day et findings However, it might also be the case that this tendency is by the older physicians' increased on nonanalytic the more individuals on their prior the less of a tendency there will be to conflicting One of the with the is to the knowledge that older individuals more on nonanalytic processes to improve the clinical practices of those physicians whose appear to be one experience the to draw on prior and be by in diagnostic it less likely that individuals will in their analytic a result, older physicians to be more with each case will likely if it the same to be more analytic has to be at in medical but this use of the of knowledge that appear to be in older physicians. the research that has been reviewed in this paper does some that might in older physicians, each of which should be tested more as to the performance of is the use of there is no diagnostic to a that of the but some of the research in this review suggests that the number of might the to which the analytic available to older physicians be a this might on which diagnostic information be any reports that to be and the number of on older physicians. These might seem but it has been shown that as as have a greater effect on cognitive in older than in a more changes might be made to diagnostic the on that of diagnostic age-related in this is taking to older physicians might an important and that only showed no in performance with aging suggests that and practice might to be the to the of aging. This result, with the current suggests that practice should more on the analytic of medical diagnosis, as nonanalytic seems to remain the way to practice strategies might to be a but continuing education efforts should be toward Education and the current review the of physician-review and programs. While the of to be in any age-related increase in the on nonanalytic of knowledge will the physicians will have in when their skills are a result, review of physicians' performance is because motivation to in the aspect of PREP will be the individual remediation that (a) his or her performance is and (b) a specific diagnosis be to the
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.047 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.003 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.001 | 0.003 |
| Insufficient payload (model declined to judge) | 0.000 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it