MétaCan
Menu
Back to cohort
Record W2645528799 · doi:10.1093/ije/dyw248

Data Resource Profile: National electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN)

2017· article· en· W2645528799 on OpenAlexaffabout
Stephanie Garies, Richard Birtwhistle, Neil Drummond, John Queenan, Tyler Williamson

Bibliographic record

VenueInternational Journal of Epidemiology · 2017
Typearticle
Languageen
FieldHealth Professions
TopicMedical Coding and Health Information
Canadian institutionsQueen's UniversityUniversity of AlbertaUniversity of Calgary
Fundersnot available
KeywordsPrimary careMedicineElectronic medical recordMedical recordResource (disambiguation)Medical emergencyFamily medicineComputer scienceInternal medicineComputer network

Abstract

fetched live from OpenAlex

The Canadian health care system provides universal, publicly funded health services to its population. Coverage includes visits to primary care, specialists, hospitalization and, in some provinces, universal drug coverage. Health care is funded and managed within each provincial and territorial jurisdiction, under the oversight of the Canada Health Act and with financial assistance from the federal government. Primary care is typically the first point of contact in the health care system and is responsible for much of the prevention, diagnosis and management of chronic disease in the community. Among high-income countries, Canada has one of the lowest rates of electronic medical record (EMR) use among family physicians.1 To this extent, Canada largely relies on administrative databases (e.g. physician billing claims, hospital discharge abstracts) and surveys to answer questions about primary health care. Many countries with a longer history of EMR use, such as the UK and The Netherlands, have been able to successfully harness these data for research and surveillance for many decades. In recent years, Canada has been rapidly catching up with its international peers in the use of EMR systems and the opportunity to use these data now exists. The detailed clinical information found in EMR data can provide a more comprehensive and contextually relevant perspective of primary care activities in Canada, which is useful for policy decision making, disease surveillance, health services research and clinical quality improvement. CPCSSN is the first, largest and only pan-Canadian primary care EMR database in the country. It began development in 2005 for the purposes of establishing a data source to support primary care research and national chronic disease surveillance, though increasingly, clinicians have found these data useful for improving patient care and practice efficiencies. CPCSSN is organized as a ‘network of networks’, in which existing primary care practice-based research networks (PC-PBRN) across the country (Figure 1) unite to contribute de-identified patient data from their participating family physicians and nurse practitioners practising in full-service, community-based primary care clinics, who thus become CPCSSN ‘sentinels’. Recently, some PC-PBRNs have expanded recruitment to include community paediatricians, though currently this represents a small proportion of the data holdings. As data custodians, sentinels consent on behalf of their patients to participate in CPCSSN and all patients are therefore included in the database unless they have specifically opted out.2 Each province operates under this implied consent model with the exception of Quebec, where health legislation requires patients to give consent individually.3 Participating practices are given patient information posters and brochures to display within the clinic. These inform patients about the CPCSSN project and provide information about opting out. Location of primary care practice-based research networks (PC-PBRNs) contributing to CPCSSN. CPCSSN has developed extraction processes to capture data from 15 different EMR systems across the country (Appendix 1, available as Supplementary data at IJE online). The routine extraction of de-identified patient data is performed remotely in order to minimize disruption to the participating clinics. Once the relevant data are extracted, they are transferred to a local server specific to each contributing PC-PBRN, where cleaning and coding algorithms are applied and the data are standardized into a common format. The data from each network are then merged into the national database. Both local and national databases are held on CPCSSN servers within the Centre for Advanced Computing4 at Queen’s University in Kingston, ON, Canada. The comprehensiveness and variability of EMR data necessitates developing case definitions designed specifically for this data source. Although most Canadian primary care EMR products use the International Classification of Disease Version 9 (ICD-9) to code diagnoses, free text is also frequently used, which adds to the complexity of identifying patients with a particular condition. Case definitions for eight chronic and neurological diseases were created by CPCSSN using a variety of text words, ICD-9 codes and disease-specific criteria such as medications or laboratory results.5,6 The case definitions were applied to the CPCSSN database and validated by networks across the country using the original patient chart as the gold standard, where most definitions demonstrated very good sensitivity and specificity.5,6 These included hypertension, diabetes, osteoarthritis, depression, chronic obstructive pulmonary disease, dementia, epilepsy and parkinsonism. Definitions for additional conditions are under development. Each PC-PBRN has received research ethics approval for the CPCSSN project at their respective host universities. Any studies external to current CPCSSN approvals require separate research ethics approval from the researcher’s home university and an Institutional Data Sharing Agreement with Queen’s University. CPCSSN has taken numerous measures to ensure the highest data security and adherence to privacy policies.2 All data are transferred securely using an encrypted Virtual Private Network (VPN) connection. Both regional and national CPCSSN data are stored in the Centre for Advanced Computing (CAC) at Queen’s University, a high-quality computing facility with multiple layers of physical and digital security.4 Each contributing PC-PBRN has conducted at least one Privacy Impact Assessment, involving extensive documentation of all project-related processes with an assigned risk score for each privacy requirement, the development of risk mitigation procedures, and a review of provincial health legislation and university-specific security policies as applicable to the project. Ensuring patient and provider confidentiality is a core value of the CPCSSN network. The names and personal information of participating sentinels are never released without their explicit consent. Re-identification of patients cannot occur outside the clinic environment or without the consent of the sentinels and separate approval from the research ethics board, giving sentinels full control over their patients’ sensitive information. As of May 2016, there were nearly 1200 sentinels participating in CPCSSN from over 200 practice sites.7 Clinical and demographic information for more than 1.5 million patients is contained within the database, with approximately 700 000 patients recording at least one clinic visit in the previous 12 months. PC-PBRNs recruit practices from most provinces and territories across Canada, including British Columbia, Alberta, Manitoba, Ontario, Quebec, Newfoundland and Labrador, Nova Scotia and the Northwest Territories (Figure 1). CPCSSN continues to recruit sentinels and additional PC-PBRNs. As a data source for surveillance and research, much consideration is given to ensuring that contributing patients, sentinels and clinics are representative of their respective Canadian base populations. As expected in a primary care sample,8,9 older adults and females are over-represented in the CPCSSN database as compared with the national population.10 As such, it is important to consider age and sex standardization and/or adjustment for all surveillance and research studies employing these data. It may also be likely that patients in the CPCSSN database have higher socioeconomic status than that of the general Canadian population.11 However, to date, the CPCSSN database does not contain the necessary information to allow users to properly adjust for systematic differences in socioeconomic status. Participating physician and clinic characteristics were evaluated against the 2013 National Physician Survey, which collects information about location of practice (urban or rural), type of practice (academic or community-based), and age and sex of the provider.12 Sentinel physicians contributing to CPCSSN tend to be more often female and younger than physicians in general in Canada, though provincial variability is evident.10 Depending on when contributing clinics introduced their EMR system into their practice or when historical data were entered into the patient chart, CPCSSN data start at various time points, with some records going back to the early 1990s. Data from 2008 onwards are considered acceptably robust for analysis, as the increased uptake and more complete use of EMR systems over time has contributed to better data quality and volume in the later years. Patient-level information is collected from almost the entire medical record, including non-identifiable demographics, current and historical diagnoses, medications, physical measures (such as blood pressure, height and weight), laboratory results, referrals, medical procedures, risk factors and physician billing submissions (if available). Data elements currently being captured are summarized in Box 1. At present, CPCSSN does not extract scanned documents because the data within these are not easily extracted and often include identifiable text that can be difficult to redact. Physician notes are also excluded for similar reasons. Due to the exceptionally large volume of laboratory and physical examination data, CPCSSN processes only those tests and values that are related to the eight conditions for which a case definition has been validated in Box 1. Additional laboratory and examination values will be added based on resources and priorities within the network. CPCSSN has developed extensive cleaning algorithms to address data quality issues that can impede the use of EMR data. Many data elements are assigned to a cleaned field (including both ICD-9 codes and text words) alongside the original entry. The cleaning process takes into consideration the many different ways of entering diagnoses into the EMR, including abbreviations and misspelled words, and maps them to a diagnosis category based on ICD-9 classification headings. ATC, Anatomical Therapeutic Chemical classification; DIN, Drug Identification Number; Y/N, yes/no. For conditions with a validated CPCSSN case definition: hypertension, diabetes, osteoarthritis, depression, chronic obstructive pulmonary disease, dementia, parkinsonism, epilepsy. Laboratory results for: fasting glucose, glucose tolerance, hemoglobin A1C, high density lipoprotein (HDL), low density lipoprotein (LDL), total cholesterol, triglycerides, microalbumin, urine albumin creatinine ratio, international normalized ratio (INR), thyroid stimulating hormone (TSH), hemoglobin, creatinine, glomerular filtration rate (GFR). Physical examinations for: systolic & diastolic blood pressure, height, weight, waist circumference, waist to hip ratio, body mass index, peak expiratory flow rate. ATC, Anatomical Therapeutic Chemical classification; DIN, Drug Identification Number; Y/N, yes/no. For conditions with a validated CPCSSN case definition: hypertension, diabetes, osteoarthritis, depression, chronic obstructive pulmonary disease, dementia, parkinsonism, epilepsy. Laboratory results for: fasting glucose, glucose tolerance, hemoglobin A1C, high density lipoprotein (HDL), low density lipoprotein (LDL), total cholesterol, triglycerides, microalbumin, urine albumin creatinine ratio, international normalized ratio (INR), thyroid stimulating hormone (TSH), hemoglobin, creatinine, glomerular filtration rate (GFR). Physical examinations for: systolic & diastolic blood pressure, height, weight, waist circumference, waist to hip ratio, body mass index, peak expiratory flow rate. Providers and practices are distinguished in the database by a non-identifying study ID. A select number of provider and clinic characteristics are available and linked to each patient record. These variables include type of provider (family physician, nurse practitioner or paediatrician), sentinel year of birth, sex, Canadian or foreign medical education, year of completed medical training, whether the clinic is academic or community based and whether in a rural or urban setting (Box 1). To meet the technical requirements for ensuring CPCSSN data repositories contain only anonymized information, CPCSSN employed a Research Privacy and Ethics Officer to review and evaluate a three-phase approach to de-identification. The first phase was the exclusion of all structured direct and indirect identifier data fields (i.e. name, address, provincial health number) in the source EMR data. This is conducted during the initial data extraction phase by either the PC-PBRN data manager or directly through the EMR vendor. Alternatively, the PC-PBRN data manager can enter into a confidentiality and security agreement with the clinic, which permits the data manager to access the most recent back-up file stored in an encrypted folder on the EMR server. Once the health data are stripped of any directly and indirectly identifying information from the structured data fields, only data from specific EMR fields are extracted. The second phase of de-identification is the application of algorithms to replace patient identifiers that may appear in unstructured, free-text fields with random digits (for example, a phone number 316‐544‐8371 would become &l;tel#>). First and last names, as well as regular expression pattern matching for other identifiers, are suppressed and replaced by a series of X’s. The third and final phase of data anonymization is the application of the PARAT tool13 to further reduce the statistical risk of re-identification by combinations of different fields. If the tool detects higher or unacceptable levels of potential re-identification risk, it suppresses fields within certain records or reduces the level of detail within certain fields, such as dropping one or more characters in a postal code or rounding the year of birth to 5-year bands. The PARAT tool is applied before the release of CPCSSN data for ethics board-approved research. CPCSSN provides a unique data source not currently available elsewhere in Canada. The national CPCSSN data have been used to answer a variety of relevant primary care research questions, with over 45 publications and 250 conference posters and presentations to date. Most notably, along with the publication of the validated CPCSSN case definitions,6 we have explored the epidemiology of these conditions in Canadian primary care settings.14–19 Additionally, CPCSSN has an emerging role in pharmacovigilance, where the data can be used to monitor adverse reactions in the post-marketing surveillance of medications prescribed in primary care in Canada.20 CPCSSN data are used at regional and local levels to answer research questions derived from these contexts, as well as at a provider and clinic level for quality improvement purposes. For instance, a family physician in rural southern Alberta was able to examine patient outcomes related to a lifestyle intervention developed specifically for obese patients, which was completed without cost to the clinic and assisted the clinic in empirically evaluating their programme.21 A primary care team in Toronto, ON, used CPCSSN data to create registries of patients with chronic diseases to assist with their clinical management and monitoring patient outcomes.22 CPCSSN data have also formed the basis of multiple student research projects at the graduate and undergraduate levels, including several important methodological advancements to which students have contributed. One such project explored the opportunity for using CPCSSN data as a source of national healthy weight data.23 Whereas the data have some important limitations that need to be carefully considered, the CPCSSN database contains, for example, more body mass index (BMI) records than all the objective BMI measurements collected by Statistics Canada health surveys over the past 20 years.23 More recently, the Public Health Agency of Canada has funded CPCSSN to further develop, implement and evaluate the CPCSSN Data Presentation Tool (DPT) in primary care clinics and departments of public health across the country.24 The CPCSSN-DPT is a customized web-based graphical interface that provides users with ready access to clinic- or jurisdiction-specific CPCSSN data after it has undergone processing and cleaning. It is anticipated that the CPCSSN-DPT will facilitate the adoption of public health methods of surveillance by primary care practitioners to enhance the monitoring, prevention and management of chronic disease across Canada. A full list of publications and conference abstracts involving CPCSSN data can be found on the website at [www.cpcssn.ca] (English version) or [www.rcsssp.ca] (French version). Linkage studies combining CPCSSN data with those from other sources of health, social or census data are a opportunity for research that has been explored in several Primary care EMR data from CPCSSN linked with administrative sources provide a for patients the health care contributing into important such as high system use and and including social when on chronic This type of research has taken in local networks (for instance, CPCSSN data linked with census data for socioeconomic status and and with to examine the socioeconomic on and more within several provinces, such as with the of Clinical in Toronto, ON, the Centre for Health in and the Newfoundland and Centre for Health in CPCSSN networks are with activities to in their respective across the country are currently using the CPCSSN data to definitions for in in the chronic disease, chronic and to include disease, multiple and from are under with an in a specific are to for case definition development and using the CPCSSN including and A of the CPCSSN database is the to patients over time and using clinical data. CPCSSN data are more comprehensive and than sources of Canadian primary care information, such as physician billing and other administrative CPCSSN data reduces found in health EMR data diagnoses, objective laboratory and examination results, and to One of CPCSSN is the coding and standardization of the data extracted from multiple EMR which are often entered as free text at the clinic. these cleaning the data would not be for research and the national of the database is a In Canada, health is and that administrative data are within each this and time CPCSSN data from different provinces into a database in a for an and source of national primary care information. The of using EMR data for purposes other than clinical care is to them that they are for use (i.e. research and cleaning and coding algorithms have unstructured, clinical information into data though there are limitations by the data quality in most of text are difficult to and information. risk such as use and are in this data are not instance, than of patients in the CPCSSN database have their CPCSSN is only able to extract data that are entered into the EMR in some the data available are those patients who primary care data that are entered into the and data that can be directly and, can be cleaned and Additionally, the health system in Canada is organized that patients may care from multiple physicians and other of their Although primary care patient whether or it may be the case that some patients in the CPCSSN database more than At present, CPCSSN is to patients within its database. Whereas this is to be it does a to the current of the CPCSSN database, as of the patient As it is difficult to monitor from patients the clinic, to a or province or as this is not or in the the of may a as sentinels are likely early of EMR systems with an in research and quality improvement. The CPCSSN database using though this is an in primary care research using CPCSSN data are to visit the website at [www.cpcssn.ca] (English version) or [www.rcsssp.ca] (French version). A CPCSSN Data is available by which the data the for the CPCSSN database, a the data and its potential and a of 200 anonymized and patient are able to a of the research project using CPCSSN data. an review by and Research are to a full and provide their of research ethics A of the CPCSSN is after the documentation is The CPCSSN data are available to health on a cost and a rate is available for CPCSSN can provide additional such as data or analysis, for a CPCSSN also visit the website for information about current research publications and CPCSSN across the country. Any additional can be directly to CPCSSN at The Canadian Primary Sentinel Network is the first and largest primary care electronic medical record (EMR) database available for health research, disease surveillance and practice improvement. CPCSSN has more than 1200 sentinel family physicians and nurse who contribute de-identified EMR data for over 1.5 million These data include patient demographics, diagnoses, medications, laboratory results, physical risk medical procedures, billing referrals, and CPCSSN has created and validated robust case definitions specific to its EMR data, including conditions such as diabetes, hypertension, depression, chronic obstructive pulmonary disease, osteoarthritis, dementia, epilepsy and parkinsonism. cleaning and processing algorithms are applied to the CPCSSN database to address quality issues that from free-text documentation and data entry. Many provinces are to CPCSSN data with other health and social data such as use, and This will use of EMR data in Canada and will contribute to a more comprehensive of primary care activities about the CPCSSN database, including a publication a data and for an electronic of for potential research is available at [www.cpcssn.ca] (English version) or [www.rcsssp.ca] (French version). Supplementary data are available at IJE The Public Health Agency of Canada a agreement to the development of CPCSSN in and has to provide additional support has been received from Canada Health Health Canada, several provincial health and the of

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.028
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Dataset · Consensus signal: Dataset
Teacher disagreement score0.991
Threshold uncertainty score0.202

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0030.028
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0150.031
Science and technology studies0.0020.000
Scholarly communication0.0020.001
Open science0.0030.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0600.019

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.458
GPT teacher head0.535
Teacher spread0.077 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreDataset

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations97
Published2017
Admission routes2
Has abstractno

Explore more

Same venueInternational Journal of EpidemiologySame topicMedical Coding and Health InformationFrench-language works237,207