Skip to main content

Virtual family physician care during COVID-19: a mixed methods study using health administrative data and qualitative interviews

Abstract

Background

The onset of the COVID-19 pandemic necessitated a rapid shift in primary health care from predominantly in-person to high volumes of virtual care. The pandemic afforded the opportunity to conduct a deep regional examination of virtual care by family physicians in London and Middlesex County, Ontario, Canada that would inform the foundation for virtual care in our region post-pandemic. Objectives: (1) to determine volumes of in-person and virtual family physicians visits and characteristics of the family physicians and patients using them during the early COVID-19 pandemic; (2) to determine how virtual visit volumes changed over the pandemic, compared to in-person; and (3) to explore family physicians’ experience in virtual visit adoption and implementation.

Methods

We conducted a concurrent mixed-methods study of family physicians from March to October 2020. The quantitative component examined mean weekly number of total, in-person and virtual visits using health administrative data. Differences in outcomes according to physician and practice characteristics for pandemic periods were compared to pre-pandemic. The qualitative study employed Constructivist Grounded Theory, conducting semi-structured family physicians interviews; analyzing data iteratively using constant comparative analysis. We mapped themes from the qualitative analysis to quantitative findings.

Results

Initial volumes of patients decreased, driven by fewer in-person visits. Virtual visit volumes increased dramatically; family physicians described using telephone almost entirely. Rural family physicians reported video connectivity issues. By early second wave, total family physician visit volume returned to pre-pandemic volumes. In-person visits increased substantially; family physicians reported this happened because previously scarce personal protective equipment became available. Patients seen during the pandemic were older, sicker, and more materially deprived.

Conclusion

These results can inform the future of virtual family physician care including the importance of continued virtual care compensation, the need for equitable family physician payment models, and the need to attend to equity for vulnerable patients. Given the move to virtual care was primarily a move to telephone care, the modality of care delivery that is acceptable to both family physicians and their patients must be considered.

Peer Review reports

Background

The onset of the COVID-19 pandemic generated a rapid shift in primary health care in Ontario, Canada from predominantly in-person care to high volumes of virtual care [1]. Prior to the pandemic, virtual care visits were uncommon with only 10% of Ontarians reporting having had a virtual visit with a physician; despite 69% of Canadians indicating they would choose virtual health visits if available to them [2].

Pre-pandemic, the only insurable option available to physicians for virtual health care services was provided through the Ontario Telemedicine Network (OTN), a secure virtual video platform [3, 4]. There was modest uptake of OTN among family physicians [5, 6]. In response to the pandemic, on March 14, 2020, the Ontario Ministry of Health instituted billing codes for virtual care, which permitted physicians to bill the Ontario Health Insurance Program (OHIP) for virtual synchronous patient interactions that could include telephone and video channels, making these visits insurable [7]. These billing codes were available to family physicians (FPs) practicing in all practice models. Practice models in Ontario include traditional fee-for-service where FPs bills OHIP for each service provided to a patient according to a payment schedule [8], enhanced fee-for-service where FPs are compensated using predominantly fee-for-service but with specific premiums and bonuses for patient enrolment, capitation-based models where FPs are compensated primarily through capitation [9].

The province of Ontario, with a population of approximately 14.7 million people [10], reported the first case of the novel coronavirus 2019 (COVID-19) cases in January 2020 [11, 12], and on March 17, 2020, the Government of Ontario declared a state of emergency to curb the impact of the pandemic [13].

The Middlesex-London Public Health Unit is located in the southwestern region of the province and includes the City of London and the County of Middlesex. This region is situated halfway between the US-Canada border and the Greater Toronto Area (Ontario’s most densely populated region). Covering an estimated population of 510,609, this region includes both urban and rural settings [14]. London is used often as a testing ground for new products because it is considered representative of the rest of Canada [15]. This region recorded the third case of COVID-19 identified in Ontario [16] and there were 1160 COVID-19 cases (case rate 231 per 100,000) and 60 deaths (death rate 12 per 100,000) between March and October of 2020 [17]. This region’s case and death rates were lower than Ontario (524 cases per 100,000 and 21.4 deaths per 100,000) and Toronto (capital of Ontario with population of approximately 3 million) (916 cases per 100,000 and 45.4 deaths per 100,000) [17].

The pandemic afforded the opportunity to study the rapid uptake and delivery of virtual care by FPs, albeit in a time of crisis. Through this study, we sought to understand the experiences of FPs in London and Middlesex County, concerning virtual care during the early pandemic, as one essential step in building a foundation for virtual care in our region post-pandemic. Given the diversity of the pandemic experience across Ontario, as it was in other parts of the world, a deep examination of regional experience is important. Our specific objectives were: (1) to determine volumes of in-person and virtual FP visits and the characteristics of the FPs and patients using them during the early COVID-19 pandemic; (2) to determine how the volume of virtual visits changed over the course of the pandemic, compared to in-person visits; and (3) to explore the FPs’ experience in adoption and implementation of virtual visits by FPs.

Methods

Design and setting

This was a concurrent mixed-methods study [18] of FPs practising family medicine in London and Middlesex County, where approximately 84% of the population live in London [19, 20]. It is estimated that 89% of the Middlesex-London population is attached to a family physician, meaning they have access to primary care through a family physician [21]. The period of the study, March to October 2020, corresponded to the first and second waves of the COVID-19 pandemic in this region [11, 13, 17-Ontario weekly case counts]. The quantitative component was a secondary analysis using health administrative (HA) data at ICES [22]. ICES is an independent, non-profit research institute whose legal status under Ontario’s health information privacy law allows it to collect and analyze health care and demographic data, without consent, for health system evaluation and improvement. All residents of Ontario obtain their medical and hospital health care services from a government-administered, single-payer insurance system that maintains a comprehensive electronic provider reimbursement claims database. As such, data from ICES constitute population-level information. The qualitative study consisted of semi-structured interviews and employed Constructivist Grounded Theory (CGT) [23].

Quantitative study methods

Cohort and data

Additional file 1: Appendix 1 describes the datasets that were linked and used in the HA analysis which were: Canadian Institute for Health Information Discharge Abstract Database (DAD), Chronic Obstructive Pulmonary Disease (COPD), Congestive Heart Failure (CHF), Institute for Clinical Evaluative Sciences Physician Database (IPDB), National Ambulatory Care Reporting System (NACRS), Ontario Asthma Dataset (ASTHMA), Ontario Crohn’s and Colitis Cohort Dataset (OCCC), Ontario Dementia Database (DEMENTIA), Ontario Diabetes dataset (ODD), Ontario Drug Benefit Claims (ODB), Ontario Health Insurance Plan Claims Database (OHIP), Ontario HIV Dataset (HIV), Ontario Hypertension Dataset (HYPER), Ontario Marginalization Index (ONMARG), Ontario Mental Health Reporting System (OMHRS), Ontario Rheumatoid Arthritis Database (ORAD), Primary Care Population (PCPOP), Registered Persons Database (RPDB), and Same Day Surgery Database (SDS). These datasets were linked using unique encoded identifiers and analyzed at ICES.

Cohort creation

We identified FPs practicing in London and Middlesex County, defined here as the region census division (CD 3539), as of March 14 2020 [19]. These FPs were identified from the ICES Physician Database (IPDB), which is a cumulative database that contains all FPs including those retired and deceased. Therefore, to identify active FPs, we excluded FPs: without billings in OHIP in the 12 months prior to March 14, 2020, who had less than 10% of their billings as family medicine billings (to exclude those who primarily practice as non-FPs), and who were in the bottom 10% of absolute number of billings (to exclude those who were on parental leave, had administrative rather than clinical roles, or who were likely retired or mostly-retired).

Covariates

For each of the physicians, we identified physician age category (50+ years/< 50 years), physician sex (male/female), physician experience (years in practice: < 5 years, 5- < 10 years, 10+ years), practice location (rural/urban), practice model (fee for service, enrolment model), and physician workload (less than 1.0 full-time equivalent (FTE), 1 FTE). Practice characteristics refer to the profile of the patients that were seen (either in-person or virtually) at each practice during the study period, aggregated as means across all practices. Patient profile variables that were aggregated included: average age and proportion of age groups of patients; proportion of patients by sex; proportion of patients at each level of neighbourhood income; proportion of patients at each level of Ontario marginalization material deprivation score [24]; proportion of patients that identified as having multimorbidity [25]; and proportion of patients with various chronic conditions [25].

Outcomes

We identified for each physician: mean weekly number of total, in-person and virtual visits across each period of interest. For total visits and in-person visits, we characterized the outcome as a ratio of visits during the pandemic period divided by baseline visits, while virtual visits, having no baseline against which to compare, were modelled as a proportion of total visits.

Timeframe

Characteristics and outcomes of the physicians and their practices were identified at four times: at baseline (March 14, 2019 to March 13, 2020), during the early first wave of the pandemic (March 14 to May 10, 2020); during the lull between the first and second waves (May 11 to September 17, 2020); and the early portion of the second wave (September 18 to the end of our observation period, October 31, 2020).

Quantitative data analysis

All analyses were conducted using SAS version 9.4 (SAS Institute, Cary, NC). Characteristics were reported for the FPs and their practices (characteristics of patients seen in those practices during the study period) in each of the pre-pandemic and pandemic periods. Differences in characteristics for each pandemic period compared to baseline were determined using one-way ANOVA or chi-squared test as applicable. Mean weekly total, in-person and virtual visits were visually represented in a trend figure across the pre-pandemic and pandemic periods. An interrupted time series using segmented regression (reported as an appendix) examined statistically significant trends across different periods during the pandemic.

We further fit multivariable linear regression models to evaluate the association between FP characteristics (age and sex) and practice characteristics (practice location and model, full-time equivalent status; % practice female patients and % practice patients with multimorbidity) and the outcomes. Assumptions for linear regression were tested.

Qualitative study methods

Recruitment and data collection

Potential FP participants were identified through publicly available lists and by study investigators and recruited through email. Potential participants were provided a letter of information and signed a consent form to participate. We purposefully recruited FPs, ensuring variation in age, sex, family practice model, and location (urban/rural).

The Principal Investigator (BLR) conducted all semi-structured interviews, which were 45 to 60 minutes in length using either Zoom or telephone. Interviews were audio-recorded using an external recording device and transcribed verbatim. Interviews took place from July 2020 to February 2021 and participants were asked to reflect back on the period from March 14, 2020 to the time of the interview, to capture the period used for the quantitative component of the study as closely as possible.

Qualitative data analysis

Three members of the research team (BLR, JBB, TF) conducted the analysis using Constructivist Grounded Theory methods [22]. We conducted the analysis iteratively and alongside data collection, supplementing the semi-structured interview guide as new themes emerged from the data. We first coded each transcript independently line by line. We then conducted focussed coding as a team, consolidating codes and deciding which codes best represented the data. We used constant comparative analysis, revisiting older data when new concepts emerged to refine our understanding. One author (JWH) input the codes into NVivo software [26]. Finally, we employed theoretical coding where we sought relationships among the codes. We made extensive memos of possible intersections among themes as they developed, areas to revisit and new themes we probed in subsequent interviews. As well, we identified any gaps in our sample of participants and used theoretical sampling to ensure a diverse sample of family physicians [23]. After we had reached data sufficiency [27], we reviewed a report of all codes, consolidated themes and developed the narrative. We enhanced trustworthiness throughout the data collection and analysis by employing reflexivity [23] to consider how we influence the research process, given our own disciplines (BLR-Epidemiology, JBB-Social Work, TF-Family Medicine) and perspectives.

Integration of quantitative and qualitative data

We brought together the analyses from the quantitative and qualitative data collections by mapping the themes from the qualitative analysis to the quantitative findings. We looked for consistent and dissonant messages as well as instances where one or the other of the methods could provide information unique to that data collection method. We present the results as one narrative according to broad themes identified.

Results

Figure 1 reports the creation of the study cohort for the quantitative study component. There was a decrease in the number of FPs seeing patients for each of the three pandemic waves compared to pre-pandemic; however, there were no significant differences in the characteristics of these FPs compared to pre-pandemic values (Table 1). Table 2 reports the characteristics of the 17 FPs interviewed for the study’s qualitative component.

Fig. 1
figure 1

Quantitative Study Hierarchy – Inclusion and Exclusion

a OHIP = Ontario Health Insurance Plan

Table 1 Characteristics of London and Middlesex County, Ontario Family Physicians Before and During COVID-19 Pandemic (Column %)
Table 2 Characteristics of London and Middlesex County, Ontario family physicians interviewed for qualitative component (n = 17)

We organized the Results section by headings that represent the Quantitative Results (which arose from analyzing the health administrative data) and the Qualitative Themes (from our constant comparative and theoretical coding analysis). Within each of these sections, connections are made between the quantitative results and the qualitative findings. The qualitative themes were: Access to care; Transitions in Providing Care during COVID-19 (sub-themes: Always being open, Initial volumes of visits dropped, Reluctance to meet in person, and Rapid move to virtual care); and Inequity of Payment Models.

Access to care

During the pandemic waves, FP practices saw a greater proportion of patients 65 years of age and older, with a lower proportion of male patients and a higher proportion of patients with multimorbidity. The proportion of the most materially deprived patients was higher than pre-pandemic during the first wave of the pandemic (Table 3).

Table 3 Aggregated practice characteristicsa London and Middlesex County, Ontario family physicians before and during COVID-19 pandemic (Column %)

These findings were consistent with the theme of “access to care” from the qualitative interviews. All FPs reported that virtual care improved access for many vulnerable patients, “the accessibility for a lot of patients is really improved”. (FP10, M, 37 years). Regarding older patients accessing virtual care, one FP said, “I think it’s a bit of a misnomer to think that elderly patients don’t use technology.” (FP11, M, 32 years). One FP expressed it was safer for older patients to be seen virtually, “… my 80-year-old doesn’t have to take a taxi out in the winter, walk on the ice and get up my stairs … It’s safer if they don’t really need to be examined.” (FP16, F, 52 years). Other FPs talked about how virtual care removed barriers for some patients; for example, patients who depend on public transportation: “These young moms with kids taking three buses because there’s only one bus route that actually goes past my door.” (FP6, M, 64 years). Participants also acknowledged how virtual care improved access for patients who have difficulty taking time off work: “… so long haul truck drivers in the States have done diabetic [virtual] visits with me from their cab.” (FP10, M, 37 years) and “… a lot of my patients who have jobs … it was a half a day off work [to come into office]” (FP6, M, 64 years).

In contrast to this overall positive perspective concerning improved access, some FPs who cared for vulnerable patients such as those who were experiencing homelessness, cautioned that for those patients, virtual care could be difficult, “a big issue … is patients [without housing] having access to virtual care. Even a telephone sometimes is tricky for them.” (FP7, F, 46 years).

The other barrier to access, raised by FPs in rural areas, was that FPs and their patients did not always have access to high-speed internet. This was especially problematic if an FP wanted to conduct a video rather than a telephone visit. “We had some technical difficulties with bandwidth, both for us [the FPs] and for them [the patients] … pictures really, really choppy … we switched to phone just because it turned out to be much easier to do” (FP3, F, 58 years).

Volume and mode of FP visits and transitions in providing care during COVID-19

Table 4 reports, for FPs who provided services, the mean weekly FP visits (total, in-person and virtual) pre-pandemic and then during the three pandemic periods of this study. Figure 2 visually describes the change in volume of FP visits over the course of the study period. Additional file 1: Appendix 2 reports the interrupted time series that describes statistically what is seen in the graph in Fig. 2. The volume of FP in-person visits dropped 72.6% within 2 weeks of March 14 resulting in an overall volume drop of 35.8% because the in-person decrease was offset by the increase in virtual visits from essentially zero per week (0.08 visits/week) to 29.4 visits per week. Within the two-week period following March 14, virtual visits comprised 56.3% of total visits. By June 15, in-person visits started to increase and overtook virtual visits. Virtual visits decreased slightly but plateaued. Total FP visits returned to pre-pandemic levels by October 2020.

Table 4 Mean number of weekly visits for London and Middlesex County, Ontario family physicians before and during the COVID-19 pandemic
Fig. 2
figure 2

Mean Number of Weekly Visits for London and Middlesex County, Ontario Family Physicians Before and During the COVID-19 Pandemica

a Pre-pandemic defined as 12 months prior to March 14, 2020, Early 1st Wave defined as March 14–May 10, 2020, Mid-Late 1st Wave defined as May 11–September 17, 2020, Early 2nd Wave defined as September 18–October 31, 2020

These findings were reflected in the qualitative theme concerning “transitions in providing care during COVID-19”. The FP interviews elaborated reasons for the trends we observed in Fig. 2. We identified a sub-theme of “always being open” with FPs indicating that, for the most part, they did not shut down their offices, “and if we couldn’t [do virtual] then we were available to do in-person visits from the get-go...” (FP7, F, 46 years). The sub-theme, “initial volumes of visits dropped” described the overall drop in visits in the early days of the pandemic, “I mean, the demand plummeted. I think we were seeing about 20 to 30% of our usual capacity – this is including virtual care...” (FP17, M, 44 years).

Regarding the decrease of in-person visits, the sub-theme, “reluctance to meet in person” described the reasons this happened, “Patients didn’t want to go out, they were all fearful.” (FP8, M, 65 years). Another FP indicated, “Everything needed to be done by telephone for patient safety and for staff safety.” (FP10, M, 37 years). An initial shortage of Personal Protective Equipment (PPE) prevented some FPs from seeing patients in-person, “So, I was seeing people but at a much lower volume... we really didn’t have PPE or anything “. (FP16, F, 52 years). Some FPs would direct patients with COVID-19 symptoms to places “where people had PPE and the equipment to deal with higher risk patients … then as we started seeing people in person, it was really as we started securing PPE.” (FP10, M, 37 years).

FPs talked about the “rapid move to virtual care”, which is congruent with the quick uptake of virtual care seen in Fig. 2; the FP interviews observed that this uptake was overwhelmingly through the telephone, “We moved everybody that we determined didn’t need to come in … and we started with phone visits exclusively …” (FP12, F, 59 years). While some FPs used OTN successfully, a number of FPs reported they and/or their patients found it problematic, “So OTN, we started using, but it’s very clumsy getting on to it. We have more recently used a [private vendor] video platform, which is easy because basically I go from my scheduler right into the video conference. Like, it’s seamless and patients, on their end, find it very easy.” (FP13, M, 55 years).

FP and practice characteristics and inequity of payment models

Table 5 describes the association between FP and practice characteristics, across each pandemic period, with total, in-person, and virtual visits as a proportion of total visits, compared to pre-pandemic levels. Assumptions for linear regression were met. The overall estimates for the statistically significant characteristics were generally very small and inconsistent across the three pandemic periods. In at least one of the three pandemic periods, mean weekly total FP visits, compared to pre-pandemic levels, were higher for younger and full-time FPs, and FPs for whom higher percentages of their patients were female and had multimorbidity. Mean weekly in-person visits, compared to pre-pandemic baselines, were associated with being an older FP, practising in a fee-for-service practice model, and having a higher proportion of patients with multimorbidity. Compared to baseline, FPs had higher mean weekly virtual visits as a proportion of their total visits if they were older, in a capitation practice model, and had higher proportions of their patients who were female. FPs had a lower proportion of virtual visits if they had a higher percentage of patients with multimorbidity.

Table 5 Characteristics associated with Total, In-Person and Virtual Mean Weekly Family Physician Visits in London and Middlesex County, Ontario (N = 549)

The quantitative results demonstrated the role of payment models in the type of visits. This also arose as a theme in the qualitative study, providing some context to the quantitative results. FPs characterized this as “the inequity of payment models” created by having different physician compensation models in Ontario. FPs who were in capitation models received basic payments from the provincial government regardless of the overall decrease in total visits early in the pandemic; whereas, FPs in fee-for-service models were paid only when they had an encounter with a patient. This perceived inequity was highlighted by FPs in both types of models; “I’m fortunate, being in [a capitation model] because we still get paid; and so even when nobody was coming in we were essentially getting most of our pay … So doctors, who were on fee-for-service, for the first [few] months, are getting paid nothing.” (FP14, M, 63 years). This inequity of payment models subtheme intersects with the subtheme above concerning initial volumes of visits dropped. Fee for service FPs were more greatly affected by the overall drop in visit volumes during the early pandemic; the rise in virtual care did not completely offset the overall drop in visit volume. As well, while virtual visits were reimbursable as of March 14, 2020, the Ontario government was not able to accept these new virtual visit billing codes until May 1, 2020 [28, 29], again differentially impacting fee-for-service physicians who receive no capitation payments.

Discussion

Using mixed methods, this study examined the experience of FPs during the early COVID-19 pandemic in London and Middlesex County. It was important to focus on this early pandemic period when much of FP care was virtual; this permitted us to see the impact that virtual care had on overall FP care before the late 2020 return to more typical in-person care. It was also important to conduct an in-depth regional examination of FP care, particularly a region like London-Middlesex, outside the Greater Toronto area with its more highly concentrated population. The use of ICES health administrative data provided population-level findings for the entire London and Middlesex County. The analysis and integration of quantitative and qualitative data over the same pandemic period in the same geographic region provides rich findings, not available through a solely quantitative inquiry.

The number of FPs seeing patients (in-person or virtually) decreased across the early pandemic. The initial volumes of patients seen decreased, driven by a decrease in in-person visits. Virtual visit volumes increased dramatically within 2 weeks of the start of the pandemic and with the implementation by the Ontario MOH of special billing codes that reimbursed FPs for virtual care including telephone and video [7]. This rapid move to virtual care was found in other Canadian jurisdictions [30] and international jurisdictions such as Australia [31, 32], the United States [32, 33], and China, Norway, Singapore, South Korea, Sweden, and the United Kingdom [32].

In interviews, FPs reported that a lack of PPE early in the pandemic resulted in the need to avoid in-person visits and their patients being reluctant to come to the office for fear of contracting COVID-19. FPs described using telephone visits almost entirely, which is consistent with other Canadian studies where preferred modalities were telephone, followed by email, and then video conferencing tools (e.g., Zoom, Skype) [1, 34,35,36] and international jurisdictions where telephone was often the primary means of care delivery [37]. Despite the availability of the OTN virtual care platform, the vast majority of the FPs interviewed did not use OTN, reporting it to be difficult for themselves and patients to use. This is consistent with previous literature where stakeholders criticize OTN for its lack of operability across platforms, inability to handle high volume of patients, and its complex user interface [38, 39]. Rural FPs reported connectivity issues with OTN and other video platforms due to lack of high-speed internet. Rural connectivity has been reported as a reason for telephone over video modalities in other jurisdictions [37].

By the early second wave of the pandemic (mid-September 2020), the total volume of FP visits returned to pre-pandemic volumes and in-person visits increased substantially, highlighting that FP offices were available to see patients and that in-person increased as the availability of PPE increased.

It was encouraging to see quantitatively that patients seen during the pandemic were older, with a higher percentage having multimorbidity, and more likely to be materially deprived; in other words, patients that needed care. This was consistent with Ontario-wide findings by Glazier et al. [5]. This also was consistent with what we heard during the interviews. Although FPs did not specifically use the language of multimorbidity, they told stories of specific patients such as vulnerable patients, patients who were older with mobility issues, and patients requiring follow-up for on-going chronic conditions such as diabetes. FPs noted that virtual care had improved access for these high-need patients during the pandemic when they could not be seen in-person or when they were reluctant to go into the FP’s office. Despite these encouraging findings, we cannot determine from our study the extent to which those with multimorbidity received all necessary care. Other studies have cited that chronic disease management and preventive care for those with chronic conditions suffered during the pandemic [37, 40]. In our study, while reporting better access because of virtual care, our FP participants cautioned that highly vulnerable patients such as those who were homeless and/or without access to a telephone were sometimes unable to access virtual care.

Limitations

Our study was not able to determine reasons for the decrease in numbers of FPs practising during the early and middle waves of the pandemic; nor were we able to determine whether this change was usual fluctuation or particular to the pandemic. We reported on socio-demographic variables such as income and material deprivation; however, Ontario does not capture information on patients’ race or ethnicity, and sex is limited to male or female. Another limitation is that our interviews extended beyond the date at which our health administrative data was available, and months after the start of the pandemic. This could lead to recall bias; however, we think this risk was mitigated by the fact that the COVID-19 pandemic was a momentous event for everyone including family physicians. As such, we found family physicians, even those interviewed 7 months after the start of the pandemic, were able to remember vividly how and when they transitioned to virtual care. They recalled clearly patient stories, sometimes even quoting what patients had said to them about virtual care.

Conclusion

The pandemic provided a disruption to the delivery of family physician care that brought about the removal of major barriers to providing virtual care in Ontario, Canada. Key among these barriers was the provision of compensation to FPs to offer virtual care through means other than the province-sanctioned OTN network, including by telephone. This study provides valuable messages to guide the future of virtual FP care including the importance of continued compensation for virtual care, the need for equitable FP payment models, and the need to attend to equity in access for highly vulnerable patients. Additionally, our study found that the move to virtual care during the pandemic was primarily a move to telephone care; therefore, when considering the success and future of virtual care, we must consider the modality of care delivery that is acceptable to both FPs and their patients.

Availability of data and materials

The data set from this study is held securely in coded form at ICES. While data sharing agreements prohibit ICES from making the data set publicly available, access may be granted to those who meet prespecified criteria for confidential access, available at https://www.ices.on.ca/DAS. The full data set creation plan and underlying analytic code are available from the authors on request, understanding that the computer programs may rely on coding templates or macros that are unique to ICES and are therefore either inaccessible or may require modification.

Abbreviations

COVID-19:

Novel coronavirus 2019

CD:

Census division

CGT:

Constructivist Grounded Theory

FPs:

Family physicians

FTE:

Full-time equivalent

HA data:

Health administrative data

IPDB:

ICES Physician Database

OHIP:

Ontario Health Insurance Program

OTN:

Ontario Telemedicine Network

PPE:

Personal protective equipment

References

  1. The College of Family Physicians of Canada. Family Physicians’ Response to the COVID-19 Pandemic. 2020. https://www.cfpc.ca/CFPC/media/Resources/Research/Covid-19-Member-Survey-ENG-Final.pdf. Accessed 16 Jan 2022.

    Google Scholar 

  2. Virtual Care Task Force. Virtual care recommendations for scaling up virtual medical services. Canadian Medical Association 2020. https://www.cma.ca/sites/default/files/pdf/virtual-care/ReportoftheVirtualCareTaskForce.pdf. Accessed 16 Jan 2022.

  3. Claims Services Branch, Ministry of Health. Virtual Care Program – Billing Amendments to Enable Direct-to-Patient Video Visits and Modernize Virtual Care Compensation. 2019. https://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/4000/bul4731.pdf. Accessed 16 Jan 2022.

    Google Scholar 

  4. Making access to care better, faster and more convenient. OTN. https://otn.ca/. Accessed 20 Jan 2022.

  5. Glazier RH, Green ME, Wu FC, Frymire E, Kopp A, Kiran T. Shifts in office and virtual primary care during the early COVID-19 pandemic in Ontario, Canada. CMAJ. 2021;193:E200–10.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Canadian Medical Association. Virtual Care in Canada: Discussion paper. 2019. https://www.cma.ca/sites/default/files/pdf/News/Virtual_Care_discussionpaper_v2EN.pdf. Accessed 16 Jan 2022.

    Google Scholar 

  7. Health Services Branch, Ministry of Health. Changes to the Schedule of Benefits for Physician Services (Schedule) in response to COVID-19 influenza pandemic effective March 14, 2020. 2020. https://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/4000/bul4745.pdf. Accessed 29 Mar 2021.

    Google Scholar 

  8. OHIP. Schedule of benefits and fees: Ontario Ministry of Health and Long-Term Care. https://www.health.gov.on.ca/en/pro/programs/ohip/sob/. Accessed 20 Jan 2022

  9. Primary Care Payment Models in Ontario. Ontario Ministry of Health and Long-Term Care. https://www.health.gov.on.ca/en/pro/programs/pcpm/. Accessed 20 Jan 2022.

  10. Ontario demographic quarterly: highlights of first quarter. Ontario 2021. http://www.ontario.ca/page/ontario-demographic-quarterly-highlights-first-quarter. Accessed 16 Jan 2022.

  11. Nielsen K. A timeline of COVID-19 in Ontario: Global News; 2020. https://globalnews.ca/news/6859636/ontario-coronavirus-timeline/. Accessed 20 Jan 2022

    Google Scholar 

  12. COVID-19 Intervention Timeline in Canada. Canadian Institute for Health Information. 2020. https://www.cihi.ca/en/covid-19-intervention-timeline-in-canada. Accessed 20 Jan 2022.

    Google Scholar 

  13. Office of the Premier. Ontario enacts declaration of emergency to protect the public: Ontario Newsroom; 2020. https://news.ontario.ca/en/release/56356/ontario-enacts-declaration-of-emergency-to-protect-the-public. Accessed 16 Jan 2022

    Google Scholar 

  14. Annual demographic estimates, census divisions: interactive dashboard. Statistics Canada 2020. https://www150.statcan.gc.ca/n1/pub/71-607-x/71-607-x2020021-eng.htm. Accessed 16 Jan 2022.

  15. D’Ascanio N. This City is the most average place in all of Canada: Reader’s Digest Canada; 2021. https://www.readersdigest.ca/travel/canada/most-average-place-in-canada/. Accessed 16 Jan 2022

    Google Scholar 

  16. The Canadian Press. Timeline of COVID-19 cases across Canada: CBC; 2020. https://www.cbc.ca/news/health/canada-coronavirus-timeline-1.5482310. Accessed 16 Jan 2022

    Google Scholar 

  17. Ontario COVID-19 data tool. Public Health Ontario 2022. https://www.publichealthontario.ca/en/data-and-analysis/infectious-disease/covid-19-data-surveillance/covid-19-data-tool. Accessed 16 Jan 2022.

  18. Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. 2nd ed. Thousand Oaks: SAGE; 2003.

    Google Scholar 

  19. London, CY [Census subdivision], Ontario and Middlesex, CTY [Census division], Ontario (table). Census Profile. 2016 Census. Statistics Canada. 2017. https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/details/page.cfm?Lang=E&Geo1=CSD&Code1=3539036&Geo2=CD&Code2=3539&SearchText=london&SearchType=Begins&SearchPR=01&B1=All&TABID=1&type=0. Accessed 16 Jan 2022.

  20. Standard Geographical Classification (SGC) 2016–3539 - Middlesex. Statistics Canada. 2016. http://www23.statcan.gc.ca/imdb/p3VD.pl?Function=getVD&TVD=314300&CVD=314303&CPV=3539&CST=01012016&CLV=3&MLV=4. Accessed 16 Jan 2022.

  21. Green ME, Glazier RH, Frymire E, Khan S, Premji K, Bayoumi I, Jaakkimainen L, Kiran T, Roberts L, Gozdyra P. Primary Care Data Reports for Ontario Health Teams. 2022. https://www.ontariohealthprofiles.ca/ontarioHealthTeam.php Accessed September 2, 2022.

    Google Scholar 

  22. About ICES. IC/ES. https://www.ices.on.ca/About-ICES. Accessed 16 Jan 2022.

  23. Charmaz K. Constructing grounded theory. 2nd ed. London: SAGE; 2014.

    Google Scholar 

  24. Matheson FI, Dunn JR, Smith KLW, Moineddin R, Glazier RH. Development of the Canadian marginalization index: a new tool for the study of inequality. Can J Public Health. 2012;103(Suppl 2):S12–6.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ryan BL, Bray Jenkyn K, Shariff SZ, Allen B, Glazier RH, Zwarenstein M, et al. Beyond the grey tsunami: a cross-sectional population-based study of multimorbidity in Ontario. Can J Public Health. 2018;109:845–54.

    Article  PubMed  PubMed Central  Google Scholar 

  26. NVivo qualitative data analysis software. QSR International Pty Ltd.; 2018.

  27. Morse JM. The significance of saturation. Qual Health Res. 1995;5:147–9.

    Article  Google Scholar 

  28. Kupfer M. Ontario doctors may not get paid for telemedicine until July: CBC News. https://www.cbc.ca/news/canada/ottawa/ontario-doctors-telemedcine-billing-delay-1.5532209. Accessed 5 Sept 2022

  29. Health Services Branch, Ministry of Health. COVID-19 Temporary Fee Schedule Codes Implemented-Physicians can begin to submit claims for COVID-19 on May 1, 2020. https://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/4000/bul4755.aspx,

  30. Canadian Institute for Health Information. Physician billing codes in response to COVID-19. Canadian Institute for Health Information; 2020. https://www.cihi.ca/en/virtual-care-a-major-shift-for-physicians-in-canada. Accessed 05 September 2022.

  31. Snoswell CL, Caffery LJ, Haydon HM, Thomas EE, Smith AC. Telehealth uptake in general practice as a result of the coronavirus (COVID-19) pandemic. Aust Health Rev. 2020;44(05):737–40.

    Article  PubMed  Google Scholar 

  32. Tu K, Sarkadi Kristiansson R, Gronsbell J, de Lusignan S, Flottorp S, Goh LH, et al. Changes in primary care visits arising from the COVID-19 pandemic: an international comparative study by the international consortium of primary care big data researchers (INTRePID). BMJ Open. 2022;12(5):e059130. https://doi.org/10.1136/bmjopen-2021-059130.

    Article  PubMed  Google Scholar 

  33. Koonin LM, Hoots B, Tsang CA, Leroy Z, Farris K, Jolly T, et al. Trends in the use of telehealth during the emergence of the COVID-19 pandemic ’ United States, January–march 2020. MMWR Morb Mortal Wkly Rep. 2020;69(43):1595–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Wong S. Quick COVID-19 primary care survey of clinicians: summary of the second weekly pan-Canadian survey of frontline primary care clinicians’ experience with COVID-19: Primary and Integrated Health Care Innovations Network; 2020. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/154873/Wong_week_1_combined.pdf?sequence=1&isAllowed=y. Accessed 20 Jan 2022

    Google Scholar 

  35. Bhatia RS, Chu C, Pang A, Tadrous M, Stamenova V, Cram P. Virtual care use before and during the COVID-19 pandemic: a repeated cross-sectional study. CMAJ Open. 2021;9:E107–14.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Enhanced Access to Primary Care: Project Evaluation Final Report. Women’s College Hospital Institute for Health Systems Solutions and Virtual Care. 2019. https://otn.ca/wp-content/uploads/2019/08/eapc-evaluation-report.pdf. Accessed 29 Mar 2021.

    Google Scholar 

  37. Matenge S, Sturgiss E, Desborough J, Dykgraaf SH, Dut G, Kidd M. Ensuring the continuation of routine primary care during the COVID-19 pandemic: a review of the international literature. Fam Pract. 2022:747–61. https://doi.org/10.1093/fampra/cmab115.

  38. Appia V. What does the future of telemedicine look like in Ontario after COVID-19: Toronto.com; 2020. https://www.toronto.com/news-story/9966360-what-does-the-future-of-telemedicine-look-like-in-ontario-after-covid-19-/. Accessed 16 Jan 2022

    Google Scholar 

  39. Jeffords S, Loriggio P. Virtual care expansion moving too slow says Ontario auditor general in annual report: CTV News; 2020. https://toronto.ctvnews.ca/virtual-care-expansion-moving-too-slow-says-ontario-auditor-general-in-annual-report-1.5219834. Accessed 16 Jan 2022

    Google Scholar 

  40. Mistry SK, Ali ARMM, Yadav UN, Ghimire S, Hossain MB, Das Shuvo S, et al. Older adults with non-communicable chronic conditions and their health care access amid COVID-19 pandemic in Bangladesh: findings from a cross-sectional study. PLoS One. 2021;16(7):e0255534. https://doi.org/10.1371/journal.pone.0255534.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long-Term Care (MLTC). The study was completed at the ICES Western site, where core funding is provided by the Academic Medical Organization of Southwestern Ontario, the Schulich School of Medicine and Dentistry, Western University, and the Lawson Health Research Institute. This study also received funding from the Western University Catalyst Grant: Surviving Pandemics. Parts of this material are based on data and information compiled and provided by: the Canadian Institute for Health Information (CIHI), Ministry of Health and Ministry of Long Term Care. The analyses, conclusions, opinions and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. We thank IQVIA Solutions Canada Inc. for use of their Drug Information File. Parts of this material are based on data and information provided by Cancer Care Ontario (CCO). The opinions, results, view, and conclusions reported in this paper are those of the authors and do not necessarily reflect those of CCO. No endorsement by CCO is intended or should be inferred.

Author information

Authors and Affiliations

Authors

Contributions

BLR conceived the study, with input from JBB, TRF, MS, SZS, ALT and MM. BLR, LR, SZS and YHC developed the analysis plan. BLR and LR conducted the analysis. TRF, SC, KT, SR and RB provided expertise on issues related to family medicine and virtual care. BLR wrote the manuscript with assistance from LM and JWH, and LR assisted with construction of tables and figures. All authors provided input to the manuscript and reviewed the final version. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Bridget L. Ryan.

Ethics declarations

Ethics approval and consent to participate

All methods were carried out in accordance with relevant guidelines and regulations. For the quantitative component using ICES data, the use of the data in this project is authorized under Section 45 of the Ontario’s Personal Health Information Protection Act (PHIPA) and does not require review by a Research Ethics Board. Consent is not required for the use of these health administrative data. For the qualitative component, ethics approval was obtained from the Western University Health Sciences Research Ethics Board (Ethics #116125). Informed consent was obtained from all participants.

Competing interests

KT provides virtual care webinars for family physicians and receives an honorarium from Astra Zeneca and Boehringer Ingelheim pharmaceuticals for this work. He has a revenue share arrangement with a not-for-profit telemedicine service (iTelemed).

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix 1.

Administrative datasets used in study. Appendix 2. Interrupted Time Series for Family Physicians’ Mean Number of Weekly Visits (N = 549). Appendix 3. Virtual Family Physician Care during COVID-19: Interview Guide – Virtual Care Questions.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ryan, B.L., Brown, J.B., Freeman, T.R. et al. Virtual family physician care during COVID-19: a mixed methods study using health administrative data and qualitative interviews. BMC Prim. Care 23, 300 (2022). https://doi.org/10.1186/s12875-022-01902-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12875-022-01902-9

Keywords