Next Article in Journal
“Pandemic Fatigue! It’s Been Going On since March 2020”: A Photovoice Study of the Experiences of BIPOC Older Adults and Frontline Healthcare Workers during the Pandemic
Next Article in Special Issue
Determinants of Telehealth Continuance Intention: A Multi-Perspective Framework
Previous Article in Journal
The Effects of Online Social Interactions on Life Satisfaction of Older Chinese Adults: New Insights Based on a Longitudinal Approach
Previous Article in Special Issue
Awareness and Use of Virtual Clinics following the COVID-19 Pandemic in Saudi Arabia
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Perception Disparity of Telemedicine Use between Outpatients and Medical Staff during the COVID-19 Pandemic

1
Department of Family Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
2
Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung 40227, Taiwan
3
Department of Critical Care Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
4
Department of Medical Administration, Taichung Veterans General Hospital, Taichung 40705, Taiwan
5
Computer and Communications Center, Taichung Veterans General Hospital, Taichung 40705, Taiwan
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(10), 1965; https://doi.org/10.3390/healthcare10101965
Submission received: 18 September 2022 / Revised: 3 October 2022 / Accepted: 6 October 2022 / Published: 8 October 2022
(This article belongs to the Special Issue COVID-19: Digital Health Response around the World)

Abstract

:
We assessed the characteristics and perception of telephone appointments among outpatients and medical staff during the COVID-19 pandemic in Taiwan. Our survey was performed by giving self-administered questionnaires to the enrollees. Basic socioeconomic status data were collected. We used a valid and reliable telehealth usability questionnaire (TUQ) to assess the telemedicine experience among outpatients and medical staff. Only outpatients with chronic illness and who had regular visits before the pandemic were enrolled. We delivered the questionnaire survey to participants who used telephone appointments from 20 May 2021 to 31 July 2021 in Taichung Veterans General Hospital. A total of 471 outpatients and 203 medical staff completed the survey. Most of the respondents were aged 30–69, college-educated, women, and married. Outpatients have higher scores in all dimensions of TUQ than medical staff, especially in the dimensions of ease of use and effectiveness. Age, gender, education, and marriage have no significant associations in the medical staff group. In the outpatient group, gender is the only significant factor in the six dimensions of TUQ. We found a significant disparity in the perception gap of telemedicine among outpatient and medical staff. Outpatients are satisfied with telephone appointments during the COVID-19 pandemic, but medical staff are concerned about the ease of use and effectiveness.

1. Introduction

Since the outbreak of the novel coronavirus disease 2019 (COVID-19) in early 2020, the evolution of telemedicine has grown drastically worldwide. Healthcare systems are dedicated to developing telemedicine in many countries, including future applications, disease prevention and control, medical quality, and economics. A recent study reported that telemedicine should not only be a temporary measure in times of an emergency pandemic; it evidently has the potential to care for outpatients during the pandemic and beyond [1].
Taiwan is one of the fastest aging societies in the world and is set to become super-aged by 2025 [2]. With increased long-term care needs and the development of information and communications technology, the Ministry of Health and Welfare in Taiwan commenced “Regulations of Treatment on Telemedicine” on 11 May 2018 to improve accessibility. However, the regulations only applied to those who lived in the mountains, outlying islands, remote areas, or other particular conditions [3]. Due to the government’s effective response to COVID-19, Taiwan’s medical system did not have great difficulty promoting telemedicine in 2020. Nevertheless, as COVID-19 started to surge in mid-May 2021, the government in Taiwan loosened the regulations. Outpatients with chronic diseases could use telemedicine, such as video or telephone conferences, for routine checks. The telemedicine regulations were relaxed until one month after the Level 3 epidemic alert lifted. Telemedicine provided continuity of care during the COVID-19 pandemic and was demonstrated as an effective solution for chronic illness management [4].
The use of telephone appointments increased significantly more than video appointments in Taichung Veterans General Hospital. Besides, the annual survey of the National Health Insurance (NHI) in Taiwan showed a satisfaction disparity between physicians and patients. Several studies have shown positive attitudes and satisfaction toward telemedicine among clinicians and outpatients [4,5,6,7]. However, there is a lack of research regarding user experience and perception gaps of telephone appointments among patients and physicians, especially in the outpatient clinic setting. For the further development of telemedicine, it is necessary to analyze the user experiences and perception gaps of telephone appointments in the outpatient clinic during the COVID-19 pandemic.

2. Materials and Methods

Our survey took the form of a self-administered questionnaire. We collected data on age, gender, basic socioeconomic profiles, and questions about telemedicine experience. Our project had two parts; one for the outpatient group and one for the medical staff group. The target population for the study was patients who had telephone appointments in Taichung Veterans General Hospital from 20 May 2021 to 31 July 2021. In total, 204 physicians, 183 nurses, and 1790 outpatients participated in the telephone appointments.
To our knowledge, there were few existing validated questionnaires in Asia to evaluate the user characteristics and experiences of telephone appointments in the outpatient clinic. We designed a questionnaire, which is an anonymous survey. It had two versions; one for outpatients and one for medical staff. The questionnaire includes gender, age, education, marriage, identity (outpatient, family member, or medical staff), and user experience. The telehealth usability questionnaire (TUQ) was used widely in surveys of telehealth [8,9]. We revised the TUQ to a six-dimension survey, including usefulness, ease of use, effectiveness, reliability, willingness to re-visit, and satisfaction (Table 1). Each dimension of the questions contains five scores, 1 for strongly disagree, 2 for disagree, 3 for no opinion, 4 for agree, and 5 for strongly agree. We gathered a focus group that enrolled six experts to assess the content validity. The mean item-level content validity indices of outpatient and medical staff versions were 0.97 and 1.00, respectively. The scale-level content validity indices, based on the universal agreement calculation method of outpatient and medical staff versions, were 0.83 and 1.00, respectively. We also evaluated the internal consistency. The Cronbach’s alpha was 0.955.
We designed a purposive sampling by sending text messaging questionnaires to people who had telephone appointments from 20 May 2021 to 31 July 2021 in Taichung Veterans General Hospital, aided by information technology technicians. The outpatients and their family members who assisted with the telephone appointment or the associated medical staff were enrolled. An agreement to participate in the questionnaire survey was required. We excluded people on the first appointment, those who did not agree to the questionnaire survey, and those aged 20 and younger. The study was approved by the ethical review committee conducted by the Institutional Review Board Taichung Veterans General Hospital (CE21288A).
Descriptive statistics were analyzed to obtain characteristics and summarize participants’ telephone appointment experiences during the COVID-19 pandemic. A Chi-Square test was used to examine the relationships between questionnaire dimensions from two sample groups. We also use multiple regression of variables within both groups to examine the association. All analyses were performed using SPSS for Windows version 16.0 (SPSS Institute Inc., Chicago, IL, USA).

3. Results

In total, 471 outpatients and 203 medical staff responded to the questionnaire. The response rates were 26.31% in the outpatient group and 52.45% in the medical staff group. The predominant age group of outpatients and medical staff was 30–69 years. Most of the respondents were women and married. The education level of both groups is mainly at the college level. Most (78.56%) of respondents to the outpatient survey were filled in by patients themselves (Table 2).
The question statements in the TUQ were slightly different in the two versions for outpatients and medical staff, but the main six dimensions were the same. In the outpatient group, respondents gave scores higher than four in all six dimensions. However, the scores were lower in the medical staff group, especially in dimensions 2 (ease of use) and 3 (effectiveness) (Table 3). The difference is significant between the two groups (Figure 1).
There is no significant difference in the analysis of variances in each dimension in the medical staff group, except for the respondent identity in dimension 3 (effectiveness). In the outpatient group, gender is a significant variable in the six dimensions (Table 4). In the multiple regression, gender is still a significant variable in the six dimensions among the outpatient group. We also used the variance-inflation factors for detecting multicollinearity.

4. Discussion

In our research, we found an evident gap in the perception of telemedicine. Outpatients gave a higher score than medical staff in all six dimensions of TUQ. In the outpatient group, patients themselves are less willing to re-visit than family and friends, which has a significant relationship. In the medical staff group, nurses gave a higher score in the effectiveness dimension than physicians. Women were more satisfied with telephones than men in the outpatient group. In the multiple regression model, age, education, and marriage have no significant associations among the six dimensions in our questionnaire.
The overall satisfaction results are compatible with the annual survey of the NHI in Taiwan. In the latest NHI satisfaction survey in 2019, people had high satisfaction with the NHI service at 89.7%, while medical staff only had 33.7% [10]. In our telephone appointments survey, the percentage of scores higher than three in the six dimensions is over 90% in the outpatient group. A Taiwan government survey in 2011 found the average time of in-person outpatient appointments is 10.2 min, which is also consistent with the time of telephone appointments.
A recent study about video telemedicine using the TUQ in the COVID-19 pandemic has shown that the average usability score (scale 1–5) was 3.87, with the highest dimensions in the usefulness (μ = 4.29) and physician satisfaction (μ = 4.13) and the lowest dimension in reliability (μ = 3.02) [11]. Our study demonstrated similar results; the average usability score was 3.42, with the highest in the usefulness dimension and the lowest in the effectiveness dimension. The disparity might be related to several factors. The medical staff had little experience with telemedicine before the pandemic. Research has shown most physicians did not get training in telemedicine [11,12]. It is urgent for medical staff to adopt the new model of outpatient appointments. A telemedicine study also revealed communication is an essential concern of the medical staff [13]. Physicians have more confidence in traditional in-person appointments because of physical exams, eye contact, and body language. Besides, telemedicine may also increase the burden on physicians.
A systemic review of patient experience with telemedicine has demonstrated that the most significant benefits were the time saved, better accessibility, convenience, and cost-efficiency. Age did not have significant associations among the satisfaction levels. Challenges with technical issues and lack of physical examination were the main concern encountered in telemedicine [14]. These findings are compatible with our results. In the view of outpatients in Taiwan, accessibility and convenience were important considerations, especially during the COVID-19 pandemic. However, the medical staff were more concerned about the safety and effectiveness of the new technology than the convenience. An interview study of physicians’ perception of telehealth also revealed doubts and uncertainty about telemedicine, such as efficiency, safety, and the adequacy of current regulations [15].
Our study has several strengths. It is the first study to evaluate telephone usability using TUQ among medical staff and outpatients. We revised the TUQ to a six-dimension survey with confirmed reliability and validity. We found a significant perception disparity of telemedicine among outpatients and medical staff. Outpatients with chronic illnesses were satisfied with the telephone appointment for regular prescriptions during the pandemic. However, medical staff considered patient safety and effectiveness more and felt unsatisfied with the current use of telephone appointments. The policymakers and administration need to enhance the telemedicine tools and programs to reduce the burden and increase patient safety in future developments.
There are several limitations to our study. First, it was a cross-sectional anonymous internet questionnaire survey with a limited number of respondents. There was a low response rate in the outpatient group, as those nonrespondents might be less educated or interested in our research topic. Because it was an anonymous self-administered questionnaire survey, we could not follow up to improve the response rate and compare the difference between respondents and nonrespondents. Second, we did not collect some socioeconomic data, such as income or urbanicity of residence in the outpatient group. Personal medical history and adherence were also not controlled. Third, only people who had outpatient appointments before the pandemic were enrolled. We exclusively evaluated audio telehealth without video telehealth. The study is not generalized to other populations. Further studies are required to explore telemedicine usability. There is still little known about characteristics among subgroups in the medical staff or time using telemedicine.

5. Conclusions

We found a significant disparity in the perception gap of telemedicine among outpatients and medical staff. Outpatients were satisfied with telephone appointments during the COVID-19 pandemic, but medical staff were concerned about the ease of use and effectiveness. Further studies are required to explore the characteristics among subgroups.

Author Contributions

Conceptualization, C.-L.W., P.-S.H. and M.-H.L.; methodology, C.-L.W. and Y.-J.H.; investigation: C.-C.H.; formal analysis, J.-J.W. and Y.-J.H.; writing—original draft preparation, J.-J.W.; writing—review and editing, J.-J.W. and P.-S.H. All authors have read and agreed to the published version of the manuscript.

Funding

No external funding was received for this study. All costs related to this research was covered by the researchers themselves.

Institutional Review Board Statement

The study was approved by the ethical review committee conducted by the Institutional Review Board Taichung Veterans General Hospital (CE21288A).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the participants to publish this paper.

Data Availability Statement

The datasets used and analyzed during the current study are available from the corresponding authors on reasonable request.

Acknowledgments

The authors are grateful to the Biostatistics Task Force of Taichung Veterans General Hospital for assistance with the statistical analysis in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bokolo, A.J. Exploring the adoption of telemedicine and virtual software for care of outpatients during and after COVID-19 pandemic. Ir. J. Med. Sci. 2020, 190, 1–10. [Google Scholar] [CrossRef] [PubMed]
  2. Lin, Y.-Y.; Huang, C.-S. Aging in Taiwan: Building a Society for Active Aging and Aging in Place. Gerontologist 2015, 56, 176–183. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Chu, C.; Wang, T.; Lee, H.; Lin, C.; Feng, C. Emergency physicians’ role in telemedicine care during the coronavirus disease pandemic: Experiences from Taiwan. Emerg. Med. Australas. 2021, 33, 569–571. [Google Scholar] [CrossRef] [PubMed]
  4. Wang, H.; Yuan, X.; Wang, J.; Sun, C.; Wang, G. Telemedicine maybe an effective solution for management of chronic disease during the COVID-19 epidemic. Prim. Health Care Res. Dev. 2021, 22, e48. [Google Scholar] [CrossRef] [PubMed]
  5. Gentry, M.T.; Puspitasari, A.J.; McKean, A.J.; Williams, M.D.; Breitinger, S.; Geske, J.R.; Clark, M.M.; Moore, K.M.; Frye, M.A.; Hilty, D.M. Clinician Satisfaction with Rapid Adoption and Implementation of Telehealth Services During the COVID-19 Pandemic. Telemed. E-Health 2021, 27, 1385–1392. [Google Scholar] [CrossRef] [PubMed]
  6. Vosburg, R.W.; Robinson, K.A. Telemedicine in Primary Care During the COVID-19 Pandemic: Provider and Patient Satisfaction Examined. Telemed. E-Health 2021, 28, 167–175. [Google Scholar] [CrossRef] [PubMed]
  7. Holtz, B.E. Patients Perceptions of Telemedicine Visits before and after the Coronavirus Disease 2019 Pandemic. Telemed. E-Health 2020, 27, 107–112. [Google Scholar] [CrossRef] [PubMed]
  8. Hajesmaeel-Gohari, S.; Bahaadinbeigy, K. The most used questionnaires for evaluating telemedicine services. BMC Med. Inform. Decis. Mak. 2021, 21, 36. [Google Scholar] [CrossRef] [PubMed]
  9. Park, H.-Y.; Kwon, Y.-M.; Jun, H.-R.; Jung, S.-E.; Kwon, S.-Y. Satisfaction Survey of Patients and Medical Staff for Telephone-Based Telemedicine during Hospital Closing Due to COVID-19 Transmission. Telemed. E-Health 2020, 27, 724–732. [Google Scholar] [CrossRef]
  10. Lee, P.C. Introduction to the National Health Insurance of Taiwan. In Digital Health Care in Taiwan; Lee, P.C., Wang, J.T.H., Chen, T.Y., Peng, C., Eds.; Springer: Cham, Switzerland, 2022. [Google Scholar] [CrossRef]
  11. Lee, J.A.; Di Tosto, G.; McAlearney, F.A.; Miller, S.; Mezoff, E.; Venkatesh, R.D.; Huang, J.; Lightdale, J.R.; Volney, J.; McAlearney, A.S. Physician Perspectives about Telemedicine: Considering the Usability of Telemedicine in Response to Coronavirus Disease 2019. J. Pediatr. Gastroenterol. Nutr. 2021, 73, 42–47. [Google Scholar] [CrossRef] [PubMed]
  12. Elawady, A.; Khalil, A.; Assaf, O.; Toure, S.; Cassidy, C. Telemedicine during COVID-19: A survey of Health Care Professionals’ perceptions. Monaldi Arch. Chest Dis. 2020, 577. [Google Scholar] [CrossRef] [PubMed]
  13. Isautier, J.M.; Copp, T.; Ayre, J.; Cvejic, E.; Meyerowitz-Katz, G.; Batcup, C.; Bonner, C.; Dodd, R.H.; Nickel, B.; Pickles, K.; et al. Lessons from the COVID-19 pandemic: People’s experiences and satisfaction with telehealth during the COVID-19 pandemic in Australia (Preprint). J. Med. Internet Res. 2020, 6–7. [Google Scholar] [CrossRef]
  14. Nanda, M.; Sharma, R. A Review of Patient Satisfaction and Experience with Telemedicine: A Virtual Solution During and Beyond COVID-19 Pandemic. Telemed. E-Health 2021, 27, 1325–1331. [Google Scholar] [CrossRef] [PubMed]
  15. Helou, S.; El Helou, E.; Abou-Khalil, V.; Wakim, J.; El Helou, J.; Daher, A.; El Hachem, C. The Effect of the COVID-19 Pandemic on Physicians’ Use and Perception of Telehealth: The Case of Lebanon. Int. J. Environ. Res. Public Health 2020, 17, 4866. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Relationships between the questionnaire dimension and two groups.
Figure 1. Relationships between the questionnaire dimension and two groups.
Healthcare 10 01965 g001
Table 1. The telehealth usability questionnaire (TUQ) of TCVGH 1.
Table 1. The telehealth usability questionnaire (TUQ) of TCVGH 1.
DimensionsQuestions
1. UsefulnessIs it easy to get the telephone appointment information and an appointment?
2. Ease of useIs the telephone system simple and easy to use?
3. EffectivenessDid the telephone appointment provide information in the same manner as the previous in-person appointment?
4. ReliabilityDo you think a telephone appointment has the same reliability as an in-person appointment?
5. Willingness to re-visitWould you use a telephone appointment again?
6. SatisfactionAre you satisfied with the telephone system?
1 TCVGH: Taichung Veteran General Hospital.
Table 2. Sociodemographic data of the participants who received telephone appointments during the COVID-19 pandemic in Taiwan.
Table 2. Sociodemographic data of the participants who received telephone appointments during the COVID-19 pandemic in Taiwan.
VariablesOutpatients (n = 471)Medical Staff (n = 203)
Age group (years), n (%)
≤1917 (3.61)-
20–2917 (3.61)37 (18.23)
30–3949 (10.40)77 (37.93)
40–4995 (20.17)45 (22.17)
50–5994 (19.96)39 (19.21)
60–69111 (23.57)4 (1.97)
70–7946 (9.77)1 (0.49)
≥8042 (8.91)-
Gender, n (%)
Men186 (39.49)91 (44.83)
Women285 (60.51)112 (55.17)
Education, n (%)
Illiteracy18 (3.82)-
Elementary school33 (7.01)-
Junior high school26 (5.52)-
Senior high school103 (21.87)-
College213 (45.22)140 (68.97)
Graduate school78 (16.56)63 (31.03)
Marriage, n (%)
Married441 (93.63)136 (67.00)
Unmarried25 (5.31)67 (33.00)
Other5 (1.06)-
Respondents, n (%)
Patient themselves370 (78.56)
Family or friends101 (21.44)
Respondents, n (%)
Physicians 131 (64.53)
Nurses 72 (35.47)
Table 3. Questionnaire dimensions of the participants who received telephone appointments during the COVID-19 pandemic in Taiwan.
Table 3. Questionnaire dimensions of the participants who received telephone appointments during the COVID-19 pandemic in Taiwan.
Questionnaire DimensionScales, n (%)Outpatients (n = 471)Medical Staff (n = 203)
1. Usefulness: Is it easy to get the telephone appointment information and an appointment?1-strongly disagree2 (0.42)8 (3.94)
2-disagree 5 (1.06) 14 (6.90)
3-no opinion 23 (4.88) 48 (23.65)
4-agree 144 (30.57) 85 (41.87)
5-strongly agree 297 (63.06) 48 (23.65)
2. Ease of use: Is the telephone system simple and easy to use?1-strongly disagree6 (1.27)18 (8.87)
2-disagree 9 (1.91) 30 (14.78)
3-no opinion 26 (5.52) 67 (33.00)
4-agree 135 (28.66) 59 (29.06)
5-strongly agree 295 (62.63) 29 (14.29)
3. Effectiveness: Did the telephone appointment provide information in the same manner as the previous in-person appointment?1-strongly disagree1 (0.21)10 (4.93)
2-disagree 7 (1.49) 49 (24.14)
3-no opinion 27(5.73) 73 (35.96)
4-agree 163 (34.61) 55 (27.09)
5-strongly agree 273 (57.96) 16 (7.88)
4. Reliability: Do you think a telephone appointment has the same reliability as an in-person appointment?1-strongly disagree1 (0.21)9 (4.43)
2-disagree 2 (0.42) 23 (11.33)
3-no opinion 9 (1.91) 62 (30.54)
4-agree 143 (30.36) 85 (41.87)
5-strongly agree 316 (67.09) 24 (11.82)
5. Willingness to re-visit: Would you use a telephone appointment again?1-strongly disagree4 (0.85)13 (6.40)
2-disagree 5 (1.06) 24 (11.82)
3-no opinion 14 (2.97) 49 (24.14)
4-agree 95 (20.17) 75 (36.95)
5-strongly agree 353 (74.95) 42 (20.69)
6. Satisfaction: Are you satisfied with the telephone system?1-strongly disagree6 (1.27)9 (4.43)
2-disagree 2 (0.42) 22 (10.84)
3-no opinion 18 (3.82) 68 (33.50)
4-agree 124 (26.33) 76 (37.44)
5-strongly agree 321 (68.15) 28 (13.79)
Table 4. Analysis of variance for respondents’ identity, gender, age, education, and marriage.
Table 4. Analysis of variance for respondents’ identity, gender, age, education, and marriage.
DimensionOutpatients
p Value
Medical Staff
p Value
Dimension 1
Respondents’ identity0.8420.213
Gender<0.0005-
Age0.3860.520
Education0.120-
Marriage0.4360.051
Dimension 2
Respondents’ identity0.4680.157
Gender0.017-
Age0.6640.862
Education0.731-
Marriage0.6550.163
Dimension 3
Respondents’ identity0.8410.010
Gender0.002-
Age0.6520.916
Education0.533-
Marriage0.2500.110
Dimension 4
Respondents’ identity0.7970.143
Gender0.019-
Age0.5940.789
Education0.785-
Marriage0.2470.614
Dimension 5
Respondents’ identity0.0040.290
Gender0.007-
Age0.4700.070
Education0.677-
Marriage0.6610.159
Dimension 6
Respondents’ identity0.1270.226
Gender0.003-
Age0.1790.584
Education0.605-
Marriage0.7620.732
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, J.-J.; Wu, C.-L.; Lee, M.-H.; Huang, C.-C.; Huang, Y.-J.; Hsu, P.-S. Perception Disparity of Telemedicine Use between Outpatients and Medical Staff during the COVID-19 Pandemic. Healthcare 2022, 10, 1965. https://doi.org/10.3390/healthcare10101965

AMA Style

Wu J-J, Wu C-L, Lee M-H, Huang C-C, Huang Y-J, Hsu P-S. Perception Disparity of Telemedicine Use between Outpatients and Medical Staff during the COVID-19 Pandemic. Healthcare. 2022; 10(10):1965. https://doi.org/10.3390/healthcare10101965

Chicago/Turabian Style

Wu, Jia-Jyun, Chieh-Liang Wu, Meng-Hsun Lee, Chieh-Chung Huang, Yi-Jhen Huang, and Pi-Shan Hsu. 2022. "Perception Disparity of Telemedicine Use between Outpatients and Medical Staff during the COVID-19 Pandemic" Healthcare 10, no. 10: 1965. https://doi.org/10.3390/healthcare10101965

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop