Next Article in Journal
Selection of Filovirus Isolates for Vaccine Development Programs
Previous Article in Journal
Decrease of Pneumococcal Community-Acquired Pneumonia Hospitalization and Associated Complications in Children after the Implementation of the 13-Valent Pneumococcal Conjugate Vaccine (PCV13) in Taiwan
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Changes in Mental Health and Preventive Behaviors before and after COVID-19 Vaccination: A Propensity Score Matching (PSM) Study

1
School of Public Health (Shenzhen), Shenzhen Campus of Sun Yat-sen University, Shenzhen 518107, China
2
Guangzhou Center for Disease Control and Prevention, Guangzhou 510440, China
3
Key Laboratory of Tropical Disease Control (Sun Yat-sen University), Ministry of Education, Guangzhou 510080, China
*
Authors to whom correspondence should be addressed.
Equal contribution as first author.
Vaccines 2021, 9(9), 1044; https://doi.org/10.3390/vaccines9091044
Submission received: 18 August 2021 / Revised: 16 September 2021 / Accepted: 16 September 2021 / Published: 19 September 2021

Abstract

:
Mass vaccination against the COVID-19 pandemic is ongoing worldwide to achieve herd immunity among the general population. However, little is known about how the COVID-19 vaccination would affect mental health and preventive behaviors toward the COVID-19 pandemic. In this study, we conducted a cross-sectional survey to address this issue among 4244 individuals at several COVID-19 vaccination sites in Guangzhou, China. Using univariate analysis and multiple linear regression models, we found that major demographic characteristics, such as biological sex, age, education level, and family per capita income, are the dominant influencing factors associated with health beliefs, mental health, and preventive behaviors. After propensity score matching (PSM) treatment, we further assessed the changes in the scores of health belief, mental health, and preventive behaviors between the pre-vaccination group and the post-vaccination group. When compared to individuals in the pre-vaccination group, a moderate but statistically significant lower score was observed in the post-vaccination group (p = 0.010), implying possibly improved psychological conditions after COVID-19 vaccination. In addition, there was also a moderate but statistically higher score of preventive behaviors in the post-vaccination group than in the pre-vaccination group (p < 0.001), suggesting a higher probability to take preventive measures after COVID-19 vaccination. These findings have implications for implementing non-pharmaceutical interventions combined with mass vaccination to control the rebound of COVID-19 outbreaks.

1. Introduction

Coronavirus disease 2019 (COVID-19) continues to spread worldwide, and the emergence of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants further brings new challenges in the prevention and control of the global pandemic [1,2]. Although this pandemic has been effectively controlled by non-pharmaceutical interventions (NPIs), including social isolation, mask use, and case isolation in China [3], it remains extremely vulnerable to imported SARS-CoV-2 transmission [4,5]. Mass vaccination against SARS-CoV-2 infection is thought as the most cost-effective strategy to establish a herd immunity barrier and eventually stop this pandemic. So far, more than 17 kinds of COVID-19 vaccines have been approved for clinical use [6].
As of 12 September 2021, more than 2.14 billion doses of COVID-19 vaccine had been administrated in China [6]. Currently, several COVID-19 vaccines have been approved for clinical use [7], but the long-term surveillance of their safety should be further studied, especially among vulnerable populations with medical conditions. In addition, it is known that the effectiveness of current COVID-19 vaccines might not be 100% [8,9], and it will be further compromised as the SARS-CoV-2 variants facilitate the immune escape from the current COVID-19 vaccines [10]. Thus, we should pay attention to the breakthrough infections after vaccination in recent real-world evidence [11,12,13,14]. A noteworthy issue is that the daily preventive behaviors of the general population might change after vaccination [15]. The maintenance of NPIs is necessary to prevent the rebound of the COVID-19 pandemic, until sufficient vaccination coverage is reached for herd immunity [4]. Thus, there is an urgent need to understand the changes in personal preventive behaviors before and after COVID-19 vaccination, which represents a top priority to adjust the prevention and control strategies with the process of mass vaccination.
Another remarkable issue is that the COVID-19 pandemic may affect the mental health status in different countries [16]. For example, clinically generalized anxiety, depressive symptoms, and poor sleep quality among the general population have been proven to be more prevalent during the COVID-19 pandemic in China [17]. However, it is not known whether the mental health status would be affected after COVID-19 vaccination. One study showed that timely HPV vaccination could effectively alleviate anxiety and depression [18], while another study indicated that HPV vaccination is not associated with physical and mental health complaints [19]. In addition, influenza vaccine had a greater negative effect on patients with depression and anxiety than on mentally healthy individuals [20]. Consequently, it is of great significance to investigate how this mass vaccination against COVID-19 would have an impact on mental health among the general population.
In the present study, we conducted a cross-sectional survey to evaluate the effects of COVID-19 vaccination on preventive behaviors and mental health status among the general population in Guangzhou, China. This work will provide insights into adjusting the corresponding strategies for further vaccination promotion and will be helpful to guide appropriate behaviors against COVID-19 during and after mass vaccination.

2. Materials and Methods

2.1. Study Design and Participants

This investigation was a cross-sectional study and conducted in a population of 18 to 80 year-olds in Guangzhou, the capital of Guangdong Province in China, from 14 April to 18 May 2021. Convenience sampling was used to collect respondents from four different vaccination sites randomly selected in four districts of Guangzhou. Assuming the proportion of the COVID-19 vaccination coverage rate as 50%, 1067 subjects were required based on the formula N = [Z21−α × (p) × (1 − p)]/d2, with a precision level of 0.03. We increased 20% subjects for possible real-world differences, and therefore a minimum of 1280 participants were required. We set up an electronic questionnaire on the website www.wjx.cn, (accessed on 14 April 2021) an online survey platform, and generated a quick response (QR) code for participants to scan and fill in at the vaccination sites. The inclusion criteria were (1) 18 to 80 year-olds (2) willing to participate in this survey. People with comprehension deficits were excluded.

2.2. Survey Tools

The questionnaire used in this survey consists of four sections: (1) demographic characteristics, including biological sex (male or female), age, education level, family monthly per capita income, frequency of domestic and foreign business trips, and influenza vaccination status; (2) health belief model (HBM) scale; (3) questions evaluating the participants’ mental health status; and (4) items regarding preventive behaviors against COVID-19. The questionnaire is provided in Supplementary Materials.
The HBM scale was previously used to evaluate people’s health beliefs and attitudes toward seasonal influenza vaccination [21], as well as to predict the acceptance of COVID-19 vaccination [22,23,24]. In this study, we modified the HBM scale to evaluate the health beliefs of vaccinated individuals. The HBM scale was adapted from above-mentioned literatures [21,22,23] and contained five dimensions: perceived the susceptibility of COVID-19 (four items), perceived the severity of COVID-19 (five items), perceived the benefits of receiving the COVID-19 vaccine (three items), perceived obstacles to access the vaccine (three items), and motivation to get vaccination (three items). The participants were asked how they agreed or disagreed with each statement, and a 5-point Likert scale was used to score each item, from strongly disagree (1 point) to strongly agree (5 points). Except for perceived obstacles to access the vaccine, which was reverse scoring to improve credibility, all other items were forward scoring. That is, higher scores indicated a greater health belief.
We assessed the mental health status using the adapted PHQ scale [25], which is a widely used assessment tool for self-reported depression. This scale reflects people’s attitudes toward the COVID-19 pandemic and symptoms, as well as their mood, sleep, and attention symptoms in the past month. The daily preventive behaviors against COVID-19 were measured via a modified 9-item scale developed by previous studies [23,26]. The participants were asked about their daily use of masks, hand washing and disinfection, and social distancing. Both the mental health scale and the preventive behavior scale were scored using a 5-point Likert scoring method, from strongly disagree (1 point) to strongly agree (5 points). Higher scores represented worse psychological conditions or a higher probability to take preventive measures against COVID-19. Considering that the above three scales were modified in this study, we used confirmatory factor analysis to evaluate the reliability and validity of these scales (Supplementary Table S1).

2.3. Definition of Subgroups

The demographic variables in this study were the following factors: biological sex (male or female), education level (junior high school or below, high school, bachelor, master or above), family monthly per capita income (RMB <5000, RMB 5000–10,000, RMB 10,001–15,000, RMB >15,000), health condition (very good, good, general, poor, very poor), influenza vaccination history in the past 3 years (no vaccination, irregular vaccination, regular vaccination), domestic business trip frequency (at least twice a month, once a month, once every 3 months, once every 6 months), and first shot time of COVID-19 vaccine (waiting to receive the first shot or just vaccinated, 2 weeks ago, 1 month ago, 3 months ago, 6 months ago). Previous studies have indicated that changes in psychological and behavioral performance usually occur after a period of vaccination [27,28,29,30]. As a result, the control group (pre-vaccination) was defined as those who were waiting to receive the first shot or were just vaccinated, while those who had been vaccinated more than 2 weeks were defined as the vaccine treatment group (post-vaccination) in our study.

2.4. Data Analysis

To ensure that our questionnaires were credible, we cleaned the data using the following procedures: (1) removed those who did not complete the baseline characteristics (such as age and biological sex) in the questionnaire, (2) excluded those who answered the quality control question incorrectly or filled in the scales incompletely, and (3) excluded those who less than 180 s or more than 3600 s to answer. Cronbach’s α coefficient was used to judge the reliability of the questionnaires. The goodness-of-fit indices, including the root mean square error of approximation (RMSEA), comparative fit index (CFI), and Tucker–Lewis index (TLI), were used to judge the suitability of models. Frequency was used as an indicator to describe categorical variables in general demographic characteristics, while the discrete variables were described by median (M) and percentile values (Q1: 25th, Q3: 75th). Differences in individual baseline characteristics were compared using the non-parametric Mann–Whitney U test or the Kruskal–Wallis H test. Multiple linear regression analyses were applied to test the associations of potential explanatory variables with health beliefs, psychological conditions, and preventive behaviors.
Propensity score matching (PSM) is a strategy to reduce the selection bias in observational studies and offers a solution to achieve balanced groups by matching treatment and a series of baseline characteristics as control units [31]. The pre-vaccination group and the post-vaccination group were paired 1:1 based on the propensity scores using the nearest-neighbor matching method. The standardized mean difference (SMD < 0.10 indicated a negligible difference between the groups) and p-value were both used as criteria. Then, single-factor analyses were used to compare the differences in scores for the above-mentioned three scales (HBM scale, mental health scale, and preventive behavior scale) between the two groups. Statistical analyses were performed using SPSS 25.0 (IBM Corporation, New York, NY, USA) and Stata version 16.0 (College Station, TX, USA), and the difference was statistically significant at p < 0.050.

3. Results

3.1. Participant Characteristics

A total of 4244 respondents were recruited in this survey. After data cleaning, we obtained 4086 valid questionnaires, and the questionnaire recovery rate was 96.3%. As shown in Table 1, before grouping, 54.0% of the participants were male, more than half of participants had a bachelor’s degree or above, 40.0% had a family monthly per capita income of RMB <5000, and 36.0% had a monthly income of RMB 5000–10,000. In addition, 94.0% of the participants had not received an influenza vaccine in the past 3 years. Only a small proportion of participants had often gone on a business trip in the past year. Among the 4086 valid participants, 2232 were assigned to the pre-vaccination group and 1854 were assigned to the post-vaccination group according to criteria defined in the Materials and Methods section (Figure 1).

3.2. Associations between Demographic Characteristics with Health Belief, Mental Health, and Preventive Behavior before PSM Treatment

The associations between demographic characteristics and the scores of the HBM scale, mental health scale, and preventive behavior scale are represented in Table 2. Statistical differences were found in the scores of the HBM scale and preventive behavior scale among biological sex, education level, family income, and domestic business trip frequency (p < 0.050). The score of the mental health scale between males and females were not different (p = 0.085), but statistical differences were found among people with different education levels and family incomes. Interestingly, the influenza vaccination history had no impact on the above three scales. The scores of the mental health scale had no difference with the frequency of domestic business trips (p = 0.132), but significant differences were found with the frequency of overseas business trips (p < 0.001). No difference was found in the scores of the HBM and preventive behavior scales between the pre-vaccination group and the post-vaccination group (p = 0.643 and p = 0.500, respectively), but the score of the mental health scale in the post-vaccination group was higher than that in the pre-vaccination group (p = 0.003).
Multiple linear regression showed that biological sex, education level, and family income are associated with the score of the HBM scale, while the mental health scale score was associated with age, education level, family income, and vaccination time. In addition, the factors influencing behavior change were age, education level, family income, and vaccination time (Supplementary Table S2).

3.3. PSM Treatment to Balance the Participant Characteristics between Pre-Vaccination and Post-Vaccination Groups

The distribution of demographic characteristic between the pre-vaccination group (n = 2232) and the post-vaccination group (n = 1854) is shown in Table 3. Before PSM treatment, there were significant differences among the following factors: biological sex, age, education level, and family income (p < 0.050). After PSM treatment, the pre-vaccination group and the post-vaccination group were paired 1:1, as described in the Materials and Methods section. As a result, there were demographic-characteristic-matched participants in the pre-vaccination group (n = 1680) and the post-vaccination group (n = 1680) after PSM treatment (Figure 1), and the differences in the above-mentioned demographic characteristics disappeared between these two groups (SMD < 0.1, p > 0.050; Table 3).

3.4. Analysis of Health Belief, Mental Health, and Preventive Behavior between the Pre-Vaccination and Post-Vaccination Groups after PSM Treatment

After PSM treatment, there was slightly difference in the HBM scale score between the pre-vaccination and post-vaccination groups (62 (57, 66) vs. 61 (56, 65), p = 0.018), and the scores of perceived susceptibility and perceived barriers in the HBM scale were also statistically different between the two groups (p < 0.001). Of note, the mental health score of the pre-vaccination group (27 (23, 30)) was higher than that of the post-vaccination group (26 (22, 29), p = 0.010; Table 4), implying possibly improved psychological conditions after COVID-19 vaccination. Moreover, the scores of the preventive behavior scale in the post-vaccination group were slightly higher than those in the pre-vaccination group (36 (35, 41) vs. 36 (34, 40), p < 0.001; Table 4), suggesting a higher probability to take preventive measures after COVID-19 vaccination.

4. Discussion

Previous studies have generally used the HBM as an independent or intermediate variable to identify the influencing factors and clues of health behavior adoption [32,33,34]. In this study, we used the HBM as an outcome variable to investigate whether health beliefs would change following COVID-19 vaccination. We aimed to explore the potential differences of HBM items between pre-vaccination and post-vaccination populations, including how they understand the severity and susceptibility of SARS-CoV-2 infection, how they understand the efficacy of COVID-19 vaccination, and what obstacles they encounter in getting vaccination. In our study, a moderate but statistically significant difference was found between the post-vaccination group and the pre-vaccination group, even after PSM treatment. These findings should be reasonable, since all participants in this study were either waiting for vaccination or had been vaccinated at COVID-19 vaccination sites. Therefore, they had a willingness to be vaccinated against COVID-19 and remained similar in health beliefs toward COVID-19. Among the items of the HBM, perceived susceptibility of COVID-19 decreased in the post-vaccination group (p < 0.001), reflecting that the participants intended to believe that COVID-19 vaccination could reduce the risk of SARS-CoV-2 infection to some extent, which was consistent with previous findings [35]. Another observation was that the scores of perceived susceptibility scores of COVID-19 were low in both pre- and post-vaccination groups, and the reason might be that the Chinese government has controlled the COVID-19 pandemic at a low level, with only sporadic cases via vigorous prevention and control policies [36,37].
Recent studies have indicated that the COVID-19 pandemic has caused a remarkably negative effect on mental health among the general population [16,17]. However, another critical question of great significance is to investigate how COVID-19 vaccination may influence the negative status of mental health toward the COVID-19 pandemic. Therefore, we planned to address this issue by our adaption scale of mental health. Interestingly, the scores of mental health status in our study were all at a low level before and after vaccination, suggesting that there is a relatively healthy mental status among the general population toward the COVID-19 pandemic in China when compared to other countries [38,39]. This might be partly attributed to the impressive controlling performance against the COVID-19 pandemic by the Chinese government, and the participants were less worried about SARS-CoV-2 infection. As a result, a highly trusted government would be a powerful measure to promote mental health among the general population. This observation may give governments and health authorities some important implications to enhance public credibility.
After PSM treatment, there was a moderate but statistically significant lower score of anxiety and depression symptoms in the post-vaccination group than in the pre-vaccination group (p = 0.010), demonstrating potentially improved mental health to defeat COVID-19 after vaccination. These findings were consistent with a study, which showed that HPV vaccination might relieve the anxiety and depression of vaccinated individuals [19]. Thus, our data indicated that the COVID-19 vaccine could not only prevent SARS-CoV-2 infection but also reduce the fear of the COVID-19 pandemic and improve the mental health status of vaccinated individuals.
With the process of mass vaccination, one concern was that the daily preventive behaviors against COVID-19 may be reduced among the general population. To our surprise, compared with the pre-vaccination group, participants in the post-vaccination group had a mildly higher frequency to follow preventive behaviors, including wearing a mask and following social distancing. One possible explanation is that the participants received good health education during the COVID-19 vaccination. In addition, the preventive behaviors in the early phase of the pandemic had been transformed into personal habits and awareness, and the continually mandatory mask wearing and social distancing in public places also facilitated strengthening of the daily preventive behaviors among the general population [40]. However, a stochastic dynamic model study previously suggested that a relaxation of NPIs would raise the reproduction number (Rt) value of SARS-CoV-2 back to 1.5, leading to sustained epidemic growth [4]. Thus, to eventually conquer this pandemic, the persistent promotion of preventive measures is still necessary in the future.
Our study had some limitations. First, the effectiveness of cross-sectional studies in examining causality is limited, and therefore further time sequence studies are needed to verify the reliability of these results. Second, the convenient sampling method and the limited number of vaccinations on-site may reduce the sample representativeness in this study. The participants in our investigation were mostly living in Guangzhou, which has a high population density (2059 people per square kilometer [41]) and the vaccination coverage exceeded 70% among the general population [42], and thus the conclusions may not be generalized to other regions.

5. Conclusions

In summary, to the best of our knowledge, this is the first study to report how the mental health and preventive behaviors toward COVID-19 would be affected after COVID-19 vaccination. We found a slightly greater awareness of preventive behaviors and a mildly better mental health status among participants in the post-vaccination group than in the pre-vaccination group. Thus, in addition to the direct effect on disease prevention, we suggest that attention should be paid to the benefit of COVID-19 vaccination on mental health improvement for the subsequent promotion of mass vaccination. In addition, given that this pandemic might exist for quite a long time, governments should combine NPIs with mass vaccination together to control the rebound of COVID-19 outbreaks.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/vaccines9091044/s1: Table S1. Reliability and confirmatory analysis values regarding to study measures; Table S2. Factors associated with the score of scales by multivariate linear regression; the questionnaire.

Author Contributions

Y.Y., and Z.D. are joint first authors. C.S. conceived and designed this project; Y.Y., Z.D., M.C., D.Y., and Y.L. performed this project and analyzed the data; J.Z., Y.L., X.L., and C.Z. contributed the resources and discussion; Y.Y., Z.D., M.C., and D.Y. drafted the manuscript; and C.S., X.L., J.Z., and H.Z. revised and edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by grants from the National Natural Science Foundation of China (81971927) and the Science and Technology Planning Project of Shenzhen City (JSGG20200225152008136, 20190804095916056). All funding parties did not have any role in the design of the study or in the explanation of the data.

Institutional Review Board Statement

This study was approved by the ethics committee of the School of Public Health (Shenzhen), Sun Yat-sen University (approval No. SYSU-PHS-IACUC-2021-034).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are not openly available due to being human data and are available from the corresponding author upon reasonable request.

Acknowledgments

We thank all members for carefully reading and commenting on the manuscript. We thank staff members at disease control institutions, hospitals, and health administrations across Guangzhou for providing us with approval and assistance to collect questionnaires on vaccination sites. We are grateful to all participants for taking part in this investigation.

Conflicts of Interest

The authors declare that they have no competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Davies, N.G.; Abbott, S.; Barnard, R.C.; Jarvis, C.I.; Kucharski, A.J.; Munday, J.D.; Pearson, C.A.B.; Russell, T.W.; Tully, D.C.; Washburne, A.D.; et al. Estimated transmissibility and impact of SARS-CoV-2 lineage B.1.1.7 in England. Science 2021, 372, eabg3055. [Google Scholar] [CrossRef]
  2. Campbell, F.; Archer, B.; Laurenson-Schafer, H.; Jinnai, Y.; Konings, F.; Batra, N.; Pavlin, B.; Vandemaele, K.; Van Kerkhove, M.D.; Jombart, T.; et al. Increased transmissibility and global spread of SARS-CoV-2 variants of concern as at June 2021. Eurosurveillance 2021, 26, 2100509. [Google Scholar] [CrossRef]
  3. Lai, S.; Ruktanonchai, N.W.; Zhou, L.; Prosper, O.; Luo, W.; Floyd, J.R.; Wesolowski, A.; Santillana, M.; Zhang, C.; Du, X.; et al. Effect of non-pharmaceutical interventions to contain COVID-19 in China. Nature 2020, 585, 410–413. [Google Scholar] [CrossRef] [PubMed]
  4. Yang, J.; Marziano, V.; Deng, X.; Guzzetta, G.; Zhang, J.; Trentini, F.; Cai, J.; Poletti, P.; Zheng, W.; Wang, W.; et al. Despite vaccination, China needs non-pharmaceutical interventions to prevent widespread outbreaks of COVID-19 in 2021. Nat. Hum. Behav. 2021, 5, 1009–1020. [Google Scholar] [CrossRef] [PubMed]
  5. Government Council. Press Conference of the Joint Prevention and Control Mechanism of the State Council. Available online: http://www.gov.cn/xinwen/gwylflkjz160/index.htm (accessed on 21 June 2021). (In Chinese)
  6. Hannah Ritchie, E.O.-O.; Beltekian, D.; Mathieu, E.; Hasell, J.; Macdonald, B.; Giattino, C.; Appel, C.; Rodés-Guirao, L.; Roser, M. Coronavirus (COVID-19) Vaccinations. Available online: https://ourworldindata.org/covid-vaccinations (accessed on 12 September 2021).
  7. Chen, M.; Yuan, Y.; Zhou, Y.; Deng, Z.; Zhao, J.; Feng, F.; Zou, H.; Sun, C. Safety of SARS-CoV-2 vaccines: A systematic review and meta-analysis of randomized controlled trials. Infect. Dis. Poverty 2021, 10, 94. [Google Scholar] [CrossRef] [PubMed]
  8. Sheikh, A.; McMenamin, J.; Taylor, B.; Robertson, C. SARS-CoV-2 Delta VOC in Scotland: Demographics, risk of hospital admission, and vaccine effectiveness. Lancet 2021, 397, 2461–2462. [Google Scholar] [CrossRef]
  9. Simpson, C.R.; Shi, T.; Vasileiou, E.; Katikireddi, S.V.; Kerr, S.; Moore, E.; McCowan, C.; Agrawal, U.; Shah, S.A.; Ritchie, L.D.; et al. First-dose ChAdOx1 and BNT162b2 COVID-19 vaccines and thrombocytopenic, thromboembolic and hemorrhagic events in Scotland. Nat. Med. 2021, 27, 1–8. [Google Scholar] [CrossRef]
  10. Wang, R.; Zhang, Q.; Ge, J.; Ren, W.; Zhang, R.; Lan, J.; Ju, B.; Su, B.; Yu, F.; Chen, P.; et al. Analysis of SARS-CoV-2 variant mutations reveals neutralization escape mechanisms and the ability to use ACE2 receptors from additional species. Immunity 2021, 54, 1611–1621. [Google Scholar] [CrossRef]
  11. Dagan, N.; Barda, N.; Kepten, E.; Miron, O.; Perchik, S.; Katz, M.A.; Hernán, M.A.; Lipsitch, M.; Reis, B.; Balicer, R.D. BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Mass Vaccination Setting. N. Engl. J. Med. 2021, 384, 1412–1423. [Google Scholar] [CrossRef]
  12. Chemaitelly, H.; Yassine, H.M.; Benslimane, F.M.; Al Khatib, H.A.; Tang, P.; Hasan, M.R.; Malek, J.A.; Coyle, P.; Ayoub, H.H.; Al Kanaani, Z.; et al. mRNA-1273 COVID-19 vaccine effectiveness against the B.1.1.7 and B.1.351 variants and severe COVID-19 disease in Qatar. Nat. Med. 2021, 27, 1614–1621. [Google Scholar] [CrossRef]
  13. Chodick, G.; Tene, L.; Rotem, R.S.; Patalon, T.; Gazit, S.; Ben-Tov, A.; Weil, C.; Goldshtein, I.; Twig, G.; Cohen, D.; et al. The effectiveness of the TWO-DOSE BNT162b2 vaccine: Analysis of real-world data. Clin. Infect. Dis. 2021. [Google Scholar] [CrossRef] [PubMed]
  14. Bergwerk, M.; Gonen, T.; Lustig, Y.; Amit, S.; Lipsitch, M.; Cohen, C.; Mandelboim, M.; Levin, E.G.; Rubin, C.; Indenbaum, V.; et al. Covid-19 Breakthrough Infections in Vaccinated Health Care Workers. N. Engl. J. Med. 2021. [Google Scholar] [CrossRef]
  15. Tam, C.C.; Li, X.; Li, X.; Wang, Y.; Lin, D. Adherence to preventive behaviors among college students during COVID-19 pandemic in China: The role of health beliefs and COVID-19 stressors. Curr. Psychol. 2021, 11. [Google Scholar] [CrossRef]
  16. Nochaiwong, S.; Ruengorn, C.; Thavorn, K.; Hutton, B.; Awiphan, R.; Phosuya, C.; Ruanta, Y.; Wongpakaran, N.; Wongpakaran, T. Global prevalence of mental health issues among the general population during the coronavirus disease-2019 pandemic: A systematic review and meta-analysis. Sci. Rep. 2021, 11, 10173. [Google Scholar] [CrossRef] [PubMed]
  17. Huang, Y.; Zhao, N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: A web-based cross-sectional survey. Psychiatry Res. 2020, 288, 112954. [Google Scholar] [CrossRef] [PubMed]
  18. Xia Juntao, W.X. Effect of HPV vaccination on psyche and quality of life of patients with HPV infection. Chin. J. Woman Child Health Res. 2020, 31, 399–403. (In Chinese) [Google Scholar]
  19. Gazibara, T.; Thygesen, L.C.; Algren, M.H.; Tolstrup, J.S. Human Papillomavirus Vaccination and Physical and Mental Health Complaints among Female Students in Secondary Education Institutions in Denmark. J. Gen. Intern. Med. 2020, 35, 2647–2654. [Google Scholar] [CrossRef] [PubMed]
  20. Harper, J.A.; South, C.; Trivedi, M.H.; Toups, M.S. Pilot investigation into the sickness response to influenza vaccination in adults: Effect of depression and anxiety. Gen. Hosp. Psychiatry 2017, 48, 56–61. [Google Scholar] [CrossRef]
  21. Santos, A.J.; Kislaya, I.; Machado, A.; Nunes, B. Beliefs and attitudes towards the influenza vaccine in high-risk individuals. Epidemiol. Infect. 2017, 145, 1786–1796. [Google Scholar] [CrossRef] [Green Version]
  22. Wong, M.C.S.; Wong, E.L.Y.; Huang, J.; Cheung, A.W.L.; Law, K.; Chong, M.K.C.; Ng, R.W.Y.; Lai, C.K.C.; Boon, S.S.; Lau, J.T.F.; et al. Acceptance of the COVID-19 vaccine based on the health belief model: A population-based survey in Hong Kong. Vaccine 2021, 39, 1148–1156. [Google Scholar] [CrossRef]
  23. Shahnazi, H.; Ahmadi-Livani, M.; Pahlavanzadeh, B.; Rajabi, A.; Hamrah, M.S.; Charkazi, A. Assessing preventive health behaviors from COVID-19: A cross sectional study with health belief model in Golestan Province, Northern of Iran. Infect. Dis. Poverty 2020, 9, 157. [Google Scholar] [CrossRef]
  24. Chen, M.; Li, Y.; Chen, J.; Wen, Z.; Feng, F.; Zou, H.; Fu, C.; Chen, L.; Shu, Y.; Sun, C. An online survey of the attitude and willingness of Chinese adults to receive COVID-19 vaccination. Hum. Vaccin. Immunother. 2021, 17, 2279–2288. [Google Scholar] [CrossRef]
  25. Hirschtritt, M.E.; Kroenke, K. Screening for Depression. JAMA 2017, 318, 745–746. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Mercadante, A.R.; Law, A.V. Will they, or Won’t they? Examining patients’ vaccine intention for flu and COVID-19 using the Health Belief Model. Res. Soc. Adm. Pharm. 2020, 17, 1596–1605. [Google Scholar] [CrossRef]
  27. Scholz, U. It’s Time to Think about Time in Health Psychology. Appl. Psychol. Health Well Being 2019, 11, 173–186. [Google Scholar] [CrossRef]
  28. Inauen, J.; Bolger, N.; Shrout, P.E.; Stadler, G.; Amrein, M.; Rackow, P.; Scholz, U. Using Smartphone-Based Support Groups to Promote Healthy Eating in Daily Life: A Randomised Trial. Appl. Psychol. Health Well Being 2017, 9, 303–323. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Gomes, A.C.R.; Cardoso, G.C. The lag-time constraint for behavioural plasticity. Proc. Biol. Sci. 2020, 287, 20200525. [Google Scholar] [CrossRef] [PubMed]
  30. Morsky, B.; Akçay, E. Evolution of social norms and correlated equilibria. Proc. Natl. Acad. Sci. USA 2019, 116, 8834–8839. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Borah, B.J.; Moriarty, J.P.; Crown, W.H.; Doshi, J.A. Application of propensity score methods in observational studies. Chin. J. Evid.-Based Med. 2021, 21, 469–474. (In Chinese) [Google Scholar]
  32. Wong, L.P.; Alias, H.; Wong, P.F.; Lee, H.Y.; AbuBakar, S. The use of the health belief model to assess predictors of intent to receive the COVID-19 vaccine and willingness to pay. Hum. Vaccin. Immunother. 2020, 16, 2204–2214. [Google Scholar] [CrossRef]
  33. Lin, Y.; Hu, Z.; Zhao, Q.; Alias, H.; Danaee, M.; Wong, L.P. Understanding COVID-19 vaccine demand and hesitancy: A nationwide online survey in China. PLoS Negl. Trop. Dis. 2020, 14, e0008961. [Google Scholar] [CrossRef] [PubMed]
  34. Janz, N.K.; Becker, M.H. The Health Belief Model: A decade later. Health Educ. Q. 1984, 11, 1–47. [Google Scholar] [CrossRef] [Green Version]
  35. Zhang, K.C.; Fang, Y.; Cao, H.; Chen, H.; Hu, T.; Chen, Y.; Zhou, X.; Wang, Z. Behavioral Intention to Receive a COVID-19 Vaccination Among Chinese Factory Workers: Cross-sectional Online Survey. J. Med. Internet Res. 2021, 23, e24673. [Google Scholar] [CrossRef]
  36. Saeed, H.; Osama, H.; Madney, Y.M.; Harb, H.S.; Abdelrahman, M.A.; Ehrhardt, C.; Abdelrahim, M.E.A. COVID-19; current situation and recommended interventions. Int. J. Clin. Pract. 2021, 75, e13886. [Google Scholar] [CrossRef]
  37. Wu, J.; Wang, J.; Nicholas, S.; Maitland, E.; Fan, Q. Application of Big Data Technology for COVID-19 Prevention and Control in China: Lessons and Recommendations. J. Med. Internet Res. 2020, 22, e21980. [Google Scholar] [CrossRef]
  38. Goularte, J.F.; Serafim, S.D.; Colombo, R.; Hogg, B.; Caldieraro, M.A.; Rosa, A.R. COVID-19 and mental health in Brazil: Psychiatric symptoms in the general population. J. Psychiatr. Res. 2021, 132, 32–37. [Google Scholar] [CrossRef]
  39. Ames-Guerrero, R.J.; Barreda-Parra, V.A.; Huamani-Cahua, J.C.; Banaszak-Holl, J. Self-reported psychological problems and coping strategies: A web-based study in Peruvian population during COVID-19 pandemic. BMC Psychiatry 2021, 21, 351. [Google Scholar] [CrossRef] [PubMed]
  40. Zhang, W.-W.; Dawei, W.; Majeed, M.T.; Sohail, S. COVID-19 and international trade: Insights and policy challenges in China and USA. Econ. Res.-Ekonomska Istrazivanja 2021. accepted. [Google Scholar] [CrossRef]
  41. Guangzhou Statistics Bureau. Administrative Division. Available online: http://tjj.gz.gov.cn/gzsq/content/post_2786710.html (accessed on 16 April 2021). (In Chinese)
  42. Liu, L. The Vaccination Coverage Rate of the Target Population of Suishen Buddha Is More Than 70%. Available online: https://m.gmw.cn/baijia/2021-06/03/1302337056.html (accessed on 21 June 2021). (In Chinese).
Figure 1. Flowchart of questionnaire collecting and data processing in this study.
Figure 1. Flowchart of questionnaire collecting and data processing in this study.
Vaccines 09 01044 g001
Table 1. Demographics characteristics of all samples involved in this survey (n = 4086).
Table 1. Demographics characteristics of all samples involved in this survey (n = 4086).
DemographicsN (%) or Mean (SD)
Biological sex
Male2236 (54.7%)
Female1850 (45.3%)
Age34.23 (10.48)
Education
Junior high school or below655 (16.0%)
High school degree952 (23.3%)
Bachelor’s degree2243 (54.9%)
Master’s degree or above236 (5.8%)
Family monthly per capita income
RMB <50001616 (39.5%)
RMB 5000–10,0001491 (36.5%)
RMB 10,001–15,000507 (12.4%)
RMB >15,000472 (11.6%)
Health condition
Very good2588 (63.3%)
Good1295 (31.7%)
Average203 (5.0%)
Influenza vaccination status (nearly 3 years)
No vaccination3853 (94.3%)
Vaccination, discontinuous194 (4.7%)
Vaccination, continuous39 (1.0%)
Domestic business trip frequency
At least twice a month120 (2.9%)
About once a month187 (4.6%)
About once every 3 months295 (7.2%)
About once every 6 months526 (12.9%)
Barely2958 (72.4%)
Foreign business trip frequency
At least once every 3 months7 (0.2%)
About once every 6 months15 (0.4%)
About once a year27 (0.7%)
Barely4037 (98.8%)
Table 2. Univariate analysis based on the HBM scale, mental health scale, and preventive behavior scale scores before PSM treatment.
Table 2. Univariate analysis based on the HBM scale, mental health scale, and preventive behavior scale scores before PSM treatment.
DemographicsHBMMental Health Preventive Behavior
M (Q1, Q3)Zp-ValueM (Q1, Q3)Zp-ValueM (Q1, Q3)Zp-Value
Biological sex
Male62 (57, 66)−2.230.02623 (20, 27)−1.72 **0.08535 (31, 36)−2.870.004
Female61 (56, 66)22 (22, 27)35 (32, 37)
Education
Junior high school or below60 (54, 64)53.39<0.00124 (21, 27)65.20 *<0.00136 (33, 36)69.75<0.010
High school degree61 (56, 66)23 (20, 27)36 (33, 37)
Bachelor’s degree62 (57, 66)22 (19, 26)34 (30, 36)
Master’s degree or above62 (58, 66)22 (19, 25)34 (30, 36)
Family monthly per capita income
RMB <500060 (56, 64)76.62<0.01023 (20, 27)38.35 *<0.00135 (32, 36)17.29<0.001
RMB 5000−10,00062 (57, 66)22 (20, 26)35 (31, 37)
RMB 10,001–15,00062 (58, 66)22 (20, 25)34 (30, 36)
RMB >15,00063 (58, 67)22 (19, 25)34 (30, 37)
Influenza vaccination status (nearly 3 years)
No vaccination61 (57, 66)1.460.48223 (20, 27)4.57 *0.10235 (31, 36)4.910.086
Vaccination, discontinuous61 (56, 65)22 (19, 26)34 (30, 36)
Vaccination, continuous61 (55, 64)24 (20, 28)35 (33, 39)
Domestic business trip frequency (nearly 1 year)
At least twice a month62 (57, 65)23.79<0.00123 (19, 27)7.08 *0.13233 (28, 36)46.50<0.001
At least once a month62 (57, 66)23 (20, 26)34 (30, 36)
At least once every 3 months63 (58, 67)22 (19, 26)34 (29, 36)
At least once every 6 months62 (58, 67)23 (20, 26)34 (31, 36)
Barely61 (56, 65)23 (20, 27)35 (32, 37)
Foreign business trip frequency (nearly 1 year)
At least once every 3 months58 (54, 69)0.920.82128 (20, 31)15.73 *<0.00138 (22, 39)0.670.879
At least once every 6 months62 (58, 67)27 (23, 30)34 (29, 36)
At least once a year59 (55, 66)24 (21, 27)34 (31, 36)
Barely61 (57, 66)23 (20, 27)35 (31, 36)
Vaccination
Pre-vaccination61 (57, 65)−0.460.64323 (20, 26)−3.01 **0.00335 (31, 36)−0.670.500
Post-vaccination62 (55, 67)24 (20, 27)36 (30, 36)
Note: * Kruskal–Wallis test; ** Mann–Whitney U test. Vaccination groups were divided into the pre-vaccination group and the post-vaccination group according to vaccination status. Abbreviations: M (Q1, Q3), median (Q1: 25th, Q2: 75th); Z, value of the non-parametric test; HBM, health belief model.
Table 3. PSM treatment to balance the participants’ characteristics between pre-vaccination and post-vaccination groups.
Table 3. PSM treatment to balance the participants’ characteristics between pre-vaccination and post-vaccination groups.
Demographic CharacteristicsBefore PSM TreatmentSMDp-ValueAfter PSM TreatmentSMDp-Value
Pre-VaccinationPost-VaccinationPre-VaccinationPost-Vaccination
n = 2232 (%)n = 1854 (%)n = 1680 (%)n = 1680 (%)
Biological sex
Male1190 (53.3)1046 (56.4)0.060.041912 (54.3)944 (56.2)0.020.508
Female1042 (46.7)808 (43.6)768 (45.7)736 (43.8)
Age32.935.80.28<0.00132.5035.250.010.822
Education
Junior high school or below286 (12.8)370 (19.9)0.28<0.001224 (13.3)330 (19.6)0.020.617
High school degree438 (19.6)514 (27.7)345 (20.5)460 (27.4)
Bachelor’s degree1372 (61.4)872 (47.0)1056 (62.9)819 (48.8)
Master’s degree or above137 (6.1)99 (5.3)55 (3.3)71 (4.2)
Family monthly per capita income
RMB <5000772 (34.6)845 (45.6)0.24<0.001682 (40.6)799 (47.6)0.010.715
RMB 5000–10,000847 (37.9)644 (34.7)651 (38.8)572 (34.0)
RMB 10,001–15,000308 (13.8)200 (10.8)196 (11.7)160 (9.5)
RMB >15,000306 (13.7)166 (8.9)151 (9.0)149 (8.9)
Note: Pearson’s chi-square. SMD, standardized mean difference.
Table 4. Analysis of health belief, mental health, and preventive behavior between the pre-vaccination and post-vaccination groups after PSM treatment.
Table 4. Analysis of health belief, mental health, and preventive behavior between the pre-vaccination and post-vaccination groups after PSM treatment.
VariableVaccination StatusZp-Value
Pre-Vaccination (n = 1680)Post-Vaccination (n = 1680)
HBM62 (57, 66)61 (56, 65)−2.370.018
Perceived susceptibility11 (8, 12)11 (8, 12)−3.27<0.001
Perceived severity22 (20, 25)21 (20, 25)−1.250.210
Perceived benefits12 (12, 15)12 (12, 15)−1.330.182
Perceived barriers12 (11, 14)13 (12, 14)−6.87<0.001
Perceived self-efficacy12 (12, 14)12 (12, 14)−3.090.002
Mental health27 (23, 30)26 (22, 29)−2.590.010
Preventive behavior36 (34, 40)36 (35, 41)−3.67<0.001
Note: Mann–Whitney U test. HBM, health belief model; Z, value of the test.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yuan, Y.; Deng, Z.; Chen, M.; Yin, D.; Zheng, J.; Liu, Y.; Liu, X.; Zou, H.; Zhang, C.; Sun, C. Changes in Mental Health and Preventive Behaviors before and after COVID-19 Vaccination: A Propensity Score Matching (PSM) Study. Vaccines 2021, 9, 1044. https://doi.org/10.3390/vaccines9091044

AMA Style

Yuan Y, Deng Z, Chen M, Yin D, Zheng J, Liu Y, Liu X, Zou H, Zhang C, Sun C. Changes in Mental Health and Preventive Behaviors before and after COVID-19 Vaccination: A Propensity Score Matching (PSM) Study. Vaccines. 2021; 9(9):1044. https://doi.org/10.3390/vaccines9091044

Chicago/Turabian Style

Yuan, Yue, Zhaomin Deng, Musha Chen, Di Yin, Jiazhen Zheng, Yajie Liu, Xinglai Liu, Huachun Zou, Chunhuan Zhang, and Caijun Sun. 2021. "Changes in Mental Health and Preventive Behaviors before and after COVID-19 Vaccination: A Propensity Score Matching (PSM) Study" Vaccines 9, no. 9: 1044. https://doi.org/10.3390/vaccines9091044

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop