Next Article in Journal
Cross-Species Transmission of Rabbit Hepatitis E Virus to Pigs and Evaluation of the Protection of a Virus-like Particle Vaccine against Rabbit Hepatitis E Virus Infection in Pigs
Previous Article in Journal
Correlates of Zero-Dose Vaccination Status among Children Aged 12–59 Months in Sub-Saharan Africa: A Multilevel Analysis of Individual and Contextual Factors
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Vaccines
Volume 10
Issue 7
10.3390/vaccines10071054
vaccines-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Factors Influencing Men’s Attitudes toward HPV Vaccination in Males Included in the Chinese National Immunization Program

by
Yi Tao
1,
Huarui Shao
2,
Ting Zhang
3,
Junliang Pu
1 and
Chengyong Tang
1,*
1
Department of Phase I Clinical Trial Ward, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400016, China
2
College of Pharmacy, Chongqing Medical University, Chongqing 400016, China
3
The First Clinical College, Chongqing Medical University, Chongqing 400016, China
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(7), 1054; https://doi.org/10.3390/vaccines10071054
Submission received: 5 May 2022 / Revised: 25 June 2022 / Accepted: 28 June 2022 / Published: 30 June 2022
Browse Figure
Review Reports Versions Notes

Abstract

:
Background: Human papillomavirus (HPV) infection is the most common sexually transmitted disease, and it is associated with anogenital warts and oropharyngeal and anogenital cancers. Among female malignant tumors in China, the incidence of cervical cancer ranks second, with only breast cancer being more prevalent. HPV infection and related diseases affects both women and men. HPV vaccination is an optimal prevention strategy in preventing HPV infection and related diseases. The inclusion of the HPV vaccine in the national immunization program is an effective way to increase immunization coverage, reduce the burden of HPV related diseases, and increase national life expectancy. Objective: This study aimed to explore the factors influencing the attitudes of Chinese men toward the inclusion of the HPV vaccine in males included in the national immunization program, thus providing reference for launching the national immunization program policy. Methods: We invited men aged 20 to 45 to participate in an online survey. The participants were requested to complete a questionnaire, including sociodemographic characteristics, sexual behavior characteristics, knowledge of HPV and the HPV vaccine, and attitudes toward the HPV vaccine. A logistic regression model was constructed to analyze the influencing factors of attitudes. Results: A total of 660 males in China participated in this survey, and 80.45% supported the inclusion of HPV vaccines in national immunization programs. Participants earning CNY 100,000–200,000 (dds ratio (OR): 0.63, 95% confidence interval (CI): 0.39–1.00) or ≥200,000 (OR: 0.34, 95% CI: 0.17–0.68) were more likely to disapprove this strategy. Compared with people without a history of HPV infection, those with a history of HPV infection (OR: 1.84, 95% CI: 1.17–2.90) were more likely to approve. Men who had better knowledge of HPV were more likely to approve than men with less knowledge about HPV (OR: 1.44, 95% CI: 1.17–1.79). Compared with participants who did not know when the HPV vaccine should be given, those who knew that the ideal time of vaccination is before an individual becomes sexually active (OR: 1.75, 95% CI: 1.04–2.95) were more likely to approve. Conclusion: One in five men did not support the inclusion of HPV vaccines in national immunization programs, and they are likely to be from higher socioeconomic background and have poor knowledge of HPV. In order to implement comprehensive immunity, targeted actions need to be taken at national and public levels. In addition, when implementing measures, more attention needs to be paid to lower income men, men without a history of HPV infection and with poor knowledge of HPV, as well as young men.

1. Introduction

Human papillomavirus (HPV) belongs to the papillomaviridae family and is a small, double-stranded DNA virus classified as either low-risk HPVs (LR-HPVs, i.e., HPV6 and 11.) or high-risk HPVs (HR-HPVs, 16/18/31/33/35/39/45/51/52/56/58/59/66/68) [1,2]. LR-HPVs are associated with anogenital warts and skin warts, and HR-HPVs have been linked to oropharyngeal cancer (of the mouth, tonsils, and throat) and anogenital cancer [2]. Among them, the most carcinogenic is HPV 16/18, which causes more than 70% of cervical cancers and a high proportion of anogenital and oropharyngeal cancers [3]. HPV is the most common sexually transmitted infection, and it is estimated that about 80% of sexually active women and men will be infected with certain HPV types during their lifetime [4].
According to the World Health Organization (WHO), cervical cancer is the fourth most common cancer among women aged 15 to 44 in the world, with 604,000 and 342,000 worldwide cases of morbidity and death, respectively, in 2020 [5,6]. Statistics show that in 2020, there were about 110,000 new cases of cervical cancer and 59,000 deaths in China [5]. In addition to cervical cancer, HPV infection is also closely related to other cancers, including anal cancer (88%), vulvar cancer (43%), vaginal cancer (70%), penile cancer (50%), and oropharyngeal cancer (37%) [2,7]. Although the current research on HPV is focused on women, men are also susceptible to HPV infection and related diseases as malignant tumors (carcinoma of the anus, penis, and vulva) and benign lesions (genital warts and anus, mouth, and throat lesions). The global prevalence of HPV infection in men ranges from 5.3% to 42.2% [8], with China reporting a figure of about 10.5% [9].
Data show that HPV infection causes about 50.1% of penile cancers, of which HPV16 is the most common pathogenic type [10]. A total of 90% of anal cancers can be attributed to HPV infection, with a higher incidence among HIV-positive men and men who have sex with men (MSM) than in the general population [11]. HPV6 and HPV11 were associated with 90.0% of genital warts incidence [12] and 30% of oropharyngeal cancers are associated with HPV, with a four to five times higher incidence in men than in women [13].
The optimal prevention strategy for HPV infection is vaccination [14]. There are currently three licensed HPV vaccines (4-valent, 2-valent, and 9-valent) [15]. China has two domestically produced HPV vaccines and one bivalent vaccine (China) undergoing WHO prequalification. Global clinical studies have demonstrated that 4-valent and 9-valent HPV vaccines provide good protective effects in the male population [16,17,18,19] and both women and men vaccinated against HPV will contribute to the production of herd immunity effects [20]. According to statistics, HPV vaccination can prevent HPV-related cancers [12], including nearly 90% of cervical cancers, 22.8% of vulvar cancers, 24.5% of penile cancers, 66.7% of vaginal cancers, 79.0% of anal cancers, 21.3% of oropharyngeal cancers, 4.0% of oral cancers, and 2.7% of laryngeal cancers in the world [21]. HPV vaccines have been approved for male vaccination in many countries [22] but not in China. A previous study found that extending HPV vaccination to men is cost-effective and could further reduce the burden of HPV-related diseases for both sexes [23,24,25]. The Advisory Committee on Immunization Practices (ACIP) recommended that HPV vaccination be administered preferentially for men aged 13 to 21 who have not been vaccinated before, as well as for men who have sex with men and those who are immunocompromised [22]. By October 2020, 110 countries had included or partially included HPV vaccines in their national immunization programs [26], in which five countries with immunization coverage were as high as 90% [27]. At present, 11 vaccines are included in China’s national immunization program, including the hepatitis B vaccine, BCG vaccine, polio vaccine, DTP vaccine, etc. By vaccinating with the above 11 vaccines, 12 infectious diseases, such as hepatitis B, can be prevented.
At present, HPV vaccines are being evaluated in Chinese men as part of clinical trials. It is likely that the HPV vaccine will be licensed for use in males in China. The inclusion of the HPV vaccine in national immunization program is an effective way to increase immunization coverage, reducing the burden of disease, and increasing national life expectancy. In this study, we explored factors influencing the attitudes of Chinese men toward the HPV vaccine in males included in the national immunization program, thus providing reference for launching the national immunization program policy.

2. Methods

2.1. Study Design

Between 1 September and 30 November 2021, 678 men were recruited using a non-probability sampling method through WeChat in a phase I clinical trial ward of the first affiliated hospital of Chongqing medical university. A phase I clinical trial ward mainly conducts phase I clinical trials; thus, the participants were generally healthy people. There was a link to the survey website in the tweet, which was tweeted every 10 days from the ward’s WeChat account (most people who follow this account are healthy volunteers). In this way, men were invited to participate in an online survey to assess their attitudes toward the HPV vaccine for males included in the national immunization program. Detailed recruitment and study procedures were described in the tweet. All the participants were informed that the questionnaires would be answered anonymously, and participation in this study was voluntary. They were assured that their information would only be used for this study, and the answers of their questionnaires would have no influence on their career. To be eligible, participants needed to: (1) be aged 20 to 45; (2) be male (i.e., male sex at birth and male gender identity); (3) reside in China; and (4) have filled more than 95% of the questionnaire items.
Respondents who could not answer all the questions accurately were deemed ineligible. The survey took 4.2 min on average. To protect against fraudulent or duplicative enrollments, screening and survey responses were cross-referenced using age and IP addresses.

2.2. Measures

Socioeconomics—Characteristics included age (continuous), race/ethnicity (Han, Other), household registration (urban, rural), education level (junior college and below, undergraduate, postgraduate and above), marriage status (unmarried, married), occupation (public institutions, private enterprise, student, other), annual income (CNY; ≤100,000, 100,000–200,000, ≥200,000), and history of HPV infection (no, yes).
Sexual behavior—Participants were asked to report if they had a sexual partner in the last 6 months (no, yes), the number of sexual partners in the last 6 months (0, 1–2, 3–6, >6), frequency of condom use (never, occasionally, every time), and if they had ever attended a sexually transmitted disease examination (no, yes) or HIV testing (no, yes).
Knowledge of HPV—6 questions, including “Have you ever heard of human papillomavirus?” (no, yes) and “Can both men and women be infected with HPV?” (no, yes). The other 4 multiple choice questions were scored as the higher the score, the better the knowledge. Participants were asked to choose diseases associated with HPV infection, the high-risk factors of HPV, the transmission routes of HPV, and preventive methods of HPV infection. For the scoring of the assessment, participants achieved one point for one right answer and no points or one point deducted for a wrong answer. The total scores were divided into three levels by the quantile classification method, based on the values of the 25% quantile.
Knowledge of the HPV vaccine—Questions were asked as to whether the HPV vaccine can prevent malignancies (no, yes), when should the HPV vaccine be given (unknown, after first sexual activity, before first sexual activity), whether men can be vaccinated (no, yes), and if the HPV vaccine protects against all types of HPV infection (unknown, yes, no).
Attitudes toward the HPV vaccine—There were three variables regarding attitudes toward the HPV vaccine, as follows: “Would you like the HPV vaccine for males included in the national immunization program?” (disapproval, approval); “Do you prefer a domestic or imported HPV vaccine?” (indifferent, domestic, imported); and the price participants could afford to spend on an HPV vaccine (CNY; ≤1000, 1000–2000, 2000–3000, ≥3000).

2.3. Statistical Analyses

All statistical analyses were performed with SAS9.4 (Statistics Analysis System, version 9.4). For continuous variables conforming to a normal distribution, the values were expressed as the mean ± standard deviation (SD). Categorical variables were presented as frequencies and percentages. Groups were compared using two independent sample t-tests, differences in distributions for categorical variables were analyzed with the chi-square test. To determine the factors associated with men’s attitudes toward HPV vaccine for males being included in the national immunization program, an ordinal logistic regression model was constructed, in which stepwise regression was performed to choose variables included in the final model (Pentry = 0.05, Pstay = 0.05). All tests were performed by two-sided tests, with p < 0.05 as the statistical difference.

3. Results

In total, 678 participants answered the questionnaires, and 18 of them were excluded (17 participants were female, 1 participant did not finish the questionnaire, with missing items of over 95%). A final total of 660 participants were enrolled in this study.

Socioeconomic Characteristics and Influencing Factors

A total of 660 men enrolled in this survey, of whom 531 approved of the male HPV vaccine being included in the national immunization program, and 129 men disapproved. The mean age of the participants was 28.04 ± 5.27. Participants were classified as being in the approval or disapproval group, based on their support of the vaccine for males being included in the national immunization program. The results were displayed in Table 1, household registration, marriage status, annual income, and history of HPV infection, showed statistical differences between the approval and disapproval groups. In the approval group, there were 314 (59.13%) urban participants, 382 (71.94%) were unmarried, 305 (57.44%) participants had an annual income of CNY ≤ 100,000, and 236 (44.44%) had a history of HPV infection. In the disapproval group, there were 90 (69.77%) urban participants, 86 (66.67%) were unmarried, 58 (44.96%) participants had an annual income of CNY ≤ 100,000, and 34 (26.36%) had a history of HPV infection.
Regarding sexual behavior, the approval and disapproval groups showed statistical differences. In total, 481 (72.88%) participants had had a sexual partner in the last 6 months, 379 of whom were in the approval group and 102 in the disapproval group (Table 2).
Among the variables regarding knowledge of HPV (Table 3), the scores related to diseases associated with HPV, high-risk factors of HPV infection, transmission routes of HPV, and preventive methods of HPV infection showed statistical differences between the approval and disapproval groups.
The variables regarding knowledge of the HPV vaccine were shown in Table 4. Participants’ knowledge of when the HPV vaccine should be given was statistically different between the approval and disapproval groups. There were 501 (75.91%) participants who answered that the best time for the vaccination to be administered is before the first sexual activity, 414 (77.97%) of whom approved for the vaccine being included in national immunization program and 87 (67.44%) disapproved.
No statistical differences were observed in attitudes toward the HPV vaccine between the groups. In the approval and disapproval groups, 276 (51.98%) and 71 (55.04%) participants had no preference between domestic or imported HPV vaccines, respectively, 153 (28.81%) and 41 (31.78%) participants, respectively, preferred an imported one. The prices participants stated they could afford the HPV vaccine were close between the approval and disapproval groups. Comparisons of participants’ preferences for vaccine prices and types are shown in Figure 1.
A multivariate logistic regression analysis was conducted to identify potential associated factors that may be associated with men’s attitudes toward the HPV vaccine being administered to males in the national immunization program, and the results were shown in Table 5; the variable selection process yielded 10 variables closely related to these attitudes. Of the 10 variables, household registration, annual income, education level, marriage, history of HPV infection, existence of a sexual partner in the last 6 months, diseases associated with HPV, high-risk factors of HPV, preventive methods of HPV infection, and timing of the HPV vaccine were the related factors.
The 10 variables that provided significance in the univariate analyses were chosen as independent variables to be included in the multivariate logistic regression analysis. As a result, a total of four factors entered the logistic regression equation; the maximum contribution was annual income, followed by timing of the HPV vaccine, high-risk factors of HPV, and history of HPV infection (Table 5). Comparing participants with annual income of CNY ≤ 100,000, those earning CNY 100,000–200,000 (odds ratio (OR): 0.63, 95% confidence interval (CI): 0.39–1.00) or CNY ≥ 200,000 (OR: 0.34, 95% CI: 0.17–0.68) were more likely to disapprove. Compared with participants without a history of HPV infection, those with a history of HPV infection (OR: 1.84, 95% CI: 1.17–2.90) were more likely to approve. For the sores related to the high-risk factors of HPV (OR: 1.44, 95% CI: 1.17–1.79), the higher the scores were, the more likely approval was. Compared with those who did not know when the HPV vaccine should be given, participants were more likely to approve if they believed the vaccine should be administered after first sexual activity (OR: 5.51, 95% CI: 0.67–45.10) or before the first sexual activity (OR: 1.75, 95% CI: 1.04–2.95).

4. Discussion

This study explored the factors influencing Chinese men’s attitudes toward the HPV vaccine being included in the national immunization program. HPV infection is related to a variety of human cancers; the HPV vaccine is a cancer-preventive vaccine that has been shown to be effective against HPV induced cancers. Meanwhile, although male HPV vaccination is becoming a priority in some countries, it is currently unavailable to males in China.
The study results showed that 80.45% of men in our survey supported the inclusion of HPV vaccines in national immunization programs, and the influencing factors were annual income, history of HPV disease, knowledge of the high-risk factors for HPV infection, and the optimal timing of HPV vaccination. Participants of lower socioeconomic background were more supportive of the inclusion of HPV vaccines in national immunization programs. Previous studies found that the cost of HPV vaccination was the main factor hindering vaccination [28,29]. The cost of three doses of 9-valent HPV vaccine in China was around CNY 3000, which was a particular economic burden for many people, especially those with low incomes. The high-income group could afford the vaccines and had less desire for the vaccine to be included in national immunization programs. Female vaccination results showed that the low female HPV vaccination coverage rate in China was connected with the high cost of vaccines. Therefore, including HPV vaccines in national immunization programs is an effective way to improve vaccination coverage. Men with a history of HPV infection were more supportive of the vaccine. Perhaps as a result of better understanding the dangers of HPV infection, these participants were more willing to be vaccinated to prevent or reduce the risk of HPV infection and related diseases. Natural HPV immunity produced by the associated antibody and preventing re-infection of the same type of HPV is difficult to achieve [30,31]. However, the HPV vaccine has a significant protective effect in people with recurrent (transient or persistent) HPV infection of previous vaccine types. Therefore, HPV vaccination is recommended for people of appropriate age, regardless of the presence of HPV infection or cytological abnormalities [32,33,34]. Participants who knew more about the risk factors of HPV infection revealed a more supportive attitude and were more eager to be vaccinated to prevent infection, due to their increased awareness of people’s susceptibility to HPV and the adverse consequences of infection [35]. People who knew when the HPV vaccine should be administered were more aware of the benefits of vaccines: the earlier the better, within the approved age range [36]. Therefore, more attention should be paid to young men when taking targeted actions.
Previous studies found that people’s willingness to use HPV vaccines was related to their level of education [37]. In this study, the level of education had no influence on men’s attitude toward the HPV vaccine being administered to males included in the national immunization program. This was possibly due to the current public awareness of vaccinations being generally high, and the internet making knowledge of vaccines more comprehensive. In addition, high-risk factors of infection, such as the number of sexual partners and the existence of a sexual partner in the last 6 months, did not affect attitudes, and they were not independent influencing factors of attitudes. Nevertheless, having multiple sexual partners and frequent sex are high-risk factors for HPV infection, meaning that people with such behaviors would benefit more from HPV vaccination [38,39].
The evidence of the cost-effectiveness of extending HPV vaccination to boys is ambiguous and has not verified worldwide [40], while researches claimed that a gender-neutral strategy would be cost-effective (or marginally cost-effective) in some countries [23,24,25,41]. Before adoption the strategy of including the male HPV vaccine in national immunization program, China should carry out further cost-effectiveness analyses. In addition to cost-effectiveness, safety is an important consideration when promoting HPV vaccine use and inclusion in national immunization programs. Studies have shown that the HPV vaccine is safe and well tolerated in both men and women [42]. To summarize, HPV vaccination is potentially a cost-effective preventive measure, and actions should be taken to integrate vaccines into immunization programs and increase vaccination rates in the population. In order to carry out this policy, recommendations are proposed as follows. Firstly, reports in the literature have stated that doctors’ advice is an effective way to promote vaccination [43]. Health science education promoting HPV knowledge should be strengthened through schools and hospitals to increase public confidence in the vaccines, and, at the same time, HPV-related science videos and information could be promoted through the media. This education strategy should be applied not only for women but also for men. HPV prevention efforts should focus on both the promotion of condom use and HPV vaccination. Consistent condom use was verified to reduce the risk of HPV infection [44]. Secondly, effective measures include accelerating the review and approval process of HPV vaccines in China, improving the enthusiasm of manufacturers and suppliers to ensure vaccine supply and, more importantly, reducing the price of vaccines to improve the accessibility and affordability of HPV vaccines. Thirdly, HPV and cervical cancer testing for women is widely available but is not available for men in most institutions. Providing HPV screening for men, especially for those high-risk groups, such as men who have sex with men (MSM), could be further prioritized. The existing screening methods mainly include Pap smears, liquid-based cytology tests, and HPV tests. Cytological specimens through swabs of the penis, scrotum, and anus are mainly used [45]. The collection of cytological specimens depends on doctors and is invasive. First-void urine HPV screening has the advantages of being simple, convenient, and non-invasive, making it the most acceptable of all diagnostic methods; it does not affect the body’s HPV infection status and can be readily offered as a screening and diagnostic pre-vaccination test for both sexes [46,47]. Lastly, a lack of vaccine information is also one of the reasons hindering vaccination [48]. Modern information technology should be developed to release vaccine-related information to improve vaccine accessibility and establish a connection between HPV vaccination and related HPV screening results in order to achieve an early prevention, early diagnosis, and early treatment strategy.

5. Conclusions

In summary, this study illustrated the factors influencing men’s attitudes toward the HPV vaccine administered to males being included in the national immunization program. The findings indicate that although most men approve of the HPV vaccine being included in the immunization program, one in five men do not support this measure. In order to implement a comprehensive immunization policy, targeted actions should be taken at national and public levels. In addition, more attention needs to be paid when implementing strategies to those who are younger, with lower income, without a history of HPV infection, and with poor knowledge of HPV. Lastly, HPV vaccination and screening combined with relevant promotion and education strategies should be implemented to prevent HPV infection and eliminate HPV-induced cancers in the coming decades.

6. Limitations

The notable limitations of this study were as follows. Firstly, although a variety of factors were found to be related to men’s attitudes toward HPV vaccination being included in the national immunization program, the design of the questionnaire was not comprehensive enough and potential variables may have been ignored, i.e., sexual orientation may be a significant factor, but it was not included in the questionnaire. Secondly, the recall bias and social expectation bias cannot be eliminated in a self-reported questionnaire. Thirdly, we sent the questionnaire link via the WeChat account of a phase I clinical trial ward. The participants viewing this account may be more interested in health topics, more eager to participate in an HPV vaccine clinical trial, and their knowledge of HPV and vaccines may be higher than the population average; this may limit the generalizability of the study results.

Author Contributions

Y.T. designed the study; H.S., T.Z., and J.P. conducted the survey; H.S. and T.Z. collected the data; Y.T. and H.S. drafted the manuscript; C.T. edited the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Science and Technology Commission Foundation of Chongqing, China (No. cstc2019jscx-gksbX0005, cstc2020jscx-msxmX0090) and the Science and Technology Commission & Health Commission Joint Research Project (No. 2020GDRC022).

Institutional Review Board Statement

This study was carried out in accordance with the principles of the Declaration of Helsinki. This study was approved by the Ethics Committee of the First Affiliated Hospital of Chongqing Medical University (No. 2022-73).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from Huarui Shao. The data are not publicly available due to privacy of participants.

Acknowledgments

We extend our gratitude to all participants in this survey for their support and cooperation. We appreciate the successful implementation of this study by all the researchers.

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Munoz, N.; Bosch, F.X.; de Sanjose, S.; Herrero, R.; Castellsague, X.; Shah, K.V.; Snijders, P.J.; Meijer, C.J.; International Agency for Research on Cancer Multicenter Cervical Cancer Study Group. Epidemiologic classification of human papillomavirus types associated with cervical cancer. N. Engl. J. Med. 2003, 348, 518–527. [Google Scholar] [CrossRef] [Green Version]
  2. Kombe Kombe, A.J.; Li, B.; Zahid, A.; Mengist, H.M.; Bounda, G.A.; Zhou, Y.; Jin, T. Epidemiology and Burden of Human Papillomavirus and Related Diseases, Molecular Pathogenesis, and Vaccine Evaluation. Front. Public Health 2020, 8, 552028. [Google Scholar] [CrossRef] [PubMed]
  3. Ortu, G.; Barret, A.S.; Danis, K.; Duchesne, L.; Levy-Bruhl, D.; Velter, A. Low vaccination coverage for human papillomavirus disease among young men who have sex with men, France, 2019. Eurosurveillance 2021, 26, 2001965. [Google Scholar] [CrossRef] [PubMed]
  4. Chesson, H.W.; Dunne, E.F.; Hariri, S.; Markowitz, L.E. The estimated lifetime probability of acquiring human papillomavirus in the United States. Sex. Transm. Dis. 2014, 41, 660–664. [Google Scholar] [CrossRef] [PubMed]
  5. International Agency for Research on Cancer (IARC). Available online: https://www.iarc.fr/faq/latest-global-cancer-data-2020-qa/ (accessed on 7 April 2022).
  6. Jasrotia, R.; Dhanjal, D.S.; Bhardwaj, S.; Sharma, P.; Chopra, C.; Singh, R.; Kumar, A.; Mubayi, A.; Kumar, D.; Kumar, R.; et al. Nanotechnology based vaccines: Cervical cancer management and perspectives. J. Drug Deliv. Sci. Technol. 2022, 71, 103351. [Google Scholar] [CrossRef]
  7. Buchanan, T.R.; Graybill, W.S.; Pierce, J.Y. Morbidity and mortality of vulvar and vaginal cancers: Impact of 2-, 4-, and 9-valent HPV vaccines. Hum. Vaccin. Immunother. 2016, 12, 1352–1356. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Gargano, J.W.; Unger, E.R.; Liu, G.; Steinau, M.; Meites, E.; Dunne, E.; Markowitz, L.E. Prevalence of Genital Human Papillomavirus in Males, United States, 2013–2014. J. Infect. Dis. 2017, 215, 1070–1079. [Google Scholar] [CrossRef]
  9. Wei, F.; Yin, K.; Wu, X.; Lan, J.; Huang, S.; Sheng, W.; Zhao, J.; Su, Y.; Wang, Y.; Li, Y.; et al. Human papillomavirus prevalence and associated factors in women and men in south China: A population-based study. Emerg. Microbes Infect. 2016, 5, e119. [Google Scholar] [CrossRef]
  10. Olesen, T.B.; Sand, F.L.; Rasmussen, C.L.; Albieri, V.; Toft, B.G.; Norrild, B.; Munk, C.; Kjaer, S.K. Prevalence of human papillomavirus DNA and p16(INK4a) in penile cancer and penile intraepithelial neoplasia: A systematic review and meta-analysis. Lancet Oncol. 2019, 20, 145–158. [Google Scholar] [CrossRef]
  11. Lin, C.; Franceschi, S.; Clifford, G.M. Human papillomavirus types from infection to cancer in the anus, according to sex and HIV status: A systematic review and meta-analysis. Lancet Infect. Dis. 2018, 18, 198–206. [Google Scholar] [CrossRef] [Green Version]
  12. Serrano, B.; Brotons, M.; Bosch, F.X.; Bruni, L. Epidemiology and burden of HPV-related disease. Best Pract. Res. Clin. Obstet. Gynaecol. 2018, 47, 14–26. [Google Scholar] [CrossRef]
  13. De Martel, C.; Plummer, M.; Vignat, J.; Franceschi, S. Worldwide burden of cancer attributable to HPV by site, country and HPV type. Int. J. Cancer 2017, 141, 664–670. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. He, W.; Pan, H.; Lin, B.; Zhong, X. Analysis of HPV Vaccination Willingness amongst HIV-Negative Men Who Have Sex with Men in China. Vaccines 2021, 9, 1069. [Google Scholar] [CrossRef] [PubMed]
  15. Markowitz, L.E.; Schiller, J.T. Human Papillomavirus Vaccines. J. Infect. Dis. 2021, 224 (Suppl. S2), S367–S378. [Google Scholar] [CrossRef] [PubMed]
  16. Ferris, D.G.; Samakoses, R.; Block, S.L.; Lazcano-Ponce, E.; Restrepo, J.A.; Mehlsen, J.; Chatterjee, A.; Iversen, O.E.; Joshi, A.; Chu, J.L.; et al. 4-Valent Human Papillomavirus (4vHPV) Vaccine in Preadolescents and Adolescents After 10 Years. Pediatrics 2017, 140, e20163947. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Giuliano, A.R.; Palefsky, J.M.; Goldstone, S.; Moreira, E.D., Jr.; Penny, M.E.; Aranda, C.; Vardas, E.; Moi, H.; Jessen, H.; Hillman, R.; et al. Efficacy of quadrivalent HPV vaccine against HPV Infection and disease in males. N. Engl. J. Med. 2011, 364, 401–411. [Google Scholar] [CrossRef] [Green Version]
  18. Castellsague, X.; Giuliano, A.R.; Goldstone, S.; Guevara, A.; Mogensen, O.; Palefsky, J.M.; Group, T.; Shields, C.; Liu, K.; Maansson, R.; et al. Immunogenicity and safety of the 9-valent HPV vaccine in men. Vaccine 2015, 33, 6892–6901. [Google Scholar] [CrossRef]
  19. Van Damme, P.; Meijer, C.; Kieninger, D.; Schuyleman, A.; Thomas, S.; Luxembourg, A.; Baudin, M. A phase III clinical study to compare the immunogenicity and safety of the 9-valent and quadrivalent HPV vaccines in men. Vaccine 2016, 34, 4205–4212. [Google Scholar] [CrossRef] [Green Version]
  20. Drolet, M.; Benard, E.; Boily, M.C.; Ali, H.; Baandrup, L.; Bauer, H.; Beddows, S.; Brisson, J.; Brotherton, J.M.; Cummings, T.; et al. Population-level impact and herd effects following human papillomavirus vaccination programmes: A systematic review and meta-analysis. Lancet Infect. Dis. 2015, 15, 565–580. [Google Scholar] [CrossRef] [Green Version]
  21. De Sanjose, S.; Serrano, B.; Tous, S.; Alejo, M.; Lloveras, B.; Quiros, B.; Clavero, O.; Vidal, A.; Ferrandiz-Pulido, C.; Pavon, M.A.; et al. Burden of Human Papillomavirus (HPV)-Related Cancers Attributable to HPVs 6/11/16/18/31/33/45/52 and 58. JNCI Cancer Spectr 2018, 2, pky045. [Google Scholar] [CrossRef] [Green Version]
  22. Markowitz, L.E.; Dunne, E.F.; Saraiya, M.; Chesson, H.W.; Curtis, C.R.; Gee, J.; Bocchini, J.A., Jr.; Unger, E.R. Human papillomavirus vaccination: Recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2014, 63, 1–30. [Google Scholar] [PubMed]
  23. Mennini, F.S.; Bonanni, P.; Bianic, F.; de Waure, C.; Baio, G.; Plazzotta, G.; Uhart, M.; Rinaldi, A.; Largeron, N. Cost-effectiveness analysis of the nine-valent HPV vaccine in Italy. Cost Eff. Resour. Alloc. 2017, 15, 11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Largeron, N.; Petry, K.U.; Jacob, J.; Bianic, F.; Anger, D.; Uhart, M. An estimate of the public health impact and cost-effectiveness of universal vaccination with a 9-valent HPV vaccine in Germany. Expert. Rev. Pharmacoecon. Outcomes Res. 2017, 17, 85–98. [Google Scholar] [CrossRef] [PubMed]
  25. De La Fuente, J.; Hernandez Aguado, J.J.; San Martin, M.; Ramirez Boix, P.; Cedillo Gomez, S.; Lopez, N. Estimating the epidemiological impact and cost-effectiveness profile of a nonavalent HPV vaccine in Spain. Hum. Vaccin. Immunother. 2019, 15, 1949–1961. [Google Scholar] [CrossRef] [PubMed]
  26. Dai, Z.; Si, M.; Su, X.; Wang, W.; Zhang, X.; Gu, X.; Ma, L.; Li, J.; Zhang, S.; Ren, Z.; et al. Willingness to human papillomavirus (HPV) vaccination and influencing factors among male and female university students in China. J. Med. Virol. 2022, 94, 2776–2786. [Google Scholar] [CrossRef]
  27. Bruni, L.; Saura-Lazaro, A.; Montoliu, A.; Brotons, M.; Alemany, L.; Diallo, M.S.; Afsar, O.Z.; LaMontagne, D.S.; Mosina, L.; Contreras, M.; et al. HPV vaccination introduction worldwide and WHO and UNICEF estimates of national HPV immunization coverage 2010–2019. Prev. Med. 2021, 144, 106399. [Google Scholar] [CrossRef]
  28. Deng, C.; Chen, X.; Liu, Y. Human papillomavirus vaccination: Coverage rate, knowledge, acceptance, and associated factors in college students in mainland China. Hum. Vaccin. Immunother. 2021, 17, 828–835. [Google Scholar] [CrossRef]
  29. Kwan, T.T.; Chan, K.K.; Yip, A.M.; Tam, K.F.; Cheung, A.N.; Young, P.M.; Lee, P.W.; Ngan, H.Y. Barriers and facilitators to human papillomavirus vaccination among Chinese adolescent girls in Hong Kong: A qualitative-quantitative study. Sex. Transm. Infect. 2008, 84, 227–232. [Google Scholar] [CrossRef] [Green Version]
  30. Colombara, D.V.; Wang, S.M. The impact of HPV vaccination delays in China: Lessons from HBV control programs. Vaccine 2013, 31, 4057–4059. [Google Scholar] [CrossRef] [Green Version]
  31. Viscidi, R.P.; Schiffman, M.; Hildesheim, A.; Herrero, R.; Castle, P.E.; Bratti, M.C.; Rodriguez, A.C.; Sherman, M.E.; Wang, S.; Clayman, B.; et al. Seroreactivity to human papillomavirus (HPV) types 16, 18, or 31 and risk of subsequent HPV infection: Results from a population-based study in Costa Rica. Cancer Epidemiol. Biomark. Prev. 2004, 13, 324–327. [Google Scholar] [CrossRef] [Green Version]
  32. Olsson, S.E.; Kjaer, S.K.; Sigurdsson, K.; Iversen, O.E.; Hernandez-Avila, M.; Wheeler, C.M.; Perez, G.; Brown, D.R.; Koutsky, L.A.; Tay, E.H.; et al. Evaluation of quadrivalent HPV 6/11/16/18 vaccine efficacy against cervical and anogenital disease in subjects with serological evidence of prior vaccine type HPV infection. Hum. Vaccin. 2009, 5, 696–704. [Google Scholar] [CrossRef] [PubMed]
  33. Huh, W.K.; Joura, E.A.; Giuliano, A.R.; Iversen, O.E.; de Andrade, R.P.; Ault, K.A.; Bartholomew, D.; Cestero, R.M.; Fedrizzi, E.N.; Hirschberg, A.L.; et al. Final efficacy, immunogenicity, and safety analyses of a nine-valent human papillomavirus vaccine in women aged 16-26 years: A randomised, double-blind trial. Lancet 2017, 390, 2143–2159. [Google Scholar] [CrossRef]
  34. Castellsague, X.; Munoz, N.; Pitisuttithum, P.; Ferris, D.; Monsonego, J.; Ault, K.; Luna, J.; Myers, E.; Mallary, S.; Bautista, O.M.; et al. End-of-study safety, immunogenicity, and efficacy of quadrivalent HPV (types 6, 11, 16, 18) recombinant vaccine in adult women 24-45 years of age. Br. J. Cancer 2011, 105, 28–37. [Google Scholar] [CrossRef] [PubMed]
  35. Mascaro, V.; Pileggi, C.; Curra, A.; Bianco, A.; Pavia, M. HPV vaccination coverage and willingness to be vaccinated among 18-30year-old students in Italy. Vaccine 2019, 37, 3310–3316. [Google Scholar] [CrossRef] [PubMed]
  36. Henrikson, N.B.; Tuzzio, L.; Gilkey, M.B.; McRee, A.L. “You’re never really off time”: Healthcare providers’ interpretations of optimal timing for HPV vaccination. Prev. Med. Rep. 2016, 4, 94–97. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Pan, H.; He, W.; Lin, B.; Zhong, X. Factors influencing HPV vaccination willingness among men who have sex with men in China: A structural equation modeling analysis. Hum. Vaccin. Immunother. 2022, 18, 2038504. [Google Scholar] [CrossRef]
  38. Nadarzynski, T.; Smith, H.; Richardson, D.; Jones, C.J.; Llewellyn, C.D. Human papillomavirus and vaccine-related perceptions among men who have sex with men: A systematic review. Sex. Transm. Infect. 2014, 90, 515–523. [Google Scholar] [CrossRef]
  39. Chelimo, C.; Wouldes, T.A.; Cameron, L.D.; Elwood, J.M. Risk factors for and prevention of human papillomaviruses (HPV), genital warts and cervical cancer. J. Infect. 2013, 66, 207–217. [Google Scholar] [CrossRef]
  40. Linertová, R.; Guirado-Fuentes, C.; Mar Medina, J.; Imaz-Iglesia, I.; Rodríguez-Rodríguez, L.; Carmona-Rodríguez, M. Cost-effectiveness of extending the HPV vaccination to boys: A systematic review. J. Epidemiol. Community Health 2021, 75, 910–916. [Google Scholar] [CrossRef]
  41. Datta, S.; Pink, J.; Medley, G.F.; Petrou, S.; Staniszewska, S.; Underwood, M.; Sonnenberg, P.; Keeling, M.J. Assessing the cost-effectiveness of HPV vaccination strategies for adolescent girls and boys in the UK. BMC Infect. Dis. 2019, 19, 552. [Google Scholar] [CrossRef] [Green Version]
  42. Moreira, E.D., Jr.; Block, S.L.; Ferris, D.; Giuliano, A.R.; Iversen, O.E.; Joura, E.A.; Kosalaraksa, P.; Schilling, A.; Van Damme, P.; Bornstein, J.; et al. Safety Profile of the 9-Valent HPV Vaccine: A Combined Analysis of 7 Phase III Clinical Trials. Pediatrics 2016, 138, e20154387. [Google Scholar] [CrossRef] [PubMed]
  43. Wilson, A.R.; Hashibe, M.; Bodson, J.; Gren, L.H.; Taylor, B.A.; Greenwood, J.; Jackson, B.R.; She, R.; Egger, M.J.; Kepka, D. Factors related to HPV vaccine uptake and 3-dose completion among women in a low vaccination region of the USA: An observational study. BMC Womens Health 2016, 16, 41. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Pierce Campbell, C.M.; Lin, H.Y.; Fulp, W.; Papenfuss, M.R.; Salmeron, J.J.; Quiterio, M.M.; Lazcano-Ponce, E.; Villa, L.L.; Giuliano, A.R. Consistent condom use reduces the genital human papillomavirus burden among high-risk men: The HPV infection in men study. J. Infect. Dis. 2013, 208, 373–384. [Google Scholar] [CrossRef] [PubMed]
  45. Burd, E.M.; Dean, C.L. Human Papillomavirus. Microbiol. Spectr. 2016, 4, 367–378. [Google Scholar] [CrossRef] [Green Version]
  46. Aung, E.T.; Fairley, C.K.; Tabrizi, S.N.; Danielewski, J.A.; Ong, J.J.; Chen, M.Y.; Bradshaw, C.S.; Chow, E.P.F. Detection of human papillomavirus in urine among heterosexual men in relation to location of genital warts and circumcision status. Sex. Transm. Infect. 2018, 94, 222–225. [Google Scholar] [CrossRef]
  47. Koene, F.; Wolffs, P.; Brink, A.; Dukers-Muijrers, N.; Quint, W.; Bruggeman, C.; Hoebe, C. Comparison of urine samples and penile swabs for detection of human papillomavirus in HIV-negative Dutch men. Sex. Transm. Infect. 2016, 92, 467–469. [Google Scholar] [CrossRef]
  48. Choi, E.P.H.; Wong, J.Y.H.; Lau, A.Y.Y.; Fong, D.Y.T. Gender and Sexual Orientation Differences in Human Papillomavirus (HPV) Vaccine Uptake among Chinese Young Adults. Int. J. Environ. Res. Public Health 2018, 15, 1099. [Google Scholar] [CrossRef] [Green Version]
Vaccines 10 01054 g001 550
Figure 1. (A) Comparison of preferences for domestic or imported vaccines. (B) Comparison of affordable vaccine prices for participants (n = 660).
Figure 1. (A) Comparison of preferences for domestic or imported vaccines. (B) Comparison of affordable vaccine prices for participants (n = 660).
Vaccines 10 01054 g001
Table
Table 1. Socioeconomic characteristics.
Table 1. Socioeconomic characteristics.
VariableTotal (n = 660)Approval (n = 531)Disapproval (n = 129)p
Age28.04 ± 5.2727.94 ± 5.3228.43 ± 5.050.878
Ethnicity 0.451
Han623 (94.39%)503 (94.73%)120 (93.02%)
Other37 (5.61%)28 (5.27%)9 (6.98%)
Household registration 0.032
Urban404 (61.21%)314 (59.13%)90 (69.77%)
Rural256 (38.79%)217 (40.87%)39 (30.23%)
Education level 0.651
Junior college and below171 (25.91%)140 (26.37%)31 (24.03%)
Undergraduate320 (48.48%)259 (48.78%)61 (47.29%)
Postgraduate and above169 (25.61%)132 (20.72%)37 (28.68%)
Occupation 0.434
Public institutions307 (46.52%)258 (48.59%)49 (37.98%)
Private enterprise81 (12.27%)70(13.18%)11 (8.53%)
Student150 (22.73%)134 (25.24%)16 (12.40%)
Other83 (12.58%)69 (12.99%)14 (10.85%)
Marriage 0.027
Unmarried468 (70.91%)382 (71.94%)86 (66.67%)
Married192 (29.09%)149 (28.06%)43 (33.33%)
Annual income 0.014
CNY ≤ 100,000363 (55.00%)305 (57.44%)58 (44.96%)
CNY 100,000–200,000234 (35.45%)182 (34.27%)52 (40.31%)
CNY ≥ 200,00063 (9.55%)44 (8.29%)19 (14.73%)
History of HPV infection 0.000
No390 (59.09%)295 (55.56%)95 (73.64%)
Yes270 (40.91%)236 (44.44%)34 (26.36%)
Data are expressed as n (%), mean ± SD, p < 0.05. Statistical analysis was performed using the t-test and chi-square test.
Table
Table 2. Sexual behavior.
Table 2. Sexual behavior.
VariableTotal (n = 660)Approval (n = 531)Disapproval (n = 129)p
Number of sexual partners 0.132
0179 (27.12%)152 (28.63%)27 (20.93%)
1–2466 (70.61%)367 (69.11%)99 (76.74%)
3–69 (1.36%)7 (1.32%)2 (1.55%)
>66 (0.91%)5 (0.94%)1 (0.78%)
Sexual partner in the last 6 months 0.047
No179 (27.12%)152 (28.63%)27 (20.93%)
Yes481 (72.88%)379 (71.37%)102 (79.07%)
Frequency of condom use 0.160
Frequently367 (55.61%)295 (55.56%)72 (55.81%)
Occasionally83 (12.58%)61 (11.49%)22 (17.05%)
Never210 (31.82%)175 (32.96%)35 (27.13%)
STD examination 0.791
No487 (73.79%)393(74.01%)94 (72.87%)
Yes173 (26.21%)138 (25.99%)35 (27.13%)
HIV testing 0.876
No431 (65.30%)346 (65.16%)85 (65.89%)
Yes229 (34.70%)185 (34.84%)44 (34.11%)
Data are expressed as n(%), p < 0.05. Statistical analysis was performed using the chi-square test.
Table
Table 3. Knowledge of HPV.
Table 3. Knowledge of HPV.
VariableTotal (n = 660)Approval (n = 531)Disapproval (n = 129)p
Have you ever heard of HPV? 0.131
No55 (8.33%)40 (7.53%)15 (11.63%)
Yes605 (91.67%)491 (92.47%)114 (88.37%)
Both men and women can be infected with HPV 0.819
No78 (11.82%)62 (11.68%)16 (12.40%)
Yes582 (88.18%)469 (88.32%)113 (87.60%)
Diseases associated with HPV infection (scores) <0.001
0–184 (12.73%)54 (10.17%)30 (23.26%)
2–3335 (50.76%)275 (51.79%)60 (46.51%)
4241 (36.52%)202 (38.04%)39 (30.23%)
High-risk factors of HPV (scores) <0.001
1–2146 (22.12%)95 (17.89%)51 (39.53%)
3192 (29.09%)155 (29.19%)37 (28.68%)
4–6322 (48.79%)281 (52.92%)41 (31.78%)
Transmission routes of HPV (scores) 0.003
1153 (23.18%)114 (21.47%)39 (30.23%)
2343 (51.97%)271 (51.04%)72 (55.81%)
3164 (24.85%)146 (27.50%)18 (13.95%)
Preventive methods of HPV infection F (scores) 0.003
1–276 (11.52%)53 (9.98%)23 (17.83%)
3–4242 (36.67%)187 (35.22%)55 (42.64%)
5–6342 (51.82%)291 (54.80%)51 (39.53%)
Data are expressed as n (%), p < 0.05. Statistical analysis was performed using the chi-square test.
Table
Table 4. Knowledge of HPV vaccine.
Table 4. Knowledge of HPV vaccine.
VariableApproval
(n = 531)		Disapproval
(n = 129)		Total
(n = 660)		p
Can the HPV vaccine prevent malignancies? 0.761
No41 (7.72%)11 (8.53%)41 (7.88%)
Yes490 (92.28%)118 (91.47%)490 (92.12%)
When should the HPV vaccine be given? 0.005
Unknown103(19.40%)41 (31.78%)144(21.82%)
After first sexual activity14 (2.64%)1 (0.78%)15 (2.27%)
Before first sexual activity414 (77.97%)87 (67.44%)501 (75.91%)
Can men be vaccinated? 0.521
No28 (5.27%)9 (6.98%)37 (5.61%)
Yes503 (94.73%)120 (93.02%)623 (94.39%)
Does the HPV vaccine protect against all types of HPV infection? 0.287
Unknown83 (15.63%)26 (20.16%)109 (16.52%)
Yes73 (13.75%)21 (16.28%)94 (14.24%)
No375 (70.62%)82 (63.57%)457 (69.24%)
Data are expressed as n (%), p < 0.05. Statistical analysis was performed using the chi-square test.
Table
Table 5. Multivariable analysis of factors influencing men’s attitudes toward HPV vaccine in males being included in the national immunization program.
Table 5. Multivariable analysis of factors influencing men’s attitudes toward HPV vaccine in males being included in the national immunization program.
Factorsβ-CoefficientOR (95%CI)p
Household registration 0.142
Urbanreference1
Rural0.341.40 (0.89–2.20)
Education level 0.189
Junior college and belowreference1
Undergraduate−0.020.98 (0.57–1.70)0.950
Postgraduate and above−0.460.63 (0.34–1.18)0.149
Marriage status 0.331
Unmarriedreference1
Married0.241.27 (0.78–2.07)
Annual income (CNY) 0.007
≤100,000reference1
100–200,000−0.470.63 (0.39–1.00)0.051
≥200,000−1.080.34 (0.17–0.68)0.002
History of HPV infection 0.008
Noreference1
Yes0.611.84 (1.17–2.90)
Sexual partner in the last 6 months 0.233
Noreference1
Yes−0.320.73 (0.43-1.23)
Diseases associated with HPV infection0.121.13 (0.91–1.39)0.269
High-risk factors of HPV0.371.44 (1.17–1.79)0.001
Transmission routes of HPV0.101.10 (0.78–1.56)0.574
Preventive methods of HPV infection−0.090.91 (0.75–1.11)0.363
Timing of vaccine administration 0.049
Unknownreference1
After first sex1.715.51 (0.67–45.10)0.112
Before first sex0.561.75 (1.04–2.95)0.036
CI, confidence interval; OR, odds ratio.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tao, Y.; Shao, H.; Zhang, T.; Pu, J.; Tang, C. Factors Influencing Men’s Attitudes toward HPV Vaccination in Males Included in the Chinese National Immunization Program. Vaccines 2022, 10, 1054. https://doi.org/10.3390/vaccines10071054

AMA Style

Tao Y, Shao H, Zhang T, Pu J, Tang C. Factors Influencing Men’s Attitudes toward HPV Vaccination in Males Included in the Chinese National Immunization Program. Vaccines. 2022; 10(7):1054. https://doi.org/10.3390/vaccines10071054

Chicago/Turabian Style

Tao, Yi, Huarui Shao, Ting Zhang, Junliang Pu, and Chengyong Tang. 2022. "Factors Influencing Men’s Attitudes toward HPV Vaccination in Males Included in the Chinese National Immunization Program" Vaccines 10, no. 7: 1054. https://doi.org/10.3390/vaccines10071054

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop