Next Article in Journal
Is “Wild” a Food Quality Attribute? Heavy Metal Content in Wild and Cultivated Sea Buckthorn and Consumers’ Risk Perception
Previous Article in Journal
Seasonal Effects of High-Altitude Forest Travel on Cardiovascular Function: An Overlooked Cardiovascular Risk of Forest Activity
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

What Are the Important Factors Influencing the Recruitment and Retention of Doctoral Students in a Public Health Setting? A Discrete Choice Experiment Survey in China

1
School of Public Health, Fudan University, Shanghai 200032, China
2
NHC Key Laboratory of Health Technology Assessment, Fudan University, Shanghai 200032, China
3
Centre for Health Management and Policy Research, School of Public Health, Cheeloo College of Medicine, Shandong University, Jinan 250012, China
4
School of Public Administration, Guangzhou University, Guangzhou 510006, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(18), 9474; https://doi.org/10.3390/ijerph18189474
Submission received: 27 July 2021 / Revised: 2 September 2021 / Accepted: 3 September 2021 / Published: 8 September 2021

Abstract

:
Objectives: This study aims to investigate the employment preferences of doctoral students majoring in social medicine and health care management (SMHCM), to inform policymakers and future employers on how to address recruitment and retention requirements at CDCs across China. Methods: An online discrete choice experiment (DCE) was conducted to elicit doctoral SMHCM students’ job preferences. The scenarios were described with seven attributes: monthly income, employment location, housing benefits, children’s education opportunities, working environment, career promotion speed, and bianzhi. A conditional logit model and a mixed logit model were used to evaluate the relative importance of the selected attributes. Results: A total of 167 doctoral SMHCM students from 24 universities completed the online survey. All seven attributes were statistically significant with the expected sign and demonstrated the existence of preference heterogeneity. Monthly income and employment location were of most concern for doctoral SMHCM students when deciding their future jobs. Among the presented attributes, working environment was of least concern. For the sub-group analysis, employment located in a first-tier city was more likely to lead to a higher utility value for doctoral students who were women, married, from an urban area, and had a high annual family income. Unsurprisingly, when compared to single students, married students were willing to forgo more for good educational opportunities for their children. Conclusions: Our study suggests that monthly income and employment location were valued most by doctoral SMHCM students when choosing a job. A more effective human resource policy intervention to attract doctoral SMHCM students to work in CDCs, especially CDCs in third-tier cities should consider both the incentives provided by the job characteristics and the background of students. Doctoral students are at the stages of career preparation, so the results of this study would be informative for policymakers and help them to design the recruitment and retention policies for CDCs.

1. Introduction

1.1. The Importance of SMHCM and the Geographical Imbalance of Health Workforce

The Coronavirus disease 2019 (COVID-19) pandemic placed a spotlight on infectious disease prevention, identification, and population healthcare management [1]. As an interdisciplinary major between medicine, social science, and management science, social medicine and health care management (SMHCM) shoulders an important part of the responsibility of training the public health workforce, who are at the frontline of this and future potential pandemics [2]. Graduates of this major constitute a significant part of the public health workforce in China and are widely employed by various health institutions, including, but not limited to, hospitals, health inspection institutes, centers for disease control and prevention (CDCs), government, academics, and pharmaceutical companies [3,4]. However, a shortage in the public health workforce and its uneven distribution across developed and underdeveloped areas still exist in China’s CDCs [5]. According to a survey conducted by Chinese CDCs in 2020, the density of the public health workforce significantly varied across 31 provinces and had decreased annually, with the aggregate ratio of public health workforce to general population decreasing from 1.47 per 10,000 in 2008 to 1.42 per 10,000 in 2017, which is consistently below the critical shortage threshold of 1.75 per 10,000 recommended by the National Health Commission (NHC) [5]. Despite the importance of SMHCM in public health, it has not been given enough attention by the government and public in China. Evidence worldwide suggests that SMHCM is not as mature a profession as other subjects, such as medicine or nursing; therefore, it needs more financial and policy support in the future [6].

1.2. The Necessity for Investigating Doctoral SMHCM Students’ Job Preferences

A high turnover of the public health workforce and a lower willingness to work in the public health system among graduates of related majors contribute significantly to the recruitment and retention problems at CDCs [7]. Recent trends show that many SMHCM graduates have chosen to work elsewhere; for example, in hospitals or pharmaceutical companies [5]. According to the statistics of the NHC, from 2009 to 2018, the amount of health workers at hospitals increased by 58.07%, while the number of personnel at CDCs decreased by 4.5% [8]. To address those problems, there is an urgent need to carefully identify enablers for the implementation of public health functions in the new era, alongside policy implications for an equitable distribution of the public health workforce with a focus on rural or underdeveloped areas, even more so in view of the current pandemic crisis. Both the existing public health workforce and doctoral SMHCM students will be important members of the health workforce in the future. Thus, to better address the recruitment and retention issues and craft corresponding policy interventions, there is a need to further investigate the nature and determinants of doctoral SMHCM students’ job preferences.

1.3. Methods for Preferences Elicitation

A variety of approaches has been used to elicit and quantify preferences in a healthcare setting, such as time trade-off (TTO), standard gamble (SG), person trade-off (PTO), and contingent valuation (CV) [9]. Although each of these approaches has merit [10], they are limited in that they are only able to measure preferences according to the trade-offs inferred between two characteristics. There has been growing interest in the application of alternative preference elicitation approaches that are capable of eliciting trade-offs between more than two characteristics; in particular, the discrete choice experiment (DCE). Thus, this study used a DCE survey to elicit the job preferences of doctoral SMHCM students in China. DCE is commonly used, is considered a realistic representation of actual decision-making, and has been shown to be one of the more robust methods to elicit preferences.

1.4. Research Progress of DCEs in Students Job Preferences

Evidence suggests that a number of DCE studies have already been conducted for student job preferences in China and many other countries, but not for public health students [11,12,13]. For example, one study conducted in the UK found that medical students value good working conditions significantly more than they value a desirable geographical location [14], while recently published research in China demonstrated that employment location and monthly income were valued most by undergraduate pharmacy students when choosing a job [15]. This study presents the first DCE evidence for doctoral public health students. Because they are completing a PhD, the highest level of education, they have typically already started planning their job career. Hence, wo hope the results of this study can be informative and robust and can assist in more effective human resource policy design for CDCs, especially CDCs in third-tier cities (underdeveloped areas in China).

2. Materials and Methods

2.1. Sampling

In China, approximately 30 universities offer an SMHCM major [7]. In order to collect as many samples as possible, an anonymous web-based survey was conducted using the Sojump software between 20 October and 12 November 2020. We posted the survey link on WeChat (a popular Chinese social media site) and also sent the link to doctoral SMHCM students at Chinese Universities identified by the authors. These students were asked to circulate the survey links to their classmates and to students they knew in other universities. Based on the simple sampling strategy proposed by Orme [16], the minimum number of respondents required for this study was 83. Considering the possibility of conducting further subgroup analyses, we aimed to enroll a minimum of 150 respondents. Although this sample size is relatively small for a conjoint analysis [17,18], given the limited number of universities that provide SMHCM trainings for PhD students, the number of students who can state their preferences in this research is still reasonable.

2.2. Discrete Choice Experiment

DCE is the most common type of ordinal preference method used in health economics and health services research [19]. In DCEs, students are expected to make trade-offs in a series of imperfect job scenarios (each job has advantages and disadvantages) with different attribute profiles. DCEs are grounded in theories [20], which assume that (1) alternatives can be described by their attributes, (2) an individual’s valuation depends upon the levels of these attributes, and (3) choices are based on a latent utility function. The DCE is considered to be a more realistic representation of actual decision-making as it allows for the estimation of overall preferences for any given combination of attributes and is shown to be one of the more robust methods to elicit preferences [21].

2.3. Selection of Attributes for the Choice Experiment

We used qualitative research and a literature review to select the attributes to be included in the DCE. From our literature review, an initial set of ten attributes that incorporated personal and employment aspirations (with their levels) were identified, including monthly income, bianzhi, employment location, housing benefits, children’s educational opportunities, working environment, career promotion speed, workload, management style, and training opportunities [22,23,24,25,26]. An iterative qualitative process was undertaken to finesse the attributes and levels. A face-to-face in-depth interview was conducted with seven doctoral SMHCM students from Fudan university and Shandong University, which suggested that the attribute of “management style” and “workload” could be removed as they were not the PhD student’s main concern compared with the other seven attributes when choosing a job. In addition, we consulted two experts in the field of DCE and three experts working in related public health trajectories for the remaining attributes. After the consultation, we retained the attribute of career promotion speed, removed the training and career development opportunity, and adjusted the level of monthly income from CNY 15,000–30,000 to CNY 10,000–25,000, equivalent to USD 1449.1–3622.7 (USD 1 = CNY 6.901 in 2020 based on OECD data). See Table 1 for more details regarding the attributes and levels.

2.4. DCE Design

We followed standard approaches for the design of the DCE in order to achieve unbiased, statistical response efficiency [27]. The DCE was based on seven attributes. Three of the seven attributes were described in choice tasks by three response levels, three attributes by two levels, and one attribute by four levels, yielding a total of (e.g., 3 × 3 × 3 × 2 × 2 × 2 × 4) 864 potential combinations. The design approach was informed by Huber and Zwerina [28], the DCE macros for SAS (version 9.4) were used for orthogonal main effect design, and selected profiles were organized into D-efficient choice designs (relative D-Efficiency: 77.9%) [29]. It is common practice in the DCE literature to include only main effects, because it is argued that such effects explain most of the variation in preferences [20]. In such case, only the main effect was estimated in our study. Finally, 36 choice sets were identified and were further divided into three blocks to reduce cognitive burden. Within each version, a single choice set was duplicated to examine the internal consistency of respondent choices. We did not leave respondents an opt-out option. This is consistent with our experiment setting. The doctoral SMHCM students are in the stages of career preparation; nearly all of them will enter the job market after graduation. Moreover, an opt-out may only introduces slight differences into the estimations [30], whereas the forced-choice method leads to more thoughtful responses and better-quality data [31]. All participants were randomized to receive one of the three versions according to their month of birth. (Block 1: January to April; Block 2: May to August; Block 3: September to December). An example of the DCE choice set is provided in Table S1.

2.5. Data Collection

In addition to the DCE questions, the online questionnaire also contained questions related to doctoral SMHCM students’ sociodemographic characteristics, job aspirations, occupational planning, and annual family income. A ranking question was conducted prior to the DCE choice sets to further examine the internal predictive validity of the DCE results, in which respondents were asked to rank three attributes (within seven attributes) from most important to least important with respect to their job preferences. At the end of the questionnaire, the respondents were given a task to indicate, on a 5-point scale, the level of difficulty in understanding the 13 DCE choice tasks. The questionnaire was piloted among doctoral SMHCM students at Fudan University and Shandong University, before data collection was conducted between July and October of 2020, to examine the comprehensibility, acceptability, and validity of the questionnaire, with the language and layout being revised thereafter.

2.6. Data Analysis

STATA 15.1 was used for all analyses. Descriptive statistics were reported for participants’ socio-demographic characteristics, the ranking results, and the 5-point scale score. The utility (U) associated with a particular job is made up of two components: the deterministic component, v n i , and the unobservable component, ε n i . The utility function for the individual, n, associated with job, I, can be specified as:
〖U〗_ni = v_ni + 〖ε〗_ni
=〖 β〗_1〖Location〗_(second-tier city) + β_2 〖Location〗_(first-tier city)+
〖 β〗_3 〖Housing〗_(allowance) + β_4 〖Housing〗_(provided)+
β_5 〖〖Children〗^’ seducation〗_(good) + β_6 〖Promotion〗_(3 year)+
β_7 〖Promotion〗_(1 year) + β_8 〖Working environment 〗_(better)+
〖 β〗_9 〖bianzhi 〗_offer + β_10 Monthly Income+〖 ε〗_ni
(1)
Two econometric models were considered: the conditional logit (Clogit) and the mixed logit (MIXL), which uses random coefficients to accommodate potential unobserved preference heterogeneity [32]. The Akaike information criterion (AIC) and Bayesian information criterion (BIC) were used for model comparisons [33,34]. The sensitivity of the final model was tested by allowing for 500, 1000, 1500, and 2000 Halton draws, showing no significant effect on parameters [35]. The final model used 500 draws.
Attributes were coded to dummy variables. When estimating MIXL, all coefficients were specified as random (normally distributed), except for monthly income, which was fixed to facilitate a calculation of willingness to pay (WTP; that is, the relative monetary value that doctoral SMHCM students place on different aspect of the job attribute levels: (−(β(1,2…9))/β10, where β_10 is the salary coefficient and β_((1,2…9)) is the coefficient for attribute level 1, 2…9). Finally, we also conducted an uptake rate study to understand to what extent the probability of choosing a given post changes as the levels of the attributes are changed.

3. Results

3.1. Respondents

A total of 193 individuals from 41 universities participated in the online survey, among which 26 (from 17 universities) were excluded because their universities did not have an SMHCM major; we therefore took them as invalid data. Among the remaining 167 participants (24 universities from 13 provinces), only 14 (8.4%) participants failed the internal consistency test (internal predictive validity), suggesting a very high level of engagement among the participants. The analysis sample (n = 153) had a mean age of 28.8 years (SD = 4.5). Most were female (62.1%), came from urban areas (65.4%), and were single (69.9%). Around 79.1% of the PhD students had decided to do a major-related job after graduation, while 18.9% has not made up their minds. See Table 2 for more details. For the ‘5-point scale’ question, 61 respondents (39.9%) thought it was easy or very easy to understand the 13 DCE questions, 66 respondents (43.1%) thought it was normal, and only 26 respondents (17.0%) thought it was difficult or very difficult, suggesting a high data quality of DCEs in our survey.

3.2. DCE Results

The DCE results reported were all based on the analysis sample (3672 observations from 153 doctoral SMHCM students). A sensitivity analysis was undertaken, including the 14 participants who failed the internal consistency test (Table S2), and these changes did not materially affect the findings. The AIC and BIC values suggested that the MIXL estimates were preferable to the Clogit estimates for the analysis sample and the results from MIXL were not substantially different from the Clogit. As such, the main paper reports the MIXL estimates (Table 3), and the Clogit estimates are presented in Table S3.
Statistical significance of all the mean preference parameters suggest that the selected attributes are all significant predictors of the job choice. Some estimated standard deviations are significant, indicating the existence of preference heterogeneity. Results from the MIXL show that doctoral SMHCM students strongly favored first-tier cities over third-tier cities (β = 1.576; p < 0.001). Doctoral SMHCM students also exhibited strong preferences for provided housing compared with no housing benefits (β = 1.004; p < 0.001), as well as bianzhi compared with no bianzhi (β = 0.964; p < 0.001). Doctoral SMHCM students expressed a preference for 1 year to get promoted (β = 0.633; p < 0.001), as well as good children’s education (β = 0.498; p < 0.001). Better working environment was deemed the least important (β = 0.344; p < 0.001).

3.3. Willingness to Pay

The WTP analysis revealed that doctoral SMHCM students were willing to forgo CNY 12,409.4 to attend a job in a first-tier city rather than in a third-tier city. Doctoral SMHCM students were willing to forgo CNY 7905.5 for housing provided rather than no housing benefits provide. In terms of bianzhi, they were willing to forgo CNY 7590.6 to get a job with bianzhi. The results of selective sub-group analyses are presented in Table 4 and Figure 1. For the subgroup analysis, a job in a first-tier city was more likely to lead to a higher utility value for doctoral SMHCM students who were women, married, coming from an urban area, and had a high annual family income. In addition, compared with female students, the male students were willing to forgo more for a job with 1 year to get promoted.

3.4. Uptake Rate

The uptake rate results are shown in Figure 2. The initial (baseline: CNY 10,000 monthly income; no housing benefits; ordinary children’s education opportunities; career promotion after 5 year; no bianzhi, ordinary working environment) probability of taking a third-tier city job is 17.1%, hence the probability of taking a first-tier city job is 82.9%. For the single incentives, only increasing monthly income from CNY 10,000 to 25,000 made the probability of choosing a third-tier city job (58.2%) exceed the probability of choosing a job in a first-tier city (41.8%). For the given multiple incentives, the policy “③ + ⑤ + ⑥ + ⑦” was the most attractive one, as it can increase the probability of taking a third-tier city job to 76.0%.

4. Discussion

Our study shows that the majority of the PhD students prefer to find a job in the university or research institution; only a few students plan to work at CDCs. Although respect for the CDC workforce was significantly enhanced after the COVID-19 outbreak, their wages, however, still decreased [36]. Turnover is a common phenomenon, both in national CDCs and local CDCs in China because of the low salary [7]. Our study confirms that financial incentives are still the most important lever for recruitment and retention, and when compared across employment locations, the magnitude of the incentive has an effect. For example, a CNY 5000 (USD 724.5) salary increase from baseline was relatively ineffective but became significant when further increased (Figure 2).
Among non-monetary attributes, working in first-tier cities is the most important factor, especially for students from urban areas. The results of ranking job posting attributes according to their importance in Figure S1 again confirmed the importance of employment location. Large metropolitan centers offer more career and educational advancement, better employment prospects, and easier access to lifestyle-related services and amenities [37]. Studies from other countries have reported that the more urban the job, the more it will be preferred [38,39]. In addition, students from urban areas showed a much stronger preference to work in a first-tier city. Therefore, as one possible emergent option, attracting and retaining doctoral SMHCM students from a rural background for the grassroots CDCs might be more effective.
In teams of housing benefits, providing housing allowance is moderately effective, but providing housing is a very powerful non-financial strategy. This shows the importance of providing housing for doctoral SMHCM students when choosing a job. Other studies have also shown similar results [40]. In recent years, although the Chinese government has always adhered to the policy that ‘houses are used for living, not for speculation’, and local governments have also implemented a series of measures, such as restricting the purchase and loan of houses and increasing the supply of affordable housing, housing prices still exceed the affordability of ordinary office workers [41]. Constrained by their financial capacity, the CDCs in third-tier cities may not be able to provide housing for their employees, but housing benefits, coupled with other incentives such as good educational resources, may work equally well. Other research also found that a bundle of incentives, such as housing combined with education opportunities or an improved working environment, are more likely to be effective in retaining health workers in the long term [42].
Contrary to our previous studies with heath administration [22], nurse [23], or medical students [43], which found that bianzhi has the lowest utility in job preferences, bianzhi is another important non-monetary factor that influenced the doctoral SMHCM students job choice in this study. In China, bianzhi refers to the authorized number of personnel (the number of established posts) in a party or government administrative organ, a service organization, or a working unit; a job with bianzhi means more stability [44]. This is perhaps because the respondents in this study were older, with an average age of 28.8, and some of them had started a family, so a job with bianzhi may have been more important for them. This suggests that, to avoid brain-drain from the CDC system, it is necessary to prepare positions with bianzhi for the more important roles, and the quantity of bianzhi allocated for high-level public health talents may increase based on needs.
Career promotion speed is another important nonmonetary factor, especially for male doctoral SMHCM students. Similar results have been obtained in other human resource DCE-based studies in low- and middle-income countries [40,45]. Snow et al. [46] indicated that the absence of senior posts in underdeveloped areas is an important factor associated with the feeling of “professional imprisonment” identified by those working in rural and remote posts. Another study conducted in China found that the most important factor influencing job satisfaction in CDCs was personal development [47]. In this case, developing clear career paths for rural and remote area posts and adopting strategies to increase public recognition are strongly recommended strategies.
The children’s education opportunities attribute was found to have a relatively smaller effect on doctoral SMHCM student’s job preferences than employment location, housing benefits, or career promotion speed. It seems contrary to the study conducted in Nepal [48] in which children’ education was found to be a much stronger predictor of choice. It could be that most of the doctoral SMHCM students we studied had not started a family, so perhaps their future children’s education was not among their main concerns. The subgroup analysis in our study also strengthened the above assumption that married doctoral students have a stronger preference for children’s education compared with unmarried doctoral students.
Working environment was the least important factor for doctoral SMHCM student’s job preferences. It was contrary to our previous studies, which strongly suggested a preference for improved working environments [22]. This finding is consistent with the results of an earlier quantitative study in which working environment was not thought of as a major contributing factor towards job choice for the doctoral students in China [49]. This suggests that changing the working environment may not be an effective or optimal method to improve recruitment and retention problems for China’s CDCs.
The pandemic of COVID-19 highlights the importance of strengthening public health systems. In the future, the demand for a public health workforce in disease control systems will increase. In addition to our study, other studies have also found that many public health graduates were unwilling to devote themselves to CDCs [5,50]. To address the potential challenge of a human resources shortage in the disease control system of China, further qualitative research, such as in-depth interviews and focus group discussions involving doctoral SMHCM students, is required to determine the specific reasons why they are unwilling to work at CDCs.
There are several limitations in this study. First, the generalizability of the study findings may be limited by the convenience sampling approach. It is not possible to identify the statistics of the target population of SMHCM PhD students currently being trained at universities in China, so the representativeness of our sample could not be fully assessed. It should also be noted that, while 153 students seems to be a relatively small sample, each had responded to 12 choice questions, resulting in a total sample size of 3672 choice observations for data analysis. The mean preference coefficients (as shown in Table 3) were mostly highly significant. Second, DCE analysis stems from the fact that a choice experiment does not offer a multitude of attributes because the choice task becomes difficult and respondents are less willing to critically appraise each attribute as the list grows. Not all potentially important attributes, such as workload, were assessed. Third, the data collected in the DCEs were based on choices among hypothetical job alternatives, and differences may arise between students’ stated and actual choices. Finally, the respondents in this study were not limited to final year doctoral SMHCM students. Though job preferences may vary between PhD students at different grades, given the limited sample size, we were unable to examine this difference.

5. Conclusions

Although China has conducted a series of DCE-based studies on graduates, the respondents were mainly undergraduate graduates [22,23,43,51]. To the best of our knowledge, this is the first study using DCE methodology to investigate the job preferences of public health related major’s doctoral students internationally. Our study suggests that monthly income and employment location were the most important attributes that impact the student’s job choices. A more effective human resource policy intervention to attract doctoral SMHCM students to work in CDCs, especially CDCs in third-tier cities, should consider both the incentives of the job itself and the background of students. Doctoral SMHCM students are in the stages of career preparation, so the results of this study will be more effective to inform policymakers regarding the design of recruitment and retention policies in the public health setting.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph18189474/s1, Figure S1: Numbers of job attributes chosen as determining factors with different levels, Table S1: Example combination of choice: Which of these jobs would you prefer?, Table S2: Mixed logit estimates (n = 167), Table S3: Conditional logit estimates (n = 153).

Author Contributions

Conceptualization, S.L. (Shimeng Liu), and Y.C.; methodology, S.L. (Shimeng Liu), C.T., and S.L. (Shunping Li); investigation, S.L. (Shimeng Liu), Y.C., S.L. (Shunping Li), C.T., and Y.W.; formal analysis, S.L. (Shimeng Liu); data curation, S.L. (Shimeng Liu); writing—original draft preparation, S.L. (Shimeng Liu); writing—review and editing, S.L. (Shimeng Liu), N.X., Y.C., S.L. (Shunping Li), and C.T.; supervision, Y.C.; funding acquisition, Y.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 72074047).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of school of public health, Fudan University (IRB#2020-10-0853; 20 October 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used and/or analyzed during the study are available from the corresponding author on reasonable request.

Acknowledgments

The authors thank all the participants for their time and effort. Responsibility for any remaining errors lies solely with the authors.

Conflicts of Interest

The authors declare that they have no competing interest.

Abbreviations

DCEDiscrete Choice Experiment
WTPWillingness to Pay
SMHCMSocial Medicine and Health Care Management
CDCCenters for Disease Control and Prevention
CNYChinese Yuan
95% CI95% Confidence Intervals
AICAkaike Information Criterion
BICBayesian Information Criterion
SEStandard Error
SDStandard Deviation

References

  1. Narayan, K.M.V.; Curran, J.W.; Foege, W.H. The COVID-19 Pandemic as an Opportunity to Ensure a More Successful Future for Science and Public Health. JAMA 2021, 325, 525–526. [Google Scholar] [CrossRef]
  2. Liang, W.N.; Hu, Z.; Wang, Y.D. Health Care Administration, 4th ed.; People’s Medical Publishing House Press: Beijing, China, 2017. (In Chinese) [Google Scholar]
  3. Wang, Q.; Zhou, P.; Hu, M.; Huang, J.X. Analysis on the Whereout of Public Health Undergraduate Graduates. China High. Med. Educ. 2010, 7, 3–4. (In Chinese) [Google Scholar]
  4. Wang, S.P.; Mao, Y.L.; Wang, X.F.; Bai, X.; Wu, H.Z. Comparison and Analysis on the Health Management Staff between China and Other Countries. Foreign Med. Health Econ. 2011, 28, 49–53. (In Chinese) [Google Scholar]
  5. Li, Y.Q.; Chen, H.; Guo, H.Y. Examining Inequality in the Public Health Workforce Distribution in the Centers for Disease Control and Prevention (CDCs) System in China, 2008–2017. Biomed. Environ. Sci. 2020, 33, 374–383. [Google Scholar] [PubMed]
  6. Weil, T.P. Health management education in Europe and in the United States: A comparative review and analysis. Health Serv. Manag. Res. 2013, 26, 76–85. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. China Education Daily. How to Improve Public Health Personnel Training. Available online: http://www.jyb.cn/rmtzgjyb/202003/t20200325_310379.html (accessed on 22 November 2020). (In Chinese).
  8. National Health Commission of the People’s Republic of China. Statistical Bulletin of Health Development in China (2009–2018). Available online: http://www.nhc.gov.cn/wjw/gongb/list.shtml (accessed on 22 November 2020). (In Chinese)
  9. Whitty, J.A.; Gonçalves, A.S.O. A Systematic Review Comparing the Acceptability, Validity and Concordance of Discrete Choice Experiments and Best-Worst Scaling for Eliciting Preferences in Healthcare. Patient 2018, 11, 301–317. [Google Scholar] [CrossRef]
  10. Ryan, M.; Scott, D.A.; Reeves, C.; Bate, A.; van Teijlingen, E.R.; Russell, E.M.; Napper, M.; Robb, C.M. Eliciting public preferences for healthcare: A systematic review of techniques. Health Technol. Assess. 2001, 5, 1–186. [Google Scholar] [CrossRef] [PubMed]
  11. Lagarde, M.; Blaauw, D.A. review of the application and contribution of discrete choice experiments to inform human resources policy interventions. Hum. Resour. Health 2009, 7, 62. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Hu, W.X.; Xu, W.H.; Xu, J.G.; Bai, L.L.; Wang, L.D. Bibliometric analysis of research on discrete choice experiment in the healthcare system of China. J. Nanjing Med. Univ. (Soc. Sci.) 2020, 20, 157–161. (In Chinese) [Google Scholar]
  13. Soekhai, V.; de Bekker-Grob, E.W.; Ellis, A.R.; Vass, C.M. Discrete Choice Experiments in Health Economics: Past, Present and Future. Pharmacoeconomics 2019, 37, 201–226. [Google Scholar] [CrossRef] [Green Version]
  14. Cleland, J.A.; Johnston, P.; Watson, V.; Krucien, N.; Skåtun, D. What do UK medical students value most in their careers? A discrete choice experiment. Med. Educ. 2017, 51, 839–851. [Google Scholar] [CrossRef] [PubMed]
  15. Liu, P.; Liu, S.; Gong, T.; Li, Q.; Chen, G.; Li, S. Job preferences of undergraduate pharmacy students in China: A discrete choice experiment. Hum. Resour. Health 2021, 19, 79. [Google Scholar] [CrossRef]
  16. Orme, B.K. Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research, 3rd ed.; Research Publishers LLC: Glendale, CA, USA, 2014; pp. 1–234. [Google Scholar]
  17. Marshall, D.; Bridges, J.F.; Hauber, B.; Cameron, R.; Donnalley, L.; Fyie, K.; Johnson, F.R. Conjoint Analysis Applications in Health—How are Studies being Designed and Reported?: An Update on Current Practice in the Published Literature between 2005 and 2008. Patient 2010, 3, 249–256. [Google Scholar] [CrossRef]
  18. de Bekker-Grob, E.W.; Donkers, B.; Jonker, M.F.; Stolk, E.A. Sample size requirements for discrete-choice experiments in healthcare: A practical guide. Patient 2015, 8, 373–384. [Google Scholar] [CrossRef] [Green Version]
  19. Louviere, J.J.; Hensher, D.A.; Swait, J.D. Stated Choice Methods: Analysis and Applications; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
  20. de Bekker-Grob, E.W.; Ryan, M.; Gerard, K. Discrete choice experiments in health economics: A review of the literature. Health Econ. 2012, 21, 145–172. [Google Scholar] [CrossRef] [PubMed]
  21. Louviere, J.J.; Lancsar, E. Choice experiments in health: The good, the bad, the ugly and toward a brighter future. Health Econ. Policy Law 2009, 4 Pt 4, 527–546. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Liu, S.; Li, S.; Li, Y.; Wang, H.; Zhao, J.; Chen, G. Job preferences for healthcare administration students in China: A discrete choice experiment. PLoS ONE 2019, 14, e0211345. [Google Scholar] [CrossRef] [Green Version]
  23. Liu, T.; Li, S.; Yang, R.; Liu, S.; Chen, G. Job preferences of undergraduate nursing students in eastern China: A discrete choice experiment. Hum. Resour. Health 2019, 17, 1. [Google Scholar] [CrossRef] [Green Version]
  24. Mandeville, K.L.; Lagarde, M.; Hanson, K. The use of discrete choice experiments to inform health workforce policy: A systematic review. BMC Health Serv. Res. 2014, 14, 367. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Ryan, M.; Kolstad, J.; Rockers, P. How to Conduct a Discrete Choice Experiment for Health Workforce Recruitment and Retention in Remote and Rural Areas: A User Guide with Case Studies; World Health Organization, World Bank, and CapacityPlus: Geneva, Switzerland, 2012. [Google Scholar]
  26. Wang, Y.; Wang, Z.; Wang, Z.; Li, X.; Pang, X.; Wang, S. Application of Discrete Choice Experiment in Health Care: A Bibliometric Analysis. Front. Public Health 2021, 9, 673698. [Google Scholar] [CrossRef]
  27. Reed Johnson, F.; Lancsar, E.; Marshall, D.; Kilambi, V.; Mühlbacher, A.; Regier, D.A.; Bresnahan, B.W.; Kanninen, B.; Bridges, J.F. Constructing experimental designs for discrete-choice experiments: Report of the ISPOR conjoint analysis experimental design good research practices task force. Value Health 2013, 16, 3–13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Huber, J.; Zwerina, K. The importance of utility balance in efficient choice designs. J. Mark. Res. 1996, 33, 307–317. [Google Scholar] [CrossRef]
  29. Kuhfeld, W.F. Experimental design, choice, conjoint, and graphical techniques. In Marketing Research Methods in SAS; SAS Institute Inc.: Cary, NC, USA, 2005. [Google Scholar]
  30. Fiebig, D.; Louviere, J.J.; Waldman, D. Contemporary Issues in Modelling Discrete Choice Experimental Data in Health Economics; University of New South Wales: Sydney, Australia, 2005; Working paper. [Google Scholar]
  31. Veldwijk, J.; Lambooij, M.S.; de Bekker-Grob, E.W.; Smit, H.A.; de Wit, G.A. The effect of including an opt-out option in discrete choice experiments. PLoS ONE 2014, 9, e111805. [Google Scholar] [CrossRef] [PubMed]
  32. McFadden, D.; Train, K. Mixed MNL models for discrete response. J. Appl. Econ. 2000, 15, 447–470. [Google Scholar] [CrossRef]
  33. Hauber, A.B.; González, J.M.; Groothuis-Oudshoorn, C.G.; Prior, T.; Marshall, D.A.; Cunningham, C.; IJzerman, M.J.; Bridges, J.F. Statistical Methods for the Analysis of Discrete Choice Experiments: A Report of the ISPOR Conjoint Analysis Good Research Practices Task Force. Value Health 2016, 19, 300–315. [Google Scholar] [CrossRef] [Green Version]
  34. Hensher, D.A. Accounting for scale heterogeneity within and between pooled data sources. Transp. Res. Part A-Policy Pract. 2012, 46, 480–486. [Google Scholar] [CrossRef]
  35. Train, K. Discrete Choice Methods with Simulation, 2nd ed.; Cambridge University Press: New York, NY, USA, 2009. [Google Scholar]
  36. Cheng, J.Q. Thoughts and suggestions on modern construction of disease prevention and control system. Chin. J. Prev. Med. 2020, 54, 475–479. (In Chinese) [Google Scholar]
  37. Zhang, W.; Jing, W.M.; Wang, Y.J. What Determines the Talent Attractiveness of First-tier Cities? Based on the Random Forest Algorithm of Influential Factors. Sci. Technol. Manag. Res. 2017, 37, 99–108. (In Chinese) [Google Scholar]
  38. Honda, A.; Vio, F. Incentives for non-physician health professionals to work in the rural and remote areas of Mozambique--a discrete choice experiment for eliciting job preferences. Hum. Resour. Health 2015, 13, 23. [Google Scholar] [CrossRef] [Green Version]
  39. Girardi, S.N.; Carvalho, C.L.; Maas, L.W.; Araujo, J.F.; Massote, A.W.; Stralen, A.C.S.V.; Souza, O.A. Preferences for work in primary care among medical students in Minas Gerais State, Brazil: Evidence from a discrete choice experiment. Cad. Saude Publica 2017, 33, e00075316. [Google Scholar] [PubMed] [Green Version]
  40. Rockers, P.C.; Jaskiewicz, W.; Kruk, M.E.; Phathammavong, O.; Vangkonevilay, P.; Paphassarang, C.; Phachanh, I.T.; Wurts, L.; Tulenko, K. Differences in preferences for rural job postings between nursing students and practicing nurses: Evidence from a discrete choice experiment in Lao People’s Democratic Republic. Hum. Resour. Health 2013, 11, 22. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Lin, M. Pressure and anxiety of young people in contemporary China. Peoples Trib. 2019, 33, 78–80. (In Chinese) [Google Scholar]
  42. Lehmann, U.; Dieleman, M.; Martineau, T. Staffing remote rural areas in middle- and low-income countries: A literature review of attraction and retention. BMC Health Serv. Res. 2008, 8, 19. [Google Scholar] [CrossRef] [Green Version]
  43. Liu, S.; Li, S.; Yang, R.; Liu, T.; Chen, G. Job preferences for medical students in China: A discrete choice experiment. Medicine 2018, 97, e12358. [Google Scholar] [CrossRef]
  44. Brodsgaard, K.E. Institutional reform and the Bianzhi system in China. China Q. 2002, 170, 361–386. [Google Scholar] [CrossRef]
  45. Blaauw, D.; Erasmus, E.; Pagaiya, N.; Tangcharoensathein, V.; Mullei, K.; Mudhune, S.; Goodman, C.; English, M.; Lagarde, M. Policy interventions that attract nurses to rural areas: A multicountry discrete choice experiment. Bull. World Health Organ. 2010, 88, 350–356. [Google Scholar] [CrossRef]
  46. Snow, R.C.; Asabir, K.; Mutumba, M.; Koomson, E.; Gyan, K.; Dzodzomenyo, M.; Kruk, M.; Kwansah, J. Key factors leading to reduced recruitment and retention of health professionals in remote areas of Ghana: A qualitative study and proposed policy solutions. Hum. Resour. Health 2011, 9, 1–11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Li, N.; Wang, Y.; Yu, D.; Xiao, S.; Liu, Y. Job satisfaction of staff in agencies for disease prevention and control in Hainan Province, China. J. Pak. Med. Assoc. 2020, 70, 523–525. [Google Scholar]
  48. Gautam, B.; Sapkota, V.P.; Wagle, R.R. Employment preferences of obstetricians and gynecologists to work in the district hospitals: Evidence from a discrete choice experiment in Nepal. Hum. Resour. Health 2019, 17, 96. [Google Scholar] [CrossRef] [PubMed]
  49. The Editorial Department of Science and Technology Review. An Analysis of Career Expectations for PhD Graduates. Sci. Technol. Rev. 2008, 12, 19–22. (In Chinese) [Google Scholar]
  50. Qi, X.; Wang, Y.; Xia, L.; Meng, Y.; Li, Y.; Yu, S.; Su, X.; Jin, S.; Li, Y.; Ge, H.; et al. Cross-sectional survey on public health informatics workforce in China: Issues, developments and the future. Public Health 2015, 129, 1459–1464. [Google Scholar] [CrossRef] [PubMed]
  51. Wu, D.; Shi, Y.; Wu, S. Aspects prioritized by nursing undergraduates during choosing a position in grassroots medical institutions analyzed based on the discrete choice experiment. Chin. Gen. Pract. 2017, 20, 3759–3762. (In Chinese) [Google Scholar]
Figure 1. Willingness to pay estimation for subgroup population.
Figure 1. Willingness to pay estimation for subgroup population.
Ijerph 18 09474 g001
Figure 2. Simulated preferences for job posting under different potential policy scenarios.
Figure 2. Simulated preferences for job posting under different potential policy scenarios.
Ijerph 18 09474 g002
Table 1. Attributes and attribute levels.
Table 1. Attributes and attribute levels.
AttributeLevelDescription
Monthly incomeCNY 10,000Pre-tax salary
CNY 15,000
CNY 20,000
CNY 25,000
Employment locationFirst-tier cityRepresents the larger cities, such as Beijing, Shanghai, Shenzhen, and Guangzhou
Second-tier cityRepresents the medium-sized cities, such as Qingdao and Xiamen
Third-tier cityRepresents the minor cities, such as Weifang and Luoyang
Housing benefitsNo housing benefitsHousing provided means a decent house is provided.
Housing allowance provided
Housing provided
Children’ education opportunitiesOrdinaryThe educational opportunities available for children (including elementary school, middle school, or high school) in the workplace.
Good
Career promotion speed1 year laterThe number of years you would have to work before being eligible for promotion.
3 year later
5 year later
Working environmentOrdinaryRefers to the physical and social environment associated with the work
Better
bianzhiNoneA job with bianzhi means more stability
Offer
US$1 = CNY 6.901; https://data.oecd.org/conversion/exchange-rates.htm (2020). (accessed on 18 February 2021).
Table 2. Respondent characteristics.
Table 2. Respondent characteristics.
Full Sample:
n = 167
Analysis Sample:
n = 153
Excluded Sample:
n = 14
χ2 (p-Value)
n%n%n%
Age (year), Mean ± SD28.84.528.84.529.13.5
Gender 0.026 (0.871)
Male6337.75837.9535.7
Female10462.39562.1964.3
Birthplace
Rural5935.35334.6642.9
Urban10864.710065.4857.1
Marital status 0.529 (0.912)
Unmarried11870.710769.91178.6
Married4828.74529.4321.4
Divorced/Widow10.610.700
Monthly consumption (CNY) 3.465 (0.629)
<15003319.82919.0428.6
1500–25007041.96542.5535.7
2500–35002313.82113.7214.3
3500–4500148.4149.200
4500–550042.432.017.1
>55002313.82113.7214.3
Annual family income (CNY) 2.865 (0.826)
<50,0002917.32516.3428.6
50,000–100,0003923.33623.5321.4
100,000–150,0003722.23321.6428.6
150,000–200,0002213.22113.717.1
200,000–250,000127.2117.217.1
250,000–300,00084.885.200
>300,0002012.01912.417.1
Will you take a job related to your major after graduation? 0.971 (0.615)
Yes13178.412179.11071.4
No31.832.000
Not sure3319.82918.9428.6
Career planning (multiple-choice: Times was selected)
University or scientific research institution 126
Hospital 63
CDCs 18
Government agency 71
Pharmaceutical company 39
Others 6
SD: standard deviation; CNY: Chinese yuan; CDC: Centers for Disease Control and Prevention.
Table 3. MIXL estimates and WTP (n = 153).
Table 3. MIXL estimates and WTP (n = 153).
Attributes and LevelsβSESDSEWTP (CNY)95% CI
Employment location (ref: Third-tier city)
Second-tier city1.080 ***0.1470.931 ***0.1868503.96424.410,799.6
First-tier city1.576 ***0. 2202.045 ***0.23812,409.49184.916,177.9
Housing benefits (ref: No housing benefits)
Housing allowance provided0.480 ***0.1190.0150.1833779.51984.05600.5
Housing provided1.004 ***0.1380.547 ***0.1777905.55910.810,194.6
Children’s education opportunities (ref: Ordinary)
Good0.498 ***0.0900.398 ***0.1523921.32531.45437.9
Career promotion speed (ref: 5 year)
3 year0.287 ***0.1120.0040.1962259.8526.44076.3
1 year0.633 ***0.1240.609 ***0.1974984.33083.87047.3
Working environment (ref: Ordinary)
Better0.344 ***0.0820.1880.2922708.71467.34007.9
bianzhi (ref: None)
Offer0.964 ***0.1150.732 ***0.1267590.65890.99475.5
Monthly income0.000127 ***0.000011
LR chi2(10)161.950
Number of observations3672
Log likelihood−914.985
AIC1867.971
BIC1985.932
*** p < 0.01; _β: coefficient; WTP: willingness to pay; CNY: Chinese yuan; SD: standard deviation; SE: standard error; 95% CI: 95% confidence intervals; AIC: Akaike information criterion; BIC: Bayesian Information Criterion.
Table 4. Subgroup analyses.
Table 4. Subgroup analyses.
Attributes and LevelsMale (n = 58)Female (n = 95)
βSESDSEβSESDSE
Second-tier city0.803 ***0.2350.912 ***0.2881.331 ***0.2111.102 ***0.279
First-tier city1.248 ***0.3642.276 ***0.4621.979 ***0.3062.107 ***0.338
Housing allowance provided0.357 *0.1880.0100.2430.593 ***0.1710.1020.571
Housing provided0.860 ***0.1980.1390.4861.145 ***0.2030.846 ***0.231
Good children’s education opportunities0.428 ***0.1330.0430.3560.572 ***0.1300.612 ***0.192
Career Promotion: 3 year0.307 *0.1830.0470.3070.316 **0.1530.0310.232
Career Promotion: 1 year0.779 ***0.2190.642 **0.2820.657 ***0.1730.662 ***0.245
Working environment: better0.357 **0.1390.2540.3180.368 ***0.1210.399 **0.190
bianzhi: offer0.759 ***0.1800.819 ***0.2291.189 ***0.1650.755 ***0.178
Monthly income0.000139 ***0.000020 0.000133 ***0.000017
Attributes and levelsUnmarried (n = 107)Married (n = 45)
βSESDSEβSESDSE
Second-tier city1.011 ***0.1710.872 ***0.2261.298 ***0.3361.382 ***0.416
First-tier city1.435 ***0.2491.960 ***0.3022.076 ***0.5002.756 ***0.618
Housing allowance provided0.527 ***0.1420.0030.2080.4170.2630.3480.531
Housing provided0.878 ***0.1550.533 **0.2161.434 ***0.3250.4030.408
Good children’s education opportunities0.395 ***0.0970.2230.2980.855 ***0.2330.659 **0.262
Career Promotion: 3 year0.1080.1280.0140.2100.847 ***0.2710.1000.416
Career Promotion: 1 year0.527 ***0.1450.626 ***0.2261.156 ***0.3020.759 **0.379
Working environment: better0.324 ***0.1040.442 **0.1750.428 **0.1810.0300.317
bianzhi: offer0.901 ***0.1240.555 ***0.1581.362 **0.3271.224 ***0.295
Monthly income0.000133 ***0.000014 0.000137 ***0.000025
Attributes and levelsRural (n = 53)Urban (n = 100)
βSESDSEβSESDSE
Second-tier city0.586 ***0.2110.676 **0.3221.367 ***0.2051.111 ***0.254
First-tier city0.801 ***0.2691.341 ***0.2812.194 ***0.3302.405 ***0.342
Housing allowance provided0.496 ***0.1870.0700.3110.474 ***0.1580.0670.280
Housing provided1.031 ***0.2100.3330.4080.997 ***0.1800.662 ***0.222
Good children’s education opportunities0.464 ***0.1400.2600.3110.548 ***0.1180.483 **0.208
Career Promotion: 3 year−0.0510.1780.0130.2710.486 ***0.1490.0280.258
Career Promotion: 1 year0.421 *0.2210.909 ***0.2530.753 ***0.1610.469 *0.265
Working environment: better0.452 ***0.1370.2990.3020.313 ***0.1070.1100.369
bianzhi: offer0.723 ***0.1770.759 ***0.2131.145 ***0.1590.760 ***0.179
Monthly income0.000145 ***0.000020 0.000123 ***0.000015
Attributes and levels≤150,000 CNY (n = 94)>150,000 CNY (n = 59)
βSESDSEβSESDSE
Second-tier city0.834 ***0.1780.940 ***0.2581.523 ***0.2771.050 ***0.291
First-tier city1.169 ***0.2722.035 ***0.3162.396 ***0.3992.172 ***0.439
Housing allowance provided0.371 **0.1530.0160.2370.668 ***0.2070.1110.336
Housing provided1.057 ***0.1710.3970.2800.912 ***0.2340.610 *0.280
Good children’s education opportunities0.504 ***0.1120.3190.2280.519 ***0.1580.639 ***0.234
Career promotion speed: 3 year0.1840.1440.0450.2190.487 **0.1920.0060.390
Career Promotion speed: 1 year0.502 ***0.1590.614 **0.2380.953 ***0.2210.585 *0.311
Working environment: better0.341 ***0.1100.3110.2780.364 **0.1410.1570.301
bianzhi: offer0.958 ***0.1570.851 ***0.1661.022 ***0.1850.601 ***0.224
Monthly income0.000142 ***0.000002 0.000110 ***0.000018
* p < 0.10; ** p < 0.05; *** p < 0.01; β: coefficient; SD: standard deviation; SE: standard error.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, S.; Chen, Y.; Li, S.; Xu, N.; Tang, C.; Wei, Y. What Are the Important Factors Influencing the Recruitment and Retention of Doctoral Students in a Public Health Setting? A Discrete Choice Experiment Survey in China. Int. J. Environ. Res. Public Health 2021, 18, 9474. https://doi.org/10.3390/ijerph18189474

AMA Style

Liu S, Chen Y, Li S, Xu N, Tang C, Wei Y. What Are the Important Factors Influencing the Recruitment and Retention of Doctoral Students in a Public Health Setting? A Discrete Choice Experiment Survey in China. International Journal of Environmental Research and Public Health. 2021; 18(18):9474. https://doi.org/10.3390/ijerph18189474

Chicago/Turabian Style

Liu, Shimeng, Yingyao Chen, Shunping Li, Ningze Xu, Chengxiang Tang, and Yan Wei. 2021. "What Are the Important Factors Influencing the Recruitment and Retention of Doctoral Students in a Public Health Setting? A Discrete Choice Experiment Survey in China" International Journal of Environmental Research and Public Health 18, no. 18: 9474. https://doi.org/10.3390/ijerph18189474

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop