Next Article in Journal
The Refraction Assessment and the Electronic Trial Frame Measurement during Standing or Sitting Position Can Affect Postural Stability
Next Article in Special Issue
Early Care and Education Center Environmental Factors Associated with Product- and Process-Based Locomotor Outcomes in Preschool-Age Children
Previous Article in Journal
COVID-19 Information Overload and Cyber Aggression during the Pandemic Lockdown: The Mediating Role of Depression/Anxiety and the Moderating Role of Confucian Responsibility Thinking
Previous Article in Special Issue
Physical Activity and Healthy Eating Programming in Schools to Support Student’s Health-Related Fitness: An Observational Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Usage of Digital Health Tools and Perception of mHealth Intervention for Physical Activity and Sleep in Black Women

Department of Kinesiology, College of Nursing and Health Innovation, University of Texas at Arlington, Arlington, TX 76019, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(3), 1557; https://doi.org/10.3390/ijerph19031557
Submission received: 14 December 2021 / Revised: 27 January 2022 / Accepted: 28 January 2022 / Published: 29 January 2022

Abstract

:
Black women of reproductive age are disproportionately affected by chronic health conditions and related disease risk factors such as physical inactivity and obesity. Health promotion studies need to focus on this population since optimizing preconception health will lead to improvement of both birth outcomes and the woman’s long-term health. mHealth interventions that utilize wearable sensors to provide personalized and timely feedback can be used to promote physical activity (PA). This study aimed to examine Black women’s wearable sensor usage and their perceptions about future mHealth interventions that target PA and sleep. Our analysis included 497 Black women (aged 18–47 years) who completed a cross-sectional online survey. Ninety-two percent of participants did not meet the recommended level of PA, and 32.3% reported poor sleep quality. More participants indicated interest in a remote PA program (77%) than an in-person one (73%). More than half of participants indicated interest in receiving personalized feedback messages based on wearable trackers about PA (58.1%) and sleep (63.5%). This perceived acceptability of remote intervention and wearable-based feedback messages did not differ by socioeconomic status. Remotely delivered mHealth interventions that utilize wearables can be a viable behavioral change strategy to promote PA and sleep quality in Black women.

1. Introduction

In the United States, the prevalence of cardiovascular disease (CVD) risk factors among women of reproductive age (18–49) has demonstrated a 40% increase over the last two decades, with the prevalence substantially greater among non-Hispanic Black women (hereafter referred to as Black women) [1]. Consequently, an increasing number of Black women are entering pregnancy with common CVD risk factors such as obesity, diabetes, and hypertension [1,2]. Further, compared to other racial groups, a greater percentage of Black women of reproductive age have undiagnosed CVD risk factors [2] which often go unrecognized and untreated [3,4]. Nonpregnant Black women of reproductive age are an important population for CVD prevention research considering that over half of all pregnancies are unplanned and the implications of cardiovascular health on maternal health (which is also an important marker of the overall health of a nation) and health later in life [5]. For example, CVD is not only the leading cause of death among Black women [6]; CVD, including cardiomyopathy, accounts for 27.8% of preventable maternal deaths among reproductive-age Black women [7]. However, compared to pregnant and older women (≥50 years), nonpregnant women of reproductive age are largely underrepresented in cardiovascular health research [4,8,9].
Several factors can increase one’s risk of developing CVD, including non-modifiable factors, such as genetics and age, and modifiable behavioral factors, such as smoking, diets rich in saturated fat and cholesterol, physical inactivity, and inadequate sleep [10]. While we recognize all these factors have their unique contributions to a person’s CVD risk, this paper will focus on two of the important modifiable behavioral factors, physical activity and sleep, in the scope of implications for digital and mobile health (mHealth) interventions. Physical activity and sleep represent two daily behaviors that can be automatically and continuously tracked by a wearable sensor, thus, providing opportunities to develop personalized, adaptive behavioral interventions [11].
Available evidence indicates that the disparity in some of these behavioral factors, such as physical activity and sleep, in Black women of reproductive age contributes to the disparities in cardiovascular health [12,13]. According to national surveillance data, Black women of reproductive age, compared to other racial/ethnic groups, are less likely to report getting the recommended levels of physical activity (defined as getting at least 150 min per week of moderate-intensity activity or at least 75 min per week of vigorous-intensity activity) and less likely to report being normal weight (defined as having a body mass index of 18.5–24.9 kg/m2) [14]. Further, compared to white women of reproductive age, Black women report shorter sleep prevalence regardless of pregnancy status [15]. A higher prevalence of Black reproductive age women also reports having trouble falling asleep, trouble staying asleep, and waking up most days (i.e., ≥4 days in the previous week) not feeling rested [15].
There is growing recognition that the fundamental driver of persistent racial/ethnic disparities in CVD, as well as disparities in behaviors such as physical activity and sleep, is structural racism [16]. Structural racism refers to the totality of ways in which society fosters racial discrimination through mutually reinforcing systems of housing, education, employment, healthcare, and other social determinants [16,17]. As a recognized determinant of health, structural racism creates stressful and unhealthy social and built environments which, in turn, can contribute to disparate behavioral risk factors, such as physical inactivity and inadequate sleep, among Black women [16,18]. For example, several social and structural factors are associated with lower levels of physical activity among Black women, including residential racial segregation, resulting in communities with fewer physical characteristics that promote physical activity [19,20], perceived time availability and monetary cost of exercise facilities, family/caregiving responsibilities, and lack of a physical activity partner or role models [21]. Similarly, decades of sleep disparities research indicate that a number of neighborhood and environmental factors, such as residential racial segregation (which can transcend socioeconomic status), and neighborhood ambient features of urban environments, such as loud noises or bright lights, can be deleterious to sleep [22]. Racial discrimination also has a known effect on sleep health through the consequences of psychosocial trauma, discrimination, and microaggressions [23]. Self-reported experiences of racial discrimination have been associated with shorter sleep duration among Black women [24]. It is believed that those experiencing racism—interpersonally or at the structural level—may have lower quality sleep because of greater “racism-related” vigilance—an inability to set aside worry and stress due to lifelong experiences with discrimination [22].
In attempts to address disparities in cardiovascular health, behavioral interventions that aim to promote an active lifestyle and adequate sleep are considered as some of the effective strategies to reduce CVD risk in Black women. Digital and mHealth interventions, which leverage mobile phones, wearable sensors, and related, Internet-linked services for health communication and monitoring, present innovative opportunities to promote more equitable health outcomes among Black women of reproductive age [25,26]. Current evidence suggests that consumer-based, wearable sensors and smartphones may serve as viable and feasible interventions to promote physical activity and sleep among reproductive-age Black women [27,28]. In the U.S., a greater percentage of Black women own smartphones (80%) compared to White women (72%) [29]. In addition, a slightly greater percentage of Black Americans (23%) reported using smartwatches or fitness trackers compared to all U.S. adults (21%) and White Americans (20%) [30]. Prior research has demonstrated high acceptability among Black Americans regarding the use of smartphones, smartwatches, or fitness tracker data for health research [26,30]. Despite high levels of access and acceptability of consumer-based, wearable sensors and smartphones among Black women, they remain underrepresented in mHealth research [26,31]. For example, Joseph and colleagues [31] identified only three digital and mHealth physical activity interventions, published between 2000 and 2016, that focused exclusively on Black women (i.e., [21,32,33]). One systematic review identified a few additional intervention studies that included a predominately Black sample (i.e., [34,35,36]). Joseph and colleagues also reported that those studies primarily used Internet-based websites and text messages; none reported evaluating the use of wearable sensors to promote physical activity. There are also few published mHealth studies focused on the use of consumer-based, wearable sensors to promote sleep among Black women [28]. Black women of reproductive age are well positioned to benefit from mHealth interventions using consumer-based, wearable sensors [26]. For example, utilizing data from consumer-facing, wearable sensors is an innovative way to provide personalized feedback to increase daily physical activity levels and decrease time in sedentary activities [11,37]. Recent advancements in wearable sensors also make tracking sleep much more accessible than before [38,39], thus, giving us a complete picture of a person’s 24 h movement behaviors (i.e., physical activity, sedentary behavior, and sleep). More research, however, is needed to inform the development of tailored, wearable, sensor-based mHealth intervention strategies that promote physical activity and sleep among Black women.
The purpose of this study is to explore Black women’s current wearable sensors usage and perceptions of receiving personalized feedback from those wearable sensors. The objectives of this study are to: (1) describe the current physical activity level and sleep quality in Black women of reproductive age; (2) assess their current usage and perceptions of wearable sensors; and (3) explore the associations between participants’ demographic characteristics and wearable sensors usage/perceptions. The present study contributes to the growing literature demonstrating the immense need for wearable sensor mHealth interventions focused on physical activity and sleep quality in racial/ethnic minority populations, specifically Black women [28,40].

2. Materials and Methods

The current study used a cross-sectional online survey of Black/African American women of reproductive age (18–49) who are residing in the United States. Participants were recruited using Prolific Academic, an online research platform designed to connect academic researchers with people who are interested in participating in online research studies [41]. Prolific Academic has been widely used as a high-quality platform for crowdsourcing behavioral research and provides a diverse pool of participants [42]. Once the research team posted the study survey to Prolific Academic, prospective participants who met the eligibility criteria were identified and notified by Prolific. Eligible individuals clicked the study survey link, completed the informed consent, and, if they agreed to the study, completed the survey. Participants were compensated at the rate of USD 9.54 per hour to complete this survey study.
QuestionPro (QuestionPro, Seattle, WA, USA) an online survey software, was used to administrate this survey study. The survey included 46 questions that assessed participants’ current physical activity level, sleep quality, health information technology usage, wearable tracker usage, perceptions of remotely delivered intervention, and demographic information. Survey items were derived from existing, validated survey instruments or from previous national studies [43,44,45]. Since the primary purpose of the survey was not to obtain a complete picture of participants’ behaviors (e.g., usual physical activity and sleep patterns), we used items from validated surveys to capture a “snapshot” of their current physical activity and sleep quality while keeping the survey brief. Please see the Supplemental Material for our survey.
The survey study was posted to Prolific Academic in February 2021 and the total response was capped to 500 individuals. Eligible participants enrolled in the study on a first-come, first-served basis. Data collection was completed within one week. Participants, on average, took 7 min to complete the survey. This study was approved by the Institutional Review Board at the University of Texas at Arlington (protocol #: 2021–0207).
Statistical analyses were conducted using the SPSS version 26.0 (IBM Corp, Armonk, NY, USA). Descriptive statistics were generated for all variables, including the mean and standard deviation for continuous variables and percentages for categorical variables. Binary logistic regression was used to obtain both the crude and adjusted estimated differences in responses by demographic characteristics. The adjusted models included all demographic variables in one model. A p-value of 0.05 or less was considered significant.

3. Results

3.1. Participant Characteristics

A total of 499 females enrolled and completed the survey study. Two individuals were excluded from the analysis since they did not indicate themselves to be Black or African American in our demographic question. Thus, our analytical sample included 497 Black women. Their average age was 28 years old (SD = 7.50, ranged 18–47 years). The majority of the women were non-Hispanic (95.9%), US-born (95.8%), and not currently pregnant (97.4%). Thirty-three percent of the women had been pregnant and/or had delivered a child. Table 1 details their demographic information.

3.2. Physical Activity Level and Sleep Quality

More than half of the women (54.3%) reported that they engaged in less than 30 min of moderate-intensity activities per week, 26.4% reported between 30–90 min/week, 11.5% reported between 90–150 min/week, and 7.8% reported more than 150 min/week. Eighty-two percent of the women indicated that they “need to be more active”. Thirty-seven percent of the participants indicated that they planned to start exercising regularly in the next 30 days, and 18% indicated they would start in the next 6 months.
Women in this study reported having an average of 6.6 h of sleep (SD = 1.38). Thirty-two percent of the women reported to have “fairly bad” or “very bad” sleep quality, and 27.2% indicated they had taken medication (prescribed or over-the-counter) to help them sleep in the past month.

3.3. Digital Health Tools Usage and Perceptions of mHealth Interventions

Thirty-nine percent of the women reported to have owned a wearable fitness tracker or smartwatch, and 16% reported that they have not owned one but were planning to get one in the next few months. Table 2 shows the results from the crude and adjusted logistic regression model. Compared to those who were not employed, participants who were employed full-time were more likely to have owned a wearable device in both the crude (odds ratio = 2.241; p < 0.05) and adjusted models (odds ratio = 1.835; p < 0.05). Those who had completed a bachelor’s degree or higher were more likely to have owned a wearable device than those without a bachelor’s degree (51.2% vs. 30.8%, respectively; odds ratio = 2.359, p < 0.01). This effect of education level persisted after controlling for all other demographic variables (odds ratio = 1.897, p < 0.01). Those with an annual household income of more than $50,000 were more likely to have owned a wearable device than those with less income (49.3% vs. 31.1%, respectively; odds ratio = 2.157, p < 0.01). The effect of household income was consistent in the adjusted model (odds ratio = 1.852, p < 0.01). Wearable device ownership did not differ by age, marital status, insurance status, or chronic disease conditions. Consistent with results for current/previous ownership, participants who were employed full-time were more likely to report planning to get a wearable device in the next few months compared to those who were not employed in both the crude (odds ratio = 2.449; p < 0.05) and adjusted models (odds ratio = 2.390; p < 0.05). Further, women aged 30 years and older were more likely to report planning to get a wearable device compared to those who were younger (34.8% vs. 21.1%, respectively; odds ratio = 1.989, p = 0.01). This effect of age persisted after controlling for all other demographic variables (odds ratio = 2.016, p < 0.05). Planning to get a wearable device did not differ by marital status, education, household income, insurance status, or chronic disease conditions. The most frequently reported primary goal for using the wearable trackers was to track activity levels for both current/previous (35.8%) and planned owners (15.5%; see Figure 1).
All but three women reported owning a smartphone (99.4%). Of those who owned a smartphone, 56.5% owned an iPhone, and 43.5% owned an Android phone. Eighty-eight percent of smartphone owners reported using their phones to look up information about a health condition during the past 12 months. Sixty-one percent reported they had used a health-related smartphone application (app) at least a couple times during the past 12 months. Fifteen percent reported using a health-related app almost daily (see Figure 2). Table 3 shows the results from the crude and adjusted logistic regression model. Women aged 30 years and older were less likely to have used any health-related app in the past 12 months compared to those who were younger (55.1% vs. 65.0%, respectively; odds ratio = 0.659, p = 0.03). The effect of age was consistent in the adjusted model (odds ratio = 0.543, p < 0.01). Compared to those who were uninsured, participants who had insurance were more likely to have used a health-related app in both the crude (odds ratio = 1.970; p < 0.05) and adjusted models (odds ratio = 2.003; p < 0.05). In the adjusted model, employment status (comparing full-time employed with non-employed) was associated with health-related app usage (odds ratio = 1.777, p < 0.05). Marital status (comparing single vs. other) was significant in the crude model only. Health-related app usage (yes vs. no) did not differ by education, household income, or chronic disease conditions.
Nineteen percent of the women reported being interested in an in-person intervention program that helps them to become more active in their daily life. Another 54.5% reported being interested in such a program only when the COVID-19 pandemic is over. Seventy-seven percent of the women reported being interested in a remotely delivered program (such as through website, emails, text messages, smartphone apps) to help them become more active. Table 4 shows the results from the crude and adjusted logistic regression model. Marital status (comparing single vs. married) was significant in the crude model only. In the adjusted model, chronic disease conditions became a significant predictor of having an interest in remotely delivered physical activity program. Compared to those without any chronic disease conditions, those with at least one chronic disease condition were more likely to report having an interest in a remote physical activity program (odds ratio = 1.692, p = 0.04). Fifty-eight percent of the women reported being interested in receiving personalized feedback messages about their activity levels based on a wearable device. Fifty-eight percent of the women reported being interested in non-pharmaceutical approaches to improve their sleep. Sixty-four percent of the women reported being interested in receiving personalized feedback messages about their sleep based on a wearable device. The likelihood of willingness to receive wearable, device-based, personalized feedback messages about activity levels and sleep did not differ by any of the demographic characteristics.

4. Discussion

In this cross-sectional survey study, we recruited Black women of reproductive age from an online research platform (Prolific Academic) and assessed their current physical activity and sleep behaviors, as well as their usage and perceptions towards digital health tools and interventions. Black women in our study had a similar proportion of marital status and insurance coverage when compared to available national data for Black women of reproductive age [46,47]. Compared to national data, the proportion of our study participants with at least a four-year degree was higher (26.2% (national) vs. 42.5% (sample)) [48], and the proportion of the study participants with employment was lower (89.6% (national) vs. 62.8% (sample)) [49]. Importantly, this study captured responses from Black women of reproductive age who were mostly insufficiently active (92.2% not meeting the recommended physical activity level), reflecting a population that is in need of physical activity interventions. We believe the present study contributes to the dearth of cardiovascular health-related mHealth literature focused on Black women of reproductive age in the United States. There are four key findings from our study that have the potential to guide further research and development of mHealth interventions using consumer-based, wearable sensors to promote physical activity and sleep.
First, in addition to reporting being mostly insufficiently physically active, Black women in this study reported an average of 6.6 h of sleep, which is slightly below the recommended 7–9 h of sleep, on a regular basis [50]. Approximately one-third of the participants reported having bad sleep quality. These results are consistent with findings from national datasets of women of reproductive age and highlight racial/ethnic disparities in physical activity and sleep [14,15]. Although it was beyond the scope of the present study, our finding underscores the need for more research investigating the impact of racism on physical activity and sleep among Black women of reproductive age. Further, to ensure more equitable health outcomes in this population, more research is needed to ensure that mHealth interventions are not only culturally tailored, but also responsive to the social context of Black women, which is inextricably linked to structural racism [25,51,52].
Second, nearly all participants in the current study reported owning a smartphone. These data are consistent with the increasing trend in smartphone ownership nationwide [53] and studies that focused on Black women [26,29,30]. Further, the present study yielded results that can inform mHealth intervention development targeting Black women. For instance, 88% of our study participants reported using their phones to look up information about a health condition, and almost two-thirds reported using a health-related app at least a couple of times in the past year, suggesting a good amount of familiarity with smartphone-based, digital health tools. Among study participants who owned or planned to own a wearable fitness tracker or smartwatch, the primary goal for using the device was to track their activity levels. Moreover, 58% and 64% of study participants indicated that they would be interested in receiving personalized feedback based on a wearable tracker regarding their physical activity level and sleep, respectively. This finding is consistent with prior studies, with community-based samples reporting that between 64% and 69% of Black women ages 18–50 were willing to participate in research using wearable trackers [26,27]. Our findings provide support for the utilization of wearable sensors, in particular consumer-facing wearables, as an excellent intervention tool for Black women.
Third, more than three-quarters (77%) of the study participants expressed an interest in remotely delivered physical activity interventions. This level of interest is higher than for an in-person program, even after being asked not to consider the potential concerns over the COVID-19 pandemic (73%). This high perceived acceptability of remote interventions is consistent with the recent findings that individuals are now very knowledgeable of the virtual environment, partly due to the COVID-19 pandemic that pushed people to work, learn, and socialize online [54]. Notably, many existing digital and mHealth interventions still involve some in-person components (e.g., for baseline assessment, brief educational sessions). It would be interesting for future studies to explore if interventions can be effectively conducted in a completely virtual/online environment (e.g., from participant onboarding and baseline assessment to follow-up assessment).
Finally, the present study identified important variations in digital health tools usage and perceptions among reproductive-age Black women. There is a growing recognition that racial/ethnic group data disaggregation is necessary to ensure health equity in racial/ethnic minority populations. In other words, examining within-group differences among Black women of reproductive age can provide crucial insights that can ensure the development of effective interventions [55,56]. An earlier study examining Black women’s willingness to participate in mHealth research identified important differences in perceptions and behaviors by age [26]. The present study explored associations between digital health tools usage and perceptions with additional participant demographic characteristics. After adjustment, the likelihood of owning a wearable fitness tracker, sensor device, or smartwatch was greater among women who reported a bachelor’s degree or higher, being full-time employed, and having a household income of ≥$50,000. This finding suggests that researchers designing mHealth intervention studies with Black women should prepare to provide participants with wearable fitness trackers or smartwatches to eliminate the potential financial barriers. Additionally, the likelihood of using a health-related smartphone app was greater among women who were older (aged 30–49 years), full-time employed, and insured. It is possible that this finding is partly due to the increased adoption of electronic medical services by health providers (e.g., patient portals, such as MyChart) where individuals with insurance are more likely to have frequent encounters. Further, many employers now offer programs for employee wellness that take advantage of health-related apps and wearable sensors (e.g., team-based wellness challenges), thus, providing opportunities for employees to interact more with health-related apps. Lastly, after adjustment, the likelihood of expressing interest in remotely delivered interventions was higher among women with at least one chronic health condition. Although most study participants expressed an interest in remotely delivered interventions, this finding underlines the importance of potentially prioritizing women with existing chronic health conditions that may increase their risk for CVD in line with expectancy value theories in public health [57,58,59]. For example, it is plausible that women with chronic health conditions may have a higher level of motivation and expected value of such mHealth interventions.
Despite the strengths of the present study, there are several potential limitations. First, the present study relied on self-report data which could have been subject to social desirability bias and recall bias. Future research should use both self-report measures of participant perceptions and objective measures for behavioral outcomes such as physical activity and sleep patterns. Second, all study participants were recruited using Prolific Academic, an online participant recruitment platform. Although Prolific Academic generally provides good quality data [42], the study sample represents reproductive-age Black women with Internet access who enrolled themselves into the study via Prolific. Thus, the results may not be generalizable to all Black reproductive age women in the United States. Nevertheless, we were able to recruit Black women from across the country with a wide range of education and income levels. Furthermore, since nearly all survey participants were insufficiently active, the opinions we gathered from them represent the same population that future physical activity interventions aim to target.

5. Conclusions

Black women of reproductive age experience disparate physical activity and sleep patterns, which contribute to CVD risk. This is an urgent public health issue because of the negative effects of CVD on women’s pregnancy outcomes and health later in life. Despite their high levels of access to and use of smartphones and wearable sensors, Black women remain underrepresented in mHealth research related to cardiovascular health. This study contributed to an understanding of reproductive-age Black women’s current physical activity and sleep patterns, current digital health tool usage, and perceptions towards future mHealth interventions. Remotely delivered mHealth interventions that utilize personalized feedback could be a viable behavioral change strategy to promote physical activity and sleep quality in reproductive-age Black women. Researchers should ensure that intervention strategies are responsive to the needs of Black women subgroups that may be overlooked during intervention development (e.g., low-income and uninsured Black women, Black women with chronic health conditions, Black women of advanced maternal age (e.g., 35–49 years old), etc.). Doing so requires continued research studies that exclusively focus on Black women and include diverse sociodemographic variables. Future research studies could also obtain more in-depth information, such as motivation and acceptance of using digital health tools, types of information presented in the feedback messages (e.g., type of wearable sensor monitoring data, tones and presentations of health-related messages), through qualitive research methods such as focus groups. Future studies could further investigate the optimal content, timing, and frequency of feedback messages based on wearable devices, as well as opinions (e.g., perceived usefulness) towards existing digital health tools in this population.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19031557/s1. Physical Activity and Sleep in Reproductive-Age Black Women Survey.

Author Contributions

Conceptualization, Y.L. and K.K.B.; methodology, Y.L. and K.K.B.; formal analysis, Y.L.; writing—original draft preparation, Y.L.; writing—review and editing, K.K.B.; funding acquisition, Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of the University of Texas at Arlington (protocol number 2021-0207) on 1 February 2021.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Admon, L.K.; Winkelman, T.N.A.; Moniz, M.H.; Davis, M.M.; Heisler, M.; Dalton, V.K. Disparities in Chronic Conditions Among Women Hospitalized for Delivery in the United States, 2005–2014. Obstet. Gynecol. 2017, 130, 1319–1326. [Google Scholar] [CrossRef] [PubMed]
  2. Britton, L.E.; Berry, D.C.; Hussey, J.M. Comorbid hypertension and diabetes among U.S. women of reproductive age: Prevalence and disparities. J. Diabetes Complicat. 2018, 32, 1148–1152. [Google Scholar] [CrossRef] [PubMed]
  3. Leifheit-Limson, E.C.; Spertus, J.A.; Reid, K.J.; Jones, S.B.; Vaccarino, V.; Krumholz, H.M.; Lichtman, J.H. Prevalence of traditional cardiac risk factors and secondary prevention among patients hospitalized for acute myocardial infarction (AMI): Variation by age, sex, and race. J. Womens Health 2013, 22, 659–666. [Google Scholar] [CrossRef] [PubMed]
  4. Vatsa, N.; Buendia, L.; Thobani, A.; Murphy, K.; Chen, Z.; Ko, Y.-A.; Mehta, P.; Lundberg, G. Cardiovascular risk factors in younger black women: Results from the 10,000 women community screening project. J. Am. Coll. Cardiol. 2021, 77, 13. [Google Scholar] [CrossRef]
  5. Staff, A.C.; Redman, C.W.G.; Williams, D.; Leeson, P.; Moe, K.; Thilaganathan, B.; Magnus, P.; Steegers, E.A.P.; Tsigas, E.Z.; Ness, R.B.; et al. Pregnancy and Long-Term Maternal Cardiovascular Health. Hypertension 2016, 67, 251–260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Centers for Disease Control and Prevention. Leading Causes of Death by Age Group, All Females, United States. 2017. Available online: https://www.cdc.gov/women/lcod/2016/nonhispanic-black/index.htm (accessed on 13 December 2021).
  7. Davis, N.L.; Smoots, A.N.; Goodman, D.A. Pregnancy-Related Deaths: Data from 14 U.S. Maternal Mortality Review Committees, 2008–2017; Centers for Disease Control and Prevention, U.S. Department of Health and Human Services: Atlanta, GA, USA, 2019; p. 4.
  8. Mazimba, S.; Peterson, P.N. JAHA Spotlight on Racial and Ethnic Disparities in Cardiovascular Disease. J. Am. Heart Assoc. Cardiovasc. Cerebrovasc. Dis. 2021, 10, e023650. [Google Scholar] [CrossRef] [PubMed]
  9. Cho, L.; Vest, A.R.; O’Donoghue, M.L.; Ogunniyi, M.O.; Sarma, A.A.; Denby, K.J.; Lau, E.S.; Poole, J.E.; Lindley, K.J.; Mehran, R.; et al. Increasing Participation of Women in Cardiovascular Trials. J. Am. Coll. Cardiol. 2021, 78, 737–751. [Google Scholar] [CrossRef]
  10. Raman Mishra, M. Determinants of cardiovascular disease and sequential decision-making for treatment among women: A Heckman’s approach. SSM-Popul. Health 2019, 7, 100365. [Google Scholar] [CrossRef]
  11. Schembre, S.M.; Liao, Y.; Robertson, M.C.; Dunton, G.F.; Kerr, J.; Haffey, M.E.; Burnett, T.; Basen-Engquist, K.; Hicklen, R.S. Just-in-time feedback in diet and physical activity interventions: Systematic review and practical design framework. J. Med. Internet Res. 2018, 20, e106. [Google Scholar] [CrossRef] [Green Version]
  12. Jackson, C.L.; Redline, S.; Emmons, K.M. Sleep as a Potential Fundamental Contributor to Disparities in Cardiovascular Health. Annu. Rev. Public Health 2015, 36, 417–440. [Google Scholar] [CrossRef] [Green Version]
  13. Mathieu, R.A.; Powell-Wiley, T.M.; Ayers, C.R.; McGuire, D.K.; Khera, A.; Das, S.R.; Lakoski, S.G. Physical activity participation, health perceptions, and cardiovascular disease mortality in a multiethnic population: The Dallas Heart Study. Am. Heart J. 2012, 163, 1037–1040. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Robbins, C.; Boulet, S.; Morgan, I.; D’Angelo, D.; Zapata, L.; Morrow, B.; Sharma, A.; Kroelinger, C. Disparities in Preconception Health Indicators—Behavioral Risk Factor Surveillance System, 2013–2015, and Pregnancy Risk Assessment Monitoring System, 2013–2014. MMWR Surveill. Summ. 2018, 67, 1–16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Feinstein, L.; McWhorter, K.L.; Gaston, S.A.; Troxel, W.M.; Sharkey, K.M.; Jackson, C.L. Racial/ethnic disparities in sleep duration and sleep disturbances among pregnant and non-pregnant women in the United States. J. Sleep Res. 2020, 29, e13000. [Google Scholar] [CrossRef]
  16. Churchwell, K.; Elkind, M.S.V.; Benjamin, R.M.; Carson, A.P.; Chang, E.K.; Lawrence, W.; Mills, A.; Odom, T.M.; Rodriguez, C.J.; Rodriguez, F.; et al. Call to Action: Structural Racism as a Fundamental Driver of Health Disparities: A Presidential Advisory From the American Heart Association. Circulation 2020, 142, e454–e468. [Google Scholar] [CrossRef] [PubMed]
  17. Bailey, Z.D.; Krieger, N.; Agénor, M.; Graves, J.; Linos, N.; Bassett, M.T. Structural racism and health inequities in the USA: Evidence and interventions. Lancet 2017, 389, 1453–1463. [Google Scholar] [CrossRef]
  18. Coke, L.A.; Hayman, L.L. The Impact of Structural Racism on Cardiovascular Health. J. Cardiovasc. Nurs. 2021, 36, 196–197. [Google Scholar] [CrossRef]
  19. Powell, L.; Slater, S.; Chaloupka, F. The relationship between community physical activity settings and race, ethnicity and socioeconomic status. Evid.-Based Prev. Med. 2004, 1, 135–144. [Google Scholar]
  20. Lee, R.E.; Mama, S.K.; Adamus-Leach, H.J.; Soltero, E.G. Contribution of neighborhood income and access to quality physical activity resources to physical activity in ethnic minority women over time. Am. J. Health Promot. AJHP 2015, 29, 210–216. [Google Scholar] [CrossRef] [Green Version]
  21. Joseph, R.P.; Ainsworth, B.E.; Keller, C.; Dodgson, J.E. Barriers to Physical Activity Among African American Women: An Integrative Review of the Literature. Women Health 2015, 55, 679–699. [Google Scholar] [CrossRef] [Green Version]
  22. Billings, M.E.; Cohen, R.T.; Baldwin, C.M.; Johnson, D.A.; Palen, B.N.; Parthasarathy, S.; Patel, S.R.; Russell, M.; Tapia, I.E.; Williamson, A.A.; et al. Disparities in Sleep Health and Potential Intervention Models: A Focused Review. Chest 2020, 159, 1232–1240. [Google Scholar] [CrossRef]
  23. Slopen, N.; Lewis, T.T.; Williams, D.R. Discrimination and sleep: A systematic review. Sleep Med. 2016, 18, 88–95. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Gaston, S.A.; Feinstein, L.; Slopen, N.; Sandler, D.P.; Williams, D.R.; Jackson, C.L. Everyday and major experiences of racial/ethnic discrimination and sleep health in a multiethnic population of U.S. women: Findings from the Sister Study. Sleep Med. 2020, 71, 97–105. [Google Scholar] [CrossRef] [PubMed]
  25. Brewer, L.C.; Fortuna, K.L.; Jones, C.; Walker, R.; Hayes, S.N.; Patten, C.A.; Cooper, L.A. Back to the Future: Achieving Health Equity Through Health Informatics and Digital Health. JMIR mHealth uHealth 2020, 8, e14512. [Google Scholar] [CrossRef] [PubMed]
  26. James, D.C.S.; Harville, C.; Whitehead, N.; Stellefson, M.; Dodani, S.; Sears, C. Willingness of African American Women to Participate in e-Health/m-Health Research. Telemed. J. E-Health 2016, 22, 191–197. [Google Scholar] [CrossRef] [PubMed]
  27. James, D.C.S.; Harville, C. Smartphone Usage, Social Media Engagement, and Willingness to Participate in mHealth Weight Management Research Among African American Women. Health Educ. Behav. 2018, 45, 315–322. [Google Scholar] [CrossRef]
  28. Melton, B.F.; Buman, M.P.; Vogel, R.L.; Harris, B.S.; Bigham, L.E. Wearable Devices to Improve Physical Activity and Sleep: A Randomized Controlled Trial of College-Aged African American Women. J. Black Stud. 2016, 47, 610–625. [Google Scholar] [CrossRef]
  29. The Nielsen Company. Reaching Black Women Across Media Platforms. Available online: https://www.nielsen.com/us/en/insights/article/2017/reaching-black-women-across-media-platforms (accessed on 13 December 2021).
  30. About One-in-Five Americans Use a Smart Watch or Fitness Tracker. Available online: https://www.pewresearch.org/fact-tank/2020/01/09/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker/ (accessed on 13 December 2021).
  31. Joseph, R.P.; Royse, K.E.; Benitez, T.J. A Systematic Review of Electronic and Mobile Health (e- and mHealth) Physical Activity Interventions for African American and Hispanic Women. J. Phys. Act. Health 2019, 16, 230–239. [Google Scholar] [CrossRef] [PubMed]
  32. Joseph, R.P.; Pekmezi, D.; Dutton, G.R.; Cherrington, A.L.; Kim, Y.-I.; Allison, J.J.; Durant, N.H. Results of a Culturally Adapted Internet-Enhanced Physical Activity Pilot Intervention for Overweight and Obese Young Adult African American Women. J. Transcult. Nurs. 2016, 27, 136–146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Joseph, R.P.; Pekmezi, D.W.; Lewis, T.; Dutton, G.; Turner, L.W.; Durant, N.H. Physical Activity and Social Cognitive Theory Outcomes of an Internet-Enhanced Physical Activity Intervention for African American Female College Students. J. Health Disparities Res. Pract. 2013, 6, 1–18. [Google Scholar]
  34. Kim, B.H.; Glanz, K. Text messaging to motivate walking in older African Americans: A randomized controlled trial. Am. J. Prev. Med. 2013, 44, 71–75. [Google Scholar] [CrossRef] [PubMed]
  35. McCoy, P.; Leggett, S.; Bhuiyan, A.; Brown, D.; Frye, P.; Williams, B. Text Messaging: An Intervention to Increase Physical Activity among African American Participants in a Faith-Based, Competitive Weight Loss Program. Int. J. Environ. Res. Public Health 2017, 14, 326. [Google Scholar] [CrossRef] [PubMed]
  36. Pekmezi, D.W.; Williams, D.M.; Dunsiger, S.; Jennings, E.G.; Lewis, B.A.; Jakicic, J.M.; Marcus, B.H. Feasibility of using computer-tailored and internet-based interventions to promote physical activity in underserved populations. Telemed. J. E-Health 2010, 16, 498–503. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Liao, Y.; Thompson, C.; Peterson, S.; Mandrola, J.; Beg, M.S. The future of wearable technologies and remote monitoring in health care. Am. Soc. Clin. Oncol. Educ. Book 2019, 39, 115–121. [Google Scholar] [CrossRef] [PubMed]
  38. Shelgikar, A.V.; Anderson, P.F.; Stephens, M.R. Sleep tracking, wearable technology, and opportunities for research and clinical care. Chest 2016, 150, 732–743. [Google Scholar] [CrossRef]
  39. Baron, K.G.; Duffecy, J.; Berendsen, M.A.; Cheung Mason, I.; Lattie, E.G.; Manalo, N.C. Feeling validated yet? A scoping review of the use of consumer-targeted wearable and mobile technology to measure and improve sleep. Sleep Med. Rev. 2018, 40, 151–159. [Google Scholar] [CrossRef]
  40. Jackson, C.L.; Powell-Wiley, T.M.; Gaston, S.A.; Andrews, M.R.; Tamura, K.; Ramos, A. Racial/Ethnic Disparities in Sleep Health and Potential Interventions Among Women in the United States. J. Womens Health 2020, 29, 435–442. [Google Scholar] [CrossRef]
  41. Prolific Online Participant Recruitment for Surveys and Market Research. Available online: https://www.prolific.co/#researcher-content (accessed on 9 November 2021).
  42. Peer, E.; Brandimarte, L.; Samat, S.; Acquisti, A. Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. J. Exp. Soc. Psychol. 2017, 70, 153–163. [Google Scholar] [CrossRef] [Green Version]
  43. Marcus, B.H.; Selby, V.C.; Niaura, R.S.; Rossi, J.S. Self-Efficacy and the Stages of Exercise Behavior Change. Res. Q. Exerc. Sport 1992, 63, 60–66. [Google Scholar] [CrossRef]
  44. Buysse, D.J.; Reynolds, C.F.; Monk, T.H.; Berman, S.R.; Kupfer, D.J. The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989, 28, 193–213. [Google Scholar] [CrossRef]
  45. Hong, Y.A.; Cho, J. Assessment of eHealth behaviors in national surveys: A systematic review of instruments. J. Am. Med. Inform. Assoc. 2018, 25, 1675–1684. [Google Scholar] [CrossRef] [Green Version]
  46. U.S. Census Bureau. Sex by Marital Status for the Population 15 Years and Olver (Black or African American Alone) (B12002B), 2019 American Community Survey 1-Year Estimates. Available online: https://data.census.gov/cedsci/table?t=Black%20or%20African%20American%3AMarital%20Status%20and%20Marital%20History&y=2019&d=ACS%201-Year%20Estimates%20Detailed%20Tables&tid=ACSDT1Y2019.B12002B (accessed on 13 December 2021).
  47. National Partnership for Women and Families. Black Women Experience Pervasive Disparities in Access to Health Insurance: Fact Sheet; National Partnership for Women and Families: Washington, DC, USA, 2019. [Google Scholar]
  48. Anthony, M., Jr.; Nichols, A.H.; Del Pilar, W. Raising Undergraduate Degree Attainment Among Black Women and Men Takes on New Urgency Amid the Pandemic. Available online: https://edtrust.org/resource/national-and-state-degree-attainment-for-black-women-and-men/ (accessed on 13 December 2021).
  49. U.S. Bureau of Labor Statistics. Employed and Unemployed Full- and Part-Time Workers by Age, Sex, Race, and Hispanic or Latino Ethnicity. Available online: https://www.bls.gov/cps/cpsaat08.htm (accessed on 13 December 2021).
  50. Canadian Society for Exercise Physiology. Canadian 24-Hour Movement Guidelines. Available online: https://csepguidelines.ca (accessed on 16 July 2021).
  51. James, D.C.S.; Harville, C.; McQueen, D.S.; Facey, J.A. “I Want a Program That Looks at My Whole Life.” A Focus Group Study on the Ideal Components for an mHealth Weight Management Program for African American Women. J. Acad. Nutr. Diet. 2022, 122, 139–148. [Google Scholar] [CrossRef] [PubMed]
  52. Chinn, J.J.; Martin, I.K.; Redmond, N. Health Equity Among Black Women in the United States. J. Womens Health 2021, 30, 212. [Google Scholar] [CrossRef]
  53. Pew Research Center. Demographics of Mobile Device Ownership and Adoption in the United States; Pew Research Center: Washington, DC, USA, 2021. [Google Scholar]
  54. Brannon, G.E.; Mitchell, S.; Ray, M.A.; Bhai, S.; Beg, M.S.; Basen-Engquist, K.M.; Liao, Y. A Qualitative Examination of COVID-19’s Impacts on Physical Activity and Perceptions of Remote Delivery Interventions. Am. J. Health Promot. 2021, 08901171211053845. [Google Scholar] [CrossRef] [PubMed]
  55. Amuta-Jimenez, A.O.; Jacobs, W.; Smith, G. Health Disparities and the Heterogeneity of Blacks/African Americans in the United States: Why Should We Care? Health Promot. Pract. 2020, 21, 492–495. [Google Scholar] [CrossRef] [PubMed]
  56. Amuta-Jimenez, A.O.; Smith, G.P.A.; Brown, K.K. Patterns and Correlates of Cervical Cancer Prevention Among Black Immigrant and African American Women in the USA: The Role of Ethnicity and Culture. J. Cancer Educ. 2020. [Google Scholar] [CrossRef] [PubMed]
  57. Green, E.C.; Murphy, E.M.; Gryboski, K. The Health Belief Model. In The Wiley Encyclopedia of Health Psychology; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2020; pp. 211–214. ISBN 978-1-119-05784-0. [Google Scholar]
  58. Carter-Parker, K.; Edwards, K.A.; McCleary-Jones, V. Correlates of physical activity and the theory of planned behavior between African American women who are physically active and those who are not. ABNF J. 2012, 23, 51–58. [Google Scholar] [PubMed]
  59. Hays, R. An Integrated Value-Expectancy Theory of Alcohol and Other Drug Use. Br. J. Addict. 1985, 80, 379–384. [Google Scholar] [CrossRef]
Figure 1. Primary goals for using wearable trackers by individuals who have owned a tracker and those who planned to get one in the next few months.
Figure 1. Primary goals for using wearable trackers by individuals who have owned a tracker and those who planned to get one in the next few months.
Ijerph 19 01557 g001
Figure 2. Frequency of using a health-related smartphone application in the past 12 months.
Figure 2. Frequency of using a health-related smartphone application in the past 12 months.
Ijerph 19 01557 g002
Table 1. Participants’ demographic characteristics (n = 497).
Table 1. Participants’ demographic characteristics (n = 497).
Demographic VariableNPercentage
Marital Status
Single37174.6%
Married9719.5%
Separated/Divorced/Widowed255.0%
Prefer not to say/Missing40.8%
Employment Status
Full-time employed17334.8%
Part-time employed9218.5%
Self-employed479.5%
Not employed15431.0%
Other275.4%
Education Level
High school diploma or lower5911.9%
Some college or vocational training22745.7%
Bachelor’s degree14930.0%
Master’s degree or higher6212.5%
Annual Household Income
Less than $20,0009218.5%
$20,001–$35,0009318.7%
$35,001–$50,0007915.9%
$50,001–$75,0008517.1%
$75,001–$100,0007314.7%
Greater than $100,0005310.7%
Prefer not to say224.4%
Insurance Status
Insured41182.7%
Uninsured6412.9%
Not sure224.4%
Chronic Disease Conditions
None30862.0%
One16332.8%
More than one265.2%
Table 2. Ownership of wearables by demographic characteristics among Black women.
Table 2. Ownership of wearables by demographic characteristics among Black women.
Have OwnedPlanned to Own
Odds Ratios
(95% Confidence Interval)
Odds Ratios
(95% Confidence Interval)
CrudeAdjusted *CrudeAdjusted *
Age
   <30 years old (ref)1.001.001.001.00
   ≥30 years old1.169
(0.807–1.694)
0.915
(0.578–1.447)
1.989
(1.173–3.373)
2.016
(1.068–3.805)
Marital Status
   Single (ref)1.001.001.001.00
   Married1.246
(0.792–1.960)
0.687
(0.387–1.222)
1.602
(0.852–3.011)
1.095
(0.501–2.396)
   Other1.223
(0.562–2.662)
1.130
(0.465–2.746)
0.700
(0.193–2.546)
0.601
(0.152–2.370)
Employment Status
   Not employed (ref)1.001.001.001.00
   Full-time employed2.241
(1.430–3.512)
1.835
(1.077–3.128)
2.449
(1.236–4.849)
2.390
(1.097–5.204)
   Other0.940
(0.590–1.498)
0.989
(0.587–1.668)
1.878
(0.981–3.593)
1.626
(0.795–3.327)
Education
   Less than bachelor’s degree (ref)1.001.001.001.00
   Bachelor’s degree and higher2.359
(1.632–3.411)
1.897
(1.219–2.952)
1.076
(0.628–1.844)
0.638
(0.318–1.281)
Household Income
   ≤$50,000 (ref)1.001.001.001.00
   >$50,0002.157
(1.482–3.140)
1.852
(1.218–2.818)
1.442
(0.845–2.459)
1.592
(0.850–2.984)
Insurance Status
   Uninsured (ref)1.001.001.001.00
   Insured0.961
(0.562–1.643)
0.832
(0.452–1.529)
1.707
(0.718–4.058)
1.493
(0.559–3.984)
Chronic Disease Conditions
   None (ref)1.001.001.001.00
   At least one1.131
(0.782–1.637)
1.177
(0.780–1.777)
1.066
(0.627–1.811)
0.942
(0.521–1.703)
* The adjusted models included all demographic variables listed in the table. Bold indicates p < 0.05.
Table 3. Health-related smartphone application (app) usage * by demographic characteristics among Black women.
Table 3. Health-related smartphone application (app) usage * by demographic characteristics among Black women.
Odds Ratios
(95% Confidence Interval)
CrudeAdjusted +
Age
   <30 years old (ref)1.001.00
   ≥30 years old0.659
(0.454–0.957)
0.543
(0.343–0.860)
Marital Status
   Single (ref)1.001.00
   Married0.954
(0.601–1.516)
0.861
(0.486–1.523)
   Other0.457
(0.210–0.993)
0.598
(0.253–1.416)
Employment Status
   Not employed (ref)1.001.00
   Full-time employed1.548
(0.986–2.431)
1.777
(1.035–3.051)
   Other1.096
(0.704–1.707)
1.124
(0.682–1.851)
Education
   Less than bachelor’s degree (ref)1.001.00
   Bachelor’s degree and higher1.373
(0.950–1.986)
1.242
(0.792–1.945)
Household Income
   ≤$50,000 (ref)1.001.00
   >$50,0001.372
(0.944–1.995)
1.206
(0.789–1.843)
Insurance Status
   Uninsured (ref)1.001.00
   Insured1.970
(1.159–3.349)
2.003
(1.106–3.627)
Chronic Disease Conditions
   None (ref)1.001.00
   At least one1.133
(0.780–1.646)
1.265
(0.836–1.914)
* Have used at least a few times vs. never used in the past 12 months. + The adjusted models included all demographic variables listed in the table. Bold indicates p < 0.05.
Table 4. Interest in remotely delivered physical activity programs * by demographic characteristics among Black women.
Table 4. Interest in remotely delivered physical activity programs * by demographic characteristics among Black women.
Odds Ratios
(95% Confidence Interval)
CrudeAdjusted +
Age
   <30 years old (ref)1.001.00
   ≥30 years old1.121
(0.715–1.756)
1.024
(0.587–1.786)
Marital Status
   Single (ref)1.001.00
   Married1.981
(1.026–3.825)
1.794
(0.826–3.896)
   Other0.615
(0.264–1.431)
0.612
(0.237–1.583)
Employment Status
   Not employed (ref)1.001.00
   Full-time employed1.030
(0.598–1.773)
0.765
(0.397–1.473)
   Other0.857
(0.502–1.464)
0.654
(0.355–1.205)
Education
   Less than bachelor’s degree (ref)1.001.00
   Bachelor’s degree and higher1.213
(0.779–1.888)
1.238
(0.721–2.125)
Household Income
   ≤$50,000 (ref)1.001.00
   >$50,0000.972
(0.618–1.527)
0.821
(0.495–1.361)
Insurance Status
   Uninsured (ref)1.001.00
   Insured1.635
(0.892–3.000)
1.469
(0.743–2.902)
Chronic Disease Conditions
   None (ref)1.001.00
   At least one1.496
(0.941–2.377)
1.692
(1.015–2.822)
* Yes vs. no/not sure. + The adjusted models included all demographic variables listed in the table. Bold indicates p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liao, Y.; Brown, K.K. Usage of Digital Health Tools and Perception of mHealth Intervention for Physical Activity and Sleep in Black Women. Int. J. Environ. Res. Public Health 2022, 19, 1557. https://doi.org/10.3390/ijerph19031557

AMA Style

Liao Y, Brown KK. Usage of Digital Health Tools and Perception of mHealth Intervention for Physical Activity and Sleep in Black Women. International Journal of Environmental Research and Public Health. 2022; 19(3):1557. https://doi.org/10.3390/ijerph19031557

Chicago/Turabian Style

Liao, Yue, and Kyrah K. Brown. 2022. "Usage of Digital Health Tools and Perception of mHealth Intervention for Physical Activity and Sleep in Black Women" International Journal of Environmental Research and Public Health 19, no. 3: 1557. https://doi.org/10.3390/ijerph19031557

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop