Next Article in Journal
Experience of Ethnic Discrimination, Anxiety, Perceived Risk of COVID-19, and Social Support among Polish and International Students during the Pandemic
Next Article in Special Issue
Wrist Circumference Cutoff Points for Determining Excess Weight Levels and Predicting Cardiometabolic Risk in Adults
Previous Article in Journal
Objectively-Assessed Ultraviolet Radiation Exposure and Sunburn Occurrence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Older People in Emergencies; Addressing Food Insecurity, Health Status and Quality of Life: Evaluating the “365+ Days of Care” Program

by
Dimitrios V. Diamantis
1,†,
Konstantinos Katsas
1,2,†,
Christina Maria Kastorini
1,
Lyndsey Mugford
3,
Nadia Dalma
1,
Marsellos Ramizi
1,
Ourania Papapanagiotou
1,
Afroditi Veloudaki
1,
Athena Linos
1 and
Matina Kouvari
1,4,5,6,*
1
Institute of Preventive Medicine Environmental and Occupational Health Prolepsis, 15121 Athens, Greece
2
Medical School, National and Kapodistrian University of Athens, 11527 Athens, Greece
3
Department of History of Science, Faculty of Arts and Sciences, Harvard College, Cambridge, MA 02138, USA
4
Department of Nutrition and Dietetics, School of Health Science and Education, Harokopio University, 17676 Athens, Greece
5
Discipline of Nutrition and Dietetics, Faculty of Health, University of Canberra, Canberra, ACT 2601, Australia
6
Functional Foods and Nutrition Research (FFNR) Laboratory, University of Canberra, Bruce, ACT 2617, Australia
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2023, 20(7), 5235; https://doi.org/10.3390/ijerph20075235
Submission received: 24 February 2023 / Revised: 14 March 2023 / Accepted: 14 March 2023 / Published: 23 March 2023

Abstract

:
During emergencies, older adults stand among the most vulnerable, facing long-lasting food insecurity and overall health issues. The “365+ Days of Care” food aid program addressed food insecurity and poor quality of life among vulnerable older adults following a devastating wildfire in Greece. Our aim was to evaluate the program’s efficiency, using a process evaluation framework and a partial cost–utility analysis. In total, n = 133 wildfire-hit residents (≥65 years) received daily tailored, pre-cooked meals and/or weekly food packages. The study outcomes were assessed from baseline to 12 months later. Focus groups and interviews (n = 30), researcher observations, and questionnaires were used to assess the beneficiaries’ perception of the initiative. Within the 12-month follow-up period, food insecurity and malnutrition risk decreased, whereas Mediterranean diet adherence; quality of life; and physical, social, and mental health were improved (p < 0.05). A one-point increase in food insecurity was positively associated with improved quality of life, general health, limitation in activities, body pain, vitality, and pain/discomfort (p’s < 0.05), and it was marginally associated with mobility, anxiety/depression, and self-evaluated health status (p’s < 0.1). Quantitative and qualitative data characterized it as successful, acceptable, beneficial, and of high quality. The partial cost–utility ratio was one QALY gained per EUR 22.608. The utilization of well-designed food aid programs during emergencies can alleviate food insecurity and improve quality of life in older adults.

1. Introduction

Humanitarian emergencies can diminish the already weakened health status and quality of life of the vulnerable older population. Providing food to those in need after an emergency is of crucial importance. Yet most food aid programs tend to focus only on the period immediately following a disaster (critical period) [1] and provide unhealthy, energy-dense, and prepackaged meals [2]. Therefore, it is urgent to design food aid programs that effectively alleviate the physiological and mental health consequences as well as the consequent food insecurity, while respecting the beneficiaries’ dietary needs, preferences, and customs [3,4,5]. Such projects require adequate planning to be able to act immediately upon the crisis, adapt to changes, and last until the food insecurity caused by the crisis is limited. Examples of unexpected detrimental events include the COVID-19 pandemic or the recent attack in Ukraine [6], which have resulted in a significant death toll along with financial constraints, poor mental health, and food insecurity among disadvantaged groups.
The present work aimed to evaluate the “365+ Days of Care” initiative and present a report of good practice during an emergency. In 2018, during the heatwave of Attica’s coastal areas, located in central Greece, one of the wildfires ended up becoming the second deadliest in our century, with a death toll of 103 individuals, 140 hospitalizations, and nearly 4000 damaged or destroyed houses [7,8]. The resulting health consequences have overwhelmed vulnerable population groups in the region, such as older adults [9]. This program was implemented by the Prolepsis Institute and aimed to address the urgent need to address food insecurity and its impact on related physical and mental health by providing food aid tailored to older adults living in fire-stricken communities. Delivered during the disaster recovery period [1], it provided food aid to older adults and observed the impacts on food insecurity, mental health, physical health, quality of life, and dietary habits. In addition to program efficacy, this report used mixed methods and triangulation approaches to evaluate the fidelity, acceptability, impact, cost-effectiveness, and feasibility of this initiative, with a particular emphasis on process evaluation [10].

2. Materials and Methods

2.1. Setting and Participants

The “365+ Days of Care” program is a non-controlled intervention study that officially started in March 2019 and ended in April 2020. Following intense efforts to communicate the program’s availability to all eligible persons in the wildfire-hit Greek municipalities of Rafina-Pikermi and Marathonas-Nea Makri, fire-stricken residents or their close relatives/acquaintances were able to contact the Prolepsis Institute and complete an application form. Eligible participants were older adults (≥65 years) residing in the aforementioned municipalities. To ensure the absence of socioeconomic bias, place of residence, full/partial residence destruction, loss of assets, financial status, need for special nutritional care, and wildfire-attributed death or injury of close relatives were considered when selecting the participants.
Assuming that 8% of the participants would switch from food secure at baseline to food insecure at follow-up and 25% of the participants would switch from food insecure at baseline to food secure at follow-up, and after applying continuity correction, adjustment for a 10% drop-out rate, 80% power, and a two-sided level of significance of 5%, the study would require a sample size of 103 participants.
However, the program’s reach was 139 participants, who were selected from 191 applicants due to budgetary limitations, thus exceeding the required sample size and ensuring the inclusion of the highest possible number of beneficiaries. All included participants satisfied the inclusion criteria and presented at least one of the aforementioned vulnerabilities/misfortunate conditions. When someone passed away (6), another applicant took their place, resulting in a sample of 133 participants. Program retention was high, and all remaining participants completed the program. Notably, participants were not allocated to an intervention or control group, due to ethical concerns.

2.2. Ethical Approval

The initiative received ethical approval from the Ethical Committee of the Prolepsis Institute, carried out in accordance with the Declaration of Helsinki. All participants received information about the program’s scope, the study’s methodology, data management, and protection. All participants provided written informed consent. The program followed all applicable institutional regulations on the ethical use of human volunteers.

2.3. Food Aid Provision

The intervention “dose” (the quantity of intervention implemented) [10] was as follows: all beneficiaries received healthy food that aimed to cover two meals per day, corresponding to ≥60% of their daily energy needs. Beneficiaries received different types of food packages based on their current place of residence, as follows:
  • For 108 beneficiaries that still resided in the fire-stricken communities, fresh, cooked lunch was provided on a daily basis along with a weekly food package with products to supplement their lunch (e.g., extra virgin olive oil) and prepare their breakfast (e.g., fruits, milk, rusks, honey, etc.). Meals and food packages were distributed at central points (military healthcare or distribution centers, public nursing homes, and local churches) or delivered to the residences of beneficiaries that were unable to reach these points or wanted to keep their inclusion in the program private.
  • For the remaining 25 beneficiaries that had moved away from these areas, food packages were delivered on a weekly basis or picked up at a close central distribution point at an arranged date and time. These food packages included packaged food products to prepare their breakfast and lunch (e.g., fruits, vegetables, raw meat, fish, legumes, dairy products, bakery products, salt, extra virgin olive oil, etc.).
The program’s dietary plans and food packages were designed by a multidisciplinary expert team of dietitian nutritionists, physicians, and food technologists based on the “National Dietary Guidelines of Greece for adults aged 65 years and older” [11]. These Guidelines are designed based on the Mediterranean dietary pattern, which is tailored to older adults. Every dietary plan was further adapted to individual nutritional needs based on reported health status, preferences (e.g., vegetarian diet), religious beliefs and customs (e.g., Christian fasting), and potential allergies [12]. For management reasons, six dietary plans were created following the principles of the Mediterranean dietary pattern: general; general with no added salt; modified fiber content for moderate gastrointestinal disorders; modified fiber content for severe gastrointestinal disorders; no animal food sources; no animal food sources and no added salt. Beneficiaries received a printed weekly dietary plan along with the food packages. Prolepsis’ dieticians were in direct contact with all beneficiaries via phone for further clarifications and adjustments regarding their nutritional needs.
To ensure the hygiene and quality of the meals, strict requirements were imposed regarding the ingredients, raw materials, and preparation practices of the meals, and samples were inspected daily and regularly sent to food laboratories. Contact with the beneficiaries was carried out almost on a weekly basis, either in person or via telephone, and any arising issues or comments were promptly recorded and rectified. The project also included health promotional activities, with more details found in Appendix A.

2.4. Baseline Measurements

During the recruitment phase, the demographic, socioeconomic, and anthropometric characteristics; food security status; risk for malnutrition; dietary habits; quality of life; and health status of the beneficiaries were recorded. Healthcare professionals (physicians, nurses, and dieticians) were responsible for the accurate completion of the questionnaires and for resolving any queries or misunderstandings.
The food security level was measured using the U.S. Adult Food Security Survey Module 10-item questionnaire [13]. The sum of insecurity-affirming responses produces a score ranging from 0 to 10, which is categorized using a two-point scale (‘food secure adults’ (scores of 0–2) and ‘food insecure adults’ (scores of 3–10)) or a four-point scale (‘high’ (0), ‘marginal’ (1–2), ‘low’ (3–5), and ‘very low’ (6–10) food security). Malnutrition risk was evaluated using the Malnutrition Universal Screening Tool (MUST), which followed a five-step screening process to identify adults who are currently malnourished or are at risk of malnutrition [14]. The total score is classified as 0 (low risk), 1 (medium risk), and 2–6 (high risk). Adherence to the Mediterranean dietary pattern was evaluated with the use of the MedDietScore, which classifies the level of adherence to the Mediterranean dietary pattern based on a set of 11 questions, which are scored as low (score: 0–20), moderate (21–35), and high (36–55) [15].
To evaluate beneficiaries’ health status and quality of life, the 36-Item Short Form Health Survey (SF-36) and the EuroQol (EQ-5D-5L) were used. The SF-36 assesses eight health concepts and produces a score for each, along with a total score ranging from 0 (highest disability/worst possible health state) to 100 (best health state) [16,17]. The EQ-5D-5L evaluates five dimensions and corresponding scores, ranging from 1 (best health state) to 5 (worst health state) [17]. The total added score ranges from 5 to 25.

2.5. Follow-Up

The follow-up evaluations of the project’s effectiveness were performed by a healthcare professional at 6 (110 beneficiaries; 82.7% participation rate) and 12 months (133 beneficiaries; 100% participation rate) after the recruitment phase. The 6-month evaluation was performed in person, while the 12-month evaluation occurred via phone interview due to COVID-19 restrictions.
In order to examine whether such a program was agreeable and feasible for replication as a best practice, the participants completed questionnaires assessing program satisfaction and acceptance at 12 months (n = 132, 99.2% participation rate). This survey assessed a number of acceptability metrics, including the quality, taste, variety, and frequency of meals and packaged foods; communication with the program’s organizers; assessment of dietary improvements; suggestions for improvement; and general satisfaction.

2.6. Statistical Analysis

Quantitative variables are presented as mean ± standard deviation (SD) for those with a normal distribution and as median (interquartile range, IQR) for non-normally distributed variables. t-tests were performed to compare the means of normally distributed quantitative variables between two groups, and Mann–Whitney U tests were used for variables with non-normal distributions. For three or more groups, ANOVA tests were utilized for normally distributed variables, and Kruskal–Wallis H tests were used for variables with non-normal distributions. Differences in a variable between baseline and each follow-up (pre–post analysis) were investigated using paired t-tests for normally distributed quantitative variables and Wilcoxon matched-pairs signed-rank tests for non-normally distributed variables. Exact symmetry tests (for KxK tables) and McNemar tests (for 2 × 2 tables) were utilized for pre–post analyses regarding categorical variables. We used multi-adjusted logistic regression models to investigate the likelihood of improvement in quality of life (SF-36 health concepts and EQ-5D health dimensions baseline and 2nd follow-up scores) depending on the increase in food insecurity score. Differences in food insecurity scores were calculated as the negative difference between food insecurity scores at the 2nd follow-up minus the score at baseline (a one-point increase indicated improvement in food security). All independent variables were checked for collinearity. The level of significance was defined as α = 0.05. All analyses were performed using SPSS statistics 26.

2.7. Cost-Effectiveness Analysis

A partial cost–utility analysis was performed, due to the lack of a control group, in which the cost of the meal provision was compared with the total quality-adjusted life years (QALYs) gained by the intervention [18]. The EQ-5D-5L health states were utilized to calculate the weighted health state indexes (index values), by applying the value sets for the United Kingdom population and, thus, calculating the QALYs gained [19]. Index values range from −0.288 to 1, with values equal to 0 representing death, values equal to 1 indicating a perfect health state, and negative values indicating a health status worse than death. As the project lasted for one whole year, the derived index values, representing the utility score (total utility index), are equal to the QALYs gained during this timeframe.
Regarding the projects’ cost, a detailed report of the implementation expenses was organized, which included expenses related to food and meal supplies, packaging costs, transportation, and operating expenses, researchers and related staff wages, communication- and managerial-related expenses, questionnaire development and distribution, and focus group implementation. The overall project cost was EUR 378,573.09.

2.8. Qualitative Assessment

Beneficiaries were selected at random to be interviewed eight months after program initiation (during November 2019) to evaluate it in terms of describing their incentives to participate and remain in the program, assessing the implementation methods, and proposing potential modifications for further consideration. The qualitative study was comprised of (i) three 45–60-min focus groups with 8 beneficiaries each receiving daily meals and (ii) six 30-min personal interviews with beneficiaries receiving weekly food packages (total n = 30). Focus groups and personal interviews were conducted until saturation was reached.
A discussion guide was developed by the multidisciplinary research team (nutritionist, psychologist, sociologist, and public health experts). The guide aimed to evaluate the beneficiaries’ initial motivations, the program’s benefits and drawbacks, communication with support workers, satisfaction with the implementation procedures, and proposals for program optimization.
Two researchers were present at all focus groups/interviews. The senior moderator posed the questions and monitored the conversation, while the assistant moderator kept notes of the responses and ensured the conversation’s recording. Transcripts were analyzed independently by two researchers following the thematic analysis approach. To enhance the study’s validity, recurrent themes and subthemes were compared, revised, and refined between the two researchers. The surrounding discussions from which indicative themes and subthemes arose were evaluated to ensure proper interpretation.

2.9. Observations

To create a complete picture of program effectiveness, following rigorous training in observational methods by experts in qualitative analysis, researchers conducted regular observations of the meal preparation and provision on site and observed the beneficiaries, meal preparation staff, and volunteers without interfering with the process of meal distribution. A total of 4 observation sessions were performed each month (weekly basis). Findings were collected in a notebook, and then a report was compiled and presented to the program coordinators. However, observations were not only available from researchers but also from volunteers, community members, and caretakers. They were asked to observe and report any implementation issues to the researchers on site as soon as they noticed them or to the project coordinator by phone. Their input was then recorded and presented to the project coordinator.

2.10. Triangulation

By combining the stakeholders’ observations, the qualitative data, and the quantitative data on effectiveness, method triangulation was achieved [20]. Triangulation can enhance the study’s credibility by combining multiple sources of data and perspectives to provide a comprehensive understanding [21,22] and ensure a better picture of the project’s effectiveness and acceptability and beneficiaries’ experience. It should be noted that each researcher performed only one of the tasks, based on their expertise: (a) analyzed the quantitative data, (b) collected the qualitative data, or (c) performed the observation sessions.

3. Results

3.1. Sociodemographic Characteristics of Beneficiaries

Beneficiaries had a mean age of 72 ± 9 years, 37.6% were males, and 58.7% were married (Table 1). Overall, 62.1% had lost their house due to the fire, 50% had lost other assets, and 8.3% had lost a first-degree relative in the wildfire events. Safe running water at home was unavailable for 21.1% of the beneficiaries.

3.2. Program’s Effectiveness

The impact of the “365+ Days of Care” program on food insecurity, malnutrition risk, BMI, level of adherence to the Mediterranean diet, quality of life, and health status from baseline to 2nd follow-up is reflected in Table 2. Significantly lower scores in food insecurity (−2.2 ± 3.4 difference) and malnutrition (−0.17 ± 0.83 difference) were observed after one year, with only 34.8% of adults being food insecure compared to 61.8% at baseline (p’s < 0.05). Adherence to the Mediterranean diet was improved (score increment by 2.7 ± 4.2), with 27.1% of beneficiaries reporting high adherence, compared with 11.5% at baseline (p < 0.001).
All quantitative variables are presented as mean ± standard deviation, except BMI (because it is not normally distributed), which is presented as median (interquartile range). We used paired t-tests for normally distributed quantitative variables and Wilcoxon matched-pairs signed-rank tests for non-normally distributed variables (BMI). Exact symmetry tests (for KxK tables) and McNemar tests (for 2 × 2 tables) were utilized for pre–post analyses regarding categorical variables.
The total quality of life scores, as well as all subscales of the SF-36 and EQ-5D questionnaires, indicated significant improvement (p < 0.05). The only exception was self-care (EQ-5D). SF-36 improved by 10.5 ± 17.2 and EQ-5D declined by 2.0 ± 3.7 (p’s < 0.001), demonstrating an improvement in quality of life. Beneficiaries reported augmentations in general, physical, emotional, and mental health; social life; and vitality but also less limitation in activities and body pain (SF-36 health concepts) (p’s < 0.05). Alleviation in pain/discomfort, anxiety/depression, and mobility issues was also evident (EQ-5D health dimensions) (p’s < 0.05). The aforementioned subscale’s mean scores can be found in Table 2.
In Table 3, the results of muti-adjusted logistic regression models investigating the association between food insecurity alleviation and the likelihood of experiencing improvement in quality of life (via improvement in SF-36 or EQ-5D scores). A one-point increase in food insecurity score was associated with evident improvement in total quality of life (SF-36: OR = 1.29; 95%CI [1.02–1.64] and EQ-5D: OR = 1.30; 95%CI [1.06–1.61]), general health (OR = 1.35; 95%CI [1.13–1.63]), body pain (OR = 1.18; 95%CI [1.01–1.38]), and vitality (OR = 1.24; 95%CI [1.05–1.47]) and reduction in limitations in everyday activities (OR = 1.22; 95%CI [1.04–1.43]) and pain/discomfort (OR = 1.22; 95%CI [1.04–1.43]). Food insecurity alleviation was also marginally associated with a reduction in anxiety/depression (OR = 1.17; 95%CI [1.00–1.36]) and improvements in mobility (OR = 1.15; 95%CI [0.99–1.34]) and self-evaluated health status (OR = 1.15; 95%CI [0.99–1.35]).

3.3. Reported Acceptability and Satisfaction of Program’s Beneficiaries

Almost all beneficiaries reported that they were satisfied with the quantity (94.7%), quality (90.9%), and taste (90.9%) of the provided products and meals. The meals and food packages were delivered on time, and no issues were presented regarding communication with the Prolepsis team. In addition, due to their participation in the program, beneficiaries tended to eat healthier overall (97%); in particular, they reported an increase in the consumption of fruits (97%), vegetables (97%), dairy products (98.5%), fish (96.2%), whole grain products (93.2%), and pulses (84.1%). Beyond these, almost all beneficiaries felt cared for and less lonely, with the program facilitating their quality of living and supporting them financially (by covering part of the cost of buying food). The overall satisfaction score was 9.5 ± 0.7 out of 10, with a range of 7–10. However, a small number of beneficiaries reported that they would prefer for the program to cover their daily home utility needs (e.g., napkins, detergent) (n = 3) and provide physiological support (n = 1).

3.4. Economic Evaluation and QALYs

The mean difference in the utility index was 0.13 ± 0.26 (p = 0.02), which translates to an average of 0.13 QALYs gained per person, yearly (Figure 1). Overall, participants gained 16.8 QALYs from their participation. The cost–utility ratio was computed as one QALY gained per person at the cost of EUR 22.608 (equal to USD 25,690 or GBP 20.038 at the 2020 exchange rate [23]). A proportional trend between improvements in QALYs with higher food insecurity was observed, with the high food security group reporting a non-significant improvement of +0.03 QALYs (95%CI: −0.08, 0.14) and the very low food security group reporting an improvement of +0.20 QALYs (95%CI: −0.12, 0.29).

3.5. Qualitative Findings

3.5.1. Focus Groups and Interviews

Qualitative analysis revealed the following three main themes regarding the beneficiaries’ characterization of the program: necessary for their health and needs, proper social initiative, and high-quality offered meals tailored to their dietary needs. Participants stressed the importance of the program not only as an urgent supportive measure right after the wildfire but as a general supportive measure for older adults facing further social difficulties as well as having poor health. A description of each theme, as well as representative quotes, can be found in Table 4. Overall, no particular issues with the program’s procedures were reported through the focus groups or interviews.

3.5.2. Observations

The researchers/observers reported the following as their main observations, based on their weekly observation sessions. First, the act of daily meal provision proved effective at reassuring the beneficiaries that someone was looking after their health and provided an opportunity for social interaction. Beneficiaries were accustomed to the volunteers, and the volunteer’s friendly attitude evidently boosted the beneficiaries’ morale. This was also confirmed by the on-site volunteers and meal providers, through their telephone communication with the institute and discussions with the researchers responsible for the observation sessions. Secondly, the distribution points and the telephone line proved to be an efficient way to communicate any dissatisfaction or need for dietary modification and efficiently change the corresponding meal. The process of dietary modification was as follows: the beneficiary informed the on-site volunteers, who later informed the Institute’s dieticians, or the beneficiary was directly linked with a dietician via telephone. The dietician then considered the necessary adjustments or changes to a different meal type and informed the on-site volunteers and the meal preparation staff of specific modifications. This process lasted for about a day and resulted in a tailored meal the following day. Finally, caretakers, community members, and researchers all reported that meal modifications further improved the beneficiaries’ morale and limited the likelihood of a beneficiary leaving the program.

3.6. Program Fidelity and Adaptability

Program fidelity assesses the degree to which an intervention is delivered according to plan [10]. Firstly, while participant communication was always included for morale and feedback purposes, the communication frequency (nearly weekly) increased in response to beneficiary requests and feedback. Dietary plans were often modified following beneficiary feedback and the ingredients’ seasonality. Finally, the emergence of the COVID-19 pandemic forced the program to adopt new methods to protect beneficiaries’ safety in March–April 2020. In these months, distribution adopted new hygiene protocols, and beneficiaries who felt unsafe could opt into at-home meal delivery. Otherwise, the intervention was delivered as planned.

4. Discussion

The “365+ Days of Care” initiative, overall, proved to be effective at reducing the long-lasting food insecurity, malnutrition risk, and disability-related health consequences among older adults living in a fire-stricken community. Moreover, this initiative favorably affected dietary habits, while, at the same time, positively affecting mental health, social activities, quality of life, and the perceived health status of the beneficiaries. Food insecurity alleviation was positively associated with improvements in quality of life, indicators of body health (i.e., less limitation in activities, body pain, depression, and more vitality), and, potentially, mental health. Quantitative, qualitative, and stakeholder assessments all indicated that the initiative was viewed as successful, acceptable, beneficial, and of high quality. The program was able to offer a substantial improvement in QALYs for a reasonable cost. This intervention, which provided high-quality, tailor-made meals to vulnerable older adults, can be used as an example of good practice not only for reducing food insecurity but also for ameliorating general, mental, and social health.
To the best of our knowledge, this is the first post-disaster food aid initiative that has indicated an overall improvement in health in older individuals during the early recovery and year-long recovery periods. In addition, the program seemed to limit long-lasting food insecurity and malnutrition risk. Long-lasting, post-disaster negative general and mental health outcomes [3,24,25] can predict long-lasting, persistent food insecurity [3]. Furthermore, in vulnerable groups, mental health, post-traumatic stress disorder, and even food insecurity can take longer to improve, which translates into a substantial disease burden [3,4,5]. Similar initiatives are scarce in the literature, with the use of high-quality, pre-prepared snacks, but these have limited timeframes of action and effectiveness indicators [26].
This initiative is unique from other food aid programs because it prioritizes flexibility, communication, connection, and personalization in addition to food delivery, efficient fund allocation, and the consideration of beneficiaries’ satisfaction. Humanitarian aid initiatives must be quick, responsive, and designed in an effective way to account for these unexpected events and aim for long-term positive outcomes [5,27,28]. The program’s fidelity and adaptability even proved adequate during unpredictable conditions, such as the COVID-19 quarantine, as rigorous processes and changes relevant to the beneficiaries’ reach proved to ameliorate the negative effects of quarantine on their mental health and quality of life [29,30]. This feature, including opportunities for feedback, also allows the program to be tailored to the needs of specific contexts and communities, as it provides a dynamic framework rather than a rigid one-size-fits-all approach.
The partial cost–utility analysis provided evidence of substantial benefit in QALYs for a reasonable cost of USD 25,690 (GBP 20,038) per additional QALY. The incremental cost-effectiveness ratio, developed by the NICE, states that an intervention costing less than GBP 20,000 per additional QALY is considered cost-effective, while willingness to pay for additional health benefits in the US can even be USD 100,000–150,000 [31,32,33]. However, these rates are based on full-on economic evaluations and are often related to drug treatments. If we considered the lack of food aid provision following a disaster, our intervention would have potentially seemed just as cost-effective; however, in reality, food aid is most often provided following a disaster without accounting for cost-effectiveness. Moreover, the provision of ready-to-eat, military-like, pre-packaged meals, without taking into account the needs and preferences of vulnerable populations, can prove to have such limited effectiveness that it overcomes its low-cost advantage [27,34].

Limitations

The initiative’s humanitarian scope and ethical principles did not allow for the design of a controlled interventional study, which could have increased our results’ credibility. Consequently, a full economic evaluation was infeasible. Another limitation is the lack of formal provision of mental and general support beyond the continuous communication conducted with all beneficiaries [35,36,37]. However, the initiative has proven effective at tackling poor mental health without even accounting for the expected surge in anxiety, sadness, and poor mental health attributed to the COVID-19 pandemic during the final re-audit [29]. A potential source of response bias was the alteration of the face-to-face final follow-up to a telephone re-audit [38], which was minimized by comparing the 6-month and 12-month effectiveness and observing a positive trend in improvement in most factors. Finally, the index value, set for the UK population, was utilized since relevant values for the Greek population were unavailable.

5. Conclusions

Following an emergency, older adults can experience long-lasting food insecurity and poor quality of life. Providing food aid that values their needs, customs, and preferences can effectively reduce the consequent health burden and positively impact their quality of life and dietary habits. Future initiatives should value the beneficiaries’ needs, preferences, and customs; closely monitor the quality and safety of the provided food; and adapt their processes based on beneficiaries’ satisfaction and needs. Initiatives should be designed with quick adaptation to changes in needs or other disasters and have a close connection with the beneficiaries constantly. Post-disaster, long-term health consequences and food insecurity in vulnerable populations should not be underestimated and must be effectively targeted through tailored food aid initiatives.

Author Contributions

Conceptualization, D.V.D., K.K., C.M.K., A.V., A.L. and M.K.; methodology, D.V.D., K.K., C.M.K. and M.K.; formal analysis, D.V.D., K.K., L.M., N.D. and M.K.; investigation, D.V.D., K.K., L.M., N.D. and M.K.; resources, D.V.D., K.K., C.M.K., L.M., N.D. and M.K.; data curation, D.V.D., K.K., C.M.K., L.M., N.D. and M.K.; writing—original draft preparation, D.V.D., K.K., L.M., M.R., O.P. and N.D.; writing—review and editing, C.M.K., N.D., A.V., A.L. and M.K.; visualization, K.K. and M.K.; supervision, A.V. and A.L.; project administration, A.L.; funding acquisition, A.V. and A.L. All authors have read and agreed to the published version of the manuscript.

Funding

The founding donor for the “365+ days of care” initiative was the Non-Profit Greek Shipowners’ Social Welfare Company SYN-ENOSIS, a legal non-profit entity. The contributions of Eurobank, THI Canada, Bodossaki Foundation, and Southbridge were also valuable. Many citizens offered donations. The authors received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors for the publication of this study.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethical Committee of Prolepsis Institute (protocol code: 13358, decision n.11 and date of approval: 2/2022.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Acknowledgments

The authors value the contributions of all researchers, staff, and volunteers that participated in the delivery of the initiative.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Supplementary Methods

In addition to meal and food package provision, the program included health promotion activities for the wider community, targeting senior citizens. Two information days took place in the fire-stricken communities. The first one, entitled “Healthy nutrition in the third age” took place in September 2019 and targeted older people in the community. The second, in November 2019, was entitled “Food hygiene and safety”, and was aimed at volunteer cooks who were responsible for preparing daily meals for the beneficiaries. Free medical examinations were implemented for all beneficiaries, 65 of whom participated in further physician consultation, either at a hospital or through a mobile medical unit for beneficiaries with mobility issues. Finally, a celebration event took place on New Year’s Eve, with student volunteers preparing gifts for the beneficiaries, fundraising for the initiative, and participating in an event with traditional dances, music, and intergenerational discussions.

References

  1. Collodel, A.G.P. Food Security and Livelihoods Interventions for Older People in Emergencies; HelpAge International: London, UK, 2012; ISBN 978-1-872590-73-8. [Google Scholar]
  2. Benson, W.F. CDC’s Disaster Planning Goal: Protect Vulnerable Older Adults. CDC Health Aging Program. 2007. p. 17. Available online: http://healthbenefitsabcs.com/home/wp-content/uploads/2015/06/disaster_planning_goal.pdf (accessed on 2 March 2022).
  3. Clay, L.A.; Papas, M.A.; Gill, K.B.; Abramson, D.M. Factors Associated with Continued Food Insecurity among Households Recovering from Hurricane Katrina. Int. J. Environ. Res. Public Health 2018, 15, 1647. [Google Scholar] [CrossRef] [Green Version]
  4. Jia, Z.; Tian, W.; Liu, W.; Cao, Y.; Yan, J.; Shun, Z. Are the Elderly More Vulnerable to Psychological Impact of Natural Disaster? A Population-Based Survey of Adult Survivors of the 2008 Sichuan Earthquake. BMC Public Health 2010, 10, 172. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Tsuboyama-Kasaoka, N.; Purba, M.B. Nutrition and Earthquakes: Experience and Recommendations. Asia Pac. J. Clin. Nutr. 2014, 23, 505–513. [Google Scholar] [CrossRef] [PubMed]
  6. HelpAge International Ukraine: Older People Face Abandonment and Isolation as Conflict with Russia Intensifies. Available online: https://www.helpage.org/newsroom/latest-news/ukraine-older-people-face-abandonment-and-isolation-as-conflict-with-russia-intensifies/ (accessed on 3 May 2022).
  7. Koukoumakas, K. Greece Wildfires: Dozens Dead in Attica Region. BBC News, 2018. Available online: https://www.bbc.com/news/world-europe-44932366(accessed on 2 March 2022).
  8. Smith, H. “In My Nightmares I’m Always in the Sea”: A Year on from the Greek Fires. The Guardian. 2019. Available online: https://www.theguardian.com/world/2019/jul/20/greek-fires-one-year-on-103-dead-survivors-and-rescuers-look-back (accessed on 2 March 2022).
  9. Koutantou, A. Greece Evacuates More Villages as Forest Fire Spreads to Attica Region. Reuters. 2021. Available online: https://www.reuters.com/world/europe/greece-evacuates-villages-forest-fire-rages-corinth-region-2021-05-20/ (accessed on 2 March 2022).
  10. Moore, G.F.; Audrey, S.; Barker, M.; Bond, L.; Bonell, C.; Hardeman, W.; Moore, L.; O’Cathain, A.; Tinati, T.; Wight, D.; et al. Process Evaluation of Complex Interventions: Medical Research Council Guidance. BMJ 2015, 350, h1258. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Prolepsis Institute National Dietary Guidelines for Adults Aged 65 Years and Older. Available online: http://www.diatrofikoiodigoi.gr/?page=summary-elderly (accessed on 31 March 2022).
  12. European Food Safety Authority. Dietary Reference Values for Nutrients Summary Report. EFSA Support. Publ. 2017, 14, e15121. [Google Scholar] [CrossRef] [Green Version]
  13. USDA. Survey Tools. Available online: https://www.ers.usda.gov/topics/food-nutrition-assistance/food-security-in-the-u-s/survey-tools/ (accessed on 31 March 2022).
  14. BAPEN. The “MUST” Toolkit. Available online: https://www.bapen.org.uk/screening-and-must/must/must-toolkit/the-must-itself (accessed on 31 March 2022).
  15. Panagiotakos, D.B.; Pitsavos, C.; Stefanadis, C. Dietary Patterns: A Mediterranean Diet Score and Its Relation to Clinical and Biological Markers of Cardiovascular Disease Risk. Nutr. Metab. Cardiovasc. Dis. NMCD 2006, 16, 559–568. [Google Scholar] [CrossRef] [PubMed]
  16. Ware, J.E.; Sherbourne, C.D. The MOS 36-Item Short-Form Health Survey (SF-36). I. Conceptual Framework and Item Selection. Med. Care 1992, 30, 473–483. [Google Scholar] [CrossRef]
  17. Herdman, M.; Gudex, C.; Lloyd, A.; Janssen, M.F.; Kind, P.; Parkin, D.; Bonsel, G.; Badia, X. Development and Preliminary Testing of the New Five-Level Version of EQ-5D (EQ-5D-5L). Qual. Life Res. 2011, 20, 1727–1736. [Google Scholar] [CrossRef] [Green Version]
  18. Turner, H.C.; Archer, R.A.; Downey, L.E.; Isaranuwatchai, W.; Chalkidou, K.; Jit, M.; Teerawattananon, Y. An Introduction to the Main Types of Economic Evaluations Used for Informing Priority Setting and Resource Allocation in Healthcare: Key Features, Uses, and Limitations. Front. Public Health 2021, 9, 722927. [Google Scholar] [CrossRef]
  19. EQ-5D 2022; Index Value Set Calculators. EuroQol Research Foundation: Rotterdam, The Netherlands, 2022.
  20. Denzin, N.K. The Research Act in Sociology: A Theoretical Introduction to Sociological Methods, 1st ed.; Routledge: London, UK, 2009. [Google Scholar]
  21. Greene, J.; McClintock, C. Triangulation in Evaluation: Design and Analysis Issues. Eval. Rev. 1985, 9, 523–545. [Google Scholar] [CrossRef]
  22. Hastings, S. Triangulation. In SAGE Publications: Encyclopedia of Research Design; Salkind, N.J., Ed.; SAGE: London, UK, 2010. [Google Scholar]
  23. World Bank World Development Indicators: Exchange Rates and Prices. Available online: http://wdi.worldbank.org/table/4.16 (accessed on 24 October 2022).
  24. Maltais, D. Elderly People with Disabilities and Natural Disasters: Vulnerability of Seniors and Post Trauma. Gerontol. Geriatr. Med. 2019, 5, 041. [Google Scholar] [CrossRef] [PubMed]
  25. Papanikolaou, V.; Adamis, D.; Kyriopoulos, J. Long Term Quality of Life after a Wildfire Disaster in a Rural Part of Greece. Open J. Psychiatry 2012, 2, 18497. [Google Scholar] [CrossRef] [Green Version]
  26. Fatmah, F.; Utomo, S.W.; Lestari, F. Broccoli-Soybean-Mangrove Food Bar as an Emergency Food for Older People during Natural Disaster. Int. J. Environ. Res. Public Health 2021, 18, 3686. [Google Scholar] [CrossRef] [PubMed]
  27. Barrett, C.B. Food Aid in Response to Acute Food Insecurity. SSRN Electron. J. 2006, 5, ag036e. [Google Scholar] [CrossRef] [Green Version]
  28. Ziliak, J.P. Food Hardship during the COVID-19 Pandemic and Great Recession. Appl. Econ. Perspect. Policy 2021, 43, 132–152. [Google Scholar] [CrossRef] [PubMed]
  29. De Pue, S.; Gillebert, C.; Dierckx, E.; Vanderhasselt, M.-A.; De Raedt, R.; Van den Bussche, E. The Impact of the COVID-19 Pandemic on Wellbeing and Cognitive Functioning of Older Adults. Sci. Rep. 2021, 11, 4636. [Google Scholar] [CrossRef] [PubMed]
  30. Tessitore, E.; Mach, F. Impact of COVID-19 on Quality of Life. E-J. Cardiol. Pract. 2021, 21, 591. [Google Scholar]
  31. Marseille, E.; Larson, B.; Kazi, D.S.; Kahn, J.G.; Rosen, S. Thresholds for the Cost–Effectiveness of Interventions: Alternative Approaches. Bull. World Health Organ. 2015, 93, 118–124. [Google Scholar] [CrossRef] [Green Version]
  32. National Institute for Health and Care Excellence. Guide to the Methods of Technology Appraisal; NICE: London, UK, 2013. [Google Scholar]
  33. Ubel, P.A.; Hirth, R.A.; Chernew, M.E.; Fendrick, A.M. What Is the Price of Life and Why Doesn’t It Increase at the Rate of Inflation? Arch. Intern. Med. 2003, 163, 1637–1641. [Google Scholar] [CrossRef]
  34. WHO; UNHCR; UNICEF; WFP. Food and Nutrition Needs in Emergencies. 2004. Available online: https://apps.who.int/iris/bitstream/handle/10665/68660/a83743.pdf (accessed on 2 March 2022).
  35. Cordero-Reyes, A.M.; Palacios, I.; Ramia, D.; West, R.; Valencia, M.; Ramia, N.; Egas, D.; Rodas, P.; Bahamonde, M.; Grunauer, M. Natural Disaster Management: Experience of an Academic Institution after a 7.8 Magnitude Earthquake in Ecuador. Public Health 2017, 144, 134–141. [Google Scholar] [CrossRef]
  36. Maeda, K.; Shamoto, H.; Furuya, S. Feeding Support Team for Frail, Disabled, or Elderly People during the Early Phase of a Disaster. Tohoku J. Exp. Med. 2017, 242, 259–261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Moghadam, M.N.; Amiresmaieli, M.; Hassibi, M.; Doostan, F.; Khosravi, S. Toward a Better Nutritional Aiding in Disasters: Relying on Lessons Learned during the Bam Earthquake. Prehospital Disaster Med. 2017, 32, 382–386. [Google Scholar] [CrossRef] [PubMed]
  38. Bogner, K.; Landrock, U. GESIS Survey Guidelines Response Biases in Standardised Surveys. 2016. Available online: https://core.ac.uk/download/pdf/286229961.pdf (accessed on 2 March 2022).
Figure 1. Mean differences in utility values and QALYs gained by the total sample as well as according to sex, food insecurity status, and malnutrition risk classification.
Figure 1. Mean differences in utility values and QALYs gained by the total sample as well as according to sex, food insecurity status, and malnutrition risk classification.
Ijerph 20 05235 g001
Table 1. Baseline sociodemographic characteristics (n = 133).
Table 1. Baseline sociodemographic characteristics (n = 133).
Age, Years *72 ± 9
Men, %37.6
Marital status, %
Living alone
Single6.8
Widowed24.8
Divorced9.8
Cohabitation
Married58.7
Nationality, % Greek96.2
Insurance, % no11.4
Electricity at home, % no3.0
Safe drinking water at home, % no21.1
House damage, %
Completely destroyed62.1
Severe damage34.1
No damage3.8
Loss of other assets, % yes 50
Loss of a first-degree relative, % yes8.3
* Age is presented as mean ± standard deviation.
Table 2. Food insecurity, risk for malnutrition, BMI, adherence to the Mediterranean diet, quality of life, and health status at baseline and 2nd follow-up.
Table 2. Food insecurity, risk for malnutrition, BMI, adherence to the Mediterranean diet, quality of life, and health status at baseline and 2nd follow-up.
Baseline (n = 133)2nd Follow-Up (n = 133)Difference
Food insecurity status
Food insecure, %61.834.8−27 **
Food insecurity score4.4 ± 3.32.2 ± 2.7−2.2 ± 3.4 **
Risk for malnutrition, %
Low78.389.1+10.8% *
Medium11.74.2−7.5% *
High106.7−3.3% *
MUST score (range: 0–6)0.34 ± 0.740.18 ± 0.53 *−0.17 ± 0.83 *
Weight status, %
Underweight00.8+0.8%
Normal2425.6+1.6%
Overweight4443.2−0.8%
Obese3230.4−1.6%
BMI, kg/m227.7 (25.2–32)27.7 (24.9–30.9)0.0
Mediterranean diet
Level of adherence to Mediterranean diet, %
Low0.00.00.0% **
Medium88.572.9−15.6% **
High11.527.1+15.6% **
MedDietScore (range: 0–55)31.1 ± 3.833.8 ± 4.2+2.7 ± 4.2 **
SF-36 health status questionnaire
Total score41.7 ± 19.552.3 ± 20.2+10.5 ± 17.2 **
General health40.1 ± 21.845.4 ± 20.6+5.4 ± 20.3 *
Limitations of activities49.4 ± 32.854.4 ± 32.7+5 ± 35 *
Physical health26.4 ± 40.250.4 ± 46.5+24.4 ± 53.6 **
Emotional health27.5 ± 39.651.7 ± 41.2+24.2 ± 54.1 **
Social activities40.3 ± 33.356.7 ± 30.2+16.3 ± 40 **
Body Pain40.1 ± 31.955 ± 34.1+15 ± 32.1 **
Vitality36.5 ± 23.947 ± 22.3+10.5 ± 22.7 **
Mental health44.8 ± 21.556.3 ± 21.5+11.5 ± 21.5 **
EQ-5D QOL
Total score13.9 ± 4.811.9 ± 4.8−2.0 ± 3.7 **
Mobility2.78 ± 1.352.44 ± 14−0.34 ± 1.1 **
Self-care1.76 ± 1.261.68 ± 1.22−0.08 ± 1.03
Usual activities2.79 ± 1.312.33 ± 1.32−0.46 ± 1.27 **
Pain/Discomfort2.98 ± 1.262.53 ± 1.23−0.45 ± 1.16 **
Anxiety/Depression3.59 ± 1.182.9 ± 1.15−0.68 ± 1.26 **
Self-evaluated health status53.1 ± 20.059.1 ± 21.5+6 ± 19.3 **
** p < 0.001; * p < 0.05. Abbreviations: QOL, quality of life; SF-36, 36-item short-form health survey.
Table 3. Multi-adjusted logistic regression with the independent variable as the change in food insecurity score (improvement of food security) * between baseline and the 12-month follow-up and the dependent variable being the respective quality of life parameters.
Table 3. Multi-adjusted logistic regression with the independent variable as the change in food insecurity score (improvement of food security) * between baseline and the 12-month follow-up and the dependent variable being the respective quality of life parameters.
OR (95% CI)p-Value
Improvement of participants’ health status, defined through the SF-36, yes/no
Overall health1.29 (1.02, 1.64)0.036
General health1.35 (1.13, 1.63)0.001
Limitations of activities1.22 (1.04, 1.43)0.013
Physical health1.00 (0.87, 1.15)0.995
Emotional health1.07 (0.92, 1.23)0.388
Social activities1.06 (0.91, 1.22)0.461
Body pain1.18 (1.01, 1.38)0.033
Vitality1.24 (1.05, 1.47)0.013
Mental health1.04 (0.88, 1.22)0.647
Improvement of participants’ health status, defined through the EQ-5D QOL, yes/no
Overall health1.30 (1.06, 1.61)0.014
Mobility1.15 (0.99, 1.34)0.063
Self-care1.18 (0.94, 1.48)0.143
Usual activities1.06 (0.92, 1.22)0.408
Pain/Discomfort1.22 (1.04, 1.43)0.014
Anxiety/Depression1.17 (1.00, 1.36)0.051
Self-evaluated health status1.15 (0.99, 1.35)0.073
* Change in food insecurity score = −(food insecurity score at follow-up − baseline food insecurity score); higher values indicate better improvement in food security. Abbreviations. QOL, quality of life; OR, odds ratio; 95% CI, 95% confidence interval; SF-36, 36-item short-form health survey, EQ-5D, EuroQol EQ-5D-5L. All models have been adjusted for age, sex, total or partial household damage, and the existence of a cohabitant in their household (living alone or being married).
Table 4. Qualitative findings, taken from combining focus groups and personal interview findings, assessing the beneficiaries’ perceptions of the program implementation and effectiveness.
Table 4. Qualitative findings, taken from combining focus groups and personal interview findings, assessing the beneficiaries’ perceptions of the program implementation and effectiveness.
Main ThemesDescriptionRepresentative Selected Quotations
Immediate needs of beneficiaries attributable to their emergency.Beneficiaries emphasized problems related to depression and hopelessness, poverty, and poor food infrastructure in temporary accommodations; no kitchens or fridges, thus allowing no dietary flexibility regarding health needs.“There is a need for this program. It’s not only a financial need. It’s also psychological.” (73 y., male, daily meal recipient)
“What you do for us is very important. Both practically and psychologically, because there are so many difficulties, and we are not young, to have all our lives ahead of us.” (81 y., male, weekly package recipient)
Proper social initiative.Beneficiaries stated that sometimes aid programs create social stigma for participants that implies pity, exclusion, or helplessness. Participants did not indicate any such feelings, and instead praised the program’s supportive nature. They felt supported, respected, loved, and cared for.“The program is a support with love. It offers love.” (71 y., female, daily meal recipient)
“I have not felt offended. I felt only love and support.” (75 y. female, weekly package recipient)
“The fact that you ask for our opinion is essential.” (69 y., male, weekly package recipient)
High-quality food aid provisions tailored to their nutritional and health needs.Participants highlighted that many of the program’s unique components were essential to their satisfaction and experience. These elements included meal quality and freshness, special menus based on religious and health needs, daily food monitoring by the organization responsible for the program, and frequent communication with those working in the program in order to provide feedback on the implementation methods as well as the actual meals. “My husband would not have had such a good blood-test, if he were not eating the special meal offered to him. Because we live in camps, we can’t cook, we don’t have a kitchen, so we eat what they give us. And what you give to us has quality and it is based on our special health needs.” (70 y., female, daily meal recipient)
“The whole program has quality. No expired products or close to expiration. What you give us in packages is excellent. We would buy them ourselves.” (83, male, daily meal recipient)
“I fast (Christian fasting) and you bring me the menu for those who fast. I appreciate it very much.” (87, female, daily meal recipient)
“Checks are necessary and we appreciate it because we know we are eating something good. Monitored.” (71 y., female, daily meal recipient)
“We see great interest and we have meaningful communication with employees. It’s not that they just throw something (meal) at us and leave.” (73 y., male, daily meal recipient)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Diamantis, D.V.; Katsas, K.; Kastorini, C.M.; Mugford, L.; Dalma, N.; Ramizi, M.; Papapanagiotou, O.; Veloudaki, A.; Linos, A.; Kouvari, M. Older People in Emergencies; Addressing Food Insecurity, Health Status and Quality of Life: Evaluating the “365+ Days of Care” Program. Int. J. Environ. Res. Public Health 2023, 20, 5235. https://doi.org/10.3390/ijerph20075235

AMA Style

Diamantis DV, Katsas K, Kastorini CM, Mugford L, Dalma N, Ramizi M, Papapanagiotou O, Veloudaki A, Linos A, Kouvari M. Older People in Emergencies; Addressing Food Insecurity, Health Status and Quality of Life: Evaluating the “365+ Days of Care” Program. International Journal of Environmental Research and Public Health. 2023; 20(7):5235. https://doi.org/10.3390/ijerph20075235

Chicago/Turabian Style

Diamantis, Dimitrios V., Konstantinos Katsas, Christina Maria Kastorini, Lyndsey Mugford, Nadia Dalma, Marsellos Ramizi, Ourania Papapanagiotou, Afroditi Veloudaki, Athena Linos, and Matina Kouvari. 2023. "Older People in Emergencies; Addressing Food Insecurity, Health Status and Quality of Life: Evaluating the “365+ Days of Care” Program" International Journal of Environmental Research and Public Health 20, no. 7: 5235. https://doi.org/10.3390/ijerph20075235

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop