Next Article in Journal
The Association between Changes in Built Environment and Changes in Walking among Older Women in Portland, Oregon
Previous Article in Journal
What Drives Visitors’ Use of Bins in Urban Parks? An Application of the Stimulus-Organism-Response Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Validation of Nutrition Environment Scoring for Chinese Style University/Work-Site Canteens (NESC-CC) and Oil–Salt Visual Analogue Scale (OS-VAS)

College of Food Science & Nutritional Engineering, China Agricultural University, Beijing 100083, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(21), 14169; https://doi.org/10.3390/ijerph192114169
Submission received: 26 September 2022 / Revised: 22 October 2022 / Accepted: 24 October 2022 / Published: 29 October 2022

Abstract

:
The assessment of the use of cooking oil/fat and salt in dining food is an unsolved issue in non-quantitative nutrition environment evaluation, and the nutrition environment of Chinese-style dining establishments has not been effectively assessed. This study developed two evaluation tools: the Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC) and the Oil–Salt Visual Analogue Scale (OS-VAS) and applied them in nine university canteens. The NESC-CC, which includes comprehensive items from the healthiness of food availability, cooking methods to other factors that support healthy choices, is featured by adjusting the scoring categories and items to suit Chinese food culture and canteen operation model. The OS-VAS is a novel virtual analog scale (VAS) based on the fuzzy judgement of the diners. It requires the randomly recruited respondents to rate their personal preference for salty taste/greasy food preference, overall saltiness/greasiness of canteen dishes, and personal demands for salt/cooking oil reduction. The oil use score, the salt use score, and the total score are derived from the given formula. The field tests of the NESC-CC in nine university canteens at three time points showed that this tool was able to effectively distinguish the nutrition environment of the Chinese food-style canteens with good reliability and validity. The result of OS-VAS scoring achieved a good resolution of the overall salt and oil/fat use and confirmed our hypothesis on the fuzzy judgement of the diners These tools are suitable for the comprehensive evaluation of Chinese-style canteens and have the potential to be applied to more group-meal-providing establishments.

1. Introduction

With the development of economy and society and the improvement of living standards, the proportion of people eating out frequently has gradually increased. The resulting unbalanced nutritional intake and unhealthy dietary pattern increases the risk of overweight, obesity, and the related chronic metabolic diseases [1].
Nutrition environment is a conceptual model first proposed in 2005 [2] with a perspective of the possible impact of food environment on personal food consumption. There is evidence that the nutritional environment plays a key role in dietary patterns, food choices, and energy intake [3,4], and thus influences the risk of obesity and chronic diseases. In recent years, many studies on obesity prevention have also focused attention on environmental factors, contributing to the formulation and publication of relevant health policies [5,6,7].
Among the nutrition environment variations, the consumer food environment in catering services is a key factor to be addressed as more and more young people depend heavily on packaged food, take-out food, and all kinds of ready-to-eat food providers. A number of evaluation tools, such as the Nutrition Environmental Measures Survey (NEMS-R) [8], the Freedman’s comprehensive dining survey [9] and the Full Restaurant Evaluation Supporting a Healthy (FRESH) Dining Environment Audit [10], have been developed to assess the availability of healthy or unhealthy food, the means to encourage access to food and the price policy of food, as well as other factors that may impact consumer’s healthy eating decisions in dining occasions.
However, due to the differences in food culture, cooking practices and dietary patterns, the evaluation tools developed based on Western food culture cannot be simply applied to the nutritional environment survey and evaluation in China. The nutrition environment evaluation of Chinese restaurant and canteens can be a great challenge as Chinese cuisine characterized by its diversified food materials, complicated cooking methods and rich food choices. For example, diners have to make choices among more than 30 kinds of dishes, which are made of over 50 raw materials, in just one of the canteens at a university campus. To our best knowledge, the nutrition environment survey of Chinese dining places has not yet been conducted.
In addition to the difficulty in identifying healthy food choices based on many meat–vegetable mixed dishes, the evaluation of nutritional environment of a canteen or restaurant can be further challenged by the need for judging the amount of cooking oil/fat and salt in the dishes. Compared with packaged food, sodium content in restaurant food is more difficult to be assessed and managed [11]. Excessive salt intake or high sodium intake is the main risk factor for hypertension [12,13,14], overweight and obesity [15], osteoporosis, kidney stones and other diseases [13]. It is closely associated with an increased risk of all-cause mortality [16,17] and excessive intake of fat can affect gut microbial homeostasis closely related to metabolism and excess energy accompanied by the abnormal metabolism of sugar, fat and water and salt can cause overweight and obesity, diabetes and cardiovascular disease [18,19,20,21]. Some studies indicated that high-fat and high-salt diets might cause cognitive impairment [22,23].
The World Health Organization has included the reduction of salt/sodium intake in the 2013–2020 global action plan for the prevention and control of non-communicable diseases [24] and on this basis has developed the SHAKE plan (Surveillance, Harness industry, Adopt standards for labeling and marketing, Knowledge, Environment) to promote the implementation of salt reduction strategies [25]. Considering the possible health consequences, there is an urgent need to develop a practical tool to assess the use of cooking oil/fat and salt use in public food service providers.
Since the university students spend most of their time on campus and heavily rely on the food provided by the canteens and cafeteria there, the assessment of the nutrition environment of university canteens is of great significance to improve the nutritional status of the students.
In this study, we developed Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC) and a novel tool for oil and salt added in dining places through the Oil–Salt Visual Analogue Scale (OS-VAS) based on the collective perception of diners. The NESC-CC and OS-VAS were tested and validated in nine canteens of China Agricultural University. This paper describes the development of the above-mentioned two tools and their reliability and validity.

2. Methods Overview

The present study consists of two studies. Study 1 is the development and validation of the Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC). Study 2 is the development and validation of the development and application of Oil–Salt Visual Analogue Scale (OS-VAS). The tools were formulated in 2021 and revised three times while tested in twice pilot surveys. The data collection was carried out through April to May 2022 on the campus of China Agricultural University.
The China Agricultural University is a public university in Beijing with about 27,000 undergraduate and graduate students, most of whom live on-campus and whose main dining venue are the nine canteens located inside the campus, which are managed by the university. The canteens provide Chinese-style meals and have daily meal plans. Students choose the staple food and dishes as they like and complete the payment and pick up their meals at the windows. They can either eat in the canteen or as a takeaway. The food sold in the canteen includes staple food, Chinese salad dishes, main dishes, cooked vegetable, fruits and drinks, etc., which are similar to the food that can be obtained at home. In our study, the nine canteens were scored for their nutrition environment and students who dined in the canteens were asked to complete the evaluation of the amount of oil and salt added.

2.1. Study 1 Development and Application of Nutrition Environment Scoring for Chinese Style University/Work-Site Canteens (NESC-CC)

2.1.1. The Conception and Structure of the NESC-CC

The goal of the NESC-CC is to build an evaluation tool for the nutrition environment of Chinese canteens. The conception of the tool drew from the conceptual model and evaluation framework of nutrition environment. Factors such as the availability of healthy choices, the modification of food service, the promotion of foods and the information environment that might impact the nutritional environment are included in the NESC-CC scoring items (File S1). In order to evaluate the cooking methods and dining environment of Chinese canteens, we added a part regarding the canteen’s facilities and related services to the framework of the tool.
Regarding the definition and types of healthy food, we applied the relevant content of the Dietary Guidelines for Chinese Residents [26] to the evaluation framework of NESC-CC. In 2005, the Chinese Dietary Balance Index (DBI) [27] proposed the combination of the content of the balanced diet pagoda and the dietary guidelines for Chinese residents and has been applied to the evaluation of dietary quality in many regions of China [28,29,30,31]. DBI evaluates the dietary quality of the population in terms of food type and intake, which is also reflected in the NESC-CC (File S1). In the evaluation module of canteen facilities and related services, we incorporated the requirements of the Guidelines for the Construction of Nutritious and Healthy Canteens [32] into NESC-CC.

2.1.2. Determine Scoring Items

Before forming the final draft, we conducted interviews with canteen leaders to understand the basic situation of each canteen. Subsequently, we revised the scoring content of NESC-CC, adjusting the time and content of the evaluation. In order to make the evaluation more feasible and discriminatory, we added the statistics of the number of food on the basis of the score. After discussion and consensus, we determined the NESC-CC scoring items.
The purpose of developing NESC-CC is to evaluate the nutritional environment of Chinese canteens from the perspective of food and the factors that influence food choice. In the process of determining the scoring items of NESC-CC, we refer to the relevant content of the Dietary Guidelines for Chinese Residents and the Guidelines for the Construction of Nutritious and Healthy Canteens.
The Dietary Guidelines for Chinese Residents is a guideline on food selection and physical activity based on the nutritional needs of the Chinese population and combined with the data from the China Health and Nutrition Survey. It recommends the intake of cereals, potatoes, vegetables and fruits, livestock, poultry, fish, eggs, milk, soybeans and nuts. The determination of the NESC-CC scoring items is also based on the Dietary Guidelines for Chinese Residents, and the healthiness and intake of food are used as an important basis for scoring.
Regarding the intake of cereals and potatoes, the Dietary Guidelines for Chinese Residents recommends that adults between the ages of 18 and 65 consume 200–300 g of cereals per day, including 50–150 g of whole grains and beans and 50–100 g of potatoes. At the same time, daily intake of cereals, potatoes and beans should comprise three types on average and five kinds every week. Therefore, in the NESC-CC scoring section on staple foods, in addition to the type of food, we also include whether the staple food contains potatoes, whole grains and beans and whether its content reaches 20% or 50% to meet the daily needs of the human body as a point of scoring.
The recommended daily intake of vegetables and fruits is at least 300 g and 200–350 g, respectively, and the intake of dark vegetables, such as spinach, broccoli, tomatoes, carrots, and purple cabbage, is also considered. Therefore, we set up scoring items on the availability and quantity of vegetables and fruits.
The Dietary Guidelines for Chinese Residents recommend an average daily intake of 120–200 g of fish, poultry, eggs and lean meat and 300–500 g of fish, 300–350 g eggs and livestock, and 300–500 g poultry per week Considering that Chinese people mainly eat meat at lunch and dinner, we divided daily and weekly intakes into each meal. In addition, soy, nuts and milk can be present in both food and beverage forms in the Chinese diet, so they all appear in different scoring sections.
Different from the Dietary Guidelines for Chinese Residents, the Guidelines for the Construction of Nutritious and Healthy Canteens focus more on the environment. In terms of organization and management, personnel training and assessment, nutrition and health education, catering and cooking and catering services, the Guidelines for the Construction of Nutritious and Healthy Canteens have laid out detailed requirements. With reference to these, we developed scoring items for different aspects to evaluate the nutrition environment in terms of other factors that influence healthy choices.
Finally, we divided NESC-CC into two parts. The first part was to evaluate the healthiness of the ingredients and food content of the canteen according to the recommendations of the Dietary Guidelines for Chinese Residents. The criteria for determining healthy food include whole grains, cooking with less oil and less salt, sugar-free drinks, etc. The second part is to evaluate other factors that support healthy choices, such as services, facilities, etc. (Table 1).

2.1.3. Training for Raters

The raters of the study were the senior undergraduate students and graduate students in the College of Food Science and Nutritional Engineering, China Agricultural University, who have adequate knowledge on food classification, food sensory evaluation, food safety and nutrition. They were trained for 4 h (two 2 h sessions) on the basic concept of nutrition environment, the goal and contents of NSEC-CC, the identification and semi-quantification of each food group in dishes made of multiple food materials and how to address possible confusing occasions in their future scoring. In terms of the scoring content, we explained misleading concepts, such as whole grains, dark vegetables, and common cooking methods. They were required to give a detailed description of the basic situation of the canteens to be evaluated, the method and content of scoring, the time of scoring and the validity of the data. The photo record of each dish in each rating session was sorted according to a coding system. At the same time, we asked the raters to pre-visit and be familiar with the food sales and dining environment of each food outlet in advance before scoring. With the consent of the canteen managers and the premise of ensuring food safety and the order of the canteen, our raters were allowed to enter the food serving area to evaluate the nutrition environment.

2.1.4. Scoring Process

The nutrition environment scoring for canteens was completed from April to May 2022. Each canteen was independently scored twice by two trained raters according to a uniform standard. The scoring process was divided into three parts: (1) review of menu acquired from the canteen manager to examine the availability of diverse healthy foods; (2) on-the-spot investigation to confirm the actual situation of the food in the canteens, including the evaluation and record the food and health-related information provision in each dining place; (3) taking photos of all food and environmental information as sorted records for future reference. The rating points that could not be directly observed were determined by asking the canteen staff.
The complete NESC-CC is detailed in the Supplementary Materials. In the healthiness of ingredients and food content part of the study, we counted the scores and the number of food items for each scoring item and explained the content that is likely to cause scoring differences between raters. In the other factors supporting the healthy choices part, combined with the recommendations of the Dietary Guidelines for Chinese Residents and the documentation requirements of the Guidelines for the Construction of Nutritious and Healthy Canteens, we scored other aspects other than food that might cause differences in nutritional environment scores.

2.1.5. Data Analysis

The intra-class correlation coefficient (ICC) was used to analyze the agreement between raters. The coefficient values of 0.2–0.4, 0.4–0.6, 0.6–0.8 and 0.8–1.0 indicated weak agreement, moderate degree of agreement, strong agreement and very consistent among raters, respectively. The Pearson’s correlation coefficient test was used to analyze the test-retest reliability of the scheme. The coefficient values of 0.2–0.4, 0.4–0.6, 0.6–0.8 and 0.8–1.0 indicated that the two scores were weakly correlated, moderately correlated, strongly correlated and extremely strongly correlated. One-way ANOVA was used to analyze the differences between different time periods in the same canteen and between different canteens in the same time period. p < 0.05 was considered significant difference and p < 0.01 was considered an extremely significant difference.

2.2. Development and Application of Oil–Salt Visual Analogue Scale (OS-VAS)

2.2.1. Scoring Process

The Visual Analogue Scale (VAS) is a straight line with zero and full marks at both ends, the ends of which are defined as the limits of the sensation or response to be measured [33]. VAS is widely used in clinical pain assessment to record patients’ subjective feelings or opinions [34], among which the rating scale with descriptive language showed better accuracy and ease of use [35].
In OS-VAS, we changed the scale and its meaning. The OS-VAS scale ranges from 0 to 100, indicating respondents’ feelings or needs for different rating content. We set scales of 10, 30, 50, 70 and 90 to represent the tipping points of varying degrees of feeling or need. Respondents were finally presented with a scale with descriptive language that was be subjectively rated (See File S2 for the Figures S1–S6).
The OS-VAS scoring tool had been revised twice to pre-test its feasibility and validation power before the survey was carried out during April to May 2022. The minimal number of randomly invited respondents was set to five percent of average daily diners of each canteen based on the interpersonal variance in the pre-test. We asked the respondents to choose their corresponding taste preferences and perception of the saltiness and oil consumption of different canteen dishes in OS-VAS according to their own judgment. The OS-VAS has hints of preference, saltiness, oil consumption and demand for oil reduction and salt reduction represented by different scores. We denoted the scores of personal saltiness preference, oil consumption preference, overall saltiness of canteen dishes, overall oil consumption of canteen dishes, personal salt reduction demand and personal oil reduction demand as S1, O1, S2, O2, S3 and O3, respectively.

2.2.2. Data Analysis

S1 and O1, respectively, indicate the respondents’ acceptance of the amount of salt and cooking oil used in dishes. The higher the score, the more salty or oily dishes the respondents prefer; S2 and O2 represent the respondents’ perceptions of the saltiness and oiliness of the canteen dishes, respectively. The higher the score, the less salt and oil used in the canteen dishes; S3 and O3, respectively, indicate the respondents’ demand for reducing the use of salt and cooking oil in the canteen dishes. The higher the score, the lower the respondents’ demand for reducing salt and oil in the canteen.
The Salt Score (CS), Oil Score (CO) and Total Score (C) are calculated separately by the following formulas:
CS = (S2 + S3) × S1/(2 × 100)
CO = (O2 + O3) × O1/(2 × 100)
C = [(S2 + S3) × S1 + (O2 + O3) × O1]/(4 × 100)
The higher the CS or CO, the more satisfied the consumers are with the use of salt or oil in the canteen. The higher the C, the more satisfied the consumers are with the overall use of oil and salt in the canteen.
The reliability and validity of the scales were tested by reliability statistics and factor analysis and the original data of each canteen was tested for normality by Kolmogorov–Smirnov test. One-way ANOVA, independent samples t-test or nonparametric test were used to analyze the differences of scores among canteens and consumers with different tastes. The follow-up analysis method was selected according to the normal test results. If the data were normally distributed and showed homogeneity of variance, the independent sample t test was used for statistical analysis of the data; if the data did not meet the normal distribution, the nonparametric test was used for statistical analysis.
All data analysis on NESC-CC and OS-VAS was carried out with SPSS version 22.0.

3. Validation of the Tools

3.1. Nutrition Environment Score of Canteens

We found that the canteens will replenish or replace food when some food is sold out, which may cause variations in the nutrition environment of the same canteen at different times as well as the ranking of canteens at a given time points. Therefore, we divided the lunch session into three periods and scored the canteens three times according to the healthiness of ingredients and food content, respectively. The results of scoring by time was presented in Table 2.
The results in Table 2 showed that the nutrition environment of different canteens at the same time had significant differences, while the scores of a same canteen at different times differed to varying degrees as well.
With respect to the other factors supporting healthy choices, the scores of the nine canteens were all relatively low, showing no significant differences (Table 3).
The inter-rater and test–retest analysis showed satisfactory consistency, as shown in Table 4. The ICC value is between 0.71–0.99, the test–retest reliability of NESC-CC is high, and the two scoring results show a moderate or more than moderate correlation in nine canteens. The low value of some canteens is due to the fact that the menu of the canteen is updated once a week.

3.2. Evaluation of the Oil and Salt Use in Canteens

The average number of diners per meal in each canteen was about 2000, of which 5% of the diners were randomly selected as respondents. A total of 1009 VAS questionnaires were distributed in our study and 981 valid questionnaires were recovered with an effective rate of 97.22%. Totals of 103, 106, 113, 113, 105, 114, 102, 119 and 106 valid questionnaires were collected from the nine canteens, respectively.
The OS-VAS questionnaires showed good reliability and validity. The Cronbach’s α reliability coefficient was 0.778, indicating that OS-VAS has good internal consistency. Based on the combined results of KMO (0.622) and Bartlett’s test (p = 6.699 × 10−35), the original data of OS-VAS were suitable for factor analysis. The factor loading matrix analysis showed that the loadings of the six items in the corresponding dimensions were all higher than 0.5 (O1, 0.863; S1, 0.813; O2, 0.777; S2, 0.683; O3, 0.814; S3, 0.807), and the scoring items were valid. The analysis results showed that S1 and O1 belong to dimension 1, and the survey content is consumers’ taste; S2, O2, S3 and O3 belong to dimension 2, and the survey content is the consumers’ evaluation of the amount of oil and salt added to the canteen dishes. The factor analysis results were consistent with the dimension division of OS-VAS score items.
The results of the Kolmogorov–Smirnov test showed that the scores of the nine canteens were all in line with the normal distribution, so we used one-way ANOVA to evaluate the differences in the amount of oil and salt used in the canteens. The scores of oil and salt used in the canteens are shown in Table 5. There are significant differences between canteen B and F, C and H and G and I in terms of C. The canteen B and canteen H had the highest Cs, while the canteen G had the lowest. The canteen G had the lowest score of Co, while the canteen H had the highest.
According to the scores of S1 and O1, we divided the respondents of different cafeterias into four categories, salty preference (S1 ≥ 50), non-salty preference (S1 < 50), greasy preference (O1 ≥ 50) and non-greasy preference (O1 < 50). The scores of the respondents were calculated by different taste preferences. The independent samples t-test was used to compare the scores of respondents with different taste preferences to explore whether there were differences in their evaluation of the oil and salt use in the same canteen. The respondents who preferred a salty taste, which accounted for 67.43% of the total respondents, gave significantly higher marks on the amount of oil and salt used in each canteen than their counterparts who preferred non-salty food did. In terms of preference for different oil levels, the number of respondents who like oily food (51.41%) and those who dislike oily food (48.59%) is basically the same. Respondents who had a preference for greasy food, which accounted for 48.59% of the respondents, also scored higher than the overall rating (Table 6).

4. Discussion

The present study presented the first scoring tool, the NESC-CC, as well as a visualized scale scheme to evaluate the nutrition environment in Chinese-style catering service. The preliminary application of the tools showed good reliability and validity and could effectively distinguish the difference in terms of the nutrition environment of university canteens.
The NESC-CC was structured based on the scientific evidence on the relationship of food intake and the risk of non-communicable chronic diseases. The food group associated with the reduced risk of diabetes and cardiovascular diseases, such as whole grains [36] and dark-green leafy vegetables [37], were given more items and scores compared with other food groups. Animal protein and plant protein food are important for maintaining muscles, especially among Asian people, who tend to have less muscle percentage compared to Caucasian people [38]. Milk and soy milk is encouraged, as most people in China have difficulty meeting the dietary reference intake of calcium [39].
It is difficult to assess Chinese food in terms of healthy food choices because of two reasons. First, it is not easy to categorize and quantify each food as multiple base ingredients are included in one dish. Second, the cooking methods of Chinese cuisine are extremely rich and complicated. At the same time, we tried to integrate the evaluation of the cooking method into the score points based on the idea of nutrient density. Cooking methods that utilize less refined oil are encouraged in the scoring system.
In the process of the validation of NESC-CC, we found that there are obvious differences in the nutrition environment of different canteens in the same university, and the nutrition environment scores of the same canteen at different times varied to some extent. In terms of other factors that support healthy choices, the performance of the nine canteens was not excellent, and most of the canteens received less than half of the total score. The low scores could be improved by educating the canteen managers and encouraging them to investigate ways to achieve a better nutrition environment. These results indicated that NESC-CC could identify the differences between the nutrition environment among food provisions with similar styles in a same culture and location.
The scoring system combines the features of both checklist and NEMS-R and integrated the consideration of cooking method. It is has been successfully applied to the context of the Chinese style canteens with a minimum of 4 h training and achieved satisfactory consistency in inter-participant and test-retest analysis. To our knowledge, this is the first report on nutrition environment assessment for Chinese-style catering service.
Compared to some previous reports on university nutrition environment [40,41], we found that Chinese canteens offer a wider variety of food and higher availability of healthy choices. However, some Chinese dishes were criticized for their high content of energy and salt. The popularity of fried food and salty food was reported by a previous quantitative nutrition survey on Chinese university canteens [41]. The National Nutrition and Chronic Disease Report 2020 showed that the average intake of refined cooking oil in China adults is 37.4 g, which is much more than the recommended amount of 25 g [42]. Excess use of cooking oil is not encouraged as it inevitably decreases nutrient density in spite of the fact that the dominant cooking oil in Chinese cuisine are vegetable oils (such as soybean oil, canola oil and peanut oil), which are rich in unsaturated fatty acid. The salt intake is found to rank first among dietary factors associated with cardiometabolic mortality in Chinese adults [43]. Based on these facts, we took oil and salt assessment as priority issues and developed an innovative VAS scheme to make a non-quantitative and low-cost evaluation possible.
The results of OS-VAS analysis showed that there were significant differences in the amount of oil and salt added between the canteens, which was reflected in the scores of CO, CS and C values, confirming the effectiveness and sensitivity of the OS-VAS. When we grouped the respondents according to taste preference, we found that there were significant differences in the respondents’ scores on the amount of oil and salt used in the same canteen (p < 0.05), which was consistent with our research hypothesis that that consumers with different taste preferences would have different perceptions of the amount of oil and salt used in the same canteen. The innovative research applied a multi-disciplinary approach of visual analog scale and subjective perception of sensory analysis, which provides a new perspective of non-quantitative measurements of cooking oil/fat and salt, which has remained a key issue in nutrition environment evaluation.
This research has its limitations. The validation of the NESC-CC and the OS-VAS was only carried out in nine canteens of one university. We planned to test them in at least 20 canteens of six universities or other group meal providers, but the plan was suspended due to the COVID-19pandemic. The applicability of these two methods of analysis to catering services of different food types and cultures other than Chinese food is yet to be confirmed. Some scoring items and the weight of the score need to be improved according to the actual situation of different geological areas and culture features. The VAS assessment can only make a subjective evaluation of a general picture of oil and salt used in a canteen. More specific and objective evaluation tools needs to be developed and applied in combination with the OS-VAS to better identify the food sources of excess oil and salt.

5. Conclusions

In the present study, a NESC-CC tool for a Chinese-style catering food environment and a novel OS-VAS for the evaluation of cooking oil/fat and salt were developed and validated in nine university canteens with satisfying inter-participant and test–retest consistency. The NESC-CC was proven to be effective and practical for the evaluation of healthy food availability, cooking methods and supportive factors conducive to healthy eating, as well as the training and facility aspect. The OS-VAS is the first virtual analog approach for the investigation of cooking oil/fat and salt use. These tool have the potential to be applied to related nutrition environment research issues but still need to be tested and optimized. In future research, we would like to explore the possibility of combining the evaluation of both the objective nutrition environment and the perceived nutrition environment.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph192114169/s1, File S1: Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC). File S2: The Oil-Salt Visual Analogue Scale (OS-VAS).

Author Contributions

Conceptualization, Z.F.; methodology, Y.H., Z.F. and Y.W.; investigation/study conducting, Y.H., Y.W., D.Z. and X.W.; data curation, Y.H.; data analysis, Y.H.; writing—original draft preparation, Y.H.; writing—review and editing, Y.H. and Z.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Chinese Nutrition Society (CNS) Nutrition Science Foundation-YUM China Dietary Health Foundation. Grant number CNS-YUM2019B15.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of China Agricultural University (CAUHR-20221002).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

We would like to express sincere thankfulness to all the subjects who participated in the survey, the respective canteen managers and the experts who gave advice and suggestions for the revision of the evaluation tools.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dahye, K.; Byeong-il, A. Eating out and consumers’ Health: Evidence on obesity and balanced nutrition intakes. Int. J. Environ. Res. Public Health 2020, 17, 586. [Google Scholar]
  2. Glanz, K.; Sallis, J.F.; Saelens, B.E.; Frank, L.D. Healthy nutrition environments: Concepts and measures. Am. J. Health Promot. 2005, 19, 330–333. [Google Scholar] [CrossRef] [PubMed]
  3. Liu, Y.; Song, S.; Gittelsohn, J.; Jiang, N.; Hu, J.; Ma, Y.; Wen, D. Adaptation and Validation of the Chinese Version of the Nutrition Environment Measurement Tool for Stores. Int. J. Environ. Res. Public Health 2019, 16, 782. [Google Scholar] [CrossRef] [Green Version]
  4. Martínez-García, A.; Trescastro-López, E.M.; Galiana-Sánchez, M.E.; Llorens-Ivorra, C.; Pereyra-Zamora, P. Cultural adaptation and evaluation of the perceived nutrition environment measures survey to the Mediterranean Spanish context (NEMS-P-MED). Nutrients 2020, 12, 3257. [Google Scholar] [CrossRef] [PubMed]
  5. Gittelsohn, J.; Trude, A. Environmental interventions for obesity and chronic disease prevention. J. Nutr. Sci. Vitaminol. 2015, 61, S15–S16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Anderson, S.E.; Martins, P.A.; Gittelsohn, J. Changing the food environment for obesity prevention: Key gaps and future directions. Curr. Obes. Rep. 2014, 3, 451–458. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Odoms-Young, A.; Singleton, C.R.; Springfield, S.; McNabb, L.; Thompson, T. Retail environments as a venue for obesity prevention. Curr. Obes. Rep. 2016, 5, 184–191. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Saelens, B.E.; Glanz, K.; Sallis, J.F.; Frank, L.D. Nutrition Environment Measures Study in restaurants (NEMS-R): Development and evaluation. Am. J. Prev. Med. 2007, 32, 273–281. [Google Scholar] [CrossRef]
  9. Freedman, M.R. Development, evaluation, and validation of environmental assessment tools to evaluate the college nutrition environment. J. Am. Coll. Health 2010, 58, 565–568. [Google Scholar] [CrossRef] [Green Version]
  10. Tanya, M.H.; Elif, D.Y.; Marlei, S.; Carol, B.B.; Adrienne, A.W.; Karla, P.S.; Melissa, D.O.; Jesse, M.; Anne, M.; Tandalayo, K. Development and validation of the Full Restaurant Evaluation Supporting a Healthy (FRESH) Dining Environment Audit. J. Hunger. Environ. Nutr. 2019, 14, 381–400. [Google Scholar]
  11. Jacobson, M.F.; Havas, S.; McCarter, R. Changes in Sodium Levels in Processed and Restaurant Foods, 2005 to 2011. JAMA Intern Med. 2013, 173, 1285–1291. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Thompson, H.J. The Dietary Guidelines for Americans (2020–2025): Pulses, Dietary Fiber, and Chronic Disease Risk—A Call for Clarity and Action. Nutrients 2021, 13, 4034. [Google Scholar] [CrossRef]
  13. He, F.J.; Tan, M.; Ma, Y.; MacGregor, G.A. Salt Reduction to Prevent Hypertension and Cardiovascular Disease. J. Am. Coll. Cardiol. 2020, 75, 632–647. [Google Scholar] [CrossRef]
  14. Elijovich, F.; Weinberger, M.H.; Anderson, C.; Appel, L.J.; Bursztyn, M.; Cook, N.R.; Dart, R.A.; Newton-Cheh, C.H.; Sacks, F.M.; Laffer, C.L.; et al. Salt Sensitivity of Blood Pressure A Scientific Statement From the American Heart Association. Hypertension 2016, 68, e7–e46. [Google Scholar] [CrossRef] [Green Version]
  15. Grimes, C.A.; Wright, J.D.; Liu, K.; Nowson, C.A.; Loria, C.M. Dietary sodium intake is associated with total fluid and sugar-sweetened beverage consumption in US children and adolescents aged 2–18 y: NHANES 2005–2008. Am. J. Clin. Nutr. 2013, 98, 189–196. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Cook, N.R.; Appel, L.J.; Whelton, P.K. Sodium Intake and All-Cause Mortality Over 20 Years in the Trials of Hypertension Prevention. J. Am. Coll. Cardiol. 2016, 68, 1609–1617. [Google Scholar] [CrossRef]
  17. Graudal, N.; Jurgens, G.; Baslund, B.; Alderman, M.H. Compared with usual sodium intake, low- and excessive-sodium diets are associated with increased mortality: A meta-analysis. Am. J. Hypertens. 2014, 27, 1129–1137. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Daniel, H.; Gholami, A.M.; Berry, D.; Desmarchelier, C.; Hahne, H.; Loh, G.; Mondot, S.; Lepage, P.; Rothballer, M.; Walker, A.; et al. High-fat diet alters gut microbiota physiology in mice. Int. Soc. Microb. Ecol. 2014, 8, 295–308. [Google Scholar] [CrossRef]
  19. Nettleton, J.A.; Villalpando, S.; Cassani, R.; Elmadfa, I. Health Significance of Fat Quality in the Diet. Ann. Nutr. Metab. 2013, 63, 96–102. [Google Scholar] [CrossRef]
  20. Dave, V.; Shukla, R.; Bhavsar, S.; Patel, N.; Sonaliya, K. Assessment of the relation between obesity, serum lipids, and dietary intake of vegetable oils. Indian J. Community Fam. Med. 2020, 6, 150. [Google Scholar]
  21. Ndrepepa, G.; Braun, S.; King, L.; Fusaro, M.; Tada, T.; Cassese, S.; Hadamitzky, M.; Haase, H.U.; Schomig, A.; Kastrati, A. Uric acid and prognosis in angiography-proven coronary artery disease. Eur. J. Clin. Investig. 2013, 43, 256–266. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Sugiura, T.; Takase, H.; Ohte, N.; Dohi, Y. Dietary Salt Intake is a Significant Determinant of Impaired Kidney Function in the General Population. Kidney Blood Press. Res. 2018, 43, 1245–1254. [Google Scholar] [CrossRef] [PubMed]
  23. Yeh, T.; Yuan, C.; Ascherio, A.; Rosner, B.A.; Blacker, D.; Willett, W.C. Long-term intake of total energy and fat in relation to subjective cognitive decline. Eur. J. Epidemiol. 2022, 37, 133–146. [Google Scholar] [CrossRef] [PubMed]
  24. Global Action Plan for the Prevention and Control of Noncommunicable Diseases 2013–2020. Available online: https://apps.who.int/iris/handle/10665/94384 (accessed on 25 August 2022).
  25. SHAKE the Salt Habit. Available online: https://apps.who.int/iris/handle/10665/250134 (accessed on 25 August 2022).
  26. Chinese Nutrition Society. The Chinese Dietary Guidelines (2022); People’s Health Publishing House: Beijing, China, 2022; pp. 1–153. ISBN 978-711-731-404-6. [Google Scholar]
  27. He, Y.N.; Zhai, F.Y.; Ge, K.Y. Approaching Chinese diet balance index. J. Hyg. Res. 2005, 34, 208–211. [Google Scholar]
  28. Zhou, W.; Xia, Q. Survey on the dietary quality among residents in Yangpu District in Shanghai City by the Chinese Diet Balance Index. Mod. Prev. Med. 2016, 43, 1394–1397. [Google Scholar]
  29. Zhao, Y.; Jin, Q.Z. Measuring diet quality of Beijing 18–59 years adults using Chinese diet balance index. Cap. J. Public Health 2018, 12, 71–73. [Google Scholar]
  30. Ren, S.; Li, X.; Cui, Y.F.; Luan, D.C.; Li, S.J. Evaluation on the dietary quality of adult residents in Liaoning Province by Chinese diet balance index. Chin. J. Health Educ. 2020, 36, 880–884. [Google Scholar]
  31. Wu, H.D.; Lai, S.R.; Yang, L.J.; Huang, Z.; Jiang, M.H.; Li, Y.F. Evaluation on the dietary quality of adult residents in Fujian by Chinese dietary balance index (DBI_16). Strait J. Prev. Med. 2022, 28, 12–15. [Google Scholar]
  32. Notice on Printing and Distributing Three Guidelines Including “Guidelines for Nutrition Labeling of Catering Foods”. Available online: http://www.nhc.gov.cn/sps/s7885u/202012/95a58c9edaa645e1adab956e278c2794.shtml (accessed on 25 August 2022).
  33. Scott, J.; Huskisson, E.C. Graphic representation of pain. Pain 1976, 2, 175–184. [Google Scholar] [CrossRef]
  34. Snow, S.; Kirwan, J.R. Visual Analog Scales-A Source of Error. Ann. Rheum. Dis. 1988, 47, 526. [Google Scholar] [CrossRef] [Green Version]
  35. Paul-Dauphin, A.; Guillemin, F.; Virion, J.M.; Briancon, S. Bias and precision in visual analogue scales: A randomized controlled trial. Am. J. Epidemiol. 1999, 150, 1117–1127. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Aune, D.; Keum, N.; Giovannucci, E.; Fadnes, L.T.; Boffetta, P.; Greenwood, D.C.; Tonstad, S.; Vatten, L.J.; Riboli, E.; Norat, T. Whole grain consumption and risk of cardiovascular disease, cancer, and all cause and cause specific mortality: Systematic review and dose-response meta-analysis of prospective studies. BMJ 2016, 353, i2716. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Blekkenhorst, L.C.; Sim, M.; Bondonno, C.P.; Bondonno, N.P.; Ward, N.C.; Prince, R.L.; Devine, A.; Lewis, J.R.; Hodgson, J.M. Cardiovascular Health Benefits of Specific Vegetable Types: A Narrative Review. Nutrients 2018, 10, 595. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Wulan, S.N.; Westerterp, K.R.; Plasqui, G. Ethnic differences in body composition and the associated metabolic profile: A comparative study between Asians and Caucasians. Maturitas 2010, 65, 315–319. [Google Scholar] [CrossRef]
  39. Guo, Q.Y.; Zhao, L.Y.; He, Y.N.; Fang, Y.H.; Fang, H.Y.; Xu, X.L.; Jia, F.M.; Yu, D.M. Survey on dietary nutrients intake of Chinese residents between 2010 and 2012. Chin. J. Prevent. Med. 2017, 51, 519–522. [Google Scholar]
  40. Pulz, I.S.; Martins, P.A.; Feldman, C.; Veiros, M.B. Are campus food environments healthy? A novel perspective for qualitatively evaluating the nutritional quality of food sold at foodservice facilities at a Brazilian university. Perspect. Public Health 2017, 137, 122–135. [Google Scholar] [CrossRef]
  41. Wang, Y.; Hu, W.Z. Investigation and analysis on food nutrition and food health status of university cafeteria. In Proceedings of the Abstracts of Food Summit in China & 14th Annual Meeting of CIFST, Wuxi, China, 8–9 November 2017; pp. 113–114. [Google Scholar]
  42. The State Council Information Office of the People’s Republic of China. Report on Chinese Residents’ Chronic Diseases and Nutrition 2020. ACTA Nutr. SINICA 2020, 6, 521. [Google Scholar]
  43. GBD 2017 Diet Collaborators. Health effects of dietary risks in 195 countries, 1990–2017: A systematic analysis forthe Global Burden of Disease Study. Lancet 2019, 393, 1958–1972. [Google Scholar] [CrossRef]
Table 1. Structure of Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC).
Table 1. Structure of Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC).
PartSectionNumber of ItemsScore Range
1. Healthiness of ingredients and food contentStaple foods130–16
Vegetables120–16
Meat, eggs and aquatic products60–7
Plant-based protein foods50–7
Fruits40–4
Dairy and soy beverages50–4
Other beverages11−2–6
2. Other factors that support healthy choicesService policies 100–12
Information environment14−2–12
Equipment and facilities100–10
Personnel training and management110–14
Total 101−4–108
Table 2. Score of healthiness of ingredients and food content by time points in nine canteens.
Table 2. Score of healthiness of ingredients and food content by time points in nine canteens.
Canteen ACanteen BCanteen CCanteen DCanteen ECanteen FCanteen GCanteen HCanteen I
11:00–11:3033.00 ± 1.83 a *33.50 ± 1.29 a25.50 ± 3.70 c32.00 ± 2.94 Aab **13.00 ± 2.94 e29.25 ± 1.26 Ab18.25 ± 2.06 d25.00 ± 1.41 Ac9.50 ± 3.00 e
11:30–12:0033.00 ± 2.16 a34.25 ± 0.96 a24.50 ± 6.14 bc27.00 ± 2.16 ABb14.00 ± 0.82 d27.75 ± 2.75 Ab21.25 ± 4.72 c25.00 ± 2.94 Abc10.25 ± 2.06 d
12:00–12:3031.75 ± 5.32 a33.25 ± 0.50 a21.75 ± 2.63 b23.00 ± 1.63 Bb12.25 ± 2.75 c22.25 ± 1.71 Bb19.00 ± 7.35 b17.75 ± 0.96 Bb10.25 ± 2.06 c
* When the lowercase letters of the means in the same row are different, it is considered that there is a significant difference between the means (p < 0.05). ** When the capital letters of the means in the same column are different, it is considered that there is a very significant difference between the means (p < 0.01).
Table 3. Score of other factors that support healthy choices in nine canteens.
Table 3. Score of other factors that support healthy choices in nine canteens.
Canteen ACanteen BCanteen CCanteen DCanteen ECanteen FCanteen GCanteen HCanteen I
Service policies 776666667
Information environment302403320
Equipment and facilities999996577
Personnel training and management777776555
Total score262324262221192019
Table 4. Inter-rater agreement and test–retest reliability of Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC).
Table 4. Inter-rater agreement and test–retest reliability of Nutrition Environment Scoring for Chinese Style University/Work-site Canteens (NESC-CC).
Canteen ACanteen BCanteen CCanteen DCanteen ECanteen FCanteen GCanteen HCanteen I
ICC0.910.860.910.970.980.990.710.980.94
Pearson’s0.680.590.450.990.650.910.500.890.89
Table 5. Oil–Salt Visual Analogue Scale (OS-VAS) results of nine canteens.
Table 5. Oil–Salt Visual Analogue Scale (OS-VAS) results of nine canteens.
Canteen ACanteen BCanteen CCanteen DCanteen ECanteen FCanteen GCanteen HCanteen I
C21.08 ± 9.89 abcd *24.08 ± 12.03 ab19.91 ± 10.71 bcd22.10 ± 9.52 abcd21.08 ± 10.38 abcd19.59 ± 11.81 cd18.42 ± 11.15 d24.38 ± 9.88 a23.75 ± 12.02 abc
CS22.99 ± 12.36 ab26.86 ± 14.28 a22.19 ± 12.54 ab23.81 ± 11.66 ab23.61 ± 12.51 ab22.24 ± 13.53 ab21.23 ± 13.10 b26.81 ± 11.03 a26.53 ± 13.51 a
CO19.18 ± 9.90 abc21.29 ± 11.72 ab17.62 ± 11.67 abc20.39 ± 9.13 ab18.55 ± 10.03 abc16.94 ± 12.16 bc15.61 ± 11.08 c21.94 ± 10.78 a20.96 ± 11.86 ab
* When the lowercase letters of the means in the same row are different, it is considered that there is a significant difference between the means (p < 0.05).
Table 6. Difference analysis of Visual Analogue Scale (VAS) scores of consumers by taste preference groups.
Table 6. Difference analysis of Visual Analogue Scale (VAS) scores of consumers by taste preference groups.
CanteensTastesNumber of PeopleVASTastesNumber of PeopleVAStp
Canteen APreference for more salt5227.38 ± 7.928Preference for less salt5114.67 ± 7.258.49 <0.05
Canteen B6130.33 ± 10.804515.61 ± 7.687.80
Canteen C7123.91 ± 9.714213.14 ± 8.815.90
Canteen D6427.74 ± 7.164914.74 ± 6.819.77
Canteen E7025.54 ± 9.143512.16 ± 6.087.83
Canteen F7524.10 ± 11.143910.91 ± 7.466.65
Canteen G7221.69 ± 10.673010.57 ± 7.975.14
Canteen H9126.58 ± 8.902817.22 ± 9.654.77
Canteen I7427.46 ± 11.843215.16 ± 7.101.26
Canteen APreference for more grease2629.20 ± 8.67Preference for less grease7718.34 ± 8.755.48
Canteen B4133.59 ± 10.826518.08 ± 8.358.29
Canteen C5226.85 ± 9.706113.99 ± 7.537.93
Canteen D4427.78 ± 7.946918.48 ± 8.685.74
Canteen E4626.19 ± 9.625917.10 ± 9.184.93
Canteen F5725.06 ± 10.905714.11 ± 10.095.57
Canteen G5323.29 ± 11.514913.16 ± 7.965.13
Canteen H7927.98 ± 8.664017.27 ± 8.206.48
Canteen I6028.85 ± 11.914617.10 ± 8.445.68
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Han, Y.; Fan, Z.; Wu, Y.; Zhang, D.; Wen, X. Development and Validation of Nutrition Environment Scoring for Chinese Style University/Work-Site Canteens (NESC-CC) and Oil–Salt Visual Analogue Scale (OS-VAS). Int. J. Environ. Res. Public Health 2022, 19, 14169. https://doi.org/10.3390/ijerph192114169

AMA Style

Han Y, Fan Z, Wu Y, Zhang D, Wen X. Development and Validation of Nutrition Environment Scoring for Chinese Style University/Work-Site Canteens (NESC-CC) and Oil–Salt Visual Analogue Scale (OS-VAS). International Journal of Environmental Research and Public Health. 2022; 19(21):14169. https://doi.org/10.3390/ijerph192114169

Chicago/Turabian Style

Han, Yue, Zhihong Fan, Yixue Wu, Dandan Zhang, and Xinyi Wen. 2022. "Development and Validation of Nutrition Environment Scoring for Chinese Style University/Work-Site Canteens (NESC-CC) and Oil–Salt Visual Analogue Scale (OS-VAS)" International Journal of Environmental Research and Public Health 19, no. 21: 14169. https://doi.org/10.3390/ijerph192114169

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop