Next Article in Journal
Risk Factors for Acute Urticaria in Central California
Next Article in Special Issue
Pre-Emptive and Non-Pre-Emptive Goal Programming Problems for Optimal Menu Planning in Diet Management of Indian Diabetes Mellitus Patients
Previous Article in Journal
Female Genital Mutilation/Cutting among Somali Women in the U.S. State of Arizona: Evidence of Treatment Access, Health Service Use and Care Experiences
Previous Article in Special Issue
Bayesian Spatial Survival Analysis of Duration to Cure among New Smear-Positive Pulmonary Tuberculosis (PTB) Patients in Iran, during 2011–2018
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Analysis of the Areas Occupied by Vessels in the Ocular Surface of Diabetic Patients: An Application of a Nonparametric Tilted Additive Model

by
Farzaneh Boroumand
1,2,
Mohammad Taghi Shakeri
2,*,
Touka Banaee
3,
Hamidreza Pourreza
4 and
Hassan Doosti
1,*
1
Department of Mathematics and Statistics, Faculty of Science and Engineering, Macquarie University, Sydney 2109, Australia
2
Department of Biostatistics, School of Health, Mashhad University of Medical Sciences, Mashhad 9137673119, Iran
3
Department of Ophthalmology and Visual Sciences, University of Texas Medical Branch, Galveston, TX 77555, USA
4
Department Computer Engineering, Faculty of Engineering, Ferdowsi University of Mashhad, Mashhad 9177948974, Iran
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(7), 3735; https://doi.org/10.3390/ijerph18073735
Submission received: 6 February 2021 / Revised: 19 March 2021 / Accepted: 28 March 2021 / Published: 2 April 2021

Abstract

:
(1) Background: As diabetes melllitus (DM) can affect the microvasculature, this study evaluates different clinical parameters and the vascular density of ocular surface microvasculature in diabetic patients. (2) Methods: In this cross-sectional study, red-free conjunctival photographs of diabetic individuals aged 30–60 were taken under defined conditions and analyzed using a Radon transform-based algorithm for vascular segmentation. The Areas Occupied by Vessels (AOV) images of different diameters were calculated. To establish the sum of AOV of different sized vessels. We adopt a novel approach to investigate the association between clinical characteristics as the predictors and AOV as the outcome, that is Tilted Additive Model (TAM). We use a tilted nonparametric regression estimator to estimate the nonlinear effect of predictors on the outcome in the additive setting for the first time. (3) Results: The results show Age (p-value = 0.019) and Mean Arterial Pressure (MAP) have a significant linear effect on AOV (p-value = 0.034). We also find a nonlinear association between Body Mass Index (BMI), daily Urinary Protein Excretion (UPE), Hemoglobin A1C, and Blood Urea Nitrogen (BUN) with AOV. (4) Conclusions: As many predictors do not have a linear relationship with the outcome, we conclude that the TAM will help better elucidate the effect of the different predictors. The highest level of AOV can be seen at Hemoglobin A1C of 9% and AOV increases when the daily UPE exceeds 600 mg. These effects need to be considered in future studies of ocular surface vessels of diabetic patients.

1. Introduction

Diabetes mellitus (DM) is a metabolic disease defined according to an individual’s level of hyperglycemia [1]. Recent estimates show that, globally, 463 million (9.3%) people live with DM. It is projected that this figure will increase to 578 million (10.2%) in 2030, and 700 million (10.9%) in 2045 [2]. The increasing prevalence of DM is concerning as it can lead to more people experiencing the complications of diabetes. Diabetes-related complications can cause damage to the body’s organs in three ways. First, they can create macrovascular or cardiovascular complications that lead to heart attack, stroke, or circulation problems in the lower limbs [3]. Second, diabetes can create microvascular complications causing problems in the eyes, kidneys, feet, and nerves. The most prominent microvascular complications are retinopathy, nephropathy, and neuropathy [3]. Third, they can affect other parts of the body including, skin (diabetic dermopathy) [4], teeth, and gums as a result of increased risk of infection [5].
In this study, we focus on microvascular complications in the ocular surface. The ocular surface refers to the conjunctiva and corneal epithelium, which protect the eye against microbes, trauma, and toxins [6]. DM can affect the ocular surface by increasing the risk of developing a dry eye disease [7], corneal epithelial fragility, decreased corneal sensitivity, and abnormal wound healing [8]. Diabetic retinopathy is one of the most important microvascular complications of diabetes. Up to now, most studies documenting the microvascular changes of diabetes have focused on the retina, but photography of the retina requires expensive fundus cameras and expert photographers, which may not be available [9,10,11]. For the purpose of this study, we analyze the vessels visible over the surface of the eye, which include both conjunctival and episcleral vessels. Hence, we explore whether the microvasculature of the ocular surface, which is easier to see and photograph, is affected by diabetes or otherwise. In a previous paper [12], we showed that the microvasculature of the ocular surface is affected by development of diabetes. That study used a regression model, which did not show any effect of different predictors on the ocular surface vessels. The current study differs in using a novel statistical method to find possible nonlinear effects of the predictors. However, studying conjunctival vessels is difficult since they rapidly react to irritations. Recently, improvements in digital photography and image processing mean that the examination of conjunctival vessels is more achievable. As a result, there is growing interest in the study of conjunctival vessels [11,13,14,15,16].
In the current study, we analyse a relatively large number of ocular surface images from diabetic patients to assess the association between demographic and clinical characteristics in relation to the Areas Occupied by Vessels (AOV) in the ocular surface. To investigate the association between clinical characteristics as the predictors and AOV as the outcome, we need to find an appropriate statistical method. The Generalized Linear Model (GLM) is a powerful methodology used to identify associations in medical research [17].
In GLM, we fit the following model
g ( E ( Y ) ) = α + β 1 X 1 + β 2 X 2 + + β p X p ,
where Y is an outcome, X 1 , , X p are the predictors, β i are unknown regression coefficient parameters, and  g ( . ) is a link function [18]. It is worth noting that this model is linear with respect to the coefficients, not the predictors. Linear regression is a special case of GLM while the link function is an identity function
E ( Y ) = α + β 1 X 1 + β 2 X 2 + + β p X p .
With fitting model (2), we assume that a line with slope β i reflects the association between the outcome and the i t h predictor, X i . In fact, in testing this hypothesis β i = 0 , it is important to note that a linear relationship will be tested, as this relationship might be nonlinear. The GLM cannot detect the nonlinear association (nonlinearity in terms of coefficients); instead, this issue can be addressed using a parametric transformation. However, parametric transformation may not fit the data well. An alternative solution might be to use a nonparametric method as a data-driven approach to let the data describe the form of the association itself [19]. In a nonparametric approach, GLM can be replaced by Generalized Additive Model (GAM) for adjusting, predicting the outcome, and detecting nonlinear associations. These approaches enable the development of models that more accurately represent the relationship between multiple predictors and the outcome in a regression setting [20]. This data-driven method allows the effect of each predictor on the outcome to be nonlinear and estimated from the data. In the case of multi-predictors, some predictors might have a linear effect and others nonlinear. In this situation, the GAM can be a mixture of linear and nonlinear effects, especially if there is a categorical predictor in the model. Not only the main effects, but also the interaction of two or more predictors, can be assumed as the nonlinear terms in the model. Therefore, GAM provides a flexible methodology to analyze a wide range of different types of data sets. The GAM can be formulated by replacing the standard linear model combination of predictors in Equation (1), such as β j X j with f j ( X j ) , where f j is a smooth non-linear function of j t h predictor X j , respectively, which is estimated from the data [21]. The GAM is written as follows:
g ( E ( Y ) ) = α + f 1 ( X 1 ) + f 2 ( X 2 ) + + f p ( X p )
The function f j in Equation (3) can be estimated in different ways. The basic step of all these methods is a scatter plot smoother. In this approach, a scatter plot transforms into a smooth fitted function. Some of these methods are spline methods, Locally Estimated Scatterplot Smoothing (LOESS), and a linear smoother, such as standard local linear smoother [21]. The estimated function f ^ j can reveal the nonlinear effect of the predictor X j on the outcome. Boroumand et al. [22] introduced a tilted linear smoother to detect the nonlinear relationship between one predictor and an outcome. They have shown that the performance of a linear smoother can be improved by applying the tilted technique. Tilting is a technique for modifying an empirical distribution, in which 1 / n as data weights (where n denotes the sample size) are replaced with p i (general multinomial distribution). It is shown that the tilted estimators are consistent and have optimal convergence rates. It means that by using this estimator for estimating f j ( X j ) , we will have even more accurate results.
In this paper, we propose a novel approach for investigating the association between clinical characteristics of predictors and AOV as the outcome. This novel approach is the Tilted Additive Model (TAM). We use a tilted nonparametric regression estimator to estimate the nonlinear effect of predictors on the outcome in the additive setting for the first time. In other words, we extend the tilted linear smoother method as a novel approach for a multi-predictor setting. We will apply TAM for estimating the f j in the GAM approach, which extends GAM for analyzing AOV in the ocular surface of diabetic patients.

2. Materials and Methods

2.1. Study Population

There were 334 diabetic patients aged 30 to 60 in this cross-sectional study. They presented to outpatient clinics at the Khatam-Al-Anbia hospital, Mashhad, Iran, from March 2009 to March 2011. The exclusion criteria include any history of severe blepharitis, large pterygium, conjunctivitis, episcleritis, scleritis, uveitis, any condition causing red-eye, or extra-capsular cataract extraction or scleral buckling. Patients who had used contact lenses were also excluded. Mild lid crusting was permitted. Patients with any history of the following diseases were eliminated: dysthyroidism, anemia, allergy, abnormal fasting blood sugar (FBS), or rheumatic disorder. Patients with hypertension were also eliminated. A complete medical history was taken. Then, height, weight, Hypertension Duration (HTN-Dur), and blood pressure were measured. A panel of laboratory tests was done, including FBS measurement, Hemoglobin A1C, Blood Urea Nitrogen (BUN), Serum Creatinine (S-cr), Urine protein (U-pr), Urine Creatinine (U-cr), daily Urinary Protein Excretion (UPE), and Glomerular Filtration Rate (GFR). Conjunctiva photography was then afterward, followed by a complete ophthalmic examination, including funduscopy with dilated pupils.

2.2. Photography

A YZ5S digital slit lamp microscope (Suzhou 66 Vision-Tech Co., Ltd., Suzhou, Jiangsu, China) was used to take digital red-free conjunctival images of the superior conjunctiva. Photography camera settings were ambient light conditions, a five-volt slit-lamp input, red-free filter, diffuser illumination arm at 45 degrees to the microscope, diffuse illumination (8 mm circle), and 25× magnification. Photography was performed as quickly as possible to minimize dryness and irritation. As the camera is slit lamp mounted, the image is taken at a standard distance, which is the focal point of the slit lamp microscope, and is a fixed distance. In addition, the magnification of the slit lamp and the camera lens were fixed. So the conditions for photography of the eyes was the same with no changes in the magnification of the images. Although we reached a conversion factor of 18 microns/pixel of images, as AOV used in the analyses is a percentage, the unit of output of the algorithm did not change. The algorithm presented in [23] was used for vessel extraction in the conjunctival images. However, this algorithm cannot distinguish between vessels with 2n-and 2n + 1-pixel widths. Thus, the algorithm was modified using Maurer’s distance transform [24]. In this transformation, the Euclidean distance of vessel pixels from backgrounds is estimated in the vessel map image. Analysing these distances provides vessel diameters. The accuracy of the algorithm was studied using several tests on synthetic images, consisting of lines of different diameters in various directions. The estimated accuracy for the algorithm was 98.5%. Finally, the outcome (AOV) was measured. An example of images is provided in Figure 1. The AOV represents a ratio of the image pixels occupied by vessels of different diameters to the total pixels in the picture. More details about the data gathering process are available in [12]. We took the AOV as the outcome variable and evaluated the associations among the predictors and the outcome using the TAM.

2.3. Statistical Method

Since the outcome (AOV) is a continous variable, the link function would be the identity so the model in Equation (3) will be
Y = α + f 1 ( X 1 ) + f 2 ( X 2 ) + + f p ( X p ) + ϵ .
For fitting the TAM to the data, we need to estimate f j using a tilted linear smoother from [22]. For a single predictor X, and Y the outcome,
Y = f ( X ) + ϵ ,
f can be estimated using the tilted linear smoother
f ^ ( x | p , h ) = i = 1 n p i l i ( x i ) Y i ,
where p i s are tilting parameters and each p i 0 and i n p i = 1 , and  l i ( x ) is the standard local linear, defined as
l i ( x ) = b i ( x ) j = 1 n b j ( x ) ,
b i ( x ) = K ( X i x h ) ( S n , 2 ( x ) ( X i x ) S n , 1 ( x ) ) ,
S n , j ( x ) = i = 1 n K ( X i x h ) ( X i x ) j ,
j = 1 , 2 .
The kernel function K, is a weighting function that assigns weights to the observations based on their distance to the target point x 0 . The kernel relies on a parameter named bandwidth outlined by h. This parameter determines the maximum distance from the target point to any observation receiving weight. In fact, h plays a trade-off role between the bias and variance of estimate. So choosing an optimal h plays the main role in the estimation procedure  [25]. By applying the tilted linear smoother method, the optimal h and tilting parameters will be estimated to get the optimal convergence rate, which leads to the best estimate in terms of Mean Square Errors (MSE). Using this procedure results in a smooth estimate of f, which reveals any nonlinearity effect of X on the outcome. With multiple predictors, where X i j denotes the value of the j t h predictor for i t h observation, the additive model is
Y i = j f j ( X i j ) + ϵ i .
Here, we assume that the intercept has been absorbed into one of the functions. We use the same approach to estimate each f j during an iterative procedure. The algorithm continues until the estimates do not change from the previous iteration.
f 1 ( X 1 ) = Y f 2 ( X 2 ) f p ( X p ) f 2 ( X 2 ) = Y f 1 ( X 1 ) f p ( X p ) f p ( X p ) = Y f 1 ( X 1 ) f 2 ( X 2 )
Applying this procedure leads to prediction of the outcome in terms of nonlinear function of each predictor. The outcome is AOV and the list of predictors is Age, Gender, BMI, HTN-Dur, daily UPE, GFR, A1C, BUN, Mean Arterial Pressure (MAP), S-cr and Area. The predictor Area with four categories refers to different parts of the eyes, 1 right eye top, 2 right eye bottom, 3 left eye top, and 4 left eye bottom. The degrees of freedom (df) for the linear model equals p ( p 1 is the number of predictors). It also can be written as the rank of the design matrix. The df for the TAM is the trace of the smoother matrix for each term. It could be said that the df for each term in the additive setting shows the complexity of each estimated function. If we have two fitted responses, a linear model and a tilted local linear smoother, we can compare two models by comparing the decrease in the Residual Sum of Squares (RSS) due to fitting a more complex smooth with the increase in df [26]. In the first step, we checked the linearity vs. non-linearity effect of each predictor by fitting GLM and TAM and decide based on any change in RSS. The linearity vs. nonlinearity of each predictor was tested using F test in the presence of all the predictors. We also used the bootstrap technique to provide a confidence band for curve estimates. We did all the programming in R (version 4.0.0., R Foundation for Statistical Computing, Vienna, Austria). The glm package was used for fitting the GLM, and we performed programming for fitting the TAM, the proposed method, and confidence band of the estimated curve. The code is available in Appendix A.

3. Results

Because some of the photographs for the 334 diabetic patients in the study were blurry, the number of images used for analysis was reduced to 297. Eventually, we reached 168 (60 patients were female) complete individual (without missing) records for assessing the associations among predictors and the outcome. The demographic and clinical characteristics of 168 diabetic patients are presented in Table 1. The vessel diameters from 4–53 pixels (72–954 μ m) were detected using the algorithm explained in [12], and AOV was obtained.
Figure 2 shows the relationship between each pair of predictors. It also provides the distribution of each predictor along the diagonal. The Pearson correlation between each pair of predictors is provided in the upper diagonal. The significant correlations are highlighted. The correlation ellipses are also provided in Figure 2. The narrower ellipse shows the greater correlation between the predictors. The wider and more round the ellipse, the more the predictors are uncorrelated.
It can be seen from Figure 2 that all the predictors are distributed approximately symmetrically, except for daily UPE and HTN-Dur, which are right-skewed. The distribution of predictors does not significantly deviate from Normal distribution. Thus, the Pearson correlation coefficient can be estimated. The Pearson correlation between Age and HTN-Dur, GFR, Hemoglobin A1C, and BUN is significant. The positive correlation between Age and HTN-Dur ( ρ = 0.22 ) is as expected. There is a negative correlation between Age and GFR ( ρ = 0.16 ) and a positive correlation between Age and Hemoglobin A1C ( ρ = 0.21 ). BMI has a positive significant correlation with HTN-Dur ( ρ = 0.45 ), and with GFR ( ρ = 0.16 ) and with S-cr ( ρ = 0.25 ) and with MAP ( ρ = 0.30 ). For Diabetic patients, there is a significant positive correlation between HTN-Dur and Hemoglobin A1C ( ρ = 0.20 ) and between HTN-Dur and MAP ( ρ = 0.19 ). There is also a significant negative correlation between HTN-Dur and BUN ( ρ = 0.20 ). Daily UPE has a negative significant correlation with BUN ( ρ = 0.20 ) and a positive significant correlation with S-cr ( ρ = 0.46 ). It is also notable that GFR has a significant negative correlation with BUN ( ρ = 0.23 ) and S-cr ( ρ = 0.35 ). There is a significant positive correlation between Hemoglobin A1C and BUN ( ρ = 0.23 ), BUN and S-cr ( ρ = 0.17 ) and S-cr and MAP ( ρ = 0.24 ).
Under the diagonal in Figure 2, scatter plots of each pair of predictors are provided. Yellow points refer to female diabetic patients, and blue points refer to male diabetic patients. Since the blue and yellow points are scattered approximately the same, we can conclude that the relationship between each pair of predictors for male and female patients is the same.
Figure 3 provides the linear vs. the nonlinear fit for all the predictors. Comparing both fits (linear vs. nonlinear) reveals that the predictors including Age, HTN-Dur, and S-cr have linear effects, while BMI, daily UPE, GFR, A1C, BUN, and MAP have nonlinear effects on the outcome, AOV. Figure 3 supports that a nonlinear model should be employed. A linear model can not detect any significant effect of these predictors since the linear fit is close to Y = 0 , while they clearly can predict the outcome in the nonlinear term. The previous research on this data set could not detect significant effects of these predictors on the outcome, using a linear model. More details are available in [12].
To support the results presented in Figure 3, the F test of the linearity vs. nonlinearity of each predictor in the presence of other predictors is presented in Table 2. This test shows whether the decrease in RSS by adding the nonlinear effect is significant or otherwise. We can see from the P-value in the last column of Table 2 that Age, BMI, daily UPE, Hemoglobin A1C, and BUN have a nonlinear effect on AOV, while the F test suggests adding HTN-Dur, GFR, S-cr, and MAP to the model as linear effects. Therefore, we modified the final model by changing the effect of HTN-Dur, GFR, S-cr, and MAP from nonlinear to linear. It is worth noting that Figure 3 suggests adding Age as a linear term to the model. However, it is not confirmed by the F test (p-value = 0.0437). Since the p-value is on the borderline, we decided to add it as a linear term. It is always preferable to fit a simple model instead of a complex one.
The final model is a combination of parametric (linear) and nonparametric (nonlinear) terms. It means that the final model is a semiparametric model. The results of the final model are provided in Figure 4, which shows the nonlinear effects, and Table 3, which provides the linear effects.
The nonlinear trend is apparent. For the following interpretations, it is assumed that other predictors are fixed. The association between AOV and BMI is presented in the top-left panel of Figure 4. As you can see, the AOV has an upward trend as the BMI increases; the first maximum for BMI is around 24 and then it fluctuated gradually before reaching the second maximum for BMI of 39. The top-middle panel shows the variation of AOV in regards to daily UPE. AOV remained steady for 100 < daily UPE < 700 and then increased slightly. The bottom-right panel shows the variation of AOV vs. hemoglobin A1C. As hemoglobin A1C increased, AOV increased before reaching a peak for hemoglobin A1C around nine then decreasing negligibly. The bottom-left panel refers to BUN, AOV for those who have 5 < BUN < 15 oscillated, and then dropped for 15< BUN <20 before increasing again.
In Table 3, the linear effects are provided. The table shows that Age has a negative significant linear effect on AOV. For every unit increase in Age, AOV decreased 0.002. Another significant predictor is MAP. The results show a positive association between MAP and AOV. For every unit increase in MAP, AOV increased 0.0005. Area, with four categories is defined as follows. One refers to the right eye top. Two refers to the right eye bottom. Three refers to the left eye top, and four refers to the left eye bottom. The results show that AOV in Area three is significantly different from others. We could not find any clinical reason for this finding in the literature. The other predictors, Gender, HTN-Dur, and S-cr do not have a significant effect on AOV. However, we kept them in the model to adjust their probable confounding effect.
In Figure 5, we checked the goodness of fit of the final model by analyzing the deviance residuals. The analysis of deviance residuals reveals that the residuals follow Normality distribution.

4. Discussion

In this research, we found a nonlinear association between clinical characteristics of daily UPE, Hemoglobin A1C, and BUN with the AOV in the ocular surface in diabetic patients. The linear associations between Age and MAP and AOV are notable. AOV decreases with increasing age and increases with increasing blood pressure. The model shows that with increasing BMI, the AOV increases, although with some fluctuations. This is consistent with the linear relation between the AOV and MAP as both increased BMI and elevated blood pressure are part of the metabolic syndrome [27] and may have a common pathophysiologic effect on the blood vessel smooth muscles. This also reflects the correlations between BMI and MAP found in Figure 2. Most of the correlations between the predictor in Figure 2 are clinically relevant. AOV increases with an increase in hemoglobin A1C and peaks when the A1C level is 9%. Increasing hemoglobin A1C by more than 9% has the reverse effect, causing lower AOV values. We still do not have an explanation for this relationship, but it seems to lie in the delicate biochemical balance of advanced glycation end-product formation and the function of the vascular smooth muscle cells. The effect of daily UPE on AOV is not discernible until a daily excretion of more than 650 mg/d. Higher amounts of protein excretion are associated with an increase in AOV. Some proteins such as vasopressin and angiotensin-converting enzyme, which have roles in vasoconstriction, can be excreted in urine [28]. We hypothesize that at this level of proteinuria, significant amounts of these proteins may be lost in the urine, hence resulting in vasodilation, although it may be an oversimplistic explanation for such a condition. The relation of BUN with AOV fluctuates but because BUN levels in this study fall mostly in the normal range, we could not find a clinically significant association. There is considerable literature examining the effect of diabetes on retina. However, there are few studies concerning the effect of DM on the ocular surface. We cannot imagine an immediate clinical application for our findings, but they are useful for future studies on the ocular surface microvasculature. We found nonlinear associations of predictors on AOV in diabetic patients that show diabetes may involve the conjunctival and episcleral vessels. Since the conjunctival vessels are more accessible, it offers an opportunity for future research to use conjunctival vessels as a marker of diabetic retinopathy.
The nonlinear modeling procedure developed here—the TAM, an extension of GAM with identity link function—is useful for three reasons. First, using this model prevents model misspecification. Model misspecification can lead to incorrect conclusions. Second, it reveals the nonlinear associations among the predictors and the outcome that cannot be identified using standard modeling techniques. Moreover, a linear association can be detected in this setting as a particular case. Third, it is easy to interpret, which means these types of modeling can be widely used in medical research. Hastie and Tibshirani [19] have provided the most comprehensive source for the GAM, describing generalized additive models as adjustable statistical methods that can be utilized to detect and model the nonlinear effect of potential predictors of disease outcome. Herman and Hastie [29] used nonparametric multiple logistic regression as a form of GAM to examine the relationship between gestational age, neonatal size, and neonatal death. They showed that gestational age has a nonlinear effect on neonatal death. Charytanowicz and Kulczycki [30] used the same approach for analyzing the correlation of hematologic parameters with creatinine for patients with renal insufficiency observed in the Stefan Kardynal Wyszynski Regional Specialists’ Hospital in Lublin (Poland). Seposo et al. [31] conducted a multi-city study carried out in tropical cities, evaluating the temperature–-diabetes relationship. Using GAM for analysing the data in this study revealed a nonlinear association between temperature and the risk of diabetes.
Using a tilting approach to estimate f j ( x ) in a GAM setting leads to improvement of the performance of the nonparametric regression estimator. Hall and Presnell [32], Hall and Huang [33], Carroll [34], Doosti and Hall [35], and Doosti et al. [36] used setup-specific Distance Measure approaches for estimating the tilting parameters. Carroll [34] proposed a new approach for density function estimation, and regression function estimation, as well as hypothesis testing under shape constraints in the model with measurement errors. A tilting method used in [34] led to curve estimators under some constraints. Doosti and Hall [35] introduced a new higher order nonparametric density estimator, using a tilting method, where they used L 2 -metric between the proposed estimator and a consistent ’Sinc’ kernel-based estimator. Doosti et al. [36], have introduced a new way of choosing the bandwidth and estimating the tilted parameters based on the cross-validation function. In [36], it was shown that the proposed density function estimator had improved efficiency and was more cost-effective than the conventional kernel-based estimators studied in this paper. Boroumand et al. [22] proposed a new tilted version of a linear smoother nonparametric regression that is obtained by minimizing the distance to a comparator estimator. The comparator estimator is selected to be an infinite-order flat-top kernel estimator. They proved that the tilted estimators achieve a high level of accuracy, yet preserving the attractive properties of an infinite-order flat-top kernel estimator. In this study, we used the tilted linear smoother in an additive setting for the first time as a novel approach to identify nonlinear effects. We were able to detect the nonlinear association among clinical characteristics and AOV in diabetic patients, while previous research on this data set could not identify the significant effects of clinical characteristics on AOV using a linear model [12].

5. Conclusions

This study shows that Hemoglobin A1C and daily urinary excretion of protein affect the ocular surface microvasculature. These findings may not have instant clinical utility but will be helpful in research using ocular surface photography for evaluation of systemic factors. A Tilted Additive Model can find correlations that were missed in a previous study on the same data set [12] using a linear regression model. This statistical method is a valuable tool to search for nonlinear relationships, which are common in the biomedical field. We detect significant nonlinear associations using a novel approach. As many predictors do not have a linear relationship with the outcome, the Tilted Additive Model is a novel approach that helps to elucidate the effect of different predictors.

Author Contributions

Conceptualization, T.B., H.D. and F.B.; methodology, H.D., M.T.S. and F.B.; software, H.D., M.T.S., H.P. and F.B.; validation, H.D. and T.B.; formal analysis, H.D., M.T.S., T.B. and F.B.; investigation, H.D., M.T.S., T.B. and F.B.; data curation, H.D., T.B., H.P. and F.B.; writing —original draft preparation, H.D., M.T.S., T.B., H.P. and F.B.; writing—review and editing, H.D., T.B. and F.B.; visualization, H.D. and F.B.; supervision, H.D., T.B. and M.T.S.; project administration, H.D. and M.T.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was undertaken with the assistance of resources and services from the National Computational Infrastructure (NCI), which is supported by the Australian Government. The data presented in this paper has been collected through a project supported by grant number 88255 of Mashhad University of Medical Sciences.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by Ethics Committee of Mashhad University of Medical Sciences (project code 971017).

Informed Consent Statement

The data presented in this paper has been collected through a project approved by the Ethics Committee in Mashhad University of Medical Sciences.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from Mashhad University of Medical Sciences, Mashhad, Iran, and are available with the permission of Mashhad University of Medical Sciences.

Acknowledgments

This research forms part of the first author’s PhD thesis approved by the ethics committee of Mashhad University of Medical Sciences with the project code 971017, Mashhad, Iran and Macquarie University, Sydney, Australia. We also acknowledge the help of M Abrishami MD and Reza Pourreza PhD who have significantly contributed to collection of the data.

Conflicts of Interest

The authors have no conflict of interest to disclose.

Appendix A. R Code for Statistical Analysis

  • #-----------------------------------------Data and bandwidths
  • res<-read.csv("")
  • var<-read.csv("")
  •  
  • h_ll=c(2.845401,1.587784,9.152896,
  • 108.1861,12.0652,0.5424099,0.5,0.2152706,8.7255)
  • h_kt=c(5.5,1/0.4,50,1/0.01,1/0.15
  • ,1/2,1/0.65,1/10,1/0.11)
  •  
  • #-----------------------------------------Bootstrap function for CI
  • library(boot)
  • Qfun <- function(data, i){
  •   d <- data[i, ]
  •   return(quantile(d,probs = c(0.025, 0.975)))
  • }
  • #-----------------------------------------Calculating df
  • library(psych)
  • l_Tllp <- function(x,X,h,p)p*bp(x,h,X)/mean(bp(x,h,X))
  • l_Tllp=Vectorize(l_Tllp,"x")
  • #-----------------------------------------TAM fitting
  • MSE=rep(NA,9)
  • e=matrix(NA,length(res[,1]),9)
  • df1=rep(NA,9) #df1=tr(t(S)*S)
  • df2=rep(NA,9) #df2=tr(S)
  • df3=rep(NA,9) #df3=tr(2*S-t(S)*S)
  • micro=c("Age","BMI","HTN_,Dur","UPE","GFR",
  • "A1C","BUN","S_cr","MAP")
  • fmicro=c("f(Age)","f(BMI)","f(HTN_Dur)","f(UPE)",
  • "f(GFR)","f(A1C)","f(BUN)","f(S_cr)","f(MAP)")
  • par(mfrow=c(3,3))
  • resid=matrix(NA,length(res[,1]),9)
  • for (i in 1:9) {
  • X=var[,i]
  • Y=res[,i]
  • n=length(Y)
  • plot(X,Y,col=rgb(0.4,0.4,0.8,0.6),
  • pch=16 , cex=1.3 ,ylab=fmicro[i],
  • xlab =micro[i],ylim=c(-0.17,0.1))
  • abline(lm(Y~X),col="darkgreen",lwd=3)
  • resid[,i]=resid(lm(Y~X))
  • curve(rn_ll(x,Y,X,h=h_ll[i]),min(X),max(X),
  • add = T,col=2, lwd=3 ,ylim=c(-0.25,0.3))
  • curve(rn_Iorder(x,h=h_kt[i],X,Y=Y),min(X),max(X)
  • ,add=T,lwd=3,col="blue")
  • theta_opt <- as.double(try(constrOptim(c(rep(1/n,k-1),h_ll[i]),
  • targetfunc,gr=NULL,ui=ui,ci=ci,Y=Y,X=X,$par,silent=T))
  • pk <- k/n-sum(theta_opt[-k])
  • <- rep(c(theta_opt[-k],pk),each=n/k)
  • curve(rn_Tllp(x,Y,X,theta_opt[k],p),min(X),max(X),
  • add=T,lwd=3,col="red",ylab=fmicro[i], xlab =micro[i])
  • #rug(X, ticksize = 0.06, side = 1, lwd =1)
  • df2[i]=tr(l_Tllp(X,X,h=theta_opt[k],p=p))
  • e[,i]=Y-rn_Tllp(X,Y,X,theta_opt[k],p)
  • MSE[i]=mean((e[,i])^2)
  • eb=(e[,i]-mean(e[,i]))/sd(e[,i]) #standardized e for bootstrapping
  • data <- data.frame(eb)
  • bo <- boot(data[,"eb"drop = FALSE], statistic=Qfun, R=5000)
  • lcb= rn_Tllp(X,Y,X,theta_opt[k],p)+mean(bo$t[,1])*sqrt(MSE[i])
  • ucb= rn_Tllp(X,Y,X,theta_opt[k],p)+mean(bo$t[,2])*sqrt(MSE[i])
  • myPredict <- cbind(rn_Tllp(X,Y,X,theta_opt[k],p),lcb,ucb)
  • ix <- sort(X,index.return=T)$ix
  • polygon(c(rev(X[ix]), X[ix]), c(rev(myPredict[ ix,3]),
  • myPredict[ ix,2]), col = rgb(0.7,0.7,0.7,0.4) , border = NA)
  • }
  • #---------------------------------Ftest linearity vs. nonlinearity
  • e2=e^2
  • dev <- apply(e2, 2, sum)
  • resid2=resid^2
  • devlm<- apply(resid2, 2, sum)
  • fstat=rep(NA,9)
  • pvalue=rep(NA,9)
  • for (i in 1:9) {
  •   fstat[i]=((devlm[i]-dev[i])*(168-df2[i]))/((dev[i])*(df2[i]-1))
  •   pvalue[i]=1-pf(abs(fstat[i]),df2[i]-1,168-df2[i])
  • }
  • RSSlm=devlm
  • RSS=dev
  • table=cbind(micro,RSSlm,RSS,df2,fstat,pvalue)
  • #-----------------------------------------Residuals normality plot
  • par(mfrow=c(1,2))
  • hist(e[,5], xlab="residuals",main= "Histogram⊔of⊔Model⊔Residuals")
  • qqnorm(e[,5], pch = 1,frame = FALSE)
  • qqline(e[,5], col = "steelblue", lwd = 2)
  • shapiro.test(e[,5])

References

  1. World Health Organization. Definition and Diagnosis of Diabetes Mellitus and Intermediate Hyperglycaemia: Report of a WHO/IDF Consultation; World Health Organization: Geneva, Switzerland, 2006. [Google Scholar]
  2. Saeedi, P.; Petersohn, I.; Salpea, P.; Malanda, B.; Karuranga, S.; Unwin, N.; Colagiuri, S.; Guariguata, L.; Motala, A.A.; Ogurtsova, K.; et al. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: Results from the International Diabetes Federation Diabetes Atlas. Diabetes Res. Clin. Pract. 2019, 157, 107843. [Google Scholar] [CrossRef] [Green Version]
  3. Fowler, M.J. Microvascular and macrovascular complications of diabetes. Clin. Diabetes 2008, 26, 77–82. [Google Scholar] [CrossRef] [Green Version]
  4. Mendes, A.L.; Miot, H.A.; Haddad Junior, V. Diabetes mellitus and the skin. An. Rasileiros Dermatol. 2017, 92, 8–20. [Google Scholar] [CrossRef] [Green Version]
  5. Kumar, M.; Mishra, L.; Mohanty, R.; Nayak, R. Diabetes and gum disease: The diabolic duo. Diabetes Metab. Syndr. Clin. Res. Rev. 2014, 8, 255–258. [Google Scholar] [CrossRef] [PubMed]
  6. Lee, W.B.; Mannis, M.J. Historical concepts of ocular surface disease. In Ocular Surface Disease: Cornea, Conjunctiva and Tear Film; Elsevier Inc.: Philadelphia, PA, USA, 2013; pp. 3–10. [Google Scholar]
  7. Alves, M.D.C.; Carvalheira, J.B.; Módulo, C.M.; Rocha, E.M. Tear Film and Ocular Surface Changes in Diabetes Mellitus. Arq. Bras. Oftalmol. 2008, 71, 96–103. [Google Scholar] [CrossRef] [Green Version]
  8. Ljubimov, A.V. Diabetic complications in the cornea. Vis. Res. 2017, 139, 138–152. [Google Scholar] [CrossRef]
  9. Owen, C.G.; Newsom, R.S.; Rudnicka, A.R.; Ellis, T.J.; Woodward, E.G. Vascular response of the bulbar conjunctiva to diabetes and elevated blood pressure. Ophthalmology 2005, 112, 1801–1808. [Google Scholar] [CrossRef]
  10. Cheung, A.; Hu, B.; Wong, S.; Chow, J.; Chan, M.; To, W.; Li, J.; Ramanujam, S.; Chen, P. Microvascular abnormalities in the bulbar conjunctiva of contact lens users. Clin. Hemorheol. Microcirc. 2012, 51, 77–86. [Google Scholar] [CrossRef]
  11. To, W.J.; Telander, D.G.; Lloyd, M.E.; Chen, P.C.; Cheung, A.T. Correlation of conjunctival microangiopathy with retinopathy in type-2 diabetes mellitus (T2DM) patients. Clin. Hemorheol. Microcirc. 2011, 47, 131–141. [Google Scholar] [CrossRef]
  12. Banaee, T.; Pourreza, H.; Doosti, H.; Abrishami, M.; Ehsaei, A.; Basiry, M.; Pourreza, R. Distribution of Different Sized Ocular Surface Vessels in Diabetics and Normal Individuals. J. Ophthalmic Vis. Res. 2017, 12, 361. [Google Scholar] [CrossRef]
  13. Jiang, H.; Zhong, J.; DeBuc, D.C.; Tao, A.; Xu, Z.; Lam, B.L.; Liu, C.; Wang, J. Functional slit lamp biomicroscopy for imaging bulbar conjunctival microvasculature in contact lens wearers. Microvasc. Res. 2014, 92, 62–71. [Google Scholar] [CrossRef] [Green Version]
  14. Khansari, M.M.; Wanek, J.; Tan, M.; Joslin, C.E.; Kresovich, J.K.; Camardo, N.; Blair, N.P.; Shahidi, M. Assessment of conjunctival microvascular hemodynamics in stages of diabetic microvasculopathy. Sci. Rep. 2017, 7, 45916. [Google Scholar] [CrossRef] [Green Version]
  15. Manchikanti, V.; Kasturi, N.; Rajappa, M.; Gochhait, D. Ocular surface disorder among adult patients with type II diabetes mellitus and its correlation with tear film markers: A pilot study. Taiwan J. Ophthalmol. 2020. [Google Scholar] [CrossRef]
  16. Di Zazzo, A.; Coassin, M.; Micera, A.; Mori, T.; De Piano, M.; Scartozzi, L.; Sgrulletta, R.; Bonini, S. Ocular surface diabetic disease: A neurogenic condition? Ocul. Surf. 2021, 19, 218–223. [Google Scholar] [CrossRef] [PubMed]
  17. Lindsey, J.K. Applying Generalized Linear Models; Springer Science & Business Media: New York, NY, USA, 2000. [Google Scholar]
  18. Nelder, J.A.; Wedderburn, R.W. Generalized Linear Models. J. R. Stat. Soc. Ser. A (Gen.) 1972, 135, 370–384. [Google Scholar] [CrossRef]
  19. Hastie, T.; Tibshirani, R. Generalized Additive Models for Medical Research. Stat. Methods Med Res. 1995, 4, 187–196. [Google Scholar] [CrossRef] [PubMed]
  20. Hastie, T.; Tibshirani, R. Generalized additive models: Some applications. J. Am. Stat. Assoc. 1987, 82, 371–386. [Google Scholar] [CrossRef]
  21. Hastie, T.J.; Tibshirani, R.J. Generalized Additive Models; CRC Press: Boca Raton, FL, USA, 1990; Volume 43. [Google Scholar]
  22. Boroumand, F.; Shakeri, M.T.; Kordzakhia, N.; Salehi, M.; Doosti, H. Tilted Nonparametric Regression Function Estimation. 2021. Available online: http://xxx.lanl.gov/abs/2102.02381 (accessed on 4 February 2021).
  23. Pourreza, R.; Banaee, T.; Pourreza, H.; Kakhki, R.D. A Radon transform based approach for extraction of blood vessels in conjunctival images. In Proceedings of the Mexican International Conference on Artificial Intelligence, Atizapan de Zaragoza, Mexico, 27–31 October 2008; Springer: Berlin/Heidelberg, Germany, 2008; pp. 948–956. [Google Scholar]
  24. Maurer, C.R.; Qi, R.; Raghavan, V. A linear time algorithm for computing exact Euclidean distance transforms of binary images in arbitrary dimensions. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25, 265–270. [Google Scholar] [CrossRef]
  25. Wasserman, L. All of Nonparametric Statistics; Springer Science & Business Media: New York, NY, USA, 2006. [Google Scholar]
  26. Buja, A.; Hastie, T.; Tibshirani, R. Linear Smoothers and Additive Models. Ann. Stat. 1989, 17, 453–510. [Google Scholar] [CrossRef]
  27. Samson, S.L.; Garber, A.J. Metabolic Syndrome. Endocrinol. Metab. Clin. 2014, 43, 1–23. [Google Scholar] [CrossRef]
  28. Hosojima, H.; Miyauchi, E.; Morimoto, S. Urinary Excretion of Angiotensin Converting Enzyme in NIDDM Patients with Nephropathy. Diabetes Care 1989, 12, 580–582. [Google Scholar] [CrossRef]
  29. Herman, A.A.; Hastie, T.J. An Analysis of Gestational Age, Neonatal Size and Neonatal Death Using Nonparametric Logistic Regression. J. Clin. Epidemiol. 1990, 43, 1179–1190. [Google Scholar] [CrossRef]
  30. Charytanowicz, M.; Kulczycki, P. Nonparametric Regression for Analyzing Correlation between Medical Parameters. In Information Technologies in Biomedicine; Springer: Berlin/Heidelberg, Germany, 2008; pp. 437–444. [Google Scholar]
  31. Seposo, X.T.; Dang, T.N.; Honda, Y. How does ambient air temperature affect diabetes mortality in tropical cities? Int. J. Environ. Res. Public Health 2017, 14, 385. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Hall, P.; Presnell, B. Intentionally biased bootstrap methods. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 1999, 61, 143–158. [Google Scholar] [CrossRef]
  33. Hall, P.; Huang, L.S. Nonparametric kernel regression subject to monotonicity constraints. Ann. Stat. 2001, 29, 624–647. [Google Scholar] [CrossRef]
  34. Carroll, R.J.; Delaigle, A.; Hall, P. Testing and estimating shape-constrained nonparametric density and regression in the presence of measurement error. J. Am. Stat. Assoc. 2011, 106, 191–202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Doosti, H.; Hall, P. Making a non-parametric density estimator more attractive, and more accurate, by data perturbation. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 2016, 78, 445–462. [Google Scholar] [CrossRef]
  36. Doosti, H.; Hall, P.; Mateu, J. Nonparametric tilted density function estimation: A cross-validation criterion. J. Stat. Plan. Inference 2018, 197, 51–68. [Google Scholar] [CrossRef]
Figure 1. An example of the conjunctival images; the right image shows how the algorithm extracts the vessels.
Figure 1. An example of the conjunctival images; the right image shows how the algorithm extracts the vessels.
Ijerph 18 03735 g001
Figure 2. A scatter plot matrix shows the relationship between each pair of predictors. In the diagonal direction, the distribution of each predictor is provided. The upper end of the diagonal shows the Pearson correlation between each pair of predictors. Significant codes: ‘***’ 0.001, ‘**’ 0.01,‘*’ 0.05. BMI = Body Mass Index; HTN-Dur = Hypertension Duration; UPE = daily Urinary Protein Excretion; GFR = Glomerular Filtration Rate; BUN = Blood Urea Nitrogen; S-cr = Serum Creatinine; MAP = Mean Arterial Pressure
Figure 2. A scatter plot matrix shows the relationship between each pair of predictors. In the diagonal direction, the distribution of each predictor is provided. The upper end of the diagonal shows the Pearson correlation between each pair of predictors. Significant codes: ‘***’ 0.001, ‘**’ 0.01,‘*’ 0.05. BMI = Body Mass Index; HTN-Dur = Hypertension Duration; UPE = daily Urinary Protein Excretion; GFR = Glomerular Filtration Rate; BUN = Blood Urea Nitrogen; S-cr = Serum Creatinine; MAP = Mean Arterial Pressure
Ijerph 18 03735 g002
Figure 3. The red curves in the nine panels of this figure are the estimated effects f ( x ) , obtained by fitting Y = f ( x ) where x is Age, BMI, HTN _ Dur, daily UPE, GFR, A1C, BUN, S-cr, and MAP; the green lines in the panels are the linear fit of every predictor.
Figure 3. The red curves in the nine panels of this figure are the estimated effects f ( x ) , obtained by fitting Y = f ( x ) where x is Age, BMI, HTN _ Dur, daily UPE, GFR, A1C, BUN, S-cr, and MAP; the green lines in the panels are the linear fit of every predictor.
Ijerph 18 03735 g003
Figure 4. The red curves are the fitted functions for the model: Y = f B M I ( B M I ) + f U P E ( U P E ) + f A 1 C ( A 1 C ) + f B U N ( B U N ) + A g e * β A g e + H T N D u r * β H T N D u r + G F R * β G F R + S c r * β S c r + M A P * β M A P using the Tilted Additive Model (TAM) approach to estimate f j . The shaded areas represent point-wise nonparametric bootstrap confidence intervals.
Figure 4. The red curves are the fitted functions for the model: Y = f B M I ( B M I ) + f U P E ( U P E ) + f A 1 C ( A 1 C ) + f B U N ( B U N ) + A g e * β A g e + H T N D u r * β H T N D u r + G F R * β G F R + S c r * β S c r + M A P * β M A P using the Tilted Additive Model (TAM) approach to estimate f j . The shaded areas represent point-wise nonparametric bootstrap confidence intervals.
Ijerph 18 03735 g004
Figure 5. Shapiro-Wilk normality test, W = 0.99288, p-value = 0.5819. There is no significant deviation from normal distribution.
Figure 5. Shapiro-Wilk normality test, W = 0.99288, p-value = 0.5819. There is no significant deviation from normal distribution.
Ijerph 18 03735 g005
Table 1. Demographic and clinical characteristics of 168 diabetic patients.
Table 1. Demographic and clinical characteristics of 168 diabetic patients.
PredictorMeanStandard Deviation
Age47.793.70
Body Mass Index (BMI) (kg/m 2 )28.664.81
Hypertension Duration (HTN-Dur)23.9829.56
daily Urinary Protein Excretion (UPE)433.3310.70
Glomerular Filtration Rate (GFR)80.1425.76
Hemoglobin A1C8.8241.85
Blood Urea Nitrogen (BUN)13.554.44
Fasting Blood Sugar (FBS)(mg/dL)166.2054.76
Serum Creatinine (S-cr) (mg/dL)1.110.20
Mean Arterial Pressure (MAP) (mg/dL)100.0615.43
Table 2. The linear effect vs. nonlinear effect of each predictor in the presence of other predictors; columns (1)–(6) refer to predictors, Residual Some of Squares Linear (RSS L), Residual Some of Squares nonlinear (RSS N), degrees of freedom Nonlinear (df N), F value, and p-Value; ** significant at 0.001, * significant at 0.05.
Table 2. The linear effect vs. nonlinear effect of each predictor in the presence of other predictors; columns (1)–(6) refer to predictors, Residual Some of Squares Linear (RSS L), Residual Some of Squares nonlinear (RSS N), degrees of freedom Nonlinear (df N), F value, and p-Value; ** significant at 0.001, * significant at 0.05.
PredictorRSS LRSS Ndf NF Valuep-Value
Age0.0910.0943.015−3.1810.0437 *
Body Mass Index (BMI)0.1430.1223.8809.397<0.001 **
Hypertension Duration (HTN-Dur)0.0910.0954.821−2.0230.097
Daily Urinary Protein Excretion (UPE)0.0940.0913.0933.2640.038 *
Glomerular Filtration Rate (GFR)0.0960.0908.9131.2930.251
Hemoglobin A1C0.1070.0907.7594.275<0.001 **
Blood Urea Nitrogen (BUN)0.1810.0998.73617.085<0.001 **
Serum Creatinine (S-cr)0.0930.0938.227−0.1460.995
Mean Arterial Pressure (MAP)0.1140.1166.770−0.3640.895
Table 3. The linear part of the final model; ** significant at 0.01, * significant at 0.05.
Table 3. The linear part of the final model; ** significant at 0.01, * significant at 0.05.
PredictorEstimateStd. Errort Valuep-Value
Intercept0.06540.08910.7330.4646
Age−0.0020.001−2.3730.019 *
Gender (Female/male)−0.0030.007−0.3650.716
Hypertension Duration (HTN-Dur)0.00020.00011.4360.153
Glomerular Filtration Rate (GFR)−1.232 × 10−61.791 × 10−4−0.0070.994
Serum Creatinine (S-cr)−0.0360.0348−1.0360.302
Mean Arterial Pressure (MAP)0.00050.00022.7280.007 **
Area (2/1)−0.00130.0057−0.2310.818
Area (3/1)0.01230.00572.1420.034 *
Area (4/1)0.00750.00571.3150.191
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Boroumand, F.; Shakeri, M.T.; Banaee, T.; Pourreza, H.; Doosti, H. An Analysis of the Areas Occupied by Vessels in the Ocular Surface of Diabetic Patients: An Application of a Nonparametric Tilted Additive Model. Int. J. Environ. Res. Public Health 2021, 18, 3735. https://doi.org/10.3390/ijerph18073735

AMA Style

Boroumand F, Shakeri MT, Banaee T, Pourreza H, Doosti H. An Analysis of the Areas Occupied by Vessels in the Ocular Surface of Diabetic Patients: An Application of a Nonparametric Tilted Additive Model. International Journal of Environmental Research and Public Health. 2021; 18(7):3735. https://doi.org/10.3390/ijerph18073735

Chicago/Turabian Style

Boroumand, Farzaneh, Mohammad Taghi Shakeri, Touka Banaee, Hamidreza Pourreza, and Hassan Doosti. 2021. "An Analysis of the Areas Occupied by Vessels in the Ocular Surface of Diabetic Patients: An Application of a Nonparametric Tilted Additive Model" International Journal of Environmental Research and Public Health 18, no. 7: 3735. https://doi.org/10.3390/ijerph18073735

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop