Next Article in Journal
From Movements to Metrics: Evaluating Explainable AI Methods in Skeleton-Based Human Activity Recognition
Next Article in Special Issue
Aluminum Nitride Thin Film Piezoelectric Pressure Sensor for Respiratory Rate Detection
Previous Article in Journal
Design of a Multi-Position Alignment Scheme
Previous Article in Special Issue
A Deep Learning-Based Platform for Workers’ Stress Detection Using Minimally Intrusive Multisensory Devices
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimating Compressive and Shear Forces at L5-S1: Exploring the Effects of Load Weight, Asymmetry, and Height Using Optical and Inertial Motion Capture Systems

1
Department of Industrial and Systems Engineering, Auburn University, Auburn, AL 36849, USA
2
Institute of Industry and Management, Universidad Austral de Chile, Puerto Montt 5480000, Chile
3
Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA
4
Department of Industrial and Systems Engineering and Engineering Management, The University of Alabama at Huntsville, Huntsville, AL 35899, USA
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(6), 1941; https://doi.org/10.3390/s24061941
Submission received: 23 January 2024 / Revised: 8 March 2024 / Accepted: 15 March 2024 / Published: 18 March 2024

Abstract

:
This study assesses the agreement of compressive and shear force estimates at the L5-S1 joint using inertial motion capture (IMC) within a musculoskeletal simulation model during manual lifting tasks, compared against a top-down optical motion capture (OMC)-based model. Thirty-six participants completed lifting and lowering tasks while wearing a modified Plug-in Gait marker set for the OMC and a full-body IMC set-up consisting of 17 sensors. The study focused on tasks with variable load weights, lifting heights, and trunk rotation angles. It was found that the IMC system consistently underestimated the compressive forces by an average of 34% (975.16 N) and the shear forces by 30% (291.77 N) compared with the OMC system. A critical observation was the discrepancy in joint angle measurements, particularly in trunk flexion, where the IMC-based model underestimated the angles by 10.92–11.19 degrees on average, with the extremes reaching up to 28 degrees. This underestimation was more pronounced in tasks involving greater flexion, notably impacting the force estimates. Additionally, this study highlights significant differences in the distance from the spine to the box during these tasks. On average, the IMC system showed an 8 cm shorter distance on the X axis and a 12–13 cm shorter distance on the Z axis during lifting and lowering, respectively, indicating a consistent underestimation of the segment length compared with the OMC system. These discrepancies in the joint angles and distances suggest potential limitations of the IMC system’s sensor placement and model scaling. The load weight emerged as the most significant factor affecting force estimates, particularly at lower lifting heights, which involved more pronounced flexion movements. This study concludes that while the IMC system offers utility in ergonomic assessments, sensor placement and anthropometric modeling accuracy enhancements are imperative for more reliable force and kinematic estimations in occupational settings.

1. Introduction

Lower back disorders are a significant health problem affecting one out of four workers in the United States [1]. Manual material handling tasks, such as lifting, impose high compression and shear forces on the spine [2]. Spinal compression and shear forces can cause damage to spinal segments and the surrounding tissues [3,4]. Understanding lower back loading is a central area of study in ergonomics, such as estimating moments and forces (compressive and shear) experienced by the lumbar spine during physical work. In order to protect workers and establish ergonomic safety limits for job design and intervention, the National Institute for Occupational Safety and Health (NIOSH) determined the compressive force limit for the lumbar vertebrae to be 3.4 kN [5]. Also, there have been studies on the tolerance of the lumbar spine to shear force, contributing to a recommended limit of 1 kN [6,7,8]. However, assessing spinal loading in vivo is challenging and rarely performed due to the method’s invasiveness [2]. Furthermore, the assessment is typically confined to controlled laboratory environments, limiting the ability to evaluate spinal loading in real-world field settings such as live production environments [9].
Musculoskeletal simulations and dynamic modeling programs that can predict forces and moments acting on the musculoskeletal system during movement are plausible options in biomechanics [10,11]. These simulations typically involve the creation of a computer-based model of the human body, including its bones, joints, ligaments, and muscles. Using equations of motion, principles of mechanics, and optimization methods, the model can predict the forces and moments acting on the musculoskeletal system during movement, providing insights into the loading experienced by different body tissues [12].
Using optical motion capture (OMC) technology, researchers can effectively capture kinematic data, such as the segment orientation, position, linear and rotational dynamics, and joint angles, by adhering to International Society of Biomechanics guidelines, which involve placing reflective markers on specific anatomical sites [13,14]. Additionally, force plates (FPs) allow kinetic analysis by recording the ground reaction forces (GRFs) and their associated moments. Yet, the real-world application of these tools in professional settings often faces complexities or infeasibility. This prompts the need to consider alternative technologies more attuned to the dynamic demands of work environments [15].
Additionally, to address the “portability” limitation of optical motion capture systems and laboratory-based equipment, some wearable measurement systems have been developed for ambulatory assessment of backloading [16,17]. However, they can be bulky and impractical for highly dynamic conditions. In order to measure the motion associated with physical work in dynamic workplaces, inertial motion capture (IMC) usage has increased during the last decade [15,18].
Kinematic data obtained from IMC systems have been validated in several studies in laboratories against data obtained from OMC systems [19,20,21,22,23,24]. Estimating kinetic variables such as backloading from IMC systems has also been validated in laboratories by using force platforms or instrumented shoes to measure the ground reaction forces [20,25,26,27,28]. Recent advancements in IMC technology, such as consistency of performance over time, accuracy, and cost efficiency [21,29], and the availability of methods to predict ground reaction forces and moments from the segment kinematics and dynamical properties have provided new opportunities for field assessment [20,30,31,32,33]. Larsen et al. [20] observed moderate-to-excellent correlations for the intraclass correlation coefficients for compression and anteroposterior shear forces at the L4–L5 joint, ranging from 0.65 to 0.92 during symmetrical and asymmetrical lifting. For the analyzed trials, however, the IMC-based model underestimated the trunk flexion compared with those measured with the OMC system, with a reported RMSE ranging from 12.43 to 16.54 degrees. The combination of ambulatory IMC measurements and musculoskeletal modeling for estimating spinal loads during manual material handling needs further evaluation before it can be used in the field. In particular, no studies have systematically evaluated the effects of key ergonomic variables such as the load mass [34,35,36,37], lifting and lowering height [38,39], asymmetry [8,40], or their potential interactions.
The current study aims to critically investigate the capability of an inertial motion capture (IMC) system in accurately assessing compression and anteroposterior shear forces at the L5-S1 joint during lifting and lowering tasks. The tasks are varied across three primary factors: the mass of the load, the degree of asymmetry, and the height at which the load is handled. Within this context, the study is guided by two distinct objectives:
  • Assess the agreement between the IMC- and OMC-based models in estimating lumbar spine kinetics and kinematics.
  • Systematically evaluate the influence of the load mass, asymmetry degree, and lifting height on the kinematics and kinetics within and between both IMC and OMC systems.
Clarifying and examining these objectives are an essential part of evaluating the effectiveness of IMC systems and understanding the factors that may impact their estimates when assessing biomechanical loads during manual handling tasks. Additionally, trunk rotation, flexion, and lateral bending were compared to better understand the differences in the force estimates. A measure of the distance between the handled box and the L5-S1 joint’s center was compared between systems as a comprehensive estimation of the segment length differences.

2. Materials and Methods

A gender-balanced sample of 36 participants (19–55 years old; mean height = 173.54 ± 7.5 cm; mean body mass = 72.78 ± 12.1 kg) was recruited. The participants were from the Auburn University student body and the local Auburn-Opelika community. The inclusion criteria included (1) no history of physician-diagnosed MSD, injury, or surgery in the lower back, (2) absence of lower back pain during the previous six months, and (3) no history of a physician-diagnosed neurodegenerative disorder that may affect movement (e.g., Parkinson’s disease or multiple sclerosis). The study was approved by the Institutional Review Board of Auburn University (Protocol No. 16-211 MR 1606).

2.1. Participant Preparation and Data Collection

Several anthropometric measurements were obtained, including the heights, weights, and lengths and circumferences of several major body links following established guidelines [41]. The participants were fitted with 17 IMU Xsens Awinda sensors (Xsens Technologies, Enschede, The Netherlands). Each IMU is a small, wireless, battery-powered unit that measures and stores the acceleration, angular velocity, and magnetic field information. The devices were secured using a combination of elastic neoprene straps or hypoallergenic athletic tapes. In addition to the IMUs, the participants wore small, reflective motion capture markers used as a “gold-standard” reference for body segment positions. The reflective markers’ trajectories were recorded with 16 cameras (Optitrack Prime 13, Natural Point, Inc., Corvallis, OR, USA). For this experiment, a total of 50 reflective markers were used. A full-body Plug-in Gait marker set was used to define the reflective markers’ locations; 11 markers were added to the 39 marker set, including on the insides of the knees, elbows, and ankles, tops of the feet, and left and right sides of the pelvis (Figure 1). The anthropometric data were used to build a rigid link biomechanical model using the information collected from the sensors. The model was compared against the one collected from the reflective markers. Major anthropometric measurements are summarized in Table 1. Figure 2 illustrates the experimental settings and the avatars from the respective systems (Video S1).

2.2. System Calibration

Standard procedures were used to calibrate the OMC and IMC systems. Segment calibration of the IMC system was necessary to align the motion trackers to the participants’ segments. The procedure consisted of the participant holding a neutral posture for a few seconds and then walking straight forward and back to the point where they started. The OMC system was calibrated before each data collection session, defining the capture volume and the global coordinate system’s orientation and origin.

2.3. Musculoskeletal Model

The biomechanical assessment was performed using the musculoskeletal modeling software Anybody™ V.7.3.1 (AnyBody Technology, Aalborg, Denmark). The OMC-based template used for the analysis was the Plug-in-Gait-MultiTrial-Standing set. For the IMC system, the template used was BVH_Xsens. The models were scaled according to the manually measured segment dimensions, which were inputted into the IMC software (v 2019.2) before initiating the data collection sessions. The BVH files from the IMC software were exported, containing information on the kinematic model static pose and the absolute position and orientation of the root pelvis segment as well as the joint angles between the segments for each time frame [42]. The Anybody Model Repository (AMR) used in this study to process BVH files was AMR v2.3.1. The compressive (proximo-distal (PD)) and shear (antero-posterior (AP)) forces were considered for the analysis. Medio-lateral (ML) shear forces were not considered due to their difference and smaller magnitude compared with the other two forces [43]. The load lifted (box) was modeled in the software using the distance between the hands and the dimensions of the box as references, with the dimensions of the actual box being lifted being 10 cm height, 25 cm width, 40 cm length.

2.4. Data Synchronization and Processing

Motion analysis was performed by using the OMC and IMC systems simultaneously. OMC data were sampled at 120 Hz, while IMC data were sampled at 60 Hz. The forces and kinematics were bidirectionally low-pass filtered with a second-order Butterworth filter at 7 Hz for the forces system and 3 Hz for the kinematics. Gaps in the OMC markers’ trajectories were filled using cubic interpolation methods in the Motive™ software v2.1.1. The force estimates for the OMC-based model were obtained using a top-down approach. In contrast, the IMC-based estimates were obtained through kinematics using the model utilized by Karatsidis et al. [42].

2.5. Experimental Procedure

The 36 participants were instructed to perform different manual material handling tasks in a laboratory environment, where kinematic and kinetic data were collected. The duration of the trials varied from 10 to 30 s, depending on the participant. Each participant performed three trials with a 2 min rest period in between. The participants were instructed to lift boxes (similar to a standard milk crate) with handles consisting of three loads—10 lbs (4.54 kg), 20 lbs (9.07 kg), and 30 lbs (13.61 kg)—both symmetrically and asymmetrically (i.e., 0°, 30°, and 60° degrees from the sagittal plane to the left) to three different shelf heights (60 cm, 100 cm, and 140 cm). Each participant completed three different combinations using the lifting technique of their preference. The tested combinations were labeled using the following terminology: LXX (XX = load of 10, 20, or 30 lbs), AYY (YY = angle of 0-, 30, or 60 degrees asymmetry), and HZZ (ZZ = height of 60, 100, or 140 cm). For example, L20_A30_H140 would represent a 20 pound load picked up from a sagittal angle of 30° and lifted to 140 cm. The loads and heights were randomized within the levels of angle for 27 combinations (every combination was performed 4 times, meaning 108 trials).

2.6. Measurements

The L5-S1 compression and shear forces, flexion, lateral bending, and rotation angles and the distance between the joint and the box on the X, Y, and Z axes were determined. These variables were measured in units of Newtons (N), degrees (°), and meters (m), respectively. The distance from the center of the L5-S1 joint was measured as indicated in Figure 3. The figure displays an example with the following coordinates: (X1, Z1, Y1) = (0.73, −0.31, −0.01), with X1 = 0.73 m for the box in front of the sacrum, Z1 = 0.31 m for the box under the sacrum, and Y1 = 0.01 m for the box to the left of the sacrum.

Data Analysis

Boxplots, kernel density estimate (KDE) plots, simple linear regression analyses, and Bland–Altman plots were used to compare the level of agreement between the systems. A 33 randomized block partially confounded design (RBPF) with blocks of a size of three was used to compare the peak forces and angles, as well as the root mean square errors (RMSEs) of the time series of the forces and angles between the systems. Confounded factorial designs are particularly appropriate if an interaction is expected to be negligible. The interactions can be confounded with groups, reducing the block size without sacrificing power in evaluating the treatments [44]. Due to the nature of the experimental design technique, the groups (four groups of nine participants each) and the main effects (load, angle, height, and their possible interactions) were analyzed to find potentially significant differences. A type I error rate of 0.05 was used for all tests. Pairwise comparisons were performed using Tukey’s test to analyze the RMSE and range for the main effects and interactions found to be significant. The effect sizes were calculated to measure the strength of the relationship between variables. Omega-squared (ω2) is recommended for complex designs with multiple variables [45]. Statistical tests were conducted using Python (v 3.10.11).

3. Results

The results were divided into two main categories, with the first showing the agreement between systems, presenting descriptive statistics of the compressive and anteroposterior shear forces (Table A1, Appendix A), joint angles (Table A2), and peak distances from the box to the spine (Table 2) and the second showing the statistical effect of the analyzed variables, the results of the experimental design (RBPF), and post hoc analyses. Figure 4 shows an example of a full-duration trial considering the force estimates for lifting and lowering. The example corresponds to a female participant lifting a load of 10 lbs (L10) with no asymmetry angle (A00) and a height of 1 m (H100). In both the lifting and lowering diagrams, two distinct peaks are evident. The more prominent peak typically corresponds to lifting or setting down the load from or onto the floor. Conversely, the secondary peak is commonly associated with placing or retrieving the load onto or from the shelf.

3.1. Forces

3.1.1. Compressive Forces

The compressive force estimates varied significantly between systems. The OMC results were, on average, 34% higher than the IMC estimates. Figure 5 shows the resultant box plots with the force estimates, where the difference increased as the observed forces increased. The KDE plots display the distribution of observations, shown in Figure 6. Due to the comparison of distribution shapes, it is noticeable that the OMC estimates showed a wider range of values than the IMC estimates for both the lifting and lowering scenarios. Figure 7 presents the Bland–Altman plots, highlighting a trend wherein increases in the magnitude of the force estimates increased the differences in agreement between the systems.
The simple linear regression analysis for the tasks is shown in Figure 8. For the lifting and lowering tasks, the regression line equations suggest a multiplication of 1.37 (95% CI: 1.24–1.51) and 1.35 (95% CI: 1.20–1.51) for the force estimates, with 293.66 (95% CI: 293.52–293.79), and 289.03 N (95% CI: 288.88–289.18) added as the intercepts, respectively.
The RMSE of the compressive forces for the time series data for all observations is shown in Figure 9. The RMSE varied mainly between 420 and 756 N (from the 25th to 90th percentiles) for the lifting and lowering tasks.
The peak compressive force differences were also calculated, mostly falling between 696 and 1397 N, with most observations being between the 25th and 90th percentiles, as seen in Figure 10.

3.1.2. Shear Forces

As with the compressive forces, the shear forces exhibited significant variation between systems, with an average difference of 30% for the lifting and lowering tasks. The maximum peak shear force observed was around 1600 N in the OMC system, while the IMC system had a maximum peak shear force of 1200 N for both the lifting and lowering tasks. Differences between 200 and 400 N were observed for the values between the 25th and 90th percentiles. Figure 11 displays the shear force estimates for each system, with noticeable differences between the estimates, especially at the higher end of the observed forces. Additionally, the probability density functions for the observations displayed in the KDE plots (Figure 12) showed a similar situation to the one observed for the compressive forces, with the OMC estimates having a wider range of values and generally higher estimates than the IMC-based estimates. As for the compressive force estimates, the Bland–Altman plots in Figure 13 reveal noticeable differences between the observations for the shear forces, highlighting the trend of higher differences with higher force estimates.
The simple linear regression analysis for the tasks is shown in Figure 14. For the lifting and lowering tasks, the regression line equations suggested slopes of 1.41 (95% CI: 1.30–1.53) and 1.42 (95% CI: 1.29–1.56) with intercepts of 21.40 (95% CI: 21.29–21.52) and 8.87 N (95% CI: 8.74–9.00), respectively.
The RMSE of the shear forces for the time series data for all observations is shown in Figure 15. The RMSE varied mainly between 109 and 225 N (25th to 90th percentiles) for the lifting and lowering tasks, respectively.
The peak shear force differences were also calculated, mostly falling between 205 and 435 N, with most observations being between the 25th and 90th percentile.

3.2. Joint Angles and Distance from the Spine to the Load

3.2.1. Flexion

The peak flexion angle comparison for every system showed that the OMC-based estimates were higher than the IMC-based ones by around 14–18 degrees. Figure 16 and Figure 17 display the differences observed. Figure 18 shows the Bland–Altman plots, where it is displayed that the mean differences were 17.9 and 17.1 degrees for the lifting and the lowering tasks, respectively.
The RMSE ranged from 2.45 to 28.54 degrees for both the lifting and lowering tasks, with most values falling between the 25th and 75th percentiles (7.06–13.13 degrees).

3.2.2. Lateral Bending

The comparison of peak lateral bending angles across the different systems revealed that the estimates based on the OMC and IMC methods were generally similar, with median values of approximately 8.5 degrees falling within the interquartile range for all scenarios. However, the OMC-based estimates were higher than those of the IMC system for the lifting and lowering tasks. The observed differences are illustrated in Figure 19 and Figure 20. Bland–Altman plots were generated, and they are displayed in Figure 21. The plots indicate that the mean differences in the peak lateral bending angles between the two systems were approximately −1 degree for the lifting and lowering tasks. In the lifting and lowering tasks, the RMSE ranged from 0.92 to 11.42 degrees, with values between the 25th and 75th percentiles ranging from 3.79 to 5.16 degrees.

3.2.3. Rotation

In terms of the peak rotation angles, the comparison between the OMC and IMC methods showed that the IMC estimates were generally higher for the lifting and lowering tasks, with median values of approximately 7.74 and 13.44 degrees, respectively. These differences are illustrated in Figure 22 and Figure 23. Bland–Altman plots were generated, as shown in Figure 24, to assess the agreement between the two systems. The plots reveal that the mean differences in the peak rotation angles between the OMC and IMC systems were 5.51 degrees (limits of agreement: −5.65, 16.67) for the lifting task and 6.19 degrees (limits of agreement: −5.98, 18.35) for the lowering task. The lifting and lowering tasks had RMSE values ranging from 0.94 to 16.31 degrees, with the 25th to 75th percentile values ranging from 3.61 to 7.77 degrees.

3.2.4. Distance from the Spine to the Load

The distance between the spine and the load was analyzed on the X, Y, and Z axes. The results are presented in Figure 25. The mean difference in the peak distance was 7.90 cm for the lifting task and 7.93 cm for the lowering task on the X axis, with a range from 0 to 27.94 cm. The mean difference in the peak distance on the Z axis was higher, being 11.51 cm for the lifting task and 12.53 cm for the lowering task, and the range was 0.1–34.80 cm. The Y axis showed smaller differences, with a mean of 3.41 cm for the lifting task, 3.71 cm for the lowering task, and a range of 0–17.34 cm.

3.3. Statistical Analysis

The RBPF 33 ANOVA results were divided into forces and joint angles. The analyses compared the peaks (forces and angles), RMSEs between systems for the time series, and peak differences for the lifting and lowering tasks. The summary of the forces for the analysis of the effect of a load’s weight, height, and asymmetry and their potential interactions are displayed in Table 3 and Table 4.

3.3.1. Compressive Forces

The statistical analysis revealed significant differences between the participant groups across all scenarios. Furthermore, among the three main factors investigated, the load was significant for the individual peaks, the RMSE, and the peak differences between the systems in both the lifting and lowering tasks. Post hoc tests using Tukey’s method demonstrated significant differences between all load levels, with the greatest difference observed between L10 and L30. Additionally, height was found to be a significant factor for estimates of the RMSE in both tasks, with H60 showing significant differences from H100 and H140. The observed trends were consistent across both the lifting and lowering tasks.

3.3.2. Shear Forces

The statistical analysis revealed significant differences between the participant groups across all scenarios, as presented in Table 3 and Table 4. Furthermore, among the three main factors investigated, the load was significant for the individual peaks, the RMSE, and the peak differences between systems in both the lifting and lowering tasks. Post hoc tests using Tukey’s method demonstrated significant differences between all load levels, with the greatest difference observed between L10 and L30. Additionally, height was found to be a significant factor for the estimates of the RMSE in both tasks, with H60 showing significant differences from H100 and H140. The observed trends were consistent across both the lifting and lowering tasks.

3.3.3. Joint Angles

The ANOVA results for the joint angles are summarized in Table 5 and Table 6.

Flexion

The flexion and extension angle analysis revealed significant differences between the groups for both systems. The lifting task also showed significant effects from the load factor on the peak IMC (p = 0.028) and the angle factor on the peak OMC (p = 0.003) and IMC (p = 0.014), with increasing peak flexion angle values as the level of the angle factor increased and A00 being significantly different from A60. However, the angle did not affect any of the peaks for the lowering task, but the height did for the peak IMC (p = 0.017), with H100 being significantly different from H140. The RMSEs for both tasks did not show significant differences. Although significant differences were not observed when evaluating the peak differences for the lifting task, a significant effect from the height was observed for the lowering task (p = 0.002). Tukey’s test indicated that H140 was significantly different from H060 and H100.

Lateral Bending

In terms of lateral bending, both the RMSEs and peak differences for the lifting and lowering tasks did not exhibit any significant effects. However, the peaks for both systems in both tasks demonstrated a significant association with the angle (p ≤ 0.001). Further analysis using Tukey’s test revealed significant differences between every angle level for the IMC (lifting and lowering) and OMC (lowering) set-ups. Additionally, A60 exhibited a significant difference from A00 and A30 for the OMC set-up in the lifting task. Regarding the peak OMC in the lowering task, the load also displayed significance (p = 0.020). Tukey’s test indicated that L10 was significantly different from L20 and L30.

Rotation

Regarding the rotation angle, the analysis revealed significant effects from groups on the peak IMC and peak differences for both the lifting and lowering tasks. Furthermore, the load factor was found to be significant only for the peak differences in the lowering task (p = 0.0049), specifically with L10 showing a significant difference from L20.
Additionally, the angle factor demonstrated significance for the peaks in both the OMC and IMC systems for both tasks (p ≤ 0.001), with each angle level displaying significant differences. The peak difference between systems in the lowering task also exhibited a significant association with the angle factor (p ≤ 0.001). Further analysis using Tukey’s test revealed that A60 significantly differed from A00 and A30, indicating higher differences as the angle level increased. Height was observed to be a significant factor in the lifting task, specifically in the estimates of the peak OMC (p = 0.008). Post hoc analysis using Tukey’s test revealed that H140 significantly differed from H100 and H060. Similarly, in the peak difference between systems, height was found to be a significant factor (p = 0.018), with post hoc analysis indicating that H140 was significantly different from H060.

4. Discussion

This study assessed the agreement of compressive and shear force estimates at the L5-S1 level obtained by a musculoskeletal model using data from an ambulatory measurement system consisting of inertial motion capture (IMC) during manual lifting. The outcomes of the IMC-based model were compared against a top-down optical motion capture (OMC)-based model.

4.1. Agreement between Force Estimates

The results revealed significant differences between the compressive (PD) and anteroposterior (AP) shear force estimates obtained from the OMC and IMC systems. On average, the IMC estimates were 34% (975.16 N) lower for the compressive forces and 30% (291.77 N) lower for the shear forces. Additionally, the values obtained from the OMC system exhibited a broader range than those from the IMC system for both force estimates. These discrepancies between the IMC and OMC systems carry practical implications, particularly when the estimates are utilized to contextualize activities within ergonomic thresholds, such as the recommended limits for compression and shear forces during manual material handling tasks, which are 3400 N and 1000 N, respectively [5,6,8,35]. The linear regression analysis of the force estimates (Figure 8 and Figure 14) indicates that obtaining a PD force of 2300 N with the IMC system would be equivalent to approximately 3400 N. In comparison, an AP force of 700 N would be equivalent to approximately 1000 N. In other words, the IMC-based forces were approximately 30% lower than the OMC estimates. Another observed trend revealed by the Bland–Altman plots (Figure 7 and Figure 13) showed that as the force estimates increased, the discrepancies between the estimates increased. Consequently, the IMC system underestimating the forces at L5–S1 could be problematic and lead to a misinterpretation of injury risk assessment in occupational settings.
In a laboratory study by Marras and Davis [8], participants were instructed to lift a 13.7 kg load (30 lbs) at various asymmetric angles using one or two hands. The compressive and shear forces at L5-S1 were measured using electromyography (EMG) and a back electrogoniometer that measured the joint angles relative to the thorax and pelvis. The results demonstrated that the compressive forces ranged from 3700 N for a symmetrical lift to 4200 N for a 60 degree angle. In contrast, our analysis of the average compression forces for the 13.7 kg load, considering different combinations of heights and angles, yielded an average of approximately 3200 N for the OMC system and 2000 N for the IMC system.
In a recent study by Skals et al. [33], musculoskeletal modeling and an IMC system were utilized to estimate the compressive and anteroposterior shear forces in manual material handling activities in the supermarket sector. The study involved handling loads ranging from 5.3 kg to 20.2 kg, considering different starting positions and shelf heights. The authors reported noteworthy force estimates for loads of 10.2 kg (reaching up to 3442 N for compression), 17.3 kg (3854 N for compression and 1113 N for shear), and 20.2 kg (4188 N for compression and 1191 N for shear). Although their results were not directly compared against an OMC model, and the loads and lifting parameters differed from those in our study, it is important to note that the observations from their IMC-based model exhibited higher magnitudes than those observed in the present study for similar loads. We suspect that these significant force discrepancies may be attributed to kinematic variations, differences in the flexion, extension, and rotation joint angles, and disparities in model scaling or segment length.
The IMC-based model template used in the current study has been reported to underestimate trunk flexion angles in previous research [20]. Larsen et al. [20] reported root mean square errors (RMSEs) between the OMC- and IMC-based models ranging from 12.43 to 16.54 degrees for symmetrical, asymmetrical, and load-transferring lifting tasks. These results align with our observations. The mean RMSE for lifting in our study was 10.92 degrees. For lowering, it was 11.19 degrees. However, it is important to note that the degree of underestimation varied with the RMSE values, being as low as 3.73 degrees for lifting and 2.45 degrees for lowering but they also reached as high as 28 degrees for both tasks.
In addition to the trunk flexion angle, Larsen et al. [20] also investigated a comparison of the lateral bending and rotation angles. They reported RMSE values ranging from 1.8 to 2.79 degrees for the lateral bending angle and 4.58 to 7.75 degrees for the rotation angle. Our study also examined these angles, and the mean values for the lateral bending angle were 4.19 degrees for lifting, 4.16 degrees for lowering, and 5.93 degrees for rotation. These findings reinforce a similar pattern of discrepancy in angle estimates, as reported in the existing literature.
To evaluate the differences in position error between the systems, the peak differences in the distance from the lifted box to L5-S1 (at peak force) were calculated. The most considerable discrepancies were observed on the X and Z axes. Specifically, there was an average difference of 8 cm on the X axis and 12 cm and 13 cm on the Z axis for lifting and lowering, respectively. Importantly, these differences indicated underestimations by the IMC system compared with the OMC system. There was no single instance where the IMC-based model’s distance exceeded that of the OMC system. These findings are consistent with a study by Faber et al. [27], which also reported similar differences between the IMC and OMC estimates in the context of biomechanical models used to estimate moments at L5-S1.
The assessment of the spine-to-box distance provided a comprehensive evaluation of the segment length, revealing a consistent underestimation, particularly in the trunk and torso, across most IMC-based models. This consistent underestimation of segment lengths, coupled with the underestimated joint angles, especially in flexion or extension, has important implications for the kinematic inputs used to estimate kinetics, potentially explaining the observed differences in forces previously presented. One potential source of this issue may be attributed to the location and placement of the sacrum sensor in the IMC system, guided by the manufacturer. Unlike the OMC system, which tracks bony landmarks to measure the trunk length, the IMC sacrum sensor is placed in a region without prominent landmarks for identification, making its placement and stability challenging. Moreover, the sacrum sensor may experience motion and upward shifts during flexion, further complicating its accurate placement and stability [20,46].
In general, the consistently shorter torso observed in the IMC-based model could be related to changes in the position of the sacrum sensor, which may be influenced by the dynamic and varied nature of the evaluated tasks that require significant forward bending. We suspect that the sacrum sensor may primarily shift upward from its original placement, impacting segment definitions. Our results indicate that the IMC-based model underestimated torso flexion, overestimated rotation, and showed similar estimates to the OMC-based system for lateral bending. These observations could be explained by the differences in the range of motion among different spinal regions. For instance, if the torso is defined above the lumbosacral joint and closer to the thoracic region, then a decrease in flexion and an increase in rotation would be expected. Researchers have observed these differences, with the flexion angle decreasing from 20 degrees at L5-S1 to 10 degrees at T11-T12 and the rotation angle increasing from approximately 5 degrees at the lumbosacral level to 9 degrees in the thoracic region [47]. Users of the IMC system should exercise caution regarding how sensor positioning affects the torso dimensions and, by extension, not just kinematics but also kinetic estimates. It may be beneficial for IMC system manufacturers to propose improved placement methods or suggest additional adjustments during pre- or post-data processing.

4.2. Impact of Load, Height, and Asymmetry

To our knowledge, the current study represents the first attempt to assess the differences in force and kinematics estimates between IMC and OMC systems using musculoskeletal models within a systematic statistical framework. We analyzed the results in relation to the load, height, and asymmetry levels, as well as their potential interactions. When comparing both systems, our main findings indicate that the root mean square error (RMSE) of both the compressive (PD) and anteroposterior (AP) forces were significantly influenced by the load levels and height levels. Specifically, the RMSE values were higher as the load levels increased and lower as the height levels increased (with no significant differences between H100 and H140). We attribute these higher differences at lower heights to the increased flexion angle associated with retrieving and placing the load from the shelf compared with the other heights. Since this level involved more flexion and extension movements, the differences between the OMC- and IMC-based estimates were more pronounced.
Regarding the impact of variables on the compressive and shear force estimates for each system, our findings align with previous studies [35,36,37,48,49], indicating that the load mass has the most substantial effect. However, our results differ regarding the impact of asymmetry on AP forces. While Skals et al. [49] found that load and asymmetry affected these forces, our study did not observe a significant effect of the angle on the estimates from either the IMC- or OMC-based models. A load × height interaction effect for the shear forces during the lifting tasks was observed for the IMC-based model, suggesting that higher load and height levels lead to higher AP peak forces. However, the small effect size estimate suggests that it may not be practically meaningful.
Future research should extend the comparison and analysis of kinetics and kinematics to other pertinent body parts, such as the shoulders and knees, which are known to be susceptible to MSDs [50]. Examining the forces and moments in these areas would provide a more comprehensive assessment of the overall biomechanical impact. Additionally, exploring how changes in variables such as the lifting technique, exertion speed, and postures (e.g., squatting or bent postures) can impact the forces and moments experienced by the body could provide valuable insights. Understanding these relationships would allow for more targeted and effective ergonomic interventions.
Furthermore, future studies should incorporate the assessment of muscular demands. Considering factors such as muscle activation levels and fatigue during various tasks would provide a deeper understanding of the physiological aspects of ergonomic assessment. By integrating muscular demands into the analysis, researchers can better comprehend the interaction between muscular activity, forces, and kinematics, leading to more comprehensive and accurate ergonomic evaluations, as Skals et al. [33] suggested.
In conclusion, when comparing compressive and anteroposterior shear forces using musculoskeletal modeling with OMC- and IMC-based models, significant differences were observed, making ergonomic assessment challenging. However, improving the scaling of the IMC-based model to reduce differences in the joint angle and segment length could enhance the quality of the estimates. As expected, increasing load levels significantly impacted the force estimates, while the lower lifting height showed higher force values than other levels.

4.3. Limitations

The present study has several limitations that should be acknowledged. Firstly, the tasks evaluated in this study focused on asymmetry levels of 0, 30, and 60 degree angles to the left of the initial box position during a two-handed lift. However, it is important to note that going beyond 60 degrees or considering right-sided asymmetry instead of left-sided asymmetry could yield different force profile trends [8]. Furthermore, the lifting technique and exertion speed were not controlled variables in the experiment, introducing potential variability in the results [22,51]. The analysis did not consider whether squatting or bent postures were utilized during load lifting, which could impact the force estimates [51].
Additionally, an acknowledged issue when using inertial measurement units (IMUs) over time is the effect of magnetic disturbance and gyroscopic drift, which can affect the reliability of the estimates [52]. Although the impact of this effect was not directly measured in our study, it is important to note that the IMC system was recalibrated between trial combinations, and the trials lasted no more than 30 s.
We utilized OMC as it is widely considered the gold standard for recording the positions of body segments in a 3D space. Reports in the literature suggest that OMC can achieve error rates below 200 μm for 97% of a 135 m3 capture volume [53]. However, two main things are worth mentioning. First, OMC-based estimates are prone to error from sources such as soft tissue artifacts [54]. Secondly, due to the complexity associated with the modeling and variability of the human body regarding force generation encompassing bones, muscles, tendons, and ligaments, joint torque estimates derived though inverse dynamics carry an inherent degree of uncertainty [12,55,56].
Another limitation of our study was the significant time investment required to process the data using the applied methodology. Similar observations have been reported in the recent literature [33], suggesting that musculoskeletal simulation tools may not be feasible as a standard for expedited industrial ergonomic assessments. However, as researchers and practitioners continue to benefit from the advantages of musculoskeletal modeling, advancements will likely be made to address and overcome these limitations.

Supplementary Materials

The following supporting information can be downloaded at https://www.youtube.com/watch?v=kKelr2xoFj0. Video S1: IMC vs. OMC study (trial example).

Author Contributions

Conceptualization, I.N.-U., R.S., M.C.S.J. and S.G.; methodology, I.N.-U., H.C. and S.G.; formal analysis, I.N.-U., M.Z., M.C.S.J. and S.G.; writing—original draft preparation, I.N.-U. and S.G; writing—review and editing, M.Z., M.C.S.J. and H.C.; funding acquisition, R.S., M.C.S.J. and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by research funding from the Centers for Disease Control and Prevention (CDC) and National Institute for Occupational Safety and Health (NIOSH, Grant No. R21OH011208-01-00) and through the Deep South Center for Occupational Health and Safety at the University of Alabama-Birmingham (UAB) and Auburn University (Grant No. T42OH008436). The findings and conclusions are those of the authors and do not necessarily represent the views of the CDC or NIOSH.

Institutional Review Board Statement

This study was approved by the Institutional Review Board of Auburn University (Protocol No. 16-211 MR 1606).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are contained within the article and Supplementary Materials.

Acknowledgments

The authors gratefully acknowledge assistance with data collection from Nathan Pool, Dania Bani Hani, and Rong Huangfu.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

Table A1. Summary of measures of the force estimates for both motion capture systems.
Table A1. Summary of measures of the force estimates for both motion capture systems.
Summary MeasurePeak OMC LiftPeak IMC LiftPeak OMC LowerPeak IMC LowerRMSE LiftRMSE
Lower
Force PD (N)
Mean2798.521823.362644.291741.59544.66556.86
SD666.71433.61614.82391.68156.83161.03
Max4864.023010.834262.282773.24871.70920.28
Min1623.871063.771354.51917.27224.15161.26
25th percentile2279.241516.672214.721448.62420.45436.55
50th percentile2708.361759.612628.071722.28524.98546.58
75th percentile3195.152096.702963.761969.03648.16684.75
90th percentile3651.782435.743524.452232.75773.54756.67
Force AP (N)
Mean944.99653.22898.91624.99147.83154.68
SD233.66152.72216.34136.6951.0651.28
Max1684.011103.531524.13989.27284.40293.85
Min532.51393.01485.71354.0547.0639.49
25th percentile770.15549.01742.61532.08109.62121.24
50th percentile920.16627.84887.49600.62144.97149.71
75th percentile1116.86750.221032.33715.50178.16187.52
90th percentile1266.48866.291214.76807.75223.52225.44
Table A2. Summary of measures of the joint angles estimates for both motion capture systems.
Table A2. Summary of measures of the joint angles estimates for both motion capture systems.
Summary MeasurePeak OMC LiftPeak IMC LiftPeak OMC LowerPeak IMC LowerRMSE LiftRMSE Lower
Joint Angles (Degrees)
Flexion or Extension Angle
Mean62.6244.6463.6846.5210.9211.19
SD10.6410.3411.2810.624.794.90
Max81.9163.4786.5765.0228.1828.55
Min39.7716.2736.9315.533.732.45
25th percentile54.4037.8357.3839.227.077.53
50th percentile64.2946.0264.8647.5510.2110.69
75th percentile71.7652.3072.3254.0913.1412.99
90th percentile74.7756.9475.2760.1416.8618.14
Lateral Bending Angle
Mean9.888.909.958.454.194.16
SD5.114.094.763.862.122.16
Max27.8320.8125.6118.2711.4211.33
Min3.082.613.032.571.040.93
25th percentile6.565.666.625.592.752.61
50th percentile8.788.249.088.223.703.74
75th percentile10.9611.1811.6310.415.015.17
90th percentile16.9415.1216.3313.937.217.24
Rotation Angle
Mean9.1114.628.7614.955.936.07
SD4.416.514.237.213.192.97
Max22.2436.4423.0435.7816.3113.86
Min2.234.912.563.770.951.02
25th percentile6.119.805.469.213.613.93
50th percentile7.7414.017.8013.455.055.65
75th percentile11.5118.8011.4119.167.547.77
90th percentile14.5822.0914.5823.889.6710.22

References

  1. Luckhaupt, S.E.; Dahlhamer, J.M.; Gonzales, G.T.; Lu, M.-L.; Groenewold, M.; Sweeney, M.H.; Ward, B.W. Prevalence, recognition of work-relatedness, and effect on work of low back pain among U.S. workers. Ann. Intern. Med. 2019, 171, 301–304. [Google Scholar] [CrossRef]
  2. Wilke, H.J.; Neef, P.; Hinz, B.; Seidel, H.; Claes, L. Intradiscal pressure together with anthropometric data—A data set for the validation of models. Clin. Biomech. 2001, 16, S111–S126. [Google Scholar] [CrossRef]
  3. Adams, M.A.; Dolan, P. Spine biomechanics. J. Biomech. 2005, 38, 1972–1983. [Google Scholar] [CrossRef] [PubMed]
  4. Van Dieën, J.H.; Weinans, H.; Toussaint, H.M. Fractures of the lumbar vertebral endplate in the etiology of low back pain: A hypothesis on the causative role of spinal compression in aspecific low back pain. Med. Hypotheses 1999, 53, 246–252. [Google Scholar] [CrossRef] [PubMed]
  5. Waters, T.R.; Putz-Anderson, V.; Garg, A.; Fine, L.J. Revised NIOSH equation for the design and evaluation of manual lifting tasks. Ergonomics 1993, 36, 749–776. [Google Scholar] [CrossRef] [PubMed]
  6. Gallagher, S.; Marras, W.S. Tolerance of the lumbar spine to shear: A review and recommended exposure limits. Clin. Biomech. 2012, 27, 973–978. [Google Scholar] [CrossRef] [PubMed]
  7. Marras, W.S.; Davis, K.G.; Kirking, B.C.; Bertsche, P.K. A comprehensive analysis of low-back disorder risk and spinal loading during the transferring and repositioning of patients using different techniques. Ergonomics 1999, 42, 904–926. [Google Scholar] [CrossRef] [PubMed]
  8. Marras, W.S.; Davis, K.G. Spine loading during asymmetric lifting using one versus two hands. Ergonomics 1998, 41, 817–834. [Google Scholar] [CrossRef] [PubMed]
  9. Faber, G.S.; Kingma, I.; van Dieën, J.H. Effect of initial horizontal object position on peak L5/S1 moments in manual lifting is dependent on task type and familiarity with alternative lifting strategies. Ergonomics 2011, 54, 72–81. [Google Scholar] [CrossRef]
  10. Damsgaard, M.; Rasmussen, J.; Christensen, S.T.; Surma, E.; de Zee, M. Analysis of musculoskeletal systems in the AnyBody Modeling System. Simul. Model. Pract. Theory 2006, 14, 1100–1111. [Google Scholar] [CrossRef]
  11. Delp, S.L.; Anderson, F.C.; Arnold, A.S.; Loan, P.; Habib, A.; John, C.T.; Guendelman, E.; Thelen, D.G. OpenSim: Open-source software to create and analyze dynamic simulations of movement. IEEE Trans. Biomed. Eng. 2007, 54, 1940–1950. [Google Scholar] [CrossRef]
  12. Lerchl, T.; Nispel, K.; Baum, T.; Bodden, J.; Senner, V.; Kirschke, J.S. Multibody Models of the Thoracolumbar Spine: A Review on Applications, Limitations, and Challenges. Bioengineering 2023, 10, 202. [Google Scholar] [CrossRef]
  13. Wu, G.; Van Der Helm, F.C.; Veeger, H.E.J.; Makhsous, M.; Van Roy, P.; Anglin, C.; Nagels, J.; Karduna, A.R.; McQuade, K.; Wang, X.; et al. ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion—Part II: Shoulder, elbow, wrist and hand. J. Biomech. 2005, 38, 981–992. [Google Scholar] [CrossRef]
  14. Wu, G.; Siegler, S.; Allard, P.; Kirtley, C.; Leardini, A.; Rosenbaum, D.; Whittle, M.; D’Lima, D.D.; Cristofolini, L.; Witte, H.; et al. ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion—Part I: Ankle, hip, and spine. J. Biomech. 2002, 35, 543–548. [Google Scholar] [CrossRef]
  15. Lee, C.J.; Lee, J.K. Inertial Motion Capture-Based Wearable Systems for Estimation of Joint Kinetics: A Systematic Review. Sensors 2022, 22, 2507. [Google Scholar] [CrossRef]
  16. Freitag, S.; Ellegast, R.; Dulon, M.; Nienhaus, A. Quantitative Measurement of Stressful Trunk Postures in Nursing Professions. Ann. Occup. Hyg. 2007, 51, 385–395. [Google Scholar] [CrossRef] [PubMed]
  17. Marras, W.S.; Lavender, S.A.; Ferguson, S.A.; Splittstoesser, R.E.; Yang, G.; Schabo, P. Instrumentation for measuring dynamic spinal load moment exposures in the workplace. J. Electromyogr. Kinesiol. 2010, 20, 1–9. [Google Scholar] [CrossRef] [PubMed]
  18. Schall, M.C.; Chen, H.; Cavuoto, L. Wearable inertial sensors for objective kinematic assessments: A brief overview. J. Occup. Environ. Hyg. 2022, 19, 501–508. [Google Scholar] [CrossRef] [PubMed]
  19. Chang, R.P.; Smith, A.; Kent, P.; Saraceni, N.; Hancock, M.; O’sullivan, P.B.; Campbell, A. Concurrent validity of DorsaVi wireless motion sensor system Version 6 and the Vicon motion analysis system during lifting. BMC Musculoskelet. Disord. 2022, 23, 909. [Google Scholar] [CrossRef] [PubMed]
  20. Larsen, F.G.; Svenningsen, F.P.; Andersen, M.S.; de Zee, M.; Skals, S. Estimation of Spinal Loading During Manual Materials Handling Using Inertial Motion Capture. Ann. Biomed. Eng. 2020, 48, 805–821. [Google Scholar] [CrossRef]
  21. Paulich, M.; Schepers, M.; Rudigkeit, N.; Bellusci, G. Xsens MTw Awinda: Miniature Wireless Inertial-Magnetic Motion Tracker for Highly Accurate 3D Kinematic Applications; Xsens: Enschede, The Netherlands, 2018; pp. 1–9. [Google Scholar] [CrossRef]
  22. Fleron, M.K.; Ubbesen, N.C.H.; Battistella, F.; Dejtiar, D.L.; Oliveira, A.S. Accuracy between optical and inertial motion capture systems for assessing trunk speed during preferred gait and transition periods. Sport. Biomech. 2019, 18, 366–377. [Google Scholar] [CrossRef] [PubMed]
  23. Bolink, S.A.A.N.; Naisas, H.; Senden, R.; Essers, H.; Heyligers, I.; Meijer, K.; Grimm, B. Validity of an inertial measurement unit to assess pelvic orientation angles during gait, sit-stand transfers and step-up transfers: Comparison with an optoelectronic motion capture system. Med. Eng. Phys. 2016, 38, 225–231. [Google Scholar] [CrossRef]
  24. Schall, M.C.; Fethke, N.B.; Chen, H.; Oyama, S.; Douphrate, D.I. Accuracy and repeatability of an inertial measurement unit system for field-based occupational studies. Ergonomics 2016, 59, 591–602. [Google Scholar] [CrossRef]
  25. Nail-Ulloa, I.; Gallagher, S.; Huangfu, R.; Bani-Hani, D.; Pool, N. Validation of a Wireless Sensor System for the Estimation of Cumulative Lumbar Loads in Occupational Settings. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 2021, 65, 489–494. [Google Scholar] [CrossRef]
  26. Koopman, A.S.; Kingma, I.; Faber, G.S.; Bornmann, J.; van Dieën, J.H. Estimating the L5S1 flexion/extension moment in symmetrical lifting using a simplified ambulatory measurement system. J. Biomech. 2018, 70, 242–248. [Google Scholar] [CrossRef]
  27. Faber, G.S.; Kingma, I.; Chang, C.C.; Dennerlein, J.T.; van Dieën, J.H. Validation of a wearable system for 3D ambulatory L5/S1 moment assessment during manual lifting using instrumented shoes and an inertial sensor suit. J. Biomech. 2020, 102, 109671. [Google Scholar] [CrossRef]
  28. Faber, G.S.; Chang, C.C.; Kingma, I.; Dennerlein, J.T.; van Dieën, J.H. Estimating 3D L5/S1 moments and ground reaction forces during trunk bending using a full-body ambulatory inertial motion capture system. J. Biomech. 2016, 49, 904–912. [Google Scholar] [CrossRef] [PubMed]
  29. Schepers, M.; Giuberti, M.; Bellusci, G. Xsens MVN: Consistent Tracking of Human Motion Using Inertial Sensing; Xsens Technologies B.V.: Enschede, The Netherlands, 2018; pp. 1–8. [Google Scholar]
  30. Fluit, R.; Andersen, M.S.; Kolk, S.; Verdonschot, N.; Koopman, H.F.J.M. Prediction of ground reaction forces and moments during various activities of daily living. J. Biomech. 2014, 47, 2321–2329. [Google Scholar] [CrossRef] [PubMed]
  31. Skals, S.; Jung, M.K.; Damsgaard, M.; Andersen, M.S. Prediction of ground reaction forces and moments during sports-related movements. Multibody Syst. Dyn. 2017, 39, 175–195. [Google Scholar] [CrossRef]
  32. Konrath, J.; Karatsidis, A.; Schepers, H.; Bellusci, G.; de Zee, M.; Andersen, M. Estimation of the Knee Adduction Moment and Joint Contact Force during Daily Living Activities Using Inertial Motion Capture. Sensors 2019, 19, 1681. [Google Scholar] [CrossRef]
  33. Skals, S.; Bláfoss, R.; Andersen, L.L.; Andersen, M.S.; de Zee, M. Manual material handling in the supermarket sector. Part 2: Knee, spine and shoulder joint reaction forces. Appl. Ergon. 2021, 92, 103345. [Google Scholar] [CrossRef] [PubMed]
  34. Plamondon, A.; Larivière, C.; Delisle, A.; Denis, D.; Gagnon, D. Relative importance of expertise, lifting height and weight lifted on posture and lumbar external loading during a transfer task in manual material handling. Ergonomics 2012, 55, 87–102. [Google Scholar] [CrossRef] [PubMed]
  35. Granata, K.P.; Marras, W.S.; Davis, K.G. Variation in spinal load and trunk dynamics during repeated lifting exertions. Clin. Biomech. 1999, 14, 367–375. [Google Scholar] [CrossRef] [PubMed]
  36. Davis, K.G.; Kotowski, S.E.; Albers, J.; Marras, W.S. Investigating reduced bag weight as an effective risk mediator for mason tenders. Appl. Ergon. 2010, 41, 822–831. [Google Scholar] [CrossRef] [PubMed]
  37. Lavender, S.A.; Andersson, G.B.J.; Schipplein, O.D.; Fuentes, H.J. The effects of initial lifting height, load magnitude, and lifting speed on the peak dynamic L5/S1 moments. Int. J. Ind. Ergon. 2003, 31, 51–59. [Google Scholar] [CrossRef]
  38. Hoozemans, M.J.M.; Kingma, I.; de Vries, W.H.K.; van Dieën, J.H. Effect of lifting height and load mass on low back loading. Ergonomics 2008, 51, 1053–1063. [Google Scholar] [CrossRef]
  39. Faber, G.S.; Kingma, I.; Kuijer, P.P.; van der Molen, H.F.; Hoozemans, M.J.; Frings-Dresen, M.H.; van Dieën, J.H. Working height, block mass and one- vs. two-handed block handling: The contribution to low back and shoulder loading during masonry work. Ergonomics 2009, 52, 1104–1118. [Google Scholar] [CrossRef]
  40. Marras, W.S.; Davis, K.G.; Kirking, B.C.; Granata, K.P. Spine loading and trunk kinematics during team lifting. Ergonomics 1999, 42, 1258–1273. [Google Scholar] [CrossRef]
  41. Pheasant, S.; Haslegrave, C.M. Bodyspace: Anthropometry, Ergonomics and the Design of Work; CRC Press: Boca Raton, FL, USA, 2006. [Google Scholar] [CrossRef]
  42. Karatsidis, A.; Jung, M.; Schepers, H.M.; Bellusci, G.; de Zee, M.; Veltink, P.H.; Andersen, M.S. Musculoskeletal model-based inverse dynamic analysis under ambulatory conditions using inertial motion capture. Med. Eng. Phys. 2019, 65, 68–77. [Google Scholar] [CrossRef]
  43. Knapik, G.G.; Marras, W.S. Spine loading at different lumbar levels during pushing and pulling. Ergonomics 2009, 52, 60–70. [Google Scholar] [CrossRef]
  44. Kirk, R. Experimental Design: Procedures for the Behavioral Sciences; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2014. [Google Scholar] [CrossRef]
  45. Kirk, R.E. Practical significance: A concept whose time has come. Educ. Psychol. Meas. 1996, 56, 746–759. [Google Scholar] [CrossRef]
  46. Schall, M.C.; Zhang, X.; Chen, H.; Gallagher, S.; Fethke, N.B. Comparing upper arm and trunk kinematics between manufacturing workers performing predominantly cyclic and non-cyclic work tasks. Appl. Ergon. 2021, 93, 103356. [Google Scholar] [CrossRef] [PubMed]
  47. White, A.A.; Panjabi, M.M. Clinical Biomechanics of the Spine; JB Lippincott: Philadelphia, PA, USA, 1978. [Google Scholar]
  48. Plamondon, A.; Gagnon, M.; Desjardins, P. Validation of two 3-D segment models to calculate the net reaction forces and moments at the L5/S1 joint in lifting. Clin. Biomech. 1996, 11, 101–110. [Google Scholar] [CrossRef] [PubMed]
  49. Skals, S.; Bláfoss, R.; de Zee, M.; Andersen, L.L.; Andersen, M.S. Effects of load mass and position on the dynamic loading of the knees, shoulders and lumbar spine during lifting: A musculoskeletal modelling approach. Appl. Ergon. 2021, 96, 103491. [Google Scholar] [CrossRef] [PubMed]
  50. U.S. Department of Labor. Nonfatal Occupational Injuries and Illnesses Requiring Days away from Work, 2015. 2006. [Online]. 2016. Available online: www.bls.gov/iif/oshcdnew.htm (accessed on 1 June 2023).
  51. Dehghan, P.; Arjmand, N. The National Institute for Occupational Safety and Health (NIOSH) Recommended Weight Generates Different Spine Loads in Load-Handling Activity Performed Using Stoop, Semi-squat and Full-Squat Techniques; a Full-Body Musculoskeletal Model Study. Hum. Factors 2024, 66, 1387–1398. [Google Scholar] [CrossRef] [PubMed]
  52. Robert-Lachaine, X.; Mecheri, H.; Larue, C.; Plamondon, A. Effect of local magnetic field disturbances on inertial measurement units accuracy. Appl. Ergon. 2017, 63, 123–132. [Google Scholar] [CrossRef] [PubMed]
  53. Aurand, A.M.; Dufour, J.S.; Marras, W.S. Accuracy map of an optical motion capture system with 42 or 21 cameras in a large measurement volume. J. Biomech. 2017, 58, 237–240. [Google Scholar] [CrossRef]
  54. Robertson, G.; Caldwell, G.; Hamill, J.; Kamen, G.; Whittlesey, S. Research Methods in Biomechanics, 2nd ed.; Human Kinetics: Champaign, IL, USA, 2014. [Google Scholar]
  55. Riemer, R.; Hsiao-Wecksler, E.T.; Zhang, X. Uncertainties in inverse dynamics solutions: A comprehensive analysis and an application to gait. Gait Posture 2008, 27, 578–588. [Google Scholar] [CrossRef]
  56. Hatze, H. The fundamental problem of myoskeletal inverse dynamics and its implications. J. Biomech. 2002, 35, 109–115. [Google Scholar] [CrossRef]
Figure 1. Full-body participant set-up, adapted Plug-in Gait marker set, and IMU sensors, with regular markers (blue circles), additional markers (red circles), and IMU sensors (green squares).
Figure 1. Full-body participant set-up, adapted Plug-in Gait marker set, and IMU sensors, with regular markers (blue circles), additional markers (red circles), and IMU sensors (green squares).
Sensors 24 01941 g001
Figure 2. (left) OMC model avatar. (middle) Participant. (right) IMC model avatar.
Figure 2. (left) OMC model avatar. (middle) Participant. (right) IMC model avatar.
Sensors 24 01941 g002
Figure 3. Distance of box to spine illustration from Plug-in Gait model template in Anybody™.
Figure 3. Distance of box to spine illustration from Plug-in Gait model template in Anybody™.
Sensors 24 01941 g003
Figure 4. Compressive (PD) and shear (AP) forces during one of the lifting (A) and lowering (B) trials.
Figure 4. Compressive (PD) and shear (AP) forces during one of the lifting (A) and lowering (B) trials.
Sensors 24 01941 g004
Figure 5. Box plots for peak compressive force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks. Circles represent outliers.
Figure 5. Box plots for peak compressive force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks. Circles represent outliers.
Sensors 24 01941 g005
Figure 6. KDE plots for peak compressive force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Figure 6. KDE plots for peak compressive force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g006
Figure 7. Bland–Altman plots for OMC and IMC system peak compressive force estimates for the lifting (left) and lowering (right) tasks.
Figure 7. Bland–Altman plots for OMC and IMC system peak compressive force estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g007
Figure 8. Scatter plots for OMC and IMC systems’ peak compressive force estimates for the lifting (left) and lowering (right) tasks.
Figure 8. Scatter plots for OMC and IMC systems’ peak compressive force estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g008
Figure 9. Box plots for the RMSE of the compressive force for the OMC and IMC systems for the lifting and lowering tasks.
Figure 9. Box plots for the RMSE of the compressive force for the OMC and IMC systems for the lifting and lowering tasks.
Sensors 24 01941 g009
Figure 10. Box plots of peak compressive force differences between systems for the lifting and lowering tasks. Circles represent outliers.
Figure 10. Box plots of peak compressive force differences between systems for the lifting and lowering tasks. Circles represent outliers.
Sensors 24 01941 g010
Figure 11. Box plots for peak shear force for the OMC and IMC systems for the lifting (left) and lowering tasks (right). Circles represent outliers.
Figure 11. Box plots for peak shear force for the OMC and IMC systems for the lifting (left) and lowering tasks (right). Circles represent outliers.
Sensors 24 01941 g011
Figure 12. KDE plots for peak shear force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Figure 12. KDE plots for peak shear force for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g012
Figure 13. Bland–Altman plots for OMC and IMC system peak shear force estimates for the lifting (left) and lowering (right) tasks.
Figure 13. Bland–Altman plots for OMC and IMC system peak shear force estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g013
Figure 14. Scatter plots for OMC and IMC system peak shear force estimates for the lifting (left) and lowering (right) tasks.
Figure 14. Scatter plots for OMC and IMC system peak shear force estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g014
Figure 15. Box plots for the RMSE of the shear forces between systems for the lifting and lowering tasks. Circles represent outliers.
Figure 15. Box plots for the RMSE of the shear forces between systems for the lifting and lowering tasks. Circles represent outliers.
Sensors 24 01941 g015
Figure 16. Box plots for the peak flexion angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks. Circles represent outliers.
Figure 16. Box plots for the peak flexion angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks. Circles represent outliers.
Sensors 24 01941 g016
Figure 17. KDE plots for the peak flexion angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Figure 17. KDE plots for the peak flexion angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g017
Figure 18. Bland–Altman plots for the OMC and IMC system peak flexion angle estimates for the lifting (left) and lowering (right) tasks.
Figure 18. Bland–Altman plots for the OMC and IMC system peak flexion angle estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g018
Figure 19. Box plots for the peak lateral bending angle for the OMC and IMC systems for the lifting (left) and lowering tasks (right). Circles represent outliers.
Figure 19. Box plots for the peak lateral bending angle for the OMC and IMC systems for the lifting (left) and lowering tasks (right). Circles represent outliers.
Sensors 24 01941 g019
Figure 20. KDE plots for the peak lateral bending angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Figure 20. KDE plots for the peak lateral bending angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g020
Figure 21. Bland–Altman plots for the OMC and IMC system peak lateral bending angle estimates for the lifting (left) and lowering (right) tasks.
Figure 21. Bland–Altman plots for the OMC and IMC system peak lateral bending angle estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g021
Figure 22. Box plots of the peak rotation angle for the OMC and IMC systems for the lifting and lowering tasks. Circles represent outliers.
Figure 22. Box plots of the peak rotation angle for the OMC and IMC systems for the lifting and lowering tasks. Circles represent outliers.
Sensors 24 01941 g022
Figure 23. KDE plots for the peak rotation angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Figure 23. KDE plots for the peak rotation angle for the OMC and IMC systems for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g023
Figure 24. Bland–Altman plots for the OMC and IMC system peak rotation angle estimates for the lifting (left) and lowering (right) tasks.
Figure 24. Bland–Altman plots for the OMC and IMC system peak rotation angle estimates for the lifting (left) and lowering (right) tasks.
Sensors 24 01941 g024
Figure 25. Box plots of the peak distance differences at peak force for the OMC and IMC systems for the lifting and lowering tasks. Diamonds represent outliers.
Figure 25. Box plots of the peak distance differences at peak force for the OMC and IMC systems for the lifting and lowering tasks. Diamonds represent outliers.
Sensors 24 01941 g025
Table 1. Summary of participants’ anthropometry.
Table 1. Summary of participants’ anthropometry.
Body Weight (kg)Body Height (cm)Shoe Length (cm)Ankle Height (cm)Ankle Width (cm)Knee Height (cm)Knee Width (cm)Elbow Width (cm)Shoulder Width (cm)Shoulder Height (cm)Hip Height (cm)Hip Width (cm)Arm Span (cm)
Mean72.78173.5425.068.727.9246.9610.848.4234.28142.0590.8824.53172.09
SD12.17.51.310.06.89.86.510.13.36.88.92.09.1
Table 2. Summary of the differences in peak distance estimates for both motion capture systems.
Table 2. Summary of the differences in peak distance estimates for both motion capture systems.
Summary MeasureX OMC-IMC LiftZ OMC-IMC LiftY OMC-IMC LiftX OMC-IMC LowerZ OMC-IMC LowerY OMC-IMC Lower
Differences in Spine-to-Load Distance (m)
Mean0.080.120.030.080.130.04
SD0.050.070.030.050.070.04
Max0.270.340.170.280.350.17
Min0.000.000.000.000.000.00
25th percentile0.040.070.010.040.070.01
50th percentile0.070.110.030.070.120.03
75th percentile0.110.160.040.110.170.05
90th percentile0.150.210.070.150.220.08
Table 3. ANOVA results testing the effects of the load (A), angle (B), height (C), and interactions for the compressive and shear forces at L5-S1 during the lifting tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
Table 3. ANOVA results testing the effects of the load (A), angle (B), height (C), and interactions for the compressive and shear forces at L5-S1 during the lifting tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
LiftingPeak OMCPeak IMCRMSE between SystemsPeak Difference
Factorsp ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2
Force PD
Groups <0.0010.544<0.0010.5510.0490.1380.0050.262
(A) Load<0.0010.938<0.0010.873<0.0010.614<0.0010.767
(B) Angle0.1170.0070.2800.0020.2160.0050.1210.021
(C) Height0.499<0.0010.994<0.001<0.0010.2340.3830.000
A × B0.570<0.0010.0620.0220.1460.0140.1200.032
A × C0.974<0.0010.1220.0140.2580.0070.496<0.001
B × C0.404<0.0010.802<0.0010.1440.0140.57<0.001
A × B × C0.819<0.0010.4200.0010.639<0.0010.874<0.001
Force AP
Groups <0.0010.518<0.0010.4770.0170.197<0.0010.397
(A) Load<0.0010.916<0.0010.868<0.0010.576<0.0010.576
(B) Angle0.399<0.0010.814<0.0010.1550.0100.0790.041
(C) Height0.2820.0020.994<0.001<0.0010.2590.1210.029
A × B0.864<0.0010.764<0.0010.574<0.0010.984<0.001
A × C0.827<0.0010.0470.0350.220.0110.1720.033
B × C0.0990.0150.3850.0010.2770.0070.3620.006
A × B × C0.636<0.0010.796<0.0010.528<0.0010.2520.032
Table 4. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for the compressive and shear forces at L5-S1 during the lowering tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
Table 4. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for the compressive and shear forces at L5-S1 during the lowering tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
LoweringPeak OMCPeak IMCRMSE between SystemsPeak Difference
Factorsp ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2
Force PD
Groups <0.0010.475<0.0010.4270.0110.2170.020.187
(A) Load<0.0010.826<0.0010.934<0.0010.630<0.0010.836
(B) Angle0.2690.0040.586<0.0010.454<0.0010.922<0.001
(C) Height0.848<0.0010.688<0.001<0.0010.1250.926<0.001
A × B0.2740.0080.0770.0120.0510.0350.2360.019
A × C0.541<0.0010.370.0010.2490.0090.936<0.001
B × C0.695<0.0010.3490.0010.0780.0280.86<0.001
A × B × C0.1830.0240.721<0.0010.1800.0230.848<0.001
Force AP
Groups <0.0010.457<0.0010.4280.0020.296<0.0010.386
(A) Load<0.0010.928<0.0010.875<0.0010.628<0.0010.698
(B) Angle0.655<0.0010.518<0.0010.604<0.0010.758<0.001
(C) Height0.574<0.0010.861<0.0010.0010.1040.913<0.001
A × B0.2500.0050.3560.0030.3770.0020.757<0.001
A × C0.3640.0010.576<0.0010.1210.0250.72<0.001
B × C0.3160.0030.407<0.0010.0780.0330.766<0.001
A × B × C0.913<0.0010.669<0.0010.1430.0340.712<0.001
Table 5. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for joint angles during the lifting tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
Table 5. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for joint angles during the lifting tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
LiftingPeak OMCPeak IMCRMSE between SystemsPeak Difference
Factorsp ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2
Flexion or Extension
Groups <0.0010.392<0.0010.3690.546<0.0010.783<0.001
(A) Load0.0630.0910.0280.1270.675<0.0010.886<0.001
(B) Angle0.0030.2610.0140.1630.578<0.0010.803<0.001
(C) Height0.435<0.0010.0510.0960.994<0.0010.449<0.001
A × B0.3850.0060.880<0.0010.2790.0540.2220.096
A × C0.676<0.0010.2880.0260.3460.0250.477<0.001
B × C0.2500.0370.557<0.0010.455<0.0010.811<0.001
A × B × C0.3780.0200.2110.0750.564<0.0010.661<0.001
Lateral Bending
Groups 0.140.0740.674<0.0010.776<0.0010.2510.035
(A) Load0.0930.0390.733<0.0010.3390.0130.1080.080
(B) Angle<0.0010.626<0.0010.7310.715<0.0010.804<0.001
(C) Height0.549<0.0010.979<0.0010.493<0.0010.574<0.001
A × B0.415<0.0010.455<0.0010.578<0.0010.1320.104
A × C0.1420.0420.680<0.0010.933<0.0010.1840.075
B × C0.788<0.0010.3730.0040.601<0.0010.2060.064
A × B × C0.547<0.0010.2650.0270.755<0.0010.632<0.001
Rotation
Groups 0.672<0.001<0.0010.4400.2400.038<0.0010.478
(A) Load0.420<0.0010.558<0.0010.1240.0970.230.027
(B) Angle<0.0010.7756<0.0010.8020.475<0.0010.0710.096
(C) Height0.0080.08160.785<0.0010.600<0.0010.0180.180
A × B0.970<0.0010.4090.0010.784<0.0010.469<0.001
A × C0.909<0.0010.961<0.0010.471<0.0010.847<0.001
B × C0.650<0.0010.633<0.0010.500<0.0010.871<0.001
A × B × C0.824<0.0010.3110.0160.464<0.0010.1410.134
Table 6. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for joint angles during the lowering tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
Table 6. ANOVA results testing the effects of load (A), angle (B), height (C), and interactions for joint angles during the lowering tasks. Significant effects (p < 0.05) are indicated in bold and italics. Large effect sizes (ω2 > 0.14) are indicated in bold.
LoweringPeak OMCPeak IMCRMSE between SystemsPeak Difference
Factorsp ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2 p ValueEffect Size ω2
Flexion or Extension
Groups <0.0010.361<0.0010.3790.494<0.0010.755<0.001
(A) Load0.1110.0930.0760.0940.542<0.0010.851<0.001
(B) Angle0.1560.0660.1180.0670.899<0.0010.412<0.001
(C) Height0.614<0.0010.0170.1870.694<0.0010.0020.369
A × B0.760<0.0010.753<0.0010.4120.0020.1560.091
A × C0.3790.0110.2250.0520.686<0.0010.867<0.001
B × C0.573<0.0010.504<0.0010.502<0.0010.422<0.001
A × B × C0.3940.0230.677−0.0620.715<0.0010.894<0.001
Lateral Bending
Groups 0.3430.0120.992<0.0010.728<0.0010.2570.033
(A) Load0.0200.0660.971<0.0010.438<0.0010.1390.106
(B) Angle<0.0010.654<0.0010.7090.641<0.0010.769<0.001
(C) Height0.517<0.0010.620<0.0010.461<0.0010.702<0.001
A × B0.3820.0030.776<0.0010.592<0.0010.422<0.001
A × C0.1660.0280.3700.0050.843<0.0010.774<0.001
B × C0.3910.0020.3630.0050.674<0.0010.3670.020
A × B × C0.634<0.0010.3550.0140.677<0.0010.897<0.001
Rotation
Groups 0.2020.0497<0.0010.3730.2380.039<0.0010.460
(A) Load0.1580.02460.505<0.0010.1280.0860.0490.087
(B) Angle<0.0010.7390<0.0010.8760.1300.085<0.0010.463
(C) Height0.1670.02310.929<0.0010.589<0.0010.501<0.001
A × B0.939<0.0010.3430.0040.921<0.0010.700<0.001
A × C0.942<0.0010.932<0.0010.637<0.0010.776<0.001
B × C0.633<0.0010.651<0.0010.537<0.0010.621<0.001
A × B × C0.775<0.0010.728<0.0010.336<0.0010.2910.040
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nail-Ulloa, I.; Zabala, M.; Sesek, R.; Chen, H.; Schall, M.C., Jr.; Gallagher, S. Estimating Compressive and Shear Forces at L5-S1: Exploring the Effects of Load Weight, Asymmetry, and Height Using Optical and Inertial Motion Capture Systems. Sensors 2024, 24, 1941. https://doi.org/10.3390/s24061941

AMA Style

Nail-Ulloa I, Zabala M, Sesek R, Chen H, Schall MC Jr., Gallagher S. Estimating Compressive and Shear Forces at L5-S1: Exploring the Effects of Load Weight, Asymmetry, and Height Using Optical and Inertial Motion Capture Systems. Sensors. 2024; 24(6):1941. https://doi.org/10.3390/s24061941

Chicago/Turabian Style

Nail-Ulloa, Iván, Michael Zabala, Richard Sesek, Howard Chen, Mark C. Schall, Jr., and Sean Gallagher. 2024. "Estimating Compressive and Shear Forces at L5-S1: Exploring the Effects of Load Weight, Asymmetry, and Height Using Optical and Inertial Motion Capture Systems" Sensors 24, no. 6: 1941. https://doi.org/10.3390/s24061941

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop