Next Article in Journal
FFPE-Based NGS Approaches into Clinical Practice: The Limits of Glory from a Pathologist Viewpoint
Next Article in Special Issue
Maritime Telemedicine: Design and Development of an Advanced Healthcare System Called Marine Doctor
Previous Article in Journal
Appendiceal Orifice Inflammation Is Associated with Lower Rate of Complete Endoscopic Remission in Patients with Ulcerative Colitis
Previous Article in Special Issue
Efficacy of Telemedicine and At-Home Telemonitoring following Hospital Discharge in Patients with COVID-19
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliability Study of Inertial Sensors LIS2DH12 Compared to ActiGraph GT9X: Based on Free Code

by
Jaime Martín-Martín
1,2,†,
Ariadna Jiménez-Partinen
3,†,
Irene De-Torres
1,4,
Adrian Escriche-Escuder
1,5,
Manuel González-Sánchez
1,5,
Antonio Muro-Culebras
1,5,
Cristina Roldán-Jiménez
1,5,
María Ruiz-Muñoz
1,6,
Fermín Mayoral-Cleries
1,7,
Attila Biró
8,
Wen Tang
9,
Borjanka Nikolova
10,
Alfredo Salvatore
11 and
Antonio I. Cuesta-Vargas
1,5,12,*
1
Biomedical Research Institute of Málaga (IBIMA), 29010 Málaga, Spain
2
Legal and Forensic Medicine Area, Department of Human Anatomy, Legal Medicine and History of Science, Faculty of Medicine, University of Málaga, 29071 Málaga, Spain
3
Department of Computer Science and Programming Languages, Higher Technical School of Computer Engineering, University of Málaga, 29071 Málaga, Spain
4
Physical Medicine and Rehabilitation Unit, Regional Universitary Hospital of Málaga, 29010 Málaga, Spain
5
Department of Physiotherapy, University of Málaga, 29071 Málaga, Spain
6
Department of Nursing and Podiatry, University of Málaga, 29071 Málaga, Spain
7
Mental Health Unit, Regional Universitary Hospital of Málaga, 29010 Málaga, Spain
8
ITWare, 1117 Budapest, Hungary
9
Faculty of Science and Technology, Bournemouth University, Bournemouth BH12 5BB, UK
10
Arthaus, Production Trade and Service Company Arthaus Doo Import-Export Skopje, 1000 Skopje, North Macedonia
11
Sensor ID Snc., 86021 Boiano, Italy
12
School of Clinical Science, Faculty of Health Science, Queensland University Technology, Brisbane 4000, Australia
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Pers. Med. 2022, 12(5), 749; https://doi.org/10.3390/jpm12050749
Submission received: 5 April 2022 / Revised: 28 April 2022 / Accepted: 3 May 2022 / Published: 5 May 2022

Abstract

:
The study’s purpose was to assess the reliability of the LIS2DH12 in two different positions, using the commercial sensor Actigraph GT9X as a reference instrument. Five participants completed two gait tests on a treadmill. Firstly, both sensors were worn on the wrist and around the thigh. Each test consisted of a 1 min walk for participants to become accustomed to the treadmill, followed by a 2 min trial at ten pre-set speeds. Data from both sensors were collected in real-time. Intraclass correlation coefficient (ICC) was used to evaluate the equality of characteristics obtained by both sensors: maximum peaks, minimum peaks, and the mean of the complete signal (sequence of acceleration values along the time) by each axis and speed were extracted to evaluate the equality of characteristics obtained with LIS2DH12 compared to Actigraph. Intraclass correlation coefficient (ICC) was extracted, and a standard deviation of the mean was obtained from the data. Our results show that LIS2DH12 measurements present more reliability than Actigraph GT9X, ICC > 0.8 at three axes. This study concludes that LIS2DH12 is as reliable and accurate as Actigraph GT9X Link and, therefore, would be a suitable tool for future kinematic studies.

1. Introduction

Inertial Measurement Units (IMUs) are equipped with an accelerometer that measures linear accelerations and a gyroscope that measures the angular velocity of the device recorded in the three directions of space [1]. Furthermore, some of them also include a magnetometer (measure the direction or strength); an angular rate and gravity (MARG) sensor module for measuring 3 degrees of freedom orientations in real-time [2]. These systems are validated against 3D movement capture devices [3]. Its use is extended to the analysis of human movement [4]. These devices have been used in the health field to validate symptoms of patients who have Parkinson’s disease [5], and the physical activity of patients in a wheelchair have been quantified [6] to calculate energetic waste [7]. Furthermore, sensors have been used as a rehabilitation instrument accompanied by other peripheral devices [8].
There is an extensive range of commercially available devices, but not all are validated and suitable for recording human motion [9]. The reliability of the obtained data is influenced by the sensor’s accuracy, the components that enclose the sensor, the position of the sensor, and the data processing [10,11]. The reliability evaluation should be applied to protocols, which can be reproduced later [12,13]. In this regard, Actigraph GT3X (Pensacola, FL, USA) [14] is one of the most used widely used thanks to its demonstrated reliability and straightforward operation [15].
Actigraph (ActiGraph LLC., Pensacola, FL, USA) is one of the leading commercially available devices [15]. It has been used as a reference to validate other devices, such as activity monitors, to determine physical activity [16]. Likewise, activPAL was compared to measure children’s sedentary behaviour aged 2–3 years [17]. Additionally, Actigraph was used relative to FitbitZip to measure steps made by patients suffering rheumatic polymyalgia [18]. In every case, results were derived from the pre-processed device’s data and not from the raw data extracted by the sensor.
There are currently reliable, low-cost devices (below $50) and validated alternatives to record steps made and physical activity [19]. The LIS2DH12 (STMicroelectronics; Shanghai, China) chip is an ultralow consumption, a high-performance accelerometer that records in three axes of space [20] and is compatible with Arduino systems [21]. LIS2DH12 is a novel sensor that has not been used in previous studies. Validating the device will make it useful for specific future applications like kinematic analysis or activity tracker. The advantage of the device, once validated, is a low cost and low consumption sensor that would allow the free design of third-party applications, unlike commercial sensors. Its acceleration measurements have not been compared with other reference devices, such as Actigraph, to evaluate the reliability of its measurements.
Therefore, this study aimed to assess the reliability of the chipset LIS2DH12 relative to the internal accelerometer of Actigraph GT9X Link as an instrument to measure accelerations produced during human movements.

2. Materials and Methods

The present study is based on a reliability study of inertial sensor Lis2DH12 chipset (“STMicroelectronics”) (equipped on a SensorID device), compared with the measurements given by the commercial device Actigraph GT9X Link (“ActiGraph Link|ActiGraph”). Actigraph GT9X Link is reliable to assess sedentary behavior and physical activity based on raw data or energy expenditure [22,23]. To obtained data, the selected movement was the gait. A protocol of increasing walking/running speeds, recorded on a treadmill, was used.

2.1. Equipment

The LIS2DH12 inertial sensor has a sampling frequency of 1 Hz to 5.3 kHz. The sensor measures the acceleration in three axes (X, Y, Z) with a values range of ±16 g. The sensor is assembled on a mainboard designed by SensorID (“Sensor ID-Proximity Wireless Technologies Made in Italy”). The device’s size is a circumference with a radius of 4.5 cm and 1 cm thick. The software was designed by SensorID, with a preset sampling frequency of 30 Hz to record the data. The data were extracted directly in raw format. This software captures sensor data in m/s2 and mg (gravitational unit value) units. The sensor signs the gravitational acceleration of Earth (9.8 m/s2). The data captured by the sensor are sent to the computer in real-time by a 5.0 Bluetooth protocol.
Actigraph GT9X Link has a sampling frequency range of 30 Hz to 100 Hz with a range of ±16 g. The dimensions of the device are 3.5 × 3.5 × 1 cm. Actigraph is available to provide actionable data on a scale of 0 to 15,000 count/min. The sensor data are recorded in the internal memory and later transferred to the computer via a micro-USB. The data used, which Actigraph GT9X Link gives, are the raw data from accelerations measured during the movement. The movement chosen was the human gait.

2.2. Data Collection

The clocks of both sensors were synchronized with the computer’s clock to ensure simultaneous recording. Both sensors were calibrated before starting to measure, placing both sensors on the same smooth surface. Two experimental setups/device locations were explored during the study. In one of them, both sensors (Actigraph GT9X Link and LIS2DH12) were placed simultaneously (both sensors overlapping) on the participant’s right wrist. Actigraph GT9X Link was used with its wristwatch accessory, with LIS2DH12 positioned with a stretchable belt.
In the second set, both sensors were placed on the participant’s thigh using a stretchable belt. This second set was carried out after the first one had finished evaluating validation at both positions. Both positions were chosen because the main objective was to collect data which could be compared. Therefore, the wrist and thigh are a good option, given that they have easy access and handling.
Five healthy adults participated in the reliability study. Two tests were carried out, each of 20 min in total; this sample size gives a large amount of data because it is a record of 200 min with a sampling frequency of 30 Hz, recording approximately 360,000 values. Actigraph GT9X Link and LIS2DH12 were placed on the right wrist and thigh, not simultaneously. The participant wore sportswear, adequate footwear, and short sleeves. Data were collected while walking and running at different speeds on a treadmill, with each wrist and thigh position evaluated separately. For each of the speeds, ten measurements were obtained with the two sensors together (five on the wrist and five on the thigh). This assumes a Confidence Level of 80% and a margin of error of 21%.
The predetermined speeds were: 1.4 km/h, 2.9 km/h, 4.3 km/h, 5 km/h, 6 km/h, 6.5 km/h, 7.0 km/h, 8.0 km/h, 9.0 km/h and 10.0 km/h. These speeds were representative a range of different subject types: subjects who were dependent, hospitalized, needing rehabilitation, discharged, regular patients and healthy subjects [24]. Participants started walking on the treadmill at a pre-set speed for one minute to adapt to rhythm, subsequently starting the recording of measured data for two minutes. Each speed for walking and running was measured separately for two minutes. Participants were asked to carry out natural movements.

2.3. Data Processing

The spatial reference system of sensor LIS2DH12 was adapted to the spatial reference system of Actigraph GT9X Link. If the spatial reference system of Actigraph GT9X Link is set as our reference system, the axes of LIS2DH12 coincide with Actigraph GT9X Link as showed in Figure 1: x-axis of LIS2DH12 is equal to z-axis of Actigraph GT9X Link, y-axis of LIS2DH12 coincides with the x-axis of Actigraph GT9X Link, and z-axis of LIS2DH12 is equivalent to y-axis of Actigraph GT9X Link (Figure 1). The orientation in repose was analyzed, and then both sensors were always put in the same position. The change of basis matrix (RL,A), which can be used to transform data from one reference frame to the other, is provided below:
R L , A =   [ 0 1 0 0 0 1 1 0 0 ] R L , A 1 = R A , L =   [ 0 0 1 1 0 0 0 1 0 ]
Actigraph GT9X Link reference system R A , L R L , A LIS2DH12 reference system.
Data processing was carried out with RStudio software version 1.2.5033, under R 3.6.2 (R Project, 2002). The codes generated for analysis can be seen in Appendix A.
One hundred files (five participants, ten speeds, and two positions to validate) in “.csv” format, belonging to Actigraph GT9X Link sensor, and another one hundred from LIS2DH12 were processed for analysis. One file was defective because it was recorded erroneously, meaning the file from the second subject at 1.4 km/h from Actigraph GT9X Link was rejected, along with its counterpart from LIS2DH12. Therefore, 198 files were analyzed in total.
Files were read with R and adapted so the formats of both sensors were the same. LIS2DH12 records the acceleration in thousandths of g-force (mg), and Actigraph GT9X Link uses g-force (g) units. Acceleration units were converted into multiples of g to enable comparison.
Two functions were designed to import data from different signed subjects to R (readSensorIdData() y readActigraphData(), Appendix A). Afterwards, 198 files were read to collect in “RData” format for subsequent use (Figure 2).
Comparison tables were drafted based on the data collected in R.
Both sensors were configured to have a sampling frequency of 30 Hz, with two minutes of gait test equivalent to 3600 samples, but there was a loss of around 50 random samples in data from LIS2DH12, due to the transmission of data by Bluetooth. Two recorded signals of both sensors are shown in Figure 2, where the gap between signals is not homogeneous throughout the entire signal, but first, they are shifted, then they are overlapped and shifted again. This fact occurs at all the times recorded. Therefore, comparison sample-by-sample was not possible, meaning that we had to compare both recorded signals using the mean of the relevant features.
After the process, the features/measurements of interest extracted from the data were the mean of maximum peaks, mean of minimum peaks (valleys), and signal mean extracted from each axis and sensor.
A predefined function of R: findpeaks() [25] was used to extract the maximum and minimum peaks of the signal, straightaway we calculated, using the mean() function, the mean of these peaks and the mean of the signal. In total, eighteen columns were obtained to compare each one (nine from the LIS2DH12 sensor and 9 from Actigraph GT9X Link).

2.4. Statistical Analysis

A statistical analysis was carried out in RStudio software with version 1.2.5033, under R 3.6.2. The intraclass correlation coefficient (ICC) was calculated to determine the reliability of LIS2DH12 compared to Actigraph GT9X Link. A descriptive analysis (mean and standard deviation) was developed.
Variability is reflected by standard deviation, allowing quantification of their differences; if dataset´s the standard deviation is a low value (relative to mean), the data are more similar. If it is equal to zero, the samples are identical.
ICC analysis allowed quantification of the variance between measurements of phenomena measured with different raters (in this case, two instruments, Actigraph GT9X Link and LIS2DH12). ICC values can fluctuate between 0 and 1, with 0 indicating that these measurements are not in agreement and 1 that these measurements are reliable. These values may be interpreted as excellent reliability if ICC ≥ 0.75, ICC between 0.4 and 0.74 indicates fair-to-high reliability, and ICC ≤ 0.39 is interpreted as poor reliability [26]. ICC was calculated with a level of significance of 0.05 and a confidence interval of 95%, a “two-way” model, because in this assay, each subject was measured by the same set of known raters, that is, Actigraph GT9X Link and LIS2DH12, considering subjects and rater’s random effects [27]. Absolute agreement analysis was used; as the study concerns if different raters assign the same score to the same subject. This agreement had two options type: “single measurements” and “average measurements”, depending on calculating the reliability by taking single measurements or whether calculating the average of the measurements from multiple raters [26,28].
The statistical analysis was applied to the features/measurements of interest: the mean of the maximum peaks, the mean of minimum peaks and the signal´s mean, recorded in each of the three axes (18 in total).
ICC was calculated by each measurement from both sensors, e.g., the value obtained from Actigraph GT9X Link as the mean of maximum peaks (measurement) of every subject at 1.4 km/h in x-axis was compared to its counterpart LIS2DH12 sensor to obtain ICC values.

2.5. Ethical Aspects

This study belongs to the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 823871 (iGame), and it was approved by the Ethics Committee of the Malaga Provincial Research of the Andalusian Health Service. The study code was: RCT-iGAME. All participants accepted and signed the informed consent following the principles established in the Declaration of Helsinki.

3. Results

Five healthy adults participated in the reliability study, whose average and standard deviation of BMI (Body Mass Index) was 21.43 kg/m2 ± 2.23 kg/m2, indicating healthy weights, and their ages oscillated between 22 and 33 years old.
Descriptive and statistical analysis was completed using ICC, “single measurements” and “average measurements” options, as reported before, to compare the features/measurements of interest; that is, mean of maximum peaks, mean of minimum peaks and the mean of the complete signal from each axis and sensor.
Table 1, for wrist position, and Table 2, for thigh position, are reported the ICC values obtained from comparing the data of all subjects for each measurement of interest along with their standard deviations and grouped by speed (km/h) and axis.
Concerning Table 1, wrist position, the average of ICC values, with “single measurements” and “average measurements” options, obtained for each feature/measurement (mean of maximum peaks, mean of minimum peaks and mean of complete signal) oscillated between 0.76 and 0.90. The mean of ICC, “single measurements” and “average measurements, is 0.793/0.863, this range indicates excellent reliability. The three best values of ICC, “single measurements” and “average measurements”, were 0.999/0.999, corresponding to mean of maximum peaks of z-axis at 9 km/h on wrist position (Table 1); and 0.996/0.999, corresponding to the mean of z-axis at 9 km/h in wrist position (Table 1). In contrast, the three worst ICC values were 0.104/0.188, corresponding to the mean of x-axis at 10 km/h on wrist position, and 0.273/0.429, corresponding to the mean of minimum peaks of the y-axis at 1.4 km/h on wrist position (Table 1).
For the thigh position, Table 2, the ICC values oscillated between 0.78 and 0.92, and the mean of ICC, “single measurements” and “average measurements, was 0.834/0.895, indicative of excellent reliability. The best ICC values were 0.998/0.999, corresponding to the mean of minimum peaks of the z-axis at 8 km/h in the thigh position (Table 2). The worst values for ICC were 0.144/0.251, corresponding to mean of minimum peaks of the y-axis at 1.4 km/h in the thigh position (Table 2). Therefore, the order of ICC obtained was 0.8, meaning excellent reliability [25].
Table 3 is a summary that synthesizes the information from Table 1 and Table 2. In this table, concerning the wrist, it could be observed that the z-axis had the highest ICC values, 0.93 (“single measurements” option) and 0.96 (“average measurements” option), and also the lowest standard deviation, 0.33. Speed 9 km/h had the best ICC values of all speeds, 0.91 and 0.95. In contrast, at low speeds (1.4 and 2.9 km/h), there are poor ICC values, around 0.6, and at speeds between 4.3 km/h and 8 km/h, ICC values obtained are higher than 0.75, being good reliability.
However, the ICC values were generally higher in the thigh position than in the wrist position. The axis with the best ICC values was axis Z, 0.87, and 0.93, “single measurements” option and “average measurements” option. Meanwhile, the speed with the greatest ICC values was 10 km/h, with ICC values of 0.90 and 0.94. The ICC values obtained were above 0.8 for all rows, but two speeds 1.4 and 2.9 km/h showed lower values of ICC in wrist. Therefore, the thigh position showed excellent reliability (Table 3).

4. Discussion

The different functions designed in R (Annex 1) allowed the unification of raw data from both sensors, Actigraph GT9X Link and LIS2DH12. This unification improved data flow. The subsequent processing of data (structure, magnitude, type of data, format, orientation of axes, etc.) allowed to establish a semiautomatic system to process all dataset together.
The most relevant features/measurements of the signal were maximum peaks, minimum peaks (valleys) and the mean of the complete signal. R functions extracted these features (findpeaks() and mean() [25]). Based on these features, a new database was generated with the values of each participant’s, mentioned as features, grouped by speed (Annex 1, getInfobySubject() function). An ICC value between a measurement obtained from LIS2DH12 and one obtained from Actigraph GT9X Link, was calculated to quantify the convergence of data (Annex 1 getICCmatrix() function).
The results obtained in this study, attending to the ICC values (“single measurements” and “average measurements”), suggest that the reliability of LIS2DH12 is appropriate. Therefore, the LIS2DH12 sensor could be an alternative for use in kinematics studies, considering its measurements are very similar to the measurements obtained from the commercial sensor Actigraph GT9X Link and its cost is much lower.
Previous studies had analyzed the reliability of other inertial sensors [29]. This study compared an in-house sensor, VetSens, to Actigraph GT3X to evaluate animals’ physical activity by recording acceleration from both sensors. These results show an ICC value above 0.90, meaning excellent reliability. These results are aligned with that obtained in the present study: ICC values oscillated between 0.76–0.90 for wrist position (Table 1) and 0.78–0.92 for thigh position (Table 2). The mean of ICC “single measurements”/“average measurements”, 0.793/ 0.863 for wrist position (Table 1), and 0.834/0.895 for thigh position (Table 2). The thigh position had slightly better results. It could be because the fastening in the thigh was greater than in the wrist, where the LIS2DH12 sensor could have a little more movement. Additionally, higher speed had better results than lower speed. There are two possible explanations: the first could be that a rude movement is slightly noisier, which masks the differences between both signals. The second could be that run has more harmonic movement, so the signals are better recorded without noise.
Likewise, the results obtained by inertial sensors had also been compared with camera motion analysis [28]. An ICC value of approximately 0.90 for gait was observed. From the comparison of both sensors, the overall ICC obtained in this study was 0.85. Therefore, both results, 0.90 and 0.85, are not very distant, demonstrating that the chosen method is an excellent option to validate measurements in this type of motion. Moreover, thanks to this study [29], it is demonstrated that LIS2DH12 gives significantly valuable results.
The sample size can seem small, with five subjects. However, two tests were carried out, 40 min in total for each participant, and 200 min were recorded. Thus, upon completion of all tests, approximately 360.000 values were recorded. This sample size (5 subjects make the test twice) defines a confidence level of 80% and a margin error of 20%.
One of the main limitations is that although data from LIS2DH12 are recorded in “.csv” format, the generated tables are not well defined. Neither the reader of R nor Excel can separate the columns correctly. This means the files must be manually adjusted before processing the data, adapting the dataset, and then, with R, the files can be read by the read_xlsx() predefined function.
Another relevant aspect is the loss of information in data transmission by Bluetooth. Both sensors were configured to have a sampling frequency of 30 Hz, with two minutes of gait test being equivalent to 3600 samples. There was a loss of around 50 random samples in data from LIS2DH12. Therefore, comparison is not possible instant by instant, meaning comparison must be made using the mean of the relevant features. Nonetheless, as shown in Figure 2, LIS2DH12 can faithfully reproduce the data collected by Actigraph GT9X Link.
Accordingly, the present study can conclude that R and the generation of codes and functions allow a more desirable data flow, improving their processing and comparison.

5. Conclusions

According to the result reported in the previous sections, we can conclude that the LIS2DH12 sensor could be an alternative device in kinematic studies, considering that its reliability is excellent, attending to the mean of ICC (model “two-way” and definition of absolute agreement) obtained, which is above 0.8.
In addition, the LIS2DH12 has desired technical characteristics for a sensor: it allows the data to be collected and processed with open-source software, enriching the scientific community; it has a small size and low weight, providing a portable option; it gives reliable and verified acceleration results (compared to validated systems such as Actigraph GT9X Link), and its cost is more affordable than other commercial sensors, so LIS2DH12 could be a good option to use in acceleration studies where the conditions of the assays would be suitable to these characteristics.

Author Contributions

Conceptualization, J.M.-M., A.J.-P., M.R.-M., A.S. and A.I.C.-V.; Data curation, A.J.-P. and A.E.-E.; Formal analysis, J.M.-M., A.J.-P. and A.E.-E.; Funding acquisition, F.M.-C. and A.B.; Investigation, J.M.-M., I.D.-T., M.G.-S., A.M.-C., C.R.-J. and A.I.C.-V.; Methodology, J.M.-M., M.G.-S., C.R.-J. and A.I.C.-V.; Project administration, F.M.-C., W.T., B.N., A.S. and A.I.C.-V.; Resources, A.S. and A.I.C.-V.; Software, A.J.-P.; Writing—original draft, J.M.-M., A.J.-P., I.D.-T., A.E.-E., M.G.-S., A.M.-C., C.R.-J., M.R.-M., F.M.-C., A.B., W.T., B.N., A.S. and A.I.C.-V.; Writing—review and editing, J.M.-M., A.J.-P., I.D.-T., A.E.-E., M.G.-S., A.M.-C., C.R.-J., M.R.-M., F.M.-C., A.B., W.T., B.N., A.S. and A.I.C.-V. All authors have read and agreed to the published version of the manuscript.

Funding

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 823871 (iGame).

Institutional Review Board Statement

This study was approved by the Malaga provincial Research Ethics Committee of the Andalusian Health Service, with the protocol code: RCT-iGAME.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

R-Code designed and data of the present study could be analyzed: https://doi.org/10.6084/m9.figshare.19518796.v1 (accessed on 5 April 2022).

Conflicts of Interest

Alfredo Salvatore is the executive director of SensorID and provided the inertial measurement unit equipped with a Lis2DH12 sensor provided by ST Microelectronics and derived by Sensor ID original firmware. The remaining authors have no conflict of interest to declare.

Appendix A

R-Code designed and data of the present study could be analyzed:

References

  1. You, Z. Chapter 7—Miniature Inertial Measurement Unit. In Space Microsystems and Micro/Nano Satellites; Micro and Nano Technologies; Butterworth-Heinemann: Oxford, UK, 2018; pp. 233–293. ISBN 978-0-12-812672-1. [Google Scholar]
  2. Bachmann, E.R.; Yun, X.; McKinney, D.; McGhee, R.B.; Zyda, M.J. Design and Implementation of MARG Sensors for 3-DOF Orientation Measurement of Rigid Bodies. In Proceedings of the 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422), Taipei, Taiwan, 14–19 September 2003; Volume 1, pp. 1171–1178. [Google Scholar]
  3. Taylor, L.; Miller, E.; Kaufman, K.R. Static and Dynamic Validation of Inertial Measurement Units. Gait Posture 2017, 57, 80–84. [Google Scholar] [CrossRef] [PubMed]
  4. Cuesta-Vargas, A.I.; Galán-Mercant, A.; Williams, J.M. The Use of Inertial Sensors System for Human Motion Analysis. Phys. Ther. Rev. 2010, 15, 462–473. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Godinho, C.; Domingos, J.; Cunha, G.; Santos, A.T.; Fernandes, R.M.; Abreu, D.; Gonçalves, N.; Matthews, H.; Isaacs, T.; Duffen, J.; et al. A Systematic Review of the Characteristics and Validity of Monitoring Technologies to Assess Parkinson’s Disease. J. Neuroeng. Rehabil. 2016, 13, 24. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Tsang, K.; Hiremath, S.V.; Crytzer, T.M.; Dicianno, B.E.; Ding, D. Validity of Activity Monitors in Wheelchair Users: A Systematic Review. J. Rehabil. Res. Dev. 2016, 53, 641–658. [Google Scholar] [CrossRef] [PubMed]
  7. O’Driscoll, R.; Turicchi, J.; Beaulieu, K.; Scott, S.; Matu, J.; Deighton, K.; Finlayson, G.; Stubbs, J. How Well Do Activity Monitors Estimate Energy Expenditure? A Systematic Review and Meta-Analysis of the Validity of Current Technologies. Br. J. Sports Med. 2018, 54, 332–340. [Google Scholar] [CrossRef] [PubMed]
  8. Porciuncula, F.; Roto, A.V.; Kumar, D.; Davis, I.; Roy, S.; Walsh, C.J.; Awad, L.N. Wearable Movement Sensors for Rehabilitation: A Focused Review of Technological and Clinical Advances. PM R 2018, 10, S220–S232. [Google Scholar] [CrossRef] [Green Version]
  9. O’Reilly, M.; Caulfield, B.; Ward, T.; Johnston, W.; Doherty, C. Wearable Inertial Sensor Systems for Lower Limb Exercise Detection and Evaluation: A Systematic Review. Sports Med. 2018, 48, 1221–1246. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Arvidsson, D.; Fridolfsson, J.; Börjesson, M.; Andersen, L.B.; Ekblom, Ö.; Dencker, M.; Brønd, J.C. Re-Examination of Accelerometer Data Processing and Calibration for the Assessment of Physical Activity Intensity. Scand. J. Med. Sci. Sports 2019, 29, 1442–1452. [Google Scholar] [CrossRef]
  11. Cooke, A.B.; Daskalopoulou, S.S.; Dasgupta, K. The Impact of Accelerometer Wear Location on the Relationship between Step Counts and Arterial Stiffness in Adults Treated for Hypertension and Diabetes. J. Sci. Med. Sport 2018, 21, 398–403. [Google Scholar] [CrossRef]
  12. Macadam, P.; Cronin, J.; Neville, J.; Diewald, S. Quantification of the Validity and Reliability of Sprint Performance Metrics Computed Using Inertial Sensors: A Systematic Review. Gait Posture 2019, 73, 26–38. [Google Scholar] [CrossRef]
  13. Begon, M.; Andersen, M.S.; Dumas, R. Multibody Kinematics Optimization for the Estimation of Upper and Lower Limb Human Joint Kinematics: A Systematized Methodological Review. J. Biomech. Eng. 2018, 140, 030801. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. ActiGraph Link|ActiGraph. Available online: https://www.actigraphcorp.com/actigraph-link/ (accessed on 25 September 2019).
  15. Migueles, J.H.; Cadenas-Sanchez, C.; Ekelund, U.; Delisle Nyström, C.; Mora-Gonzalez, J.; Löf, M.; Labayen, I.; Ruiz, J.R.; Ortega, F.B. Accelerometer Data Collection and Processing Criteria to Assess Physical Activity and Other Outcomes: A Systematic Review and Practical Considerations. Sports Med. 2017, 47, 1821–1845. [Google Scholar] [CrossRef] [PubMed]
  16. Van der Weegen, S.; Essers, H.; Spreeuwenberg, M.; Verwey, R.; Tange, H.; de Witte, L.; Meijer, K. Concurrent Validity of the MOX Activity Monitor Compared to the ActiGraph GT3X. Telemed. J. E-Health Off. J. Am. Telemed. Assoc. 2015, 21, 259–266. [Google Scholar] [CrossRef] [PubMed]
  17. Pereira, J.R.; Sousa-Sá, E.; Zhang, Z.; Cliff, D.P.; Santos, R. Concurrent Validity of the ActiGraph GT3X+ and ActivPAL for Assessing Sedentary Behaviour in 2-3-Year-Old Children under Free-Living Conditions. J. Sci. Med. Sport 2020, 23, 151–156. [Google Scholar] [CrossRef]
  18. Chandrasekar, A.; Hensor, E.M.A.; Mackie, S.L.; Backhouse, M.R.; Harris, E. Preliminary Concurrent Validity of the Fitbit-Zip and ActiGraph Activity Monitors for Measuring Steps in People with Polymyalgia Rheumatica. Gait Posture 2018, 61, 339–345. [Google Scholar] [CrossRef]
  19. McClain, J.J.; Hart, T.L.; Getz, R.S.; Tudor-Locke, C. Convergent Validity of 3 Low Cost Motion Sensors with the ActiGraph Accelerometer. J. Phys. Act. Health 2010, 7, 662–670. [Google Scholar] [CrossRef]
  20. STMicroelectronics. Available online: http://www.st.com/internet/com/home/home.jsp (accessed on 20 November 2021).
  21. Arduino-Home. Available online: https://www.arduino.cc/ (accessed on 11 October 2019).
  22. Crotti, M.; Foweather, L.; Rudd, J.R.; Hurter, L.; Schwarz, S.; Boddy, L.M. Development of Raw Acceleration Cut-Points for Wrist and Hip Accelerometers to Assess Sedentary Behaviour and Physical Activity in 5-7-Year-Old Children. J. Sports Sci. 2020, 38, 1036–1045. [Google Scholar] [CrossRef]
  23. Rhudy, M.B.; Dreisbach, S.B.; Moran, M.D.; Ruggiero, M.J.; Veerabhadrappa, P. Cut Points of the Actigraph GT9X for Moderate and Vigorous Intensity Physical Activity at Four Different Wear Locations. J. Sports Sci. 2020, 38, 503–510. [Google Scholar] [CrossRef]
  24. Fritz, S.; Lusardi, M. White Paper: “Walking Speed: The Sixth Vital Sign”. J. Geriatr. Phys. Ther. 2009, 32, 2. [Google Scholar] [CrossRef] [Green Version]
  25. Borchers, H.W.; Borchers, M.H.W. “Package ‘pracma’”. Available online: https://cran.r-project.org/web/packages/pracma/index.html (accessed on 4 March 2022).
  26. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [Green Version]
  27. Mcgraw, K.O.; Wong, S.P. Forming Inferences About Some Intraclass Correlation Coefficients. Psychol. Method. 1996, 1, 30–46. [Google Scholar] [CrossRef]
  28. Beyea, J.; McGibbon, C.A.; Sexton, A.; Noble, J.; O’Connell, C. Convergent Validity of a Wearable Sensor System for Measuring Sub-Task Performance during the Timed Up-and-Go Test. Sensors 2017, 17, 934. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Westgarth, C.; Ladha, C. Evaluation of an Open Source Method for Calculating Physical Activity in Dogs from Harness and Collar Based Sensors. BMC Vet. Res. 2017, 13, 322. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Reference system by the manufacturer.
Figure 1. Reference system by the manufacturer.
Jpm 12 00749 g001
Figure 2. Data sensors ActiGraph GT9X Link and LIS2H12 x-axis, y-axis and z-axis at 9 km/h on the wrist.
Figure 2. Data sensors ActiGraph GT9X Link and LIS2H12 x-axis, y-axis and z-axis at 9 km/h on the wrist.
Jpm 12 00749 g002
Table 1. ICC values and standard deviation grouped by speed (km/h) and axis, in wrist position.
Table 1. ICC values and standard deviation grouped by speed (km/h) and axis, in wrist position.
ICC WRIST 95%Mean Peaks ValuesMean Minimum ValuesMean ValuesBy Rows
Km/hAxisSingle ICCAverage ICCAverage Peaks (g)SD (g)Single ICCAverage ICCAverage Valleys (g)SD (g)Single ICCAverage ICCAverage (g)SD (g)Mean Single ICCMean Average ICCMean Average (g)Mean SD (g)
1.4X0.6480.786−0.8480.0210.3870.558−1.0880.0200.5840.737−0.9410.0200.5400.694−0.9590.020
Y0.5330.6960.3550.0690.2730.4290.1750.0650.3730.5430.2640.0660.3930.5560.2650.067
Z0.9100.9530.1770.0340.8760.934−0.0090.0410.8930.9430.0850.0370.8930.9430.0840.037
2.9X0.5810.735−0.7490.0440.4490.620−1.2500.0610.4240.596−0.9350.0430.4850.650−0.9780.049
Y0.0290.0560.4280.1730.5070.6730.1070.1170.2790.4370.2650.1410.2720.3880.2670.144
Z0.9140.9550.3100.0310.8580.9240.0310.0390.8950.9450.1650.0340.8890.9410.1690.035
4.3X0.9570.978−0.6510.0200.5720.728−1.3620.0510.8390.912−0.9370.0250.7890.873−0.9830.032
Y0.6020.7510.5080.1250.6770.8080.1450.0650.6380.7790.3110.0870.6390.7790.3210.092
Z0.9590.9790.3110.0260.8240.9040.0080.0420.8990.9470.1520.0350.8940.9430.1570.034
5X0.9620.980−0.5990.0170.8670.929−1.4290.0390.8470.917−0.9490.0240.8920.942−0.9920.027
Y0.7260.8410.5140.0680.8670.9290.0900.0440.7770.8740.2790.0530.7900.8810.2940.055
Z0.9730.9870.3850.0240.9230.9600.0320.0300.9350.9670.1940.0280.9440.9710.2040.028
6X0.9750.987−0.5070.0240.9090.952−1.4840.0500.9520.975−0.9790.0180.9450.972−0.9900.031
Y0.6750.8060.5530.1080.8760.9340.0440.0610.7790.8760.2570.0770.7770.8720.2850.082
Z0.9910.9950.3410.0120.9150.956−0.0220.0500.9490.9740.1560.0320.9510.9750.1580.031
6.5X0.9590.979−0.4990.0320.8050.892−1.5220.0670.8860.940−0.9890.0330.8830.937−1.0030.044
Y0.7280.8430.6830.1180.6950.8200.0430.0610.5720.7280.3140.0800.6650.7970.3470.086
Z0.9950.9980.5270.0100.9460.9720.0250.0330.9420.9700.2430.0280.9610.9800.2650.024
7X0.6040.7530.8310.0860.9100.953−0.9820.1140.5960.747−0.0790.1000.7030.818−0.0770.100
Y0.9500.9743.1990.0870.9840.992−0.3430.0240.9330.9651.0600.0320.9560.9771.3050.048
Z0.9850.9920.9660.0320.7770.875−0.2140.0390.9780.9890.2670.0210.9130.9520.3400.031
8X0.9210.9590.8520.0540.3630.532−1.0560.1920.3220.487−0.1090.1160.5360.660−0.1040.121
Y0.9880.9943.4530.0370.9630.981−0.4780.0290.8340.9101.0650.0140.9290.9621.3470.027
Z0.9970.9980.7930.0250.9540.976−0.3390.0540.9890.9950.1620.0240.9800.9900.2050.035
9X0.9060.9510.9810.0710.8480.918−1.0040.0470.8680.929−0.0490.0430.8740.933−0.0240.054
Y0.9800.9903.5360.0670.9870.993−0.4980.0130.7800.8771.0880.0280.9160.9531.3750.036
Z0.9991.0001.0970.0170.8120.897−0.3980.0580.9960.9980.2540.0180.9360.9650.3180.031
10X0.9310.9640.9270.0750.6520.790−1.1760.2080.1040.188−0.1280.1200.5620.647−0.1260.134
Y0.9870.9943.4520.0870.9570.978−0.4940.0560.8630.9261.0450.0270.9360.9661.3350.057
Z0.9900.9951.1690.0520.8330.909−0.3910.0740.9920.9960.2800.0220.9380.9670.3520.049
Average0.8450.896 0.0550.7760.857 0.0620.7570.836 0.0470.7930.863 0.055
ICC = Interclass correlation coefficient; g = acceleration in gravitational force equivalent; SD = standard deviation.
Table 2. ICC values and standard deviation grouped by speed (km/h) and axis, in thigh position.
Table 2. ICC values and standard deviation grouped by speed (km/h) and axis, in thigh position.
ICC THIGH 95%Mean Peaks ValuesMean Minimum ValuesMean ValuesBy Rows
Km/hAxisSingle ICCAverage ICCAverage Peaks (g)SD (g)Single ICCAverage ICCAverage Valleys (g)SD (g)Single ICCAverage ICCAverage (g)SD (g)Mean Single ICCMean Average ICCMean Average (g)Mean SD (g)
1.4X0.5850.7380.1660.0740.3080.471−0.2610.0930.5350.697−0.0470.0770.4760.636−0.0480.081
Y0.8520.920−0.8390.0060.1440.251−1.2110.0260.7670.868−0.9880.0060.5880.680−1.0130.013
Z0.7920.8840.3910.0390.9660.983−0.2770.0190.9500.975−0.0730.0220.9030.9470.0140.027
2.9X0.8740.9330.4390.0600.9530.976−0.5420.0500.8370.911−0.0710.0460.8880.940−0.0580.052
Y0.2840.442−0.4920.0240.9530.976−1.5890.0460.4530.624−1.0000.0110.5630.680−1.0270.027
Z0.9150.9560.7820.0800.9450.972−0.4420.0390.9240.961−0.0510.0230.9280.9630.0960.048
4.3X0.9040.9500.6130.0800.9400.969−0.7980.0660.7810.877−0.0770.0460.8750.932−0.0880.064
Y0.9510.975−0.2740.0290.8380.912−1.8190.0500.8650.928−1.0300.0060.8850.938−1.0410.028
Z0.8820.9371.1550.1450.9520.975−0.5930.0450.9510.975−0.0610.0210.9280.9620.1670.070
5X0.7400.8500.7530.0960.9790.989−0.7220.0340.9070.951−0.0100.0390.8750.9300.0070.056
Y0.8130.897−0.1280.0450.8820.937−1.9500.0590.7310.844−1.0480.0090.8080.893−1.0420.038
Z0.6600.7951.3110.1800.9670.983−0.7070.0510.8850.939−0.0450.0220.8380.9060.1860.085
6X0.8620.9260.8470.0760.8830.938−0.9190.0720.9460.972−0.0950.0280.8970.945−0.0560.058
Y0.9580.9790.0350.0330.9500.974−2.2900.0560.8920.943−1.0700.0060.9330.965−1.1090.032
Z0.6560.7921.4860.2270.9690.984−0.8910.0510.8780.935−0.0810.0310.8340.9040.1710.103
6.5X0.9790.9890.9670.0620.8570.923−0.8530.0610.9360.967−0.0590.0340.9240.9600.0180.052
Y0.9720.9860.1680.0340.9670.983−2.5010.0550.9460.973−1.0680.0050.9620.981−1.1340.031
Z0.6240.7681.2810.2200.9380.968−1.0790.0670.8460.917−0.1790.0380.8020.8840.0080.109
7X0.9650.9820.8650.0600.8820.937−0.9860.1230.8160.899−0.0910.0540.8870.939−0.0710.079
Y0.8930.9430.3970.0440.9760.988−2.7880.0300.6150.762−1.0990.0150.8280.898−1.1630.030
Z0.8070.8931.0980.1640.9110.953−1.0660.0680.8530.921−0.0640.0360.8570.922−0.0110.089
8X0.9340.9660.9880.0970.5450.705−1.0100.1800.4720.641−0.0890.1110.6500.771−0.0370.129
Y0.9500.9740.6460.0620.9860.993−2.9090.0400.8810.937−1.1130.0170.9390.968−1.1250.040
Z0.8330.9091.1810.1560.9980.999−1.2310.0130.8240.904−0.1270.0420.8850.937−0.0590.070
9X0.9700.9851.1350.0590.8890.941−1.1290.0830.0480.091−0.0850.0390.6360.673−0.0270.060
Y0.9550.9770.7680.0620.9420.970−3.1220.0870.8050.892−1.1580.0180.9000.946−1.1710.056
Z0.8320.9081.3110.1800.9670.983−1.3490.0530.7370.848−0.1080.0510.8450.913−0.0480.095
10X0.9780.9891.2020.0460.9530.976−1.2460.0700.8830.938−0.0720.0370.9380.968−0.0390.051
Y0.9410.9700.8850.0630.9730.986−3.2660.0650.8270.905−1.1850.0220.9140.954−1.1890.050
Z0.9090.9521.4210.1710.9650.982−1.5290.0540.6630.798−0.1430.0510.8460.911−0.0840.092
Average0.8420.905 0.0890.8790.919 0.0600.7820.860 0.0320.8340.895 0.060
ICC = Interclass correlation coefficient; g = acceleration in gravitational force equivalent; SD = standard deviation.
Table 3. Mean of ICC values for “single measurements” option, “average measurements” option, an average of the signal and standard deviation (SD), for each axis and velocity in each position, wrist and thigh.
Table 3. Mean of ICC values for “single measurements” option, “average measurements” option, an average of the signal and standard deviation (SD), for each axis and velocity in each position, wrist and thigh.
Mean of “Single” ICCMean of “Average” ICCAverage (g)Mean of SD (g)
WristThighWristThighWristThighWristThigh
Axis X0.7210.8050.8120.869−0.624−0.0400.0610.068
Axis Y0.7270.8320.8130.8900.714−1.1010.0690.034
Axis Z0.9300.8670.9630.9250.2250.0440.0330.079
1.4 km/h0.6090.6560.7310.754−0.203−0.3490.0420.040
2.9 km/h0.5490.7930.6600.861−0.181−0.3300.0760.042
4.3 km/h0.7740.8960.8650.944−0.168−0.3210.0530.054
5 km/h0.8750.8400.9320.910−0.165−0.2830.0360.060
6 km/h0.8910.8880.9400.938−0.182−0.3310.0480.064
6.5 km/h0.8360.8960.9050.942−0.131−0.3700.0510.064
7 km/h0.8570.8570.9160.9200.523−0.4150.0600.066
8 km/h0.8150.8250.8700.8920.488−0.4070.0610.080
9 km/h0.9080.7940.9500.8440.556−0.4150.0400.070
10 km/h0.8120.8990.8600.9440.520−0.4370.0800.064
ICC = Interclass correlation coefficient; g = acceleration in gravitational force equivalent; SD = standard deviation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martín-Martín, J.; Jiménez-Partinen, A.; De-Torres, I.; Escriche-Escuder, A.; González-Sánchez, M.; Muro-Culebras, A.; Roldán-Jiménez, C.; Ruiz-Muñoz, M.; Mayoral-Cleries, F.; Biró, A.; et al. Reliability Study of Inertial Sensors LIS2DH12 Compared to ActiGraph GT9X: Based on Free Code. J. Pers. Med. 2022, 12, 749. https://doi.org/10.3390/jpm12050749

AMA Style

Martín-Martín J, Jiménez-Partinen A, De-Torres I, Escriche-Escuder A, González-Sánchez M, Muro-Culebras A, Roldán-Jiménez C, Ruiz-Muñoz M, Mayoral-Cleries F, Biró A, et al. Reliability Study of Inertial Sensors LIS2DH12 Compared to ActiGraph GT9X: Based on Free Code. Journal of Personalized Medicine. 2022; 12(5):749. https://doi.org/10.3390/jpm12050749

Chicago/Turabian Style

Martín-Martín, Jaime, Ariadna Jiménez-Partinen, Irene De-Torres, Adrian Escriche-Escuder, Manuel González-Sánchez, Antonio Muro-Culebras, Cristina Roldán-Jiménez, María Ruiz-Muñoz, Fermín Mayoral-Cleries, Attila Biró, and et al. 2022. "Reliability Study of Inertial Sensors LIS2DH12 Compared to ActiGraph GT9X: Based on Free Code" Journal of Personalized Medicine 12, no. 5: 749. https://doi.org/10.3390/jpm12050749

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop