Issue |
SICOT-J
Volume 8, 2022
|
|
---|---|---|
Article Number | 27 | |
Number of page(s) | 7 | |
Section | Lower Limb | |
DOI | https://doi.org/10.1051/sicotj/2022027 | |
Published online | 24 June 2022 |
Original Article
Evaluation of lower extremity gait analysis using Kinect V2® tracking system
1
Department of Orthopedic Surgery, Nagoya City University Graduate School of Medical Sciences, Nagoya, Aichi 467-8601, Japan
2
Nagoya City University East Medical Center, Nagoya, Aichi 464-8547, Japan
3
Center for Advanced Medicine and Clinical Research Nagoya University Hospital, Nagoya, Aichi 466-8560, Japan
4
National Hospital Organization Toyohashi Medical Center, Nagoya, Aichi 440-8510, Japan
5
Department of Rehabilitation Medicine, Nagoya City University Graduate School of Medical Sciences, Nagoya, Aichi 467-8601, Japan
* Corresponding author: kokuryugen@yahoo.co.jp
Received:
21
April
2022
Accepted:
23
May
2022
Introduction: Microsoft Kinect V2® (Kinect) is a peripheral device of Xbox® and acquires information such as depth, posture, and skeleton definition. In this study, we investigated whether Kinect can be used for human gait analysis. Methods: Ten healthy volunteers walked 20 trials, and each walk was recorded by a Kinect and infrared- and marker-based-motion capture system. Pearson’s correlation and overall agreement with a method of meta-analysis of Pearson’s correlation coefficient were used to assess the reliability of each parameter, including gait velocity, gait cycle time, step length, hip and knee joint angle, ground contact time of foot, and max ankle velocity. Hip and knee angles in one gait cycle were calculated in Kinect and motion capture groups. Results: The coefficients of correlation for gait velocity (r = 0.92), step length (r = 0.81) were regarded as strong reliability. Gait cycle time (r = 0.65), minimum flexion angle of hip joint (r = 0.68) were regarded as moderate reliability. The maximum flexion angle of the hip joint (r = 0.43) and maximum flexion angle of the knee joint (r = 0.54) were regarded as fair reliability. Minimum flexion angle of knee joint (r = 0.23), ground contact time of foot (r = 0.23), and maximum ankle velocity (r = 0.22) were regarded as poor reliability. The method of meta-analysis revealed that participants with small hip and knee flexion angles tended to have poor correlations in maximum flexion angle of hip and knee joints. Similar trajectories of hip and knee angles were observed in Kinect and motion capture groups. Conclusions: Our results strongly suggest that Kinect could be a reliable device for evaluating gait parameters, including gait velocity, gait cycle time, step length, minimum flexion angle of the hip joint, and maximum flexion angle of the knee joint.
Key words: Gait analysis / Kinect V2 / Motion capture system / Posture recognition / Skeleton definition
© The Authors, published by EDP Sciences, 2022
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Introduction
Gait analysis provides kinematic changes in joints during gait, providing a better understanding of changes in joint function and pathological conditions. The movement of joints during walking in patients with orthopedic joint disease is different from that in healthy individuals. On the other hand, various factors such as implant alignment and surgical method are known to affect postoperative clinical outcomes after lower extremity joint surgeries [1, 2]. Gait velocity and range of motion of the knee and hip joints are normally recovered after surgery [3, 4]. However, how other kinematic or spatiotemporal parameters affect clinical outcomes has not been fully clarified.
Several technologies, including video examination, force plate examination, electromyography, accelerometer, and infrared-based-motion capture, have been developed to evaluate human gait parameters [5–7]. Among them, infrared- and marker-based-motion capture systems such as Optorack® (Northern Digital Inc., ON, Canada) and VICON® (Vicon Motion Systems, Oxford, UK), are widely used for gait analysis. These systems show high reliability of kinematic parameters, including position, velocity, and acceleration [7–9]. However, these systems necessitate multiple cameras and a large amount of space, and the equipment is expensive. In this study, we investigated whether Microsoft Kinect V2®, which is a low-cost, portable and peripheral device of Xbox®, evaluates kinematic and spatiotemporal parameters and can be used for human gait analysis in healthy individuals.
Materials and method
Participant
From June 2020 to December 2020, 10 young, healthy volunteers (one male and nine females) were enrolled in this study. Informed consent was obtained firmly from each participant. Mean height and body weight was 169.1 ± 7.0 cm and 59.2 ± 6.6 kg, respectively (Table 1). To minimize measurement errors, 10 walks were captured simultaneously by motion capture, pressure sensing device, and Kinect on two different days.
Summary of the participants’ characteristics.
Variables
Kinematic parameters including gait velocity, gait cycle time, step length, maximum and minimum flexion angle of the hip joint, maximum and minimum flexion angle of the knee joint, ground contact time of foot, and maximum ankle velocity were calculated by the methods as shown in Table 2.
Identification method of all variables for Kinect and motion capture system.
Gait analysis procedures
Kinematic parameters were obtained by Kinect, infrared- and marker-based-motion capture system (MA-3000®; ANIMA Inc., Tokyo, Japan), and plantar pressure sensing device (Walk Way MV-1000®; ANIMA Inc.), simultaneously. Kinect was placed on a tripod about 70 cm in front of the participants. The participants were instructed to walk from 4 m to 1 m toward the Kinect (Figure 1A). Using the Kinect software development kit (SDK), the estimated joint position of the spine shoulder, spine mid, spine base, hip, knee, ankle, and foot were obtained at 30 Hz [8, 10]. The coordinates axis of Kinect was defined as follows: X was the mediolateral axis, Y was the vertical axis, and Z was the posteroanterior axis (Figure 1B). Because the Kinect was in front of the participant, the Z-axis corresponded to the walking direction.
Figure 1 (A) Six infrared sensors were located around the participant. Single Kinect V2® and a pressure sensing device were set in front of the participant. Participants walk from 4 m to 1 m on the plantar pressure sensing device towards Kinect. (B) The illustration shows the Kinect coordinate axis. X, Y, and Z directions show mediolateral, vertical, and posteroanterior axis, respectively. |
Gait analysis by infrared- and marker based-motion capture system was performed as follows: The participants’ neck, acromion process, elbow, wrist, posterior superior iliac spine, anterior superior iliac spine, greater trochanter, lateral condyle of femur, lateral malleolus, and fourth metatarsal bone all had reflective markers attached to them. Six infrared sensors tracked each position. The sampling frequency was 100 Hz. A plantar pressure sensing device was used to analyze the walk cycle, step length, and ground contact time of the foot. The device, with a sheet length of 3 m, was installed in the middle of the walkway by connecting three modules as previously described [11]. The data obtained from both infrared- and marker-based-motion capture systems and the pressure sensing device were synchronized and output by the software (MD-1000®; ANIMA Inc.).
Each participant walked at least 5 times on different days. Every walk was captured by Kinect, at infrared- and marker-based-motion capture system, and pressure-sensing devices simultaneously. One walk cycle was defined as the period from one heel strike to the next.
Regarding the analysis by Kinect, we used the kinematic data from the Y and Z-axis to calculate variables. One walk cycle was extracted by using a hip-knee cyclogram, which shows the relationship between hip and knee joint angle [12]. This cyclogram allows for the estimation of the heel strike and the extraction of one walk cycle. The walk and foot speeds were calculated using the speed in the Z-axis of the spine base and the ankle, respectively. The maximum distance between the left and right ankles in the Z-axis was used to define step length. Two vectors (hip joint angle, hip-knee vector, and gravity vector) were used to calculate the joint angle. Knee joint angle; knee-hip vector and knee-ankle vector) in the sagittal plane (Y–Z plane). The ground contact time of the foot was defined as the period of ankle speed <1 m/s on the Z-axis.
Statistical analysis
Each variable obtained by Kinect were compared to those by infrared- and marker-based-motion capture system and a pressure sensing device, respectively. Pearson’s correlation coefficients were calculated for each participant, and each correlation coefficient was then integrated using a meta-analysis method. Models for locally estimated scatterplot smoothing (LOESS). The forest plot was calculated using gait velocity, gait cycle time, and the maximum flexion angle of the hip and knee joints. All the analyses were conducted using the R statistics package, version 3.6.1 (R Core Team, Foundation for Statistical Computing, Vienna, Austria). The P-value < 0.05 was regarded as statistically significant.
Results
The correlation coefficients for all parameters ranged from 0.22 to 0.92 (Table 3). The correlation coefficients were regarded as very strong reliability in gait velocity (r = 0.92, p < 0.01), step length (r = 0.81, p < 0.01). The correlation coefficients were regarded as moderate in gait cycle time (r = 0.65, p < 0.01), minimum flexion angle of hip joint (r = 0.68, p < 0.01). The correlation coefficients were regarded as fair in maximum flexion angle of hip joint (r = 0.43, p = 0.011), maximum flexion angle of knee joint (r = 0.54, p < 0.01). The correlation coefficients were regarded as poor in minimum flexion angle of knee joint (r = 0.23, p = 0.07), ground contact time of foot (r = 0.23, p = 0.08), and maximum ankle velocity (r = 0.22, p = 0.011) (Table 3) [13].
Results of every variable, and Pearson’s correlation coefficients (r).
To investigate why correlation coefficients were low in minimum flexion angle of the knee joint, ground contact time of foot, and maximum ankle velocity, we further investigated correlation coefficients based on each subject in gait velocity, gait cycle time, and maximum flexion angle of hip and knee joints. As a result, the correlation coefficients in gait velocity and gait cycle time did not differ across subjects (Supplemental Figures S1A and S1B). The correlation coefficients of maximum flexion angle of hip and knee joints, on the other hand, varied (Figures 2A and 2B).
Figure 2 Correlation coefficients of maximum flexion angle of right hip (A) and right knee (B) in each subject varied among each subject. Overall meta-analysis shows that maximum flexion angle of hip and knee correlates with r = 0.500 and p = 0.035, and r = 0.504 and p < 0.001, respectively. |
In addition, the analysis of individual subjects revealed that the participants who showed small hip and knee flexion angles tended to present poor correlations in maximum flexion angle of hip and knee joints in the Kinect group. Individual analysis revealed that participants (#8–10) had low correlation coefficients for hip and knee joint angles. These participants (#8–10) had a small average maximum flexion angle of the hip and knee joints, which was measured using an infrared and marker-based-motion capture system. Conversely, participants (#1, 4, 5, 7) showing the average maximum flexion angle of hip and knee joints more than 40° showed strong and fair correlation coefficients (Table 4).
Degrees of the maximum flexion of hip and knee joint of each participant.
LOESS models were used to show hip and knee angles in the Kinect group and motion capture group, revealing that both shapes were similar to each other (Figure 3).
Figure 3 The LOESS models show right hip (A) and knee angle (B) of participant (#9) over one gait cycle. Solid lines, which express the average angle of all walks, have similar trajectories in Kinect and motion capture groups. |
Discussion
Measurement of gait parameters is indispensable for human gait analysis and useful to understand changes in joint function in orthopedic surgery. In this study, we investigated whether Kinect, a peripheral device of Xbox® that acquires information such as depth, posture, and skeleton definition, can be used for human gait analysis in healthy subjects. We found that gait parameters, including gait velocity, gait cycle time, step length, minimum flexion angle of the hip joint, and maximum flexion angle of the knee joint obtained by Kinect, were well correlated with those by infrared- and marker based-motion capture system.
There were some limitations in this study. The sample size was small. To consider the measurement errors, we collected at least 10 walks for each participant on different days in this study. Furthermore, we matched the target walking cycle between the Kinect and motion capture groups. Because the majority of the participants in this study were young men, the kinematic variables may have been skewed. Taking our findings into account, the kinematic variables examined in this study would not differ based on gender.
The usage of Kinect in gait analysis has not been fully established. Numerous studies on human gait analysis using the infrared- and marker-based-motion capture system have been reported in the field of orthopedic surgery [7–9]. In general, the infrared- and marker-based-motion capture system requires a lot of markers attached to the body and performs gait analysis [7–9]. Although Kinect lacks markers, proper gait analysis parameters were obtained in this study. Thus, it is likely that Kinect could be used as an Xbox® peripheral device and as a gait analysis device in orthopedic surgery. It also appears that Kinect does not require a fixed-point camera and can easily perform gait analysis without the use of marker settings.
As for the methods of gait analysis, a treadmill walk survey shows that Kinect enables to measure hip and knee joint trajectories in healthy subjects [14]. It has also been reported that the Kinect accurately captures hip and knee joint trajectories but not ankle joint trajectories [15] (Table 5). Although gait analysis on a treadmill is useful because it can be performed in a small space with healthy subjects, it appears difficult for patients with severe musculoskeletal disease such as osteoarthritis. Thus, our method that participants walk a few meters on a flat surface seemed to be simple and effective even for patients with joint disease. On the other hand, walking speed or step length would be the good kinematic variables reflecting gait impairments caused by joint disease [3, 4]. Previous studies reported that gait parameters, including gait velocity, gait cycle time, and step length, obtained by Kinect are reliable [8, 10]. The values of gait velocity, gait cycle time, and step length in this study were similar to those in previous papers [8, 10]. As a result, Kinect may be a tool for accurately measuring kinematic variables that reflect gait impairments caused by joint disease in the field of orthopedic surgery.
Study, participants’ characteristics and gait analysis devices.
Regarding the hardware and software, the mechanism of posture recognition is based on projecting a pulsed infrared pattern and simultaneously measuring the reflection with an infrared sensor and a red/green/black (RGB) sensor. Kinect measures the time of flight (TOF) for each pattern and then matches the data to the RGB image [16]. Our preliminary study showed that the detection of heel strike judged from the position of the ankle was not precisely recognized because infrared was blocked in the case where the forefoot covers the ankle. Thus, to recognize exact ankle detection, we adopted a hip-knee cyclogram in this study [12]. As for the number of Kinect installed for gait analysis, multiple Kinect systems have been used for gait analysis [8, 16] (Table 5). However, the use of multiple Kinect systems requires relatively high cost and technical skills to integrate each data. In this study, we used a single Kinect sensor to capture gait variables, eliminating the need for data integration. Latorre et al. used a single Kinect sensor to assess gait parameters such as walking speed and step length. The study, however, lacked a standard system as a control [17]. We compared each variable between Kinect and the motion capture system and found that Kinect showed a good correlation with the motion capture system. On the other hand, we examined correlation coefficients in gait velocity, gait cycle time, and maximum flexion angle of hip and knee joints based on each subject and discovered that the correlation coefficients of maximum flexion angle of hip and knee joints varied from each subject, whereas correlation coefficients in gait velocity and gait cycle time did not differ in all participants. In addition, the analysis of individual subjects revealed that the participants who showed small hip and knee flexion angles under 40° tended to present poor correlations in maximum flexion angle of hip and knee joints. Taking these findings into account, it is most likely that kinematic and spatiotemporal parameters obtained by Kinect in participants with a large bending angle of the hip and knee joints are reliable. Further investigation will be necessary to evaluate these gait parameters in patients with hip or knee joint disorders.
In conclusion, our results strongly suggest that Kinect could be a reliable device in lower extremity gait analysis compared to the infrared- and marker-based-motion capture system.
Conflict of interest
There are no conflicts of interest to declare.
Funding
The present study was supported in part by a Grant-in-Aid for Scientific Research (19K18471) from the Ministry of Education, Culture, Sports, Science and Technology of Japan, Sugiura Memorial Foundation, and Japan Hip Joint Foundation.
Ethical approval
Ethical approval was not required.
Informed consent
This article does not contain any studies involving human subjects.
Authors’ contributions
T. Usami, H. Iguchi and G. Kuroyanagi: Designed the study. T. Usami and K. Nishida: Analyzed data. T. Usami, H. Sakai, R. Ida, M. Horiba, S. Kashima, K. Sahashi, and H. Asai: Collected data. T. Usami and G. Kuroyanagi: Drafted the manuscript. Y. Nagaya, H. Murakami, and Y. Ueki: Critically reviewed the manuscript. All authors have read and approved the final submitted manuscript.
Supplementary material
Figure S1A Correlation coefficients of gait velocity in each subject, respectively. |
Figure S1B Correlation coefficients of gait cycle time in each subject, respectively. |
References
- Assi C, Kheir N, Samaha C, et al. (2017) Novel anatomical-based surgical technique for positioning of the patellar component in total knee arthroplasty. SICOT J 3, 67. [CrossRef] [EDP Sciences] [PubMed] [Google Scholar]
- Ozaki Y, Baba T, Homma Y, et al. (2018) Posterior versus direct anterior approach in total hip arthroplasty: Difference in patient-reported outcomes measured with the Forgotten Joint Score-12. SICOT J 4, 54. [CrossRef] [EDP Sciences] [PubMed] [Google Scholar]
- Hatfield GL, Hubley-Kozey CL, Astephen Wilson JL, et al. (2011) The effect of total knee arthroplasty on knee joint kinematics and kinetics during gait. J Arthroplasty 26(2), 309–318. [CrossRef] [PubMed] [Google Scholar]
- Bahl JS, Nelson MJ, Taylor M, et al. (2018) Biomechanical changes and recovery of gait function after total hip arthroplasty for osteoarthritis: A systematic review and meta-analysis. Osteoarthr Cartil 26(7), 847–863. [CrossRef] [Google Scholar]
- Whittle MW (1996) Clinical gait analysis: A review. Hum Mov Sci 15, 369–387. [CrossRef] [Google Scholar]
- Tao W, Liu T, Zheng R, et al. (2012) Gait analysis using wearable sensors. Sensors (Basel) 12(2), 2255–2283. [CrossRef] [PubMed] [Google Scholar]
- Merriaux P, Dupuis Y, Boutteau R, et al. (2017) A study of Vicon system positioning performance. Sensors (Basel) 17(7), 1591. [CrossRef] [Google Scholar]
- Geerse DJ, Coolen BH, Roerdink M (2015) Kinematic validation of a multi-Kinect v2 instrumented 10-meter walkway for quantitative gait assessments. PLoS One 10(10), e0139913. [CrossRef] [PubMed] [Google Scholar]
- Tsushima H, Morris ME, McGinley J (2003) Test-retest reliability and inter-tester reliability of kinematic data from a three-dimensional gait analysis system. J Jpn Phys Ther Assoc 6(1), 9–17. [CrossRef] [PubMed] [Google Scholar]
- Mentiplay BF, Perraton LG, Bower KJ, et al. (2015) Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables. J Biomech 48(10), 2166–2170. [CrossRef] [PubMed] [Google Scholar]
- Nishimura A, Ito N, Nakazora S, et al. (2018) Does hallux valgus impair physical function? BMC Musculoskelet Disord 19, 174. [CrossRef] [PubMed] [Google Scholar]
- Heck A, Van Dongen C (2008) Gait analysis by high school students. Phys Educ 43(3), 284–290. [CrossRef] [Google Scholar]
- Chan YH (2003) Biostatistics 104: Correlational analysis. Singap Med J 44(12), 614–619. [Google Scholar]
- Xu X, McGorry RW, Chou LS, et al. (2015) Accuracy of the Microsoft Kinect for measuring gait parameters during treadmill walking. Gait Posture 42(2), 145–151. [CrossRef] [PubMed] [Google Scholar]
- Timmi A, Coates G, Fortin K, et al. (2018) Accuracy of a novel marker tracking approach based on the low-cost Microsoft Kinect v2 sensor. Med Eng Phys 59, 63–69. [CrossRef] [PubMed] [Google Scholar]
- Guffanti D, Brunete A, Hernando M, et al. (2020) The accuracy of the microsoft Kinect V2 sensor for human gait analysis. A different approach for comparison with the ground truth. Sensors (Basel) 20(16), 4405. [CrossRef] [Google Scholar]
- Latorre J, Colomer C, Alcañiz M, et al. (2019) Gait analysis with the Kinect v2: Normative study with healthy individuals and comprehensive study of its sensitivity, validity, and reliability in individuals with stroke. J Neuroeng Rehabil 16(1), 97. [CrossRef] [PubMed] [Google Scholar]
Cite this article as: Usami T, Nishida K, Iguchi H, Okumura T, Sakai H, Ida R, Horiba M, Kashima S, Sahashi K, Asai H, Nagaya Y, Murakami H, Ueki Y & Kuroyanagi G (2022) Evaluation of lower extremity gait analysis using Kinect V2® tracking system. SICOT-J 8, 27
All Tables
All Figures
Figure 1 (A) Six infrared sensors were located around the participant. Single Kinect V2® and a pressure sensing device were set in front of the participant. Participants walk from 4 m to 1 m on the plantar pressure sensing device towards Kinect. (B) The illustration shows the Kinect coordinate axis. X, Y, and Z directions show mediolateral, vertical, and posteroanterior axis, respectively. |
|
In the text |
Figure 2 Correlation coefficients of maximum flexion angle of right hip (A) and right knee (B) in each subject varied among each subject. Overall meta-analysis shows that maximum flexion angle of hip and knee correlates with r = 0.500 and p = 0.035, and r = 0.504 and p < 0.001, respectively. |
|
In the text |
Figure 3 The LOESS models show right hip (A) and knee angle (B) of participant (#9) over one gait cycle. Solid lines, which express the average angle of all walks, have similar trajectories in Kinect and motion capture groups. |
|
In the text |
Figure S1A Correlation coefficients of gait velocity in each subject, respectively. |
|
In the text |
Figure S1B Correlation coefficients of gait cycle time in each subject, respectively. |
|
In the text |
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.