Next Article in Journal
Chloride Intracellular Channel Protein 2 Promotes Microglial Invasion: A Link to Microgliosis in the Parkinson’s Disease Brain
Next Article in Special Issue
Arousal Regulation by the External Globus Pallidus: A New Node for the Mesocircuit Hypothesis
Previous Article in Journal
Searching for a Relationship between Early Breastfeeding and Cognitive Development of Attention and Working Memory Capacity
Previous Article in Special Issue
Psychotic Episode and Schizophrenia in Slovakian Narcolepsy Database
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Back on the Road: Comparing Cognitive Assessments to Driving Simulators in Moderate to Severe Traumatic Brain Injuries

Casa Colina Hospital and Centers for Healthcare Pomona, Pomona, CA 91769, USA
*
Author to whom correspondence should be addressed.
Brain Sci. 2023, 13(1), 54; https://doi.org/10.3390/brainsci13010054
Submission received: 22 November 2022 / Revised: 20 December 2022 / Accepted: 22 December 2022 / Published: 28 December 2022
(This article belongs to the Special Issue Women in Brain Science: Achievements, Challenges and Perspectives)

Abstract

:
Objective: To compare established clinical outcome assessments for predicting behind the wheel driving readiness and driving simulator results across age groups and in traumatic brain injury. Methods: Participants included adults who had a traumatic brain injury ranging in age from 31 to 57 years and a non-impaired adult population ranging in age from 18 to 80 years. Physical and cognitive outcomes measures were collected included range of motion and coordination, a “Rules of the Road Test” a “Sign Identification Test,” Trails A and B, and the clock drawing test. Visual measures included the Dynavision D2 system and motor-free visual perceptual test-3 (MVPT-3). Finally, the driving simulators (STIÒ version M300) metro drive assessment was used, which consisted of negotiating several obstacles in a metropolitan area including vehicles abruptly changing lanes, pedestrians crossing streets, and negotiating construction zones. Results: Our findings suggest that the standard paper-pencil cognitive assessments and sign identification test significantly differentiate TBI from a non-impaired population (Trails A, B and Clock drawing test p < 0.001). While the driving simulator did not show as many robust differences with age, the TBI population did have a significantly greater number of road collisions (F3, 78 = 3.5, p = 0.02). We also observed a significant correlation between the cognitive assessments and the simulator variables. Conclusions: Paper-pencil cognitive assessments and the sign identification test highlight greater differences than the STI Driving Simulator between non-impaired and TBI populations. However, the driving simulator may be useful in assessing cognitive ability and training for on the road driving.

1. Introduction

Driving is an essential activity of daily living for many individuals to maintain their independence [1]. Cessation of driving has often been found to have adverse consequences and has been associated with decreased health related quality of life, depression and social isolation [2]. For patients recovering from injury or illness, return to driving is often identified as a primary goal as it represents independence and autonomy [3,4]. Due to the complexity and heterogeneity of a neurologic injury such as a Traumatic Brain Injury, as well as the lack of clear and consistent clinical guidelines, established outcome measures or parameters it remains very difficult for healthcare providers to determine when an individual is ready to return to driving following the injury [5]. Comprehensive driving evaluations, which include behind the wheel driving, are considered the gold standard for this population [6,7]. However, several clinically validated paper and pencil assessments have been used to help determine readiness to return to on-road driving [8]. Physicians are often reluctant to provide driving clearance to patients due to liability concerns. In a report by the Federal Motor Carrier Safety Administration, they noted an insufficient amount of evidence to address the question of safety for persons with TBI to return to driving [9].
Safe return to driving following injury is contingent on cognitive, physical, and visual motor skills [8,9,10,11]. Several assessment tools have been studied in an attempt to develop performance-based neuropsychological predictors of safe driving [12]. The Clock Drawing test has been regarded as a promising screening tool of driving performance, as it is a brief and easy to administer test [13,14]. Another cognitive measure that has been found to correlate highly with driving performance is the Trail Making Test A and B, which assesses the domain of visual conceptual and visuomotor [15,16]. Further, both the clock drawing test and Trails A and B have been shown to be good predictors of driving performance using a driving simulator [13,17,18]. The Motor Free Visual Perceptual Test 3 (MVPT 3), which assesses the domain of visual perceptual ability, has also been shown to predict an increased likelihood of on-road accidents and it correlates with driving performance in stroke populations [19,20]. Persons who had poor performance on the cognitive domain of Trail Making B and MVPT where 22 times more likely to fail on-road evaluation [21,22]. Finally, the Dynavision, which assesses the domains of visual scanning, peripheral visual awareness, visuomotor reaction time, and basic cognitive skills and physical/mental endurance, has been used as a successful clinical tool in predicting success/failure in the on-road driving test [23,24].
The use of driving simulators is becoming more common by both occupational therapists and researchers to predict readiness for on the road driving and to understand underlying factors involved with safe driving and crash avoidance [25,26]. Driving simulators are able to provide stimulus control, allowing for controlled data collection verses on the road assessment in which factors are more dynamic and variable each time. Multiple studies have found driving simulators useful in the evaluation of on-road driving abilities or fitness to drive in older individuals, those with Parkinson’s, stroke, and brain injury [5,25,27,28]. Specifically, evidence suggests driving simulators are able to detect differences between young and aging drivers on variables such as speed, steering control, divided attention, lane boundary crossing, and total collisions [25,29]. Driving simulators have also been reported to detect differences in driving ability on the above variables and others be-tween healthy drivers and those with neurologic injury including traumatic brain injury (TBI [5,27] stroke [22,30], Parkinson’s Disease (PD) [27,31], Multiple Sclerosis [32], and dementia [13,33].
Despite the current utility of neuropsychological cognitive, clinical pre-driving assessments and simulator assessments, there is a lack of comparison of these outcomes and changes that over with age or difference between impaired and non-impaired populations. Therefore, the purpose of this study to compare clinically proven outcome assessments for predicting behind the wheel driving readiness and driving simulator results in across age groups and in traumatic brain injury.

2. Materials and Methods

2.1. Participants

A sample of 62 healthy adults ranging in age from 18–80 years was recruited from a random sample of staff and individuals from the community. A second sample of 21 traumatic brain injury patients from age 31 to 57 years were recruited from a rehabilitation facility. Exclusion for the non-impaired population included: not having a valid driver’s license, a history of a previous brain injury, inability to read and not having proficiency in the English language. Participants for the non-impaired population were assigned to a group based on age (18–40, 41–65, and 66–85). The exclusion for the TBI population was inability to understand the directions, not having proficiency in the English language, inability to read and follow directions.

2.2. Study Design

Prior to initiation of this study, it was reviewed and approved by the Institutional Review Board and all research was done in accordance to required ethical standards. Study assessments were conducted in a single two-hour session by an occupational therapist, physical therapist or research assistant. Each was trained in administering the assessments prior to independent administration for each participant. Participants first completed self-reported intake forms that documented prior medical history, driving history, pain and dizziness, (both pain and dizziness were on a zero-to-ten-point scale, with ten indicating the most severe symptoms, the dizziness and pain scales would also be noted post simulator use).

2.3. Outcome Measures

Physical measures included active assessment of bilateral upper extremity, lower extremity, and trunk range of motion, muscle strength, and coordination to establish if a participant would physically be able to use the driving simulator.
Cognitive/Visual measures included the “Rules of the Road Test” (Max 5), the “Sign Identification Test” (max 4) (both based on the written driving test given by the state of California Department of Motor Vehicles), the Trails Making A and B test, the Clock Drawing test, Dynavision D2, and the Motor-Free Visual Perceptual Test-3 (MVPT-3).
The Systems Technology Incorporated Simulator (STI version M300) (STISIM) driving simulator is a PC based interactive simulator that is designed to immerse the participant in a range of psychomotor and cognitive tasks. The driving tasks that were selected for use in this study included: introduction to traffic violation (D) assessment and metro drive (D) assessment, which included 39 variables.

2.4. Statistical Analysis

The mean and standard deviation were reported according to age groups. Differences between the TBI population and the 3 non-impaired age groups were assessed with an ANOVA and correlations were run to compare the paper pencil and Dynavision assessments with the driving simulator.

3. Results

3.1. Participants

The non-impaired population was binned into one of 3 age-range categories, 18–40 (n = 21), 41–65 (n = 23), and over 65 (n = 18). The mean age overall for the non-impaired population was 50.3 ± 19.2 years while the mean age for each non-impaired population age group was 28.95 ± 6.6, 50.9 ± 7.3, and 74.3 ± 5.5 years, respectively. The mean age for the TBI population was 44.14 ± 13.2 years (Table 1). When comparing medical information across all groups, medical issues such as diabetes and hypertension increased with age, however vertigo, seizures, loss of consciousness, and dizziness had the highest incidence in the TBI population (Table 1).

3.2. Driving Information

Driving information provided by the participants was consistent with national driving statistics in that the 65–85-year-olds spend less time driving on freeways (88%), at night (83%), and long distances (72%) (Table 2). The TBI population followed by the 18–40-year-olds had the greatest number of moving violations and accidents. A significant difference in the number of accidents was noted between the groups with the 41–64 years having the fewest (0.04) compared with the 18–40 (0.38), 65+ (0.28), and the TBI population (0.71) (Table 2). All ages scored similarly on the rules of the road and sign identification tests, except the TBI population had significantly greater impairment on the sign identification tests (F (3, 78) = 15.7, p < 0.001).

3.3. Congitive Function and Visual Perception

Results for the cognitive function and visual perception tasks showed expected age-related changes and differences in the TBI population (Table 3). A significant increase in the time taken to complete Trails A and B was observed in the TBI population and with the 65+ group (F (3, 74) = 9.9, p < 0.001; F (3, 74) = 14.4, p < 0.001). The clock-drawing test showed significant differences in cognition for the TBI population (F (3, 74) = 11.0, p < 0.001). The Dynavision D2 Mode B with flash showed significant age-related differences while the TBI population performed similar to the 18–40-year-olds (F (3, 74) = 9.9, p < 0.0001). Similarly, when looking at visual perception with the MVPT-3 we observed significant differences between the 41–65-year-olds and 65–85-year-olds and 18–40-year-olds and the TBI population (Table 3).

3.4. Driving Simulator

Results with the driving simulator only showed one significant age-related difference. Interestingly, the TBI population had a significantly greater number of road collisions (Table 4, F (3, 78) = 3.5, p = 0.02). When looking at age-related changes the 18–40-year-olds trended towards having the greatest number of collisions, traffic tickets, and the slowest reaction time overall. Spearman rank correlations were done to determine if the driving simulator data correlates with any of the medical, driving, or clinical assessment data that were collected. Significant correlations were observed between the simulator, reaction time and cognitive abilities (Table 5). Specifically, we found cognitive impairments were associated with the percent of time outside of the lane and time over the speed limit. The majority of these correlations were also seen in the 65+ group but not the other age groups. The exception was with the Dynavision mode B, where a significant correlation was observed between percentage of time spent outside of the lane and the number of hits. This correlation was also present in the 18–40-year-old group (Table 5). Using the MVPT-3 as a visual perception assessment we found significant correlations between the MVPT-3, number of collisions, percent of time outside of the lane and number of times over the speed limit (Table 5). When correlations with the MVPT were run for each individual age group these correlations were no longer significant. Finally, we saw interesting relationships between the five-point rules of the road test and driving metrics on the simulator including number of traffic tickets, time outside of the lane and time over the speed limit. When these correlations were run for the different age groups, we found relationships for the 65+ and 18–40-year-old groups only.

4. Discussion

Driving is an essential activity for independent living and often identified as a goal for patients who are recovering from injury or illness. Safe return to driving following injury is contingent on both cognitive and physical status however, clear and consistent clinical guidelines to determine when an individual is ready to return to driving following an injury are lacking. While a review of the literature on TBI and Driving assessment has concluded there is insufficient evidence that a driving simulator can substitute for real-world driving [17,34], there appears to be the potential for stimulator use for rehabilitation intervention and assessment [5]. The purpose of this study was to compare clinically proven outcome assessments for predicting behind the wheel driving readiness and driving simulator results in across age groups and in traumatic brain injury.
Our study found that paper-pencil cognitive assessments and sign identification strongly identify significant differences between individuals with TBI and the non-impaired population; however, the addition of driving simulator data did not further stratify these groups.
The results of this study replicate the work of other researchers who have found a correlation between neuropsychological tests and driving skill. The older group and the TBI population in this study was noted to have lower scores on the cognitive measures (Trails A, B and the clock test), which have been shown to be a salient predictor of crash involvement in older adult [19]. The Clock Drawing test which assesses executive function, has been found to have limited utility as a solitary measure of on-road performance for patients with dementia, but has been suggested to be useful when paired with other screening assessments [35]. In our study the Clock test showed significant differences between the TBI group and all of the non-impaired groups, with decreased executive function in the TBI group population. Previous studies have also found that persons who had poor performance on the cognitive domain of Trail Making B and MVPT where 22 times more likely to fail an on-road evaluation [22]. In our study both Trails A and B showed significant differences when comparing the TBI and the non-impaired groups. Interestingly, the MVPT-3 showed a significant difference between groups however the TBI group performed similar to the 18–40-year-olds suggesting more age-related changes than injury related impairment. We found a similar pattern with the Dynavision Mode B with similarities in performance between the 18–40-year-olds and the TBI population and a significant difference in performance between these groups and the 41–65- and 65–85-year-old non-impaired groups (p < 0.0001, F (3, 74) = 9.9). Our data is in contrast to previous studies, which has shown the Dynavision to be a successful clinical tool in predicting success/failure in the on-road driving test [23,24]. One difference between our study and the previous studies was the number of trials or practice that was given [24]. In a recent study it was found that 15 training sessions were needed to overcome produce a reliable performance for the test [36].
Results with the driving simulator are in line with earlier reports regarding younger drivers as we found that the 18–40-year-old group showed an increase in collisions, number of traffic light tickets, and number of times over the speed limit, which may be related to increased risk taking. Younger drivers between the ages of 18 to 25 years old are more likely to run red lights as compared to other age groups [37]. This finding is also supported by earlier studies that noted red light runners tend to be drivers under 30 [38,39]. Interestingly, we also found that the youngest group showed increased pedal reaction time (taking a longer time to engage the brake pedal when slowing down), which may suggest a lack of attention to the task, distraction while driving, or a lack of experience which results in misestimation of the time it takes to cover a set distance. We only observed 1 significant effect for the TBI population in all the variables measured with the driving simulator. While the TBI population had the greatest number of road collisions with the simulator, a significant difference was only observed when comparing with the 41–65 and 65–85-year-olds. A significant difference between the TBI and 18–40-year-old non-impaired groups was not observed. Studies have found that the strategy and movements made in a simulator are similar to actual driving [40]. However, the level of visual engagement was lower in a simulator [40]. Another study found that a when a physiological response was measured a stress reaction and higher level of arousal was only measured in the real vehicle [41].
There are advantages with the driving simulator which include a safe environment to observe individuals driving behaviors in a virtual reality version of real road situations, direct and real time feedback to the participant of their performance via the driving simulator, and driving simulators are found to have higher face validity than pencil paper tests for pre-on road assessment [5]. In addition, patients anecdotally accept the feedback from their performance on the driving simulator more readily due to the real time feedback and look forward to additional opportunities to practice. However, in this study paper-pencil cognitive assessments and the sign identification test appear to be the best predictors of both TBI related impairments and behind the wheel driving readiness. Use of the STI Driving Simulator alone or in conjunction with other tests and measures was not as strong of predictor as anticipated but as mentioned above may have a role in aiding the return to driving following TBI. More research is also needed to see if practice sessions would help to improve the validity of the testing measures.

Study Limitations

The study was limited by a convenience sample along with a smaller sample size. We had participants who began the simulator assessment but showed Simulator Adaptation Syn-drome (SAS) and had to modify the protocol. SAS includes nausea, sweating, headaches, disorientation, vertigo, and eyestrain [42]. This can affect the client’s attention and driving performance as well as the validity of the simulator outcome [43]. To counteract SAS the two side screens were turned off for those individuals, which modified the visual input of trees, mountains on the periphery. All of the other content remained the same. 4.8% of participants required the side screens turned off.

5. Conclusions

The focus of this study was to assess pencil paper assessments with driving simulator data to determine if the use of the driving simulator in conjunction with the standardized paper pencil test assists clinicians in predicting behind the wheel driving readiness for a traumatic brain injury population. Our findings suggest that paper-pencil cognitive assessments and sign identification tests do the best at differentiating TBI from a non-impaired population. When using the driving simulator TBI patients perform similar to the 18–40-year-old group of non-impaired individuals. It has been noted in best practice guidelines for driving that the driving simulator cannot be the sole determinant of fitness to drive in older adults, but the simulator activities may be valuable as part of a comprehensive driving evaluation [5,6].
As driving simulators are becoming more common in the field of rehabilitation our data suggests that the addition of a driving simulator does not further define differences between a non-impaired and TBI population, but may be used as an adjunct to on the road driving.

Author Contributions

Conceptualization, E.R.R. and S.K.; methodology, E.R.R. and D.S.O.; formal analysis, E.R.R.; investigation, All authors; resources, E.R.R. and S.K.; data curation, E.R.R. and D.S.O.; writing—original draft preparation, E.R.R.; writing—review and editing, All authors; visualization, all authors; supervision, E.R.R. and S.K.; project administration, D.S.O.; funding acquisition, S.K. and E.R.R. All authors have read and agreed to the published version of the manuscript.

Funding

The authors would like to thank Loverso, the Casa Colina Board of Directors, and the Casa Colina Foundation for supporting this research. The foundation was not involved in the design of the study and collection, analysis, and interpretation of data or in writing the manuscript.

Institutional Review Board Statement

Study protocols were approved by the institutional review board of Casa Colina Hospital and Centers for Healthcare (FWA0006711).

Informed Consent Statement

Written informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data that support the findings of this study are available upon request from the corresponding author.

Acknowledgments

The authors would like to thank Felice Loverso, the Casa Colina Board of Directors, and the Casa Colina Foundation for supporting this research. In addition, we would like to thank the numerous clinicians and researcher who helped make this study possible including Rachel E Tabak, Celeste R Dunlap, David Russak, Sarah Meredith, Jake Hazen, and Kelsey Fitzgerald.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Driving & Community Mobility|AOTA. Available online: https://www.aota.org/practice/practice-settings/driving-community-mobility (accessed on 11 November 2022).
  2. Chihuri, S.; Mielenz, T.J.; DiMaggio, C.J.; Betz, M.E.; DiGuiseppi, C.; Jones, V.C.; Li, G. Driving Cessation and Health Outcomes in Older Adults. J. Am. Geriatr. Soc. 2016, 64, 332–341. [Google Scholar] [CrossRef] [Green Version]
  3. Novack, T.A.; Labbe, D.; Grote, M.; Carlson, N.; Sherer, M.; Arango-Lasprilla, J.C.; Bushnik, T.; Cifu, D.; Powell, J.M.; Ripley, D. Return to driving within 5 years of moderate-severe traumatic brain injury. Brain Inj. 2010, 24, 464–471. [Google Scholar] [CrossRef]
  4. Rapport, L.J.; Bryer, R.C.; Hanks, R.A. Driving and community integration after traumatic brain injury. Arch. Phys. Med. Rehabil. 2008, 89, 922–930. [Google Scholar] [CrossRef]
  5. Imhoff, S.; Lavallière, M.; Teasdale, N.; Fait, P. Driving assessment and rehabilitation using a driving simulator in individuals with traumatic brain injury: A scoping review. NeuroRehabilitation 2016, 39, 239–251. [Google Scholar] [CrossRef]
  6. Classen, S.; Brooks, J.; National Highway Traffic Safety Administration; American Occupational Therapy Association. Driving simulators for occupational therapy screening, assessment, and intervention. Occup. Ther. Health Care 2014, 28, 154–162. [Google Scholar] [CrossRef]
  7. Classen, S.; Wang, Y.; Winter, S.M.; Velozo, C.A.; Lanford, D.N.; Bédard, M. Concurrent criterion validity of the safe driving behavior measure: A predictor of on-road driving outcomes. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2013, 67, 108–116. [Google Scholar] [CrossRef] [Green Version]
  8. Dickerson, A.E. Driving Assessment Tools Used by Driver Rehabilitation Specialists: Survey of Use and Implications for Practice. Am. J. Occup. Ther. 2013, 67, 564–573. [Google Scholar] [CrossRef] [Green Version]
  9. Tregear, S.; Phil, D. Traumatic Brain Injury and CMV Driver Safety. Available online: https://www.fmcsa.dot.gov/sites/fmcsa.dot.gov/files/docs/TBI_DriverSafetyMRB_Present_123109.pdf (accessed on 11 November 2022).
  10. Sayers, S.P.; Gibson, K. Effects of High-Speed Power Training on Muscle Performance and Braking Speed in Older Adults. J. Aging Res. 2012, 2012, 426278. [Google Scholar] [CrossRef] [Green Version]
  11. Marottoli, R.A.; Allore, H.; Araujo, K.L.B.; Iannone, L.P.; Acampora, D.; Gottschalk, M.; Charpentier, P.; Kasl, S.; Peduzzi, P. A Randomized Trial of a Physical Conditioning Program to Enhance the Driving Performance of Older Persons. J. Gen. Intern. Med. 2007, 22, 590–597. [Google Scholar] [CrossRef] [Green Version]
  12. Daigneault, G.; Joly, P.; Frigon, J.-Y. Executive functions in the evaluation of accident risk of older drivers. J. Clin. Exp. Neuropsychol. 2002, 24, 221–238. [Google Scholar] [CrossRef]
  13. Freund, B.; Gravenstein, S.; Ferris, R.; Burke, B.L.; Shaheen, E. Drawing clocks and driving cars. J. Gen. Intern. Med. 2005, 20, 240–244. [Google Scholar] [CrossRef] [Green Version]
  14. Cosentino, S.; Jefferson, A.; Chute, D.L.; Kaplan, E.; Libon, D.J. Clock drawing errors in dementia: Neuropsychological and neuroanatomical considerations. Cogn. Behav. Neurol. Off. J. Soc. Behav. Cogn. Neurol. 2004, 17, 74–84. [Google Scholar] [CrossRef]
  15. Hopewell, C.A. Driving assessment issues for practicing clinicians. J. Head Trauma Rehabil. 2002, 17, 48–61. [Google Scholar] [CrossRef]
  16. Pellerito, J. Driver Rehabilitation and Community Mobility: Principles and Practice; Elsevier Mosby: St. Louis, MO, USA, 2006. [Google Scholar]
  17. Bédard, M.B.; Parkkari, M.; Weaver, B.; Riendeau, J.; Dahlquist, M. Assessment of driving performance using a simulator protocol: Validity and reproducibility. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2010, 64, 336–340. [Google Scholar] [CrossRef] [Green Version]
  18. Mathias, J.L.; Lucas, L.K. Cognitive predictors of unsafe driving in older drivers: A meta-analysis. Int. Psychogeriatr. 2009, 21, 637–653. [Google Scholar] [CrossRef]
  19. Ball, K.K.; Roenker, D.L.; Wadley, V.G.; Edwards, J.D.; Roth, D.L.; McGwin, G., Jr.; Raleigh, R.; Joyce, J.J.; Cissell, G.M.; Dube, T. Can High-Risk Older Drivers Be Identified Through Performance-Based Measures in a Department of Motor Vehicles Setting? IDENTIFYING HIGH-RISK OLDER DRIVERS. J. Am. Geriatr. Soc. 2006, 54, 77–84. [Google Scholar] [CrossRef]
  20. Korner-Bitensky, N.; Bitensky, J.; Sofer, S.; Man-Son-Hing, M.; Gelinas, I. Driving evaluation practices of clinicians working in the United States and Canada. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2006, 60, 428–434. [Google Scholar] [CrossRef] [Green Version]
  21. Holowaychuk, A.; Parrott, Y.; Leung, A.W.S. Exploring the Predictive Ability of the Motor-Free Visual Perception Test (MVPT) and Trail Making Test (TMT) for On-Road Driving Performance. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2020, 74, 7405205070p1–7405205070p8. [Google Scholar] [CrossRef]
  22. Mazer, B.L.; Korner-Bitensky, N.A.; Sofer, S. Predicting ability to drive after stroke. Arch. Phys. Med. Rehabil. 1998, 79, 743–750. [Google Scholar] [CrossRef]
  23. Klavora, P.; Gaskovski, P.; Martin, K.; Forsyth, R.D.; Heslegrave, R.J.; Young, M.; Quinn, R.P. The effects of Dynavision rehabilitation on behind-the-wheel driving ability and selected psychomotor abilities of persons after stroke. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 1995, 49, 534–542. [Google Scholar] [CrossRef]
  24. Wells, A.J.; Hoffman, J.R.; Beyer, K.S.; Jajtner, A.R.; Gonzalez, A.M.; Townsend, J.R.; Mangine, G.T.; Robinson, E.H.; McCormack, W.P.; Fragala, M.S.; et al. Reliability of the dynavisionTM d2 for assessing reaction time performance. J. Sports Sci. Med. 2014, 13, 145–150. [Google Scholar]
  25. Lee, H.C.; Lee, A.H. Identifying older drivers at risk of traffic violations by using a driving simulator: A 3-year longitudinal study. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2005, 59, 97–100. [Google Scholar] [CrossRef] [Green Version]
  26. Shechtman, O.; Classen, S.; Awadzi, K.; Mann, W. Comparison of driving errors between on-the-road and simulated driving assessment: A validation study. Traffic Inj. Prev. 2009, 10, 379–385. [Google Scholar] [CrossRef] [PubMed]
  27. Uc, E.; Rizzo, M.; Anderson, S.; Lawrence, J.; Dawson, J. Driver rehabilitation in parkinson’s disease using a driving simulator: A pilot study. Proc. Int. Driv. Symp. Hum. Factors Driv. Assess. Train Veh. Des. 2011, 2011, 248–254. [Google Scholar] [PubMed]
  28. Mazer, B.; Gélinas, I.; Duquette, J.; Vanier, M.; Rainville, C.; Chilingaryan, G. A randomized clinical trial to determine effectiveness of driving simulator retraining on the driving performance of clients with neurological impairment. Br. J. Occup. Ther. 2015, 78, 369–376. [Google Scholar] [CrossRef] [Green Version]
  29. Brouwer, W.H.; Waterink, W.; Van Wolffelaar, P.C.; Rothengatter, T. Divided attention in experienced young and older drivers: Lane tracking and visual analysis in a dynamic driving simulator. Hum. Factors 1991, 33, 573–582. [Google Scholar] [CrossRef]
  30. Devos, H.; Hawley, C.A. Screening tools for fitness to drive after traumatic brain injury and stroke. Eur. J. Neurol. 2013, 20, 1225–1226. [Google Scholar] [CrossRef]
  31. Zesiewicz, T.A.; Cimino, C.R.; Malek, A.R.; Gardner, N.; Leaverton, P.L.; Dunne, P.B.; Hauser, R.A. Driving safety in Parkinson’s disease. Neurology 2002, 59, 1787–1788. [Google Scholar] [CrossRef]
  32. Kotterba, S.; Orth, M.; Eren, E.; Fangerau, T.; Sindern, E. Assessment of driving performance in patients with relapsing-remitting multiple sclerosis by a driving simulator. Eur. Neurol. 2003, 50, 160–164. [Google Scholar] [CrossRef]
  33. Szlyk, J.P.; Myers, L.; Zhang, Y.; Wetzel, L.; Shapiro, R. Development and assessment of a neuropsychological battery to aid in predicting driving performance. J. Rehabil. Res. Dev. 2002, 39, 483–496. [Google Scholar]
  34. Classen, S.; Levy, C.; McCarthy, D.; Mann, W.C.; Lanford, D.; Waid-Ebbs, J.K. Traumatic brain injury and driving assessment: An evidence-based literature review. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 2009, 63, 580–591. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Manning, K.J.; Davis, J.D.; Papandonatos, G.D.; Ott, B.R. Clock Drawing as a Screen for Impaired Driving in Aging and Dementia: Is It Worth the Time? Arch. Clin. Neuropsychol. 2014, 29, 1–6. [Google Scholar] [CrossRef] [PubMed]
  36. Wells, A.J.; Johnson, B.-A.D.I. Test-Retest Reliability, Training, and Detraining Effects Associated With the Dynavision D2TM Mode A Visuomotor Reaction Time Test. J. Sport Rehabil. 2022, 31, 253–261. [Google Scholar] [CrossRef] [PubMed]
  37. Porter, B.E.; Berry, T.D. A nationwide survey of self-reported red light running: Measuring prevalence, predictors, and perceived consequences. Accid. Anal. Prev. 2001, 33, 735–741. [Google Scholar] [CrossRef] [PubMed]
  38. Goldenbeld, C.; Daniels, S.; Schermers, G. Red light cameras revisited. Recent evidence on red light camera safety effects. Accid. Anal. Prev. 2019, 128, 139–147. [Google Scholar] [CrossRef]
  39. Retting, R.A.; Ulmer, R.G.; Williams, A.F. Prevalence and characteristics of red light running crashes in the United States. Accid. Anal. Prev. 1999, 31, 687–694. [Google Scholar] [CrossRef]
  40. Robbins, C.J.; Allen, H.A.; Chapman, P. Comparing drivers’ visual attention at Junctions in Real and Simulated Environments. Appl. Ergon. 2019, 80, 89–101. [Google Scholar] [CrossRef]
  41. Gemonet, E.; Bougard, C.; Masfrand, S.; Honnet, V.; Mestre, D.R. Car drivers coping with hazardous events in real versus simulated situations: Declarative, behavioral and physiological data used to assess drivers’ feeling of presence. PLoS ONE 2021, 16, e0247373. [Google Scholar] [CrossRef]
  42. Zhang, L.-L.; Wang, J.-Q.; Qi, R.-R.; Pan, L.-L.; Li, M.; Cai, Y.-L. Motion Sickness: Current Knowledge and Recent Advance. CNS Neurosci. Ther. 2016, 22, 15–24. [Google Scholar] [CrossRef]
  43. De Winkel, K.N.; Talsma, T.M.W.; Happee, R. A meta-analysis of simulator sickness as a function of simulator fidelity. Exp. Brain Res. 2022, 240, 3089–3105. [Google Scholar] [CrossRef]
Table 1. Demographic/Medical Intake information (self-reported).
Table 1. Demographic/Medical Intake information (self-reported).
Demographic/Medical Information18–40 Year Olds (n = 21)41–65 Year Olds (n = 23)65–85 Year Olds (n = 18)TBI Population (n = 21)
Age (Mean ± SD)28.95 ± 6.650.9 ± 7.374.3 ± 5.544.14 ± 13.2
Gender81% F/19% M65% F/35% M50% F/50% M15% F/85% M
Ave # of med issues0.48 ± 0.20.70 ± 0.21.3 ± 0.2 *N/A
Medical Issues85% No48% No22% NoN/A
Seizures95% No100% No88% No86% No
Loss of Consciousness90% No91% No94% No24% No
Dizziness90% No95% No83% No43% No
Vertigo95% No91% No83% No66% No
Diabetes100% No95% No78% No95% No
Hypertension81% No56% No44% No71% No
Pain level (1–10) (mean score)0.14 + 0.480.14 + 0.640.4 + 0.740.86 + 1.65 *
* denotes significance at p < 0.05. # denotes number.
Table 2. Intake Driving information.
Table 2. Intake Driving information.
Driving Information18–40 Year Olds (n = 21)41–65 Year Olds (n = 22)65–85 Year Olds (n = 15)TBI Population (n = 21)
Automatic transmission100% 91% 93% 86%
Drive on freeway90% 100% 88% 95%
Drive at night100% 100% 83% 95%
Drive long distance86% 100% 72% 95%
Drive for work100% 91% 33% 71%
# of moving violations (Mean)0.48 ± 0.750.22 ± 0.40.05 ± 0.5 *0.57 ± 0.87
# of Accidents (Mean)0.38 ± 0.50.04 ± 0.2 *0.28 ± 0.110.71 ± 1.4
Rules of the road (max 5)4.5 ± 14.95 ± 0.24.6 ± 0.84.35 ± 0.93
Sign Identification (4 signs) 3.9 ± 0.54 ± 03.94 ± 0.23.15 ± 0.75 *
* denotes significance at p < 0.05. # denotes number
Table 3. Clinical Assessments.
Table 3. Clinical Assessments.
Assessments18–40 Year Olds (n = 21)41–65 Year Olds (n = 24)65–85 Year Olds (n = 17)TBI (n = 16)ANOVA
Trails A24.4 ± 2.4 C27.9 ± 2.3 BC38.3 ± 2.6 B46.3 ± 3.2 Ap < 0.0001
F (3, 74) = 9.9
Trails B57.6 ± 6.6 B58.3 ± 6.3 B94.6 ± 7.1 B170.0 ± 14.3 Ap < 0.0001
F (3, 74) = 14.4
Clock test 6–15.4 ± 0.14 B5.7 ± 0.14 B5.2 ± 0.15 B2.8 ± 1.6 Ap < 0.0001
F (3, 74) = 11.0
Dynavision, Mode A ave. rxn time0.99 ± 0.041.13 ± 0.041.4 ± 0.041.3 ± 0.12p = 0.23
F (3, 74) = 1.46
Dynavision, Mode B with Flash # hits37.0 ± 2.7 A26.0 ± 2.6 B13.3 ± 3.0 C30.9 ± 3.1 Ap < 0.0001
F (3, 74) = 9.9
Motor free Visual Perception (SS)99.3 ± 4.2 B123.4 ± 3.9 A117.0 ± 4.3 A96.8 ± 4.3 Bp = 0.0001
F (3, 79) = 9.5
Data represents the mean ± SEM. # denotes number. Groups not connected by the same letter are significantly different, i.e., A is statistically different from B and C and B is statistically different from A and C.
Table 4. Driving simulator data.
Table 4. Driving simulator data.
Driving Simulator Data (Hazard Perception)18–40 Year Olds (n = 21)41–65 Year Olds (n = 22)65–85 Year Olds (n = 15)TBI (n = 16)p Value
# of road collisions 0.64 ± 0.120.35 ± 0.110.31 ± 0.140.8 ± 0.14 *p = 0.02 F (3, 78) = 3.5
# of traffic light tickets0.19 ± 0.060.0 ± 0.060.11 ± 0.070.04 ± 0.07p = 0.14 F (3, 78) = 1.8
# of times over speed limit2.4 ± 0.361.68 ± 0.42.4 ± 0.42.4 ± 0.4p = 0.53 F (3, 78) = 0.7
# of times driver went off road0.7 ± 0.090.7 ± 0.080.94 ± 0.10.9 ± 0.09p = 0.17 F (3, 78) = 1.7
% of time outside of lanes0.2 ± 0.20.25 ± 0.20.92 ± 0.20.26 ± 0.2p = 0.14 F (3, 78) = 1.8
Total pedal reaction time13.26 ± 2.46.6 ± 2.44.9 ± 2.712.6 ± 2.7p = 0.06 F (23, 78) = 2.5
* denotes significance at p < 0.05. # denotes number. % denotes the percentage.
Table 5. Correlations between simulator data and Clinical assessment data.
Table 5. Correlations between simulator data and Clinical assessment data.
Driving Simulator DataClinical Assessment DataSpearman Rank ρ
Attention/Cognition
% of time out of laneTrails A 10.377 **
Total # of times over speed limitTrails A 10.2583 *
% of time out of laneMode A average reaction time0.2732 *
% of time out of laneMode B with flash #hits 2−0.3147 *
Visual Perception
% of time out of laneMVPT standard score −0.2657
Total # of times over speed limitMVPT standard score−0.3794
Total # of collisionsMVPT standard score−0.3649
Driving assessment
% of time out of laneRules of road/5 2−0.4433
Total # of times over speed limitRules of road/5 1,2−0.3624
Total # of traffic light ticketsRules of road/5 1−0.2819
* p < 0.05, ** p < 0.01; 1 when analyzed by age bin a significant correlation was present for the 65+ group; 2 when analyzed by age bin a significant correlation was present for the 18–40-year-old group. # denotes number.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ouellette, D.S.; Kaplan, S.; Rosario, E.R. Back on the Road: Comparing Cognitive Assessments to Driving Simulators in Moderate to Severe Traumatic Brain Injuries. Brain Sci. 2023, 13, 54. https://doi.org/10.3390/brainsci13010054

AMA Style

Ouellette DS, Kaplan S, Rosario ER. Back on the Road: Comparing Cognitive Assessments to Driving Simulators in Moderate to Severe Traumatic Brain Injuries. Brain Sciences. 2023; 13(1):54. https://doi.org/10.3390/brainsci13010054

Chicago/Turabian Style

Ouellette, Debra S., Stephanie Kaplan, and Emily R. Rosario. 2023. "Back on the Road: Comparing Cognitive Assessments to Driving Simulators in Moderate to Severe Traumatic Brain Injuries" Brain Sciences 13, no. 1: 54. https://doi.org/10.3390/brainsci13010054

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop