Next Article in Journal
Cardiologist-Directed Sedation Management in Patients Undergoing Transvenous Lead Extraction: A Single-Centre Retrospective Analysis
Next Article in Special Issue
Adverse Outcome Following Mild Traumatic Brain Injury Is Associated with Microstructure Alterations at the Gray and White Matter Boundary
Previous Article in Journal
On the Virtues of “Team Medicine”—A City of Hope Perspective
Previous Article in Special Issue
A Multidimensional Approach to Assessing Factors Impacting Health-Related Quality of Life after Pediatric Traumatic Brain Injury
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quality of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO)—The First Disease-Specific Self-Report Questionnaire after Traumatic Brain Injury

1
Institute of Medical Psychology and Medical Sociology, University Medical Center Göttingen, Waldweg 37A, 37073 Göttingen, Germany
2
Institute of Psychology, University Innsbruck, Innrain 52f, 6020 Innsbruck, Austria
3
Departamento de Ciencias de la Salud de la Universidad Pública de Navarra, Campus de Arrosadía, 31006 Pamplona, Spain
4
Instituto de Investigación Sanitaria de Navarra (IdiSNA), 31008 Pamplona, Spain
5
cBRAIN, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, LMU University Hospital, Ludwig-Maximilian University, Nussbaumstrasse 5, 80336 Munich, Germany
6
Department of Pediatric Neurology and Developmental Medicine, LMU Center for Development and Children with Medical Complexity, Dr. von Hauner Children’s Hospital, LMU University Hospital, Haydnstr. 5, 80336 Munich, Germany
7
Specialist Center for Paediatric Neurology, Neurorehabilitation and Epileptology, Schoen Klinik, Krankenhausstraße 20, 83569 Vogtareuth, Germany
8
Department of Paediatric Neurology, Hospital of Goethe University, Theodor-Stern-Kai 7, 60590 Frankfurt am Main, Germany
9
Interdisciplinary Pediatric Center for Children with Developmental Disabilities and Severe Chronic Disorders, Department of Pediatrics and Adolescent Medicine, University Medical Center, Robert-Koch-Str. 40, 37075 Göttingen, Germany
10
Department of Pediatric Intensive Care Medicine and Neonatology, University Hospital Muenster, Albert-Schweitzer-Campus 1, 48149 Muenster, Germany
11
Neuropediatrics, St. Mauritius Therapeutic Clinic, Strümper Straße 111, 40670 Meerbusch, Germany
12
Hegau-Jugendwerk GmbH, Neurological Rehabilitation Center for Children, Adolescents and Young Adults, Kapellenstr. 31, 78262 Gailingen am Hochrhein, Germany
13
Department of Health and Prevention, University of Greifswald, Robert-Blum-Str. 13, 17487 Greifswald, Germany
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(15), 4898; https://doi.org/10.3390/jcm12154898
Submission received: 27 June 2023 / Revised: 18 July 2023 / Accepted: 22 July 2023 / Published: 26 July 2023
(This article belongs to the Special Issue Traumatic Brain Injury (TBI): Recent Trends and Future Perspectives)

Abstract

:
The subjective impact of the consequences of pediatric traumatic brain injury (pTBI) on different life dimensions should be assessed multidimensionally and as sensitively as possible using a disease-specific health-related quality of life (HRQoL) instrument. The development and psychometrics of the first such self-report questionnaire for children and adolescents after TBI are reported here. Focus group interviews with children, adolescents, and their parents, cognitive debriefing, item pool generation and reduction using Delphi expert panels were performed. The resulting version was psychometrically tested on 300 individuals aged 8–17 years. After item reduction based on factor analyses, differential item functioning, reliability, and validity were investigated. The final 35 items were associated with six scales (Cognition, Self, Daily Life and Autonomy, Social Relationships, Emotions, Physical Problems). Internal consistency and construct validity were satisfactory. Health-related Quality of life (HRQoL) was significantly lower in older and in female participants, as well as those with cognitive disabilities, anxiety, depression and post-concussion symptoms, than in comparative groups. The new QOLIBRI-KID/ADO is a comprehensive, multidimensional, reliable, and valid instrument, comparable in content and items to the QOLIBRI adult version. Therefore, disease-specific HRQoL can now be measured across the lifespan and may support the amelioration of treatment, care, rehabilitation, and daily life of children and adolescents after TBI.

1. Introduction

Pediatric traumatic brain injury (pTBI) constitutes an important global health challenge, as it is the most common injury-related cause of death and disability in this age group [1]. The incidence and mortality rates vary widely between countries. Incidence extends from 12 (Sweden) to 670 (Germany) children per 100,000 children per year [2]. Mortality ranges from 0.5 (Germany) [3] to 3.75 (Australia) [4]. Due to medical advances, mortality has decreased over the past decades [3]. However, many surviving children and adolescents still suffer from short- and long-term functional [5], cognitive [6], emotional [7], and social impairments [6]. There has been extensive research on the manifold sequelae after pTBI using a variety of predominantly unidimensional measures and methods (e.g., [8]). The heterogeneity and complexity of TBI and the wide spectrum of affected life dimensions and negative consequences cannot be captured comprehensively using unidimensional instruments. Therefore, the perspectives of children and adolescents on their health-related quality of life (HRQoL) after TBI, as well as those of their parents (and health care professionals), should be captured in a multidimensional way [8].
The HRQoL construct is inherently multidimensional. The WHO defines it as “the individual’s perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns” [9]. In determining the subjective effects of health conditions on an individual’s wellbeing and functioning, a distinction is made between generic [10] and disease-specific HRQoL [11]. Generic HRQoL includes a wide range of life dimensions related to different health conditions that can be assessed with the same instrument [10]. Disease-specific HRQoL, on the other hand, concentrates on a specific health condition. Disease-specific measures are reported to be more sensitive to the consequences of a specific health condition than generic ones [12]. Until now, HRQoL in pTBI could only be measured generically using e.g., the Pediatric Quality of Life Inventory (PedsQL) [13], as there was no TBI-specific patient-reported outcome measure (PROM) for assessing HRQoL [14].
Research results on the factors associated with impaired HRQoL after pTBI have been inconclusive. Only a few studies have investigated the influence of sociodemographic variables on HRQoL after pTBI, including age at injury, (e.g., [15]), sex [16], gender [17], and education [15]. More often, associations have been reported regarding TBI severity (e.g., [15,18]) and posttraumatic stress disorder (e.g., [19]). Mental health issues such as depression (e.g., [20]) and a higher number of post-concussion symptoms (e.g., [21]) have also been linked to lower HRQoL.
For some children and adolescents after TBI, it can be challenging to obtain reliable information using self-reports. Judgements may fluctuate due to young age, including difficulties in understanding the constructs being assessed [14,22], cognitive deficits (e.g., [22]), and a possible lack of awareness [23]. Hence, proxy-reports provided by parents are often used to collect information on the HRQoL of the children in question (e.g., [24]). However, disparities between these reports are observed. Only when children cannot answer for themselves should parent ratings be collected as a surrogate [25]. Some studies [14,22] have shown that children as young as five years old are already able to report on their HRQoL, supporting the feasibility and importance of assessing the child’s perspective through self-reports.
Thus, the aim of the current study was to present the theory- and data-driven development and psychometric validation of the first TBI-specific pediatric PROM for HRQoL assessment: the Quality Of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO) questionnaire—an age-adapted HRQoL instrument for children and adolescents (8–17 years) after TBI. The QOLIBRI-KID/ADO will enable the assessment of the impact of the sequelae of TBI on disease-specific HRQoL in children and adolescents, including the effects of short- and long-term treatment, interventions, and care. The contents of the selected items should be comparable to those of the adult version of the QOLIBRI, in particular to permit a longitudinal assessment from childhood to adulthood. The importance of its longitudinal clinical use is underlined by several studies reporting that some negative consequences of TBI in early childhood may not be observed until later in life (e.g., [26]). The methods used to develop the instrument will allow disease-specific HRQoL to be measured across the life span. Implementing the QOLIBRI-KID/ADO in daily clinical routine and research may support the amelioration of rehabilitation and daily life of children and adolescents after TBI.

2. Materials and Methods

2.1. Participants

The study was conducted in Germany from April 2017 to January 2022. Participants were included in this retrospective study according to the following criteria: aged 8–17 years at the time of study enrollment, diagnosis of TBI (at least three months and no more than ten years post injury), TBI severity (assessed using the Glasgow Coma Scale (GCS) at time of injury [27], International Statistical Classification of Diseases and Related Health Problems (ICD-10) [28] code, or from the clinical description of TBI severity), outpatient status (or at the start of resuming inpatient treatment), and the ability to understand and answer the questions.
Exclusion criteria were a current vegetative state, spinal cord injury, severe mental illness before TBI (e.g., psychosis, autism), epilepsy prior to TBI, disease leading to death, or very severe polytrauma (information collected by investigators from the medical records). Written informed consent was obtained from all participants and their parents. Assessments were conducted via face-to-face interviews with children and adolescents (online or in person), and parent reports were carried out in writing by mail or completed during a visit to the recruiting clinic, rehabilitation center, or outpatient center.
Sample size estimation was performed for the planned analyses, resulting in the requirement of around 140 subjects per age group (taking into account an excellent congruence coefficient of 0.98) for parameters of factor analyses with six factors according to a simulation study [29].

2.2. Ethical Approval

The QOLIBRI-KID/ADO study was conducted in accordance with all relevant laws in Germany, including but not limited to the ICH Harmonized Tripartite Guideline for Good Clinical Practice (ICH GCP) and the World Medical Association Declaration of Helsinki (“Ethical Principles for Medical Research Involving Human Subjects”). The study attained ethical clearance at each recruitment center, and informed consent was obtained from all participants according to the German law for data protection (General Data Protection Regulation, GDPR). The Ethics Committee of the University Medical Center Goettingen approved the study (application no. 19/4/18).

2.3. Sociodemographic and Clinical Data and Disability Rating

Data on participants’ age and gender as well as parents’ educational background were obtained from parent questionnaires. Information on the existence of cerebral lesions was extracted from neuroimaging data (CT or MRI) in the medical records. Severity of TBI (mild: GCS 13-15; complicated mild including detectable intracranial abnormalities in CT or MRI imaging [30]: GCS ≥ 13; moderate: GCS 9-12, severe: GCS ≤ 8) as assessed by the GCS [27] or according to the ICD-10 [28] was retrieved from the medical records. If GCS was missing, a clinical description of the TBI was aggregated from data on loss of consciousness (LOC), post-traumatic amnesia (PTA), need for ventilation and resuscitation, nausea/vomiting, post-traumatic epilepsy, presence of lesions (based on MRI/CT findings), need for surgical intervention, and injury severity score (ISS). Time since TBI was determined using information from the medical records and dichotomized using a median split to obtain two equal groups for further analyses.
Children’s and adolescents’ current health problems were reported by parents. We aggregated “physical, sensory, and cognitive problems” after TBI (smell, taste, vision, hearing, learning problems, seizures, difficulties with language/speech, back pain, difficulties moving hands/arms, walking problems, and seizures) into a summary variable. The variable “cognitive problems after TBI” comprised learning problems and difficulties with language/speech.
Functional status was rated by the investigators using the King’s Outcome Scale for Closed Head Injury (KOSCHI) [31] covering the following levels of disability/recovery after pTBI: 1 = ‘dead’, 2 = ‘vegetative state’, 3a = ‘lower severe disability’, 3b = ‘upper severe disability’, 4a = ‘lower moderate disability’, 4b = ‘upper moderate disability’, 5a = ‘good recovery’, or 5b = ‘intact recovery’.

2.4. Patient-Reported Outcome Measures (PROM)

The QOLIBRI-KID/ADO is a TBI-specific HRQoL self-report questionnaire for children and adolescents aged 8–17 years, containing 35 items on six scales. Satisfaction with cognitive and social functioning, self-concept, and perceived autonomy are assessed using a five-point Likert-type scale (“Not at all” to “Very”), as well as feeling bothered by emotional and physical problems. The timeframe of the evaluation is the preceding week, including the day of the assessment. Items regarding “feeling bothered” are recoded positively to allow aggregation with the satisfaction items for further analysis. Scores for each QOLIBRI scale are obtained by a linear transformation of the scores to a scale from 0 to 100 and the subsequent calculation of the mean per scale. The total score is calculated as the average scores across scales. Higher scores indicate a better HRQoL.
The generic Pediatric Quality of Life Inventory (PedsQLTM) [13] assesses 23 items (physical, emotional, social, and school functioning). Two total scores, a Physical Health Summary Score (8 items) and a Psychosocial Health Summary Score (15 items), can be calculated. Participants filled in the questionnaire concerning problems during the last four weeks using a four-point Likert-type scale (“Never” to “Almost always”). Scores range from 0 to 100, with higher scores indicating better HRQoL.
The Generalized Anxiety Disorder 7 (GAD-7) [32] measures seven symptoms of generalized anxiety according to the DSM-IV [33], rated on a four-point Likert-type scale ranging from 0 to 3 (“Not at all” to “Nearly every day”). The severity is characterized by minimal (1–4), mild (5–9), moderate (10–14), and severe (15–21) symptoms.
The Patient Health Questionnaire 9 (PHQ-9) [34] captures the persistence and severity of major depression with nine symptoms according to DSM-IV [33] criteria. The response categories range from 0 to 3 (“Not at all” to “Nearly every day”). Severity corresponds to the following scores: minimal (1–4), mild (5–9), moderate (10–14), and severe (15–27) symptoms.
The screening for anxiety and depression was based on parental reports, as self-reports have not been validated for children. Cut-offs for the categorization of mild, moderate, and severe symptoms were used as in other studies with parents of children aged from 5 to 12 years [35] and adolescents [36].
The German translation of the Post-Concussion Symptom Inventory (PCSI-SR8 for children and PCSI-SR13 for adolescents) [37] includes 16 self-rated post-concussion symptoms for children and 21 for adolescents. The PCSI-SR8 and PCSI-SR13 are answered on a Gutmann-type scale ranging from 0 to 2 (“No” to “A lot”) and from 0 to 6 with three anchor categories (“Not a problem”, “Moderate problem”, and “Severe problem”), respectively. Total scores are computed as the sum of all PCSI scales (physical, emotional, cognitive, and sleep/fatigue) for the post-TBI evaluations and categorized as being above, below, or within the age group’s average range (M ± 1SD).

2.5. Neuropsychological Test

The Rey Auditory Verbal Learning Test (RAVLT) [38] tests the ability to acquire 15 words in eight trials. It includes five consecutive recall trials (Trials I–V). The learning rate is obtained by subtracting the number of words correctly recalled in Trial I from those in Trial V. Learning rates are compared with the respective age norms [38] and categorized as being above, below, or within the average range (M ± 1SD).

2.6. Psychometric Item Reduction, Differential Item Functioning, Reliability and Validity Analyses, and Descriptive Statistics of the QOLIBRI-KID/ADO Questionnaire

In reporting on questionnaire development and validation, we followed the Consensus-based Standards for the Selection of Health Measurement Instrument (COSMIN) guidelines and checklists [39]. The original item pool, consisting of 83 items for children and 87 items for adolescents, was based on the results of focus group interviews, items adapted from (HR)QoL and TBI-related instruments, and a Delphi panel consensus procedure. Forty-three items that were conceptually and semantically acceptable and mostly comparable to the content of the adult version of the QOLIBRI were retained. The detailed procedure is described in the Supplementary File S1.
The number of items was then reduced by carrying out the following psychometric analyses. First, confirmatory factor analysis (CFA) was performed assuming the scale structure of the QOLIBRI adult version, which was supported by the results of the focus group interviews with children and adolescents after TBI [14]. Diagonally weighted least squares with mean and variance adjustment (WLSMV) was performed as an estimation approach suitable for ordinal data [40]. The following indices were applied for model evaluation (cut-off values in parentheses): χ2 statistics with respective p-values (p > 0.01) [41], comparative fit index (CFI > 0.95) [42], Tucker–Lewis index (TLI > 0.95) [42], root mean square error of approximation (RMSEA < 0.06) [43] with a 90% confidence interval (CI90%), and standardized root mean square residual (SRMR < 0.08) [42]. Item loadings on the assigned latent factors above 0.40 were considered satisfactory [44]. Items were then analyzed in terms of their contribution to the internal consistency of the assumed home scale as measured by Cronbach’s α when the item was omitted. Items that did not increase the initial internal consistency of the home scale after omission were retained. A Cronbach’s α   ≥ 0.70 was regarded as being satisfactory [45].
Since two age-adapted versions were administered, it was investigated whether the response behavior of the participants warranted an aggregation of the two versions. A logistic ordinal regression approach was applied to detect differential item functioning (DIF) (LORDIF) [46]. The DIF evaluation consisted of a comparison of a LORDIF model that included scale scores for the item alone and a LORDIF model that included the scale score, the age category, and the age category–ability interaction. Items exhibit a DIF when a significant difference ( α   = 0.01) is identified between the LORDIF models and when the associated effect size (McFadden’s pseudo R2) indicates more than a very small effect (i.e., r > 0.05) [47]. In the absence of DIF, responses were treated as being independent of age and further analyses could then be performed using an aggregated age sample.
After reducing the number of items using the CFA and obtaining evidence for the absence of DIF between age versions, means (M), standard deviations (SD), and skewnesses (SK) were calculated for the individual items, as well as the total and the scale scores. Skewness was considered symmetrical for values from −0.5 to 0.5, moderately skewed for values from ±0.5 to ±1, and heavily skewed for values beyond ±1 [48]. Furthermore, the percentage of responses in the most satisfied/least bothered category (ceiling effects) was reported, as well as the percentage of responses in the least satisfied/most bothered category (floor effects).
The internal consistency of the aggregated final item set was again investigated using Cronbach’s α and corrected item-total correlations (CITC). As measuring HRQoL in subjects with cognitive impairment may pose a threat to internal consistency [49], Cronbach’s α was also assessed separately in individuals with and without cognitive problems. To further investigate the reliability of the questionnaire across different domains of symptoms, Cronbach’s α was calculated and stratified by learning rate as measured by the RAVLT (low: M − 1SD vs. average-to-high: M and M + 1SD), TBI severity (mild vs. moderate/severe), functional recovery (KOSCHI, low: <5 vs. full score: 5), presence of physical, sensory, and cognitive problems (yes vs. no), post-concussion-symptoms (PCSI-SR8/-SR13, higher symptom frequency: M + 1SD vs. average to low symptom burden: M and M − 1SD), and different levels of depression and anxiety (PHQ-9 or GAD-7, mild to severe: ≥5 vs. no symptoms: <5). Values of Cronbach’s α   ≥ 0.60 were considered satisfactory [45] and items yielding a CITC > 0.40 were kept [50].
Test-retest reliability was examined in a subsample of 28 participants, who filled in the instrument 10 to 20 days after the initial self-report. Intraclass correlation coefficients were computed for the total score and each scale based on a two-way random effects model without aggregation (ICC-2,1). An ICC above 0.60 indicated satisfactory reliability [51]. Furthermore, the standard error of measurement (SEm) [52] and the variation between test and retest were calculated, as well as the minimal/smallest detectable change (MDC/SDC), which indicates the questionnaires’ ability to capture differences across time. In line with what is generally known about the stability of HRQoL assessments over time [53], changes below 15% of the total possible range of a measurement instrument were regarded as acceptable [54]. On the five-point response scale used in the QOLIBRI-KID/ADO, the cut-off would thus be MDC 0.75.
Then, a CFA was again performed using the final item set to determine the factorial structure of the instrument and the model fit to the data. Fit indices (i.e., χ2 statistics, CFI, TLI, RMSEA, and SRMR) were inspected, and the assumed one-level six-factor model of the QOLIBRI adult version [55,56] was compared with a two-level six-factor model with an additional latent global HRQoL factor by means of a chi-square test.
To investigate whether the QOLIBRI-KID/ADO reflects the construct of HRQoL, we calculated Pearson correlation coefficients for total and scale scores with the generic PedsQL, as there is no other pTBI-specific HRQoL questionnaire. In addition to the conventional scale scores, a psychosocial functioning score for the QOLIBRI was aggregated by averaging the cognitive, self, social, and emotional scale scores and correlated with the PedsQL psychosocial functioning score. Cohen’s cut-off criteria for evaluating the strength of associations were applied: small (0.10), moderate (0.30), and large (0.50) [57]. The correlations (r ≥ 0.30) between the QOLIBRI-KID/ADO total and scale scores and the PedsQL scores were expected to be at least moderate.
The QOLIBRI-KID/ADO total and scale scores were correlated with the GAD-7 and the PHQ-9, expecting small to medium Pearson correlations [57]. Children and adolescents with no or minimal anxiety and depression (scores 0–4) were compared with those reporting at least mild anxiety or depression (scores ≥ 5). Higher symptom burden was assumed to be associated with lower HRQoL, as found in children and adolescents with multiple chronic diseases and mental health issues [58].
Finally, the association between sociodemographic variables (i.e., age, gender, education of the parents) and the QOLIBRI-KID/ADO total and scale scores was investigated. Based on earlier pediatric studies, we assumed that boys would report higher HRQoL values than girls [17] and that HRQoL would decrease with increasing age [59]. The following clinical characteristics were assumed to be associated with lower HRQoL, as in the respective reference group: moderate to severe TBI [18], lower level of recovery [5], high physical, sensory, and cognitive problems [59], and high post-concussion burden [21]. To investigate symptom burden descriptively, the frequency of symptoms grouped by domain was first examined for the total sample. Then, the different symptom domains grouped by TBI severity (mild vs. moderate/severe) were analyzed to better characterize the population on which the psychometric development of the questionnaire was based. Cronbach’s α analyses were conducted here as well. The same cut-off values were applied as used for the total and scale scores of the total samples.
Pearson correlation analysis was then performed, investigating the relationship between time since TBI (in months) and the QOLIBRI-KID/ADO total score. Also, the presence of persisting neuropsychiatric symptoms (sequelae) and the mean time since TBI were compared between participants with and without neuropsychiatric symptoms. Any parent-reported cognitive problems, mild to severe depression or anxiety, and above-average post-concussion symptoms were regarded as neuropsychiatric symptoms.
Pearson’s correlation coefficient was used in the correlational analyses, Student’s t-test for mean comparisons, and Cohen’s d for effect size calculations in mean difference analyses. The association between the QOLIBRI-KID/ADO total score and age was analyzed using significance testing against the assumption of no correlation. For comparisons based on other demographic and clinical data using t-tests, a one-tailed significance test was applied. Cohen’s d values of 0.20, 0.50, and 0.80 represented small, medium, and large effects, respectively.

2.7. Missing Values

Little’s test of complete randomness [60] on the QOLIBRI-KID/ADO data indicated no evidence of a deviation from complete randomness (all: χ2(820) = 691.9, p = 0.999; children: χ2(270) = 258.44, p = 0.683; adolescents: χ2(652) = 591.51, p = 0.956). As no more than 5% of the data were missing, the number and distribution of missing values were considered acceptable. QOLIBRI-KID/ADO scores for individual participants were computed if not more than one-third of the scales’ items were missing, and total scores were computed only when scores were present for all scales. For the PedsQL, scale scores were only computed if up to a half of a scale’s responses were missing [61]. For the GAD-7 and PHQ-9, total scores were calculated if up to one-third of the items per scale were missing.
All analyses were performed with R (version 4.1.0) [62], using the packages naniar [63] for the analysis of missing values, lavaan [64] for CFAs, lordif [65] for DIF analyses, and psych [66] for the calculation of psychometric properties. Unless otherwise stated, the significance level was set at 5%.

3. Results

3.1. Participants

Data were collected from 302 participants (152 children and 150 adolescents), whereas data from two adolescents had to be excluded due to the violation of inclusion criteria. Most participants were male (total: 60%; KID: 62% and ADO: 57%). The mean age was 12.48 ± 2.71 years (KID: 10.63 ± 1.40; ADO: 15.24 ± 1.47). Most participants were interviewed in person (74%), the others online. Participants who were assessed online did not report a different QOLIBRI-KID/ADO total score (M = 75.10) than those assessed in person (M = 73.81; t(124.16) = −0.81, p = 0.418, d = 0.11). They most commonly experienced an uncomplicated mild TBI. Thirty-three percent underwent neuroimaging (CT/MRI), which identified 29% participants with at least one cerebral lesion. Nearly half of the TBIs had occurred up to four years prior to the participation in this study. Descriptive data are shown in Table 1 (see Appendix A, Table A1, for information on age groups).
As shown in Table 1, approximately one third of participants were experiencing symptoms at the time of the assessment: any physical, sensory, or cognitive problem (33%), cognitive problems only (26%), low learning rate (41%), anxiety (28%), depression (35%), and post-concussion symptoms (11%).
Table 2 differentiates between the symptoms grouped by TBI severity. Almost all symptoms were more common in individuals after moderate-to-severe TBI (24% to 54%) than in those after mild TBI (5% to 38%). Only post-concussive symptoms were distributed almost evenly between the two severity groups.

3.2. Psychometric Item Reduction, Differential Item Functioning, Reliability and Validity Analyses, and Descriptive Statistics of the QOLIBRI-KID/ADO Questionnaire and the Other PROMs

A total of 43 items from the child and adolescent versions were included in the psychometric item reduction analyses. Thirty of them corresponded in content to the questions from the adult QOLIBRI version (see Table 3). Cronbach’s α for the scales ranged from 0.70 to 0.78. One item was excluded due to low factor loading (CFA), and two items because the Cronbach’s α for the scales increased when they were omitted. In addition, five items, which resulted in the smallest decrease in their scale’s internal consistency when omitted, were removed to further reduce the length of the questionnaire.
Following these reductions, the final QOLIBRI-KID/ADO contained 35 items. CITCs and item loadings ranged from 0.29 to 0.77 and 0.37 to 0.81, respectively. Although CITCs of the items “Orientation”, “Daily Independence”, “Family Relationship”, and “TBI Effects” were slightly below the cut-off value of 0.40, they were kept to maintain comparability with the adult version.
Analyses of DIF showed no relevant differences between the two age groups (see Table A2 in Appendix B). Consequently, the total sample was used in the further analyses. Table 4 presents relevant questionnaire scores. For the QOLIBRI-KID/ADO, mean scores for “satisfaction” scales were higher than 50, as often observed in other satisfaction studies [67]. These scales were also moderately to highly skewed to the left. The “bothered” scales, however, yielded a mean close to 50 and no skewness. The total score was evenly distributed. Descriptive statistics of the scales by age group and the distribution of participants’ responses to the reduced item set can be found in Table A6 and Table A3, Table A4 and Table A5 in Appendix C, respectively.
Table 5 shows Cronbach’s α for the total and scale scores of the total sample and for impaired and unimpaired subgroups. All QOLIBRI-KID/ADO scores displayed good internal consistency, with Cronbach’s α ranging from 0.70 to 0.89. Reliability coefficients stratified by symptom domain were mostly satisfactory, with Cronbach’s α ≥ 0.60. For the subgroup with higher post-concussion symptoms, the internal consistency was rather poor for the “Physical Problems” and “Emotions” scales (Cronbach’s α = 0.49). However, these groups were somewhat small for a reliable alpha calculation.
Almost no items demonstrated an increase in Cronbach’s α for the home scale if an item was dropped, except for “Family Relationship”. Similarly, almost all items exhibited an acceptable CITC, except for the items “Orientation”, “Everyday Independence”, and “Family Relationship” (see Appendix D, Table A7).
For the test-retest correlations, ICCs for twenty-eight self-reports were analysed at two consecutive time points with an interval of 10 to 20 days (M = 11.63, SD = 2.84) for the scales ranging from 0.42 to 0.64, mostly slightly below to the criterion of 0.60. Table 6 shows the ICC, SEm, and MDC. The MDCs ranged from 1.53 to 2.58 indicating that all the values exceeded the 0.75 criterion.
Inspecting the response categories revealed that the lowest response category “not at all” was not endorsed by participants for the items “Orientation” and “Accomplishment”. Therefore, prior to CFA, the response categories “not at all” and “slightly” were collapsed into one category for the satisfaction items. For the “bothered by” items, the categories “very” and “quite” were collapsed. The one-level model comprising six correlated latent factors yielded a better fit compared to the two-level model with six latent factors and an additional latent global HRQoL factor (Δχ²(9) = 125.09, p < 0.001). It also exhibited fit indices that met all the requirements for an excellent fit (CFI = 0.97, TLI = 0.97, RMSEA = 0.05 CI90% [0.04–0.05], SRMR = 0.08). Only the χ²-fit index displayed a significant discrepancy between the model and the data. This can, however, be attributed to the high number of degrees of freedom (df = 545) and is therefore not indicative of a model misfit. For more details on fit indices and resulting factor loadings, see Table A8 (Appendix E) and Figure A1.
The Pearson correlation coefficients for the QOLIBRI-KID/ADO total and scale scores and the comparable PedsQL scale and total scores ranged from r = 0.47 (psychosocial functioning scores) to r = 0.67 (total scores). Overall, the correlations suggested some expected overlap between the assessed generic and TBI-specific HRQoL constructs. The correlations between the scales of the QOLIBRI-KID/ADO total score and emotional states using the GAD-7 and PHQ-9 were r = −0.31 and r = −0.36, respectively. See Table 7 for further details.
Table 8 shows comparisons of QOLIBRI-KID/ADO total scores with regard to different sociodemographic and clinical groups.
Individuals without anxiety symptoms reported significantly higher QOLIBRI-KID/ADO total scores than those with mild to severe anxiety. Similarly, individuals without depression experienced significantly higher QOLIBRI-KID/ADO total scores than those with mild to severe depression.
Age was found to be negatively correlated with the QOLIBRI-KID/ADO total score, with children reporting higher QOLIBRI-KID/ADO total scores than adolescents (r(296) = −0.22, p < 0.001). Significantly higher QOLIBRI-KID/ADO total scores were seen in male than in female participants.
Comparisons of participants after mild TBI and participants after moderate to severe TBI yielded no significant differences in terms of the QOLIBRI-KID/ADO total score (see Appendix F, Table A9). However, time since TBI was weakly but positively correlated with the QOLIBRI-KID/ADO total score (r = 0.14, p = 0.014). Participants having experienced a TBI within the last four years reported significantly lower QOLIBRI-KID/ADO scores then those after a TBI dating back more than four years.
Participants with KOSCHI scores of 5a or 5b (i.e., those with good recovery) rated their total HRQoL significantly higher than did those with KOSCHI scores of 3a to 4b. In line with these findings, participants for whom parents described no problems after TBI reported a higher total HRQoL score than did children and adolescents for whom parents reported cognitive, sensory, or physical problems after TBI. Participants who experienced more post-concussion symptoms (PCSI) reported a significantly lower total HRQoL than did those with average and fewer symptoms.
In our study, at least one neuropsychiatric symptom was reported for 156 participants (see Appendix G, Table A10). Participants with cognitive problems and mild to severe anxiety did not differ in their time since TBI from those without these symptoms (see Appendix G, Table A10). Furthermore, participants who reported mild to severe depression and above-average post-concussion symptoms were those who had experienced the TBI more recently (PHQ: ΔM = 0.71 years, t(215.38) = 2.06, p = 0.040; PCSI: ΔM = 1.14 years, t(44.02) = 2.35, p = 0.023). This pattern of results suggests that our study participants reported cognitive problems and anxiety symptoms with equal frequency across the time span since TBI, whereas depression and post-concussion symptoms often seemed to occur sooner after TBI.

4. Discussion

The aim of the current study was to report on the development and psychometrics of a new PROM, the QOLIBRI-KID/ADO questionnaire, for assessing TBI-specific HRQoL in children (8–12 years) and adolescents (13–17 years). The longitudinal comparability of HRQoL measurement in children and adolescents was an important goal of the study. Item selection was based on satisfactory psychometric characteristics and the notion that a sufficient number of items from the adult QOLIBRI version, partly adapted for the pediatric version, could be retained to allow evaluation over the life span. Furthermore, DIF analyses did not reveal important differences between the response behaviors of children and adolescents. Thus, the two age-adapted modules were aggregated into one shortened QOLIBRI-KID/ADO version. This collated version represents an instrument that is economical (in terms of time and patient burden) and has good to excellent psychometric properties.
In this study, HRQoL is operationalized as the self-reported experience of children and adolescents’ own subjective health status, functioning, and well-being after TBI. TBI-specific aspects of HRQoL are most often not captured as sensitively by existing generic PROMs [12], and there is as yet no disease-specific, self-reported, age-adapted HRQoL instrument for children and adolescents after TBI. The QOLIBRI-KID/ADO questionnaire meets the need for a theory-driven, multidimensional instrument that is age-appropriate, reliable, and valid for children and adolescents after TBI. It is TBI-specific and addresses the unmet need to measure self-reported pediatric HRQoL after TBI. It captures multiple aspects of HRQoL, including the physical, psychological (e.g., emotional and cognitive), social, and functional domains, in a similar way to the adult version [55,56]. It therefore allows TBI-specific HRQoL to be assessed from childhood to old age using age-appropriate versions of a single instrument, a rare achievement in longitudinal observational research and clinical studies. The content of the QOLIBRI-KID/ADO questionnaire is specifically relevant for children and adolescents who have experienced a TBI, as reported in a study on focus group analyses [14].
This study reflects the good psychometric and validity properties of the new TBI-specific pediatric HRQoL questionnaire, the QOLIBRI-KID/ADO. Most of the children and adolescents were quite satisfied with their HRQoL and did not report feeling greatly bothered by physical or emotional problems. This may be partly explained by the sample composition, which included rather few individuals who experienced moderate and severe TBI [18], disability or chronic health conditions [68], cognitive impairment [15,69], or risk factors such as family violence [70]. Nevertheless, in our sample, 26% to 41% of the participants presented with symptoms in different domains at the time of the assessment: physical, sensory, or cognitive problems, a lower learning rate, anxiety, or depression as well as post-concussion symptoms (11%). Interestingly, symptoms stratified by TBI severity were distributed across all severity groups and tended to be higher following moderate to severe TBI. However, even in the group after mild TBI, a quarter to more than a third suffered from symptoms in different domains. Due to the small sample sizes in some groups, the results were not analyzed further in this study and should not be generalized. This characterization should support readers in better understanding the population in which the QOLIBRI-KID/ADO questionnaire was developed and validated.
Low socio-economic status is often associated with lower HRQoL (e.g., [59]). This pattern was also present in our study. Participants whose parents hold a university degree rated their HRQoL higher than others. However, also this finding should be treated with caution, as individuals living in households with a lower level of education were underrepresented in our study.
Despite variations in the demographic and clinical characteristics, the internal consistency remained satisfactory across all groups. The reliabilities of the QOLIBRI-KID/ADO total and scale scores are at least acceptable (Cronbach’s α ≥ 0.70), including those for subgroups with any symptom burden. Only the scales “Cognition” and “Daily Life and Autonomy” (Cronbach’s α 0.57–0.68) exhibited a somewhat lower reliability for the subgroups with actual problems (low functional recovery, physical, sensory, and cognitive problems, cognitive problems only, depression, and post-concussion symptoms), where some variance may be expected [71]. In individuals with higher rates of post-concussion symptoms, the internal consistency was below the cut-off for “Emotions” and “Physical Problems” scales. Given the small sample sizes (N = 34), these results should be treated with caution. This finding is compatible with several frequently used pediatric instruments which are also characterized by lower internal consistency scores (i.e., <0.60) [72]. Given the satisfactory reliability results for the total sample, the different symptom domains, and the TBI severity groups, further validation of the QOLIBRI-KID/ADO in more severely impaired individuals and those still reporting symptoms years after the TBI may shed more light on this issue. Some authors have already discussed the relationship between self-awareness and HRQoL in adult patients (e.g., [73]). However, there is a paucity of literature investigating this topic in pTBI. Nevertheless, we can conclude that our results demonstrate that the QOLIBRI-KID/ADO is sensitive to cognitive impairment and that cognitive impairment does not affect the reliability of self-reports.
The test-retest reliability was examined 10 to 20 days after initial testing, in line with recommendations for health status measures [74]. The test-retest reliability of the scales and the total score is slightly below the criterion (ICC < 0.60), but comparable to that of other pediatric instruments [51] and thus acceptable in the pediatric field.
The CFA results support this six-factor structure of the QOLIBRI-KID/ADO version, which is in line with previous studies on generic HRQoL in children [10]. This finding is congruent with multiple analyses of the adult version of the QOLIBRI, which indicate a one-level model with six latent factors [75,76]. The fit indices should however be interpreted with caution, since these were established using maximum likelihood estimation techniques [77]. Therefore, an external validation of the factorial structure of the QOLIBRI-KID/ADO is recommended using additional samples.
Validity analyses revealed that the QOLIBRI-KID/ADO was positively related to a measure of generic HRQoL (i.e., the PedsQL), indicating a certain expected construct congruence [13]. It showed moderate associations with the total and the physical scales, but also, though weaker, associations with the psychosocial domains of the PedsQL.
Furthermore, we found a negative relationship between HRQoL, anxiety and depression which are common sequelae of TBI lasting for up to 10 to 20 years after pTBI in adults [78]. Previous findings report that 11 to 45% of children are at risk of developing mental health problems after TBI (e.g., [79]). In our study, 28% of participants showed mild to severe symptoms of anxiety, and 35% mild to severe symptoms of depression, even up to 10 years after TBI, and reported a significantly reduced HRQoL. Similar results were described for children and adolescents with chronic diseases and mental health problems [58]. Early screening and therapy of emotional problems in children and adolescents after TBI could facilitate and ameliorate the rehabilitation and HRQoL of the individuals concerned and their families.
We also found age to be related to disease-specific HRQoL. This corresponds to studies on subjective health complaints, which are reported to increase from childhood to adolescence after TBI (e.g., [80]). Our findings concerning male participants reporting better HRQoL than females is also consistent with previous reports describing younger age [59] and male gender [17] or sex [16] to be significantly associated with perceptions of higher HRQoL in healthy reference groups.
Moreover, as in previous research (e.g., [18]), our findings showed no association between moderate and severe TBI and lower HRQoL. This may be explained by the fact that in some studies TBI severity and HRQoL are reported not to be linearly correlated (e.g., [81]).
The relationship between time since injury and HRQoL was positive and significantly different from zero. Yet, the explained variance was only 2%. Therefore, further research is needed, especially regarding other influencing factors (e.g., age, TBI severity, etc.).
Our results also showed that the participants with mild to severe depression and above-average post-concussion symptoms were those who had experienced their TBI more recently. This finding is in contrast to studies reporting that persistent symptoms and negative consequences after TBI in early childhood may only be observed later in life [82]. In our study, only few symptoms were reported several years after TBI, possibly due to the fact that our participants had mainly experienced a mild TBI. Several studies emphasize that for persistent symptoms, severity could be more important than the time after the TBI event or the age of the child (e.g., [83]).
Based on the literature, we also expected that HRQoL would increase with better functional recovery (e.g., [5]) and lower levels of actual cognitive, physical, or sensory problems [59]. In line with this assumption, the level of functional disability/recovery of the children and adolescents after TBI was moderately correlated with disease-specific HRQoL. Those experiencing better recovery and a lower symptom burden experienced good HRQoL, and vice versa. This finding supports previous observations of children hospitalized with brain injuries of all severities, who even after a mild TBI reported lower generic HRQoL [18]. Furthermore, in our study, individuals with actual physical, sensory, and cognitive problems reported a significantly lower HRQoL than did individuals without these problems. This finding is reflected in several studies mentioned in a meta-analysis (e.g., [18]).
In the current study, significantly lower QOLIBRI-KID/ADO total scores were reported by participants with a higher number of post-concussion symptoms, indicating lower HRQoL compared with those mentioning fewer symptoms. The proportion of children and adolescents with post-concussion symptoms (11%) is comparable to that in previous work, with a prevalence of 14 to 29% after mild TBI (e.g., [84]). Post-concussion symptoms are most noticeable within the first year after TBI, but they can persist many years post-injury [85]. The significant relationship between post-concussion symptoms and HRQoL reported in our study illustrates the importance of assessing these early on and considering this association in therapeutic contexts, even years after TBI, also in children after mild TBI.

4.1. Limitations

We used a retrospective convenience sample to develop the instrument, which is an accepted scientific practice when developing PROMs for patients (e.g., [18]). As in most observational studies [18], our sample consisted predominantly of pediatric individuals after uncomplicated mild TBI. Most of them had experienced the TBI more than four years previously. This lack of variance may complicate the interpretation of the psychometric results. However, we discovered that HRQoL as measured by the QOLIBRI-KID/ADO total score, was affected by time since TBI but not by TBI severity. Therefore, as our instrument is able to detect differences in HRQoL among participants after mild TBI, it should also be able to reliably and validly measure HRQoL in patients after moderate to severe TBI.
A further limitation may be the fact that we used parent reports of the children’s and adolescents’ depression and anxiety. Differences in agreement between self-ratings and parent ratings of emotional problems, especially among older children, may mean that the validity of parent ratings as a proxy for children’s self-reports may be very limited [25]. Likewise, children and adolescents whose parents reported any problems (e.g., cognitive, physical, and sensory) rated their HRQoL lower.
Another limitation of the study is that our results on TBI-specific HRQoL may be biased by self-selection (e.g., [86]), as approximately 80–90% of families did not wish to participate. We observed that parents of children who had a severe TBI and suffered serious negative consequences refused to participate because of a potential re-traumatization through taking part in the study. On the other hand, parents of children who did not experience any symptoms after TBI did not want them to participate as they felt this was neither beneficial for the study nor for their children. This may be another reason for carrying out an external validation.
Learning more about the HRQoL of a broader range of children and adolescents after more severe TBI with cognitive impairment should also be a topic for future research, as well as the investigation of patients with different care pathways (e.g., those discharged from the emergency room vs. those admitted to a hospital ward or intensive care unit) and children and adolescents from families with risk factors (e.g., lower socioeconomic status, violence as cause of TBI, etc.).

4.2. Outlook

The final external validation of the QOLIBRI-KID/ADO is currently being conducted, including two reworded items that were affected by age differences (as indicated by DIF), responsiveness testing, and a replication of the psychometric analyses. Furthermore, linguistic validation of the questionnaire is ongoing in English, French, Italian, and Spanish.
As a part of our research, we are also developing a parent version of the QOLIBRI-KID/ADO for use as a surrogate when children are unable to self-report on their HRQoL. Further comparisons of the QOLIBRI-KID/ADO self-reports with parental and general population assessments are also underway to increase the clinical relevance of HRQoL evaluation after pTBI. We will also provide a self- and proxy-reported version for young children (QOLIBRI-KIDDY version for children of 6–7 years of age) for longitudinal evaluation.

5. Conclusions

The development of the QOLIBRI-KID/ADO questionnaire for children and adolescents after TBI in a multicenter study in the German-speaking context has resulted in the first reliable and valid pTBI-specific HRQoL instrument. The questionnaire comprises six domains, including Cognition, Self, Daily Life and Autonomy, Social Relationships, Emotions, and Physical Problems. Significant sensitive relationships were observed between the QOLIBRI-KID/ADO and generic HRQoL as well as, e.g., with functional recovery, depression, anxiety, and post-concussion symptoms, confirming the validity of the new instrument. Internal consistency of the instrument concerning these aforementioned clinical criteria as well as different symptom domains was satisfactory to excellent. Analyses also revealed significant associations between pre-injury factors (age, sex, education level of parents) and injury-related characteristics and HRQoL. The QOLIBRI-KID/ADO questionnaire will be a useful tool for assessing self-reported disease-specific HRQoL after TBI, collecting information that is not captured by currently available clinical ratings of functional recovery or PROMs in the field of pTBI. In addition to research, assessing TBI-specific HRQoL will enable health authorities to address broader areas of public health policy. It is also important for interpreting the outcomes in daily clinical routine. Furthermore, this instrument is especially relevant for clinical and rehabilitation contexts, for evaluating the effectiveness of interventions and health care programs, for tailoring them, and for understanding the unmet needs of affected individuals after TBI.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12154898/s1, S1—QOLIBRI-KID/ADO item pool generation and item reduction. References [87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102] are cited in the Supplementary Materials.

Author Contributions

Conceptualization, N.v.S., S.G., L.O.-L. and K.C.; methodology, N.v.S., S.G. and M.Z.; software, S.G.; validation, N.v.S., M.Z. and K.C.; formal analysis, S.G.; investigation, N.v.S., U.K., D.T., I.K.K., M.V.B., S.B., M.K., K.B., M.R., M.L., M.S. and K.C.; resources, N.v.S.; data curation, S.G.; writing—original draft preparation, N.v.S., L.O.-L., S.G. and K.C.; writing—review and editing, N.v.S., S.G., L.O.-L., M.Z., U.K., D.T., I.K.K., M.V.B., S.B., M.K., K.B., M.R., M.L., M.S., S.S., H.M. and K.C.; visualization, S.G., U.K. and K.C.; supervision, N.v.S.; project administration, N.v.S. and K.C.; funding acquisition, N.v.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Dr. Senckenbergische Stiftung/Clementine Kinderhospital Dr. Christ‘sche Stiftungen (Germany), and Uniscientia Stiftung (Switzerland).

Institutional Review Board Statement

The QOLIBRI-KID/ADO study was conducted in accordance with all relevant laws of Germany, including but not limited to the ICH Harmonized Tripartite Guideline for Good Clinical Practice (ICH GCP) and the World Medical Association Declaration of Helsinki (“Ethical Principles for Medical Research Involving Human Subjects”). The study attained ethical clearance at each recruitment center and obtained the informed consent of all participants in accordance with the German law for data protection (General Data Protection Regulation, GDPR). The Ethics Committee of the University Medical Center in Goettingen approved the study (application no. 19/4/18).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding authors. Data are not publicly available for reasons of data protection.

Acknowledgments

We are immensely grateful to all investigators and our participants for helping us in our efforts to improve care and outcome after pTBI. We acknowledge support by the Open Access Publication Funds of Goettingen University. We would especially like to thank all members of the consortium who made this project possible by recruiting and examining the individuals after TBI: Mattea Ausmeier, Hanna Boenitz, Lea Busch, Johann de Maeyer, Helena Duewel, Anastasia Gorbunova, Louisa Harmsen, Sina Kantelhardt, Maximilian Kluge, Lena Kuschel, Katja Lorenz, Louisa Lohrberg, Isabelle Mueller, Philine Mueller, Anna-Lena Raidl, Maren Roehl, Dorle Schaper, Emma Schmiedekind, Carolin Singelmann, Inga Steppacher, Johanna von Petersdorff, Sophia Mueller, Nico Rodo, Victoria Stefan, Shaghayegh Gorji, Celine Koenig, Carl Jannes Neuse, Alexander Kaiser, Meike Engelbrecht, Agnes Berghuber, Stefan Hillmann, Julius Poppel, Benjamin Nast-Kolb, Hanna Klaeger, Nils Schoenberg, Jonas Pietersteiner, Sophia Hierlmayer, Korbinian Heinrich, Rieke Boeddeker, Elena M. Bonke, Lisa F. Umminger, Leonard B. Jung, Paul S. Raffelhüschen, Lara Pankatz, Paula von Schorlemer, and Tim L.T. Wiegand. We would especially like to thank Nicole Fabri, Clara Lamersdorff, and Philine Rojczyk for their successful efforts in patient recruitment and examination. We would also like to thank the additional national and international experts supporting us for the duration of the project, especially during the item generation and reduction process. National experts: Claudia Armgardt, Monika Bullinger, Katharina Diepold, Christiane Gruß, Ralf Heindorf, Dirk Heinicke, Rainer John, Dorothea Mielke, Ulrike Neirich, Bettina Schulz, Gertrud Wietholt, Angela Woller, and Joy Weber. International experts: Anna Adlam, Nada Andelic, Juan Carlos Arango-Lasprilla, Miriam Beauchamp, Jeroen Bekkers, Emily Bennett, Enrico Castelli, Mathilde Chevignard, Gemma Costello, Rita Formisano, Rob Forsyth, Carol Hawley, Fiona Lecky, Marianne Løvstad, Mari Saarinen, Shannon Scratch, Suzanna Watson, and Shari Wade. Finally, we are also very thankful to the extremely helpful input of the reviewers.

Conflicts of Interest

The authors declare no conflict of interest. The sponsors had no role in the design of the study, in the collection, analyses, or interpretation of data, in the writing of the manuscript, or in the decision to publish the results.

Appendix A. Sample Description for Age Groups

Table A1. Demographic and clinical characteristics of the participants by age group.
Table A1. Demographic and clinical characteristics of the participants by age group.
VariableGroupChildren
(N, %)
Adolescents
(N, %)
Gender Female 58 (38%)62 (42%)
Male 94 (62%)85 (57%)
Non-binary 0 (0%)1 (1%)
AgeM10.6315.24
SD1.401.47
Min8.0013.00
Max12.9217.92
Parents’ Highest Level of EducationPrimary school0 (0%)1 (1%)
Secondary school33 (22%)24 (16%)
Occupational school20 (14%)19 (12%)
University92 (62%)97 (64%)
Unknown or missing data3 (2%)11 (7%)
TBI Severity Mild106 (70%)109 (74%)
Moderate16 (11%)9 (6%)
Severe30 (20%)30 (20%)
Lesion(s) No108 (71%)100 (68%)
Yes43 (28%)43 (29%)
Data missing1 (1%)5 (3%)
KOSCHI Disability Score 3a0 (0%)0 (0%)
3b1 (1%)0 (0%)
4a3 (2%)5 (3%)
4b4 (3%)18 (12%)
5a15 (10%)25 (17%)
5b129 (85%)100 (68%)
Time Since TBI<1 year4 (3%)3 (2%)
1–<2 years24 (16%)20 (14%)
2–<4 years45 (30%)36 (24%)
4–10 years79 (52%)88 (59%)
Data missing0 (0%)1 (1%)
Physical, Sensory, and Cognitive Problems after TBI No97 (64%)99 (67%)
Yes51 (33%)49 (33%)
Data missing4 (3%)0 (0%)
Cognitive Problems after TBINo108 (71%)110 (74%)
Yes40 (26%)37 (25%)
Data missing4 (3%)1 (1%)
RAVLT Learning Rate Below average71 (47%)53 (36%)
Average21 (14%)13 (9%)
Above average60 (39%)80 (54%)
Data missing0 (0%)2 (1%)
GAD-7No anxiety (1–4)98 (64%)110 (74%)
Mild to severe anxiety (≥5)49 (32%)36 (24%)
Data missing5 (3%)2 (1%)
PHQ-9No depression (1–4)98 (64%)89 (60%)
Mild to severe depression (≥5)49 (32%)57 (39%)
Data missing5 (3%)2 (1%)
PCSI-SR8/-SR13Fewer symptoms (below average)0 (0%)9 (6%)
Average117 (77%)97 (65%)
More symptoms (above average)15 (10%)19 (13%)
Missing20 (13%)23 (16%)
Note. N = absolute frequencies, % = percent, M = mean, SD = standard deviation, Min = Minimum, Max = Maximum, TBI = traumatic brain injury, KOSCHI = King’s Outcome Scale for Closed Head Injury, RAVLT = Rey Auditory Verbal Learning Test, GAD-7 = Generalized Anxiety Disorder 7, PHQ-9 = Patient Health Questionnaire 9, PCSI = Post-Concussion Symptom Inventory.

Appendix B. Results of DIF-Analyses of the QOLIBRI-KID/ADO Items

Table A2. Summary of LORDIF analyses.
Table A2. Summary of LORDIF analyses.
ScaleItemp-Value McFadden’s R²
CognitionConcentration (*)0.033
Talking to Others (*)0.753
Remembering (*)0.150
Thinking Speed (*)0.401
Planning (*)0.395
Orientation (*)0.001 ***0.018
Decision Between Two Things (*)0.094
SelfAppearance (*)0.026
Self-Esteem (*)0.345
Accomplishment (*)0.418
Future (*)0.755
Energy (*)0.994
Daily Life and
Autonomy
Manage at School (*)0.625
Decision Making0.951
Daily Independence0.003 **0.041
Getting Out and About (*)0.247
Social Activities (*)0.151
Support from Others0.323
Ability to Move0.254
Social
Relationships
Family Relationship (*)0.111
Relationship with Friends (*)0.130
Attitudes of Others (*)0.051
Friendships0.083
Open up to Others0.994
Demands from Others0.022
EmotionsAnger (*)0.298
Anxiety (*)0.020
Sadness (*)0.309
Loneliness (*)0.955
Physical
Problems
TBI Effects (*)0.605
Headaches (+)0.857
Pain (+)0.399
Clumsiness (*)0.640
Seeing/Hearing (*)0.012
Other Injuries (*)0.451
Note. p-values refer to a χ2-test between LORDIF models regressing on responses to an item. One regression model only used scale scores as a predictor, whereas the other applied scale score, the age category, and the age category–ability interaction. McFadden’s R2 is only reported for items with significant differences in the comparison of the models. ** = p-value < 0.01, *** = p-value < 0.001. (*) = Items corresponding to the items in the adult QOLIBRI version. (+) = Pain and Headaches are assessed using a single question in the adult QOLIBRI version.

Appendix C. Item and Scale Values of the QOLIBRI-KID/ADO Questionnaire by Age Group

Table A3. Descriptive statistics for items of the QOLIBRI-KID/ADO.
Table A3. Descriptive statistics for items of the QOLIBRI-KID/ADO.
ScaleItemMSD%
Missing
SK% Floor%
Ceiling
CognitionConcentration (*)4.070.871.67−0.89578
Talking to Others (*)3.760.861.67−0.57664
Remembering (*)4.390.820−1.47387
Thinking Speed (*)4.730.570−2.12094
Planning (*)3.851.011−0.64864
Orientation (*)3.941.030.33−0.85869
Decision Between Two Things (*)3.940.910−0.71773
SelfAppearance (*)4.200.900.33−1.06479
Self-Esteem (*)4.590.590−1.32196
Accomplishment (*)4.020.880.33−0.68474
Future (*)4.240.890.67−1.16582
Energy (*)3.451.000−0.551452
Daily Life and
Autonomy
Manage at School (*)4.160.830.33−0.87482
Decision Making4.310.791.33−1.21285
Daily Independence4.170.820.67−0.89280
Getting Out and About (*)4.560.660−1.70194
Social Activities (*)4.430.870.67−1.83487
Support from Others4.830.512−3.83195
Ability to Move4.520.851.33−1.91486
Social
Relationships
Family Relationship (*)3.950.800−0.76477
Relationship with Friends (*)3.960.961−0.64869
Attitudes of Others (*)4.650.710.67−2.26292
Friendships4.610.680−2.02294
Open up to Others4.440.690.67−1.19191
Demands from Others4.150.880.67−0.97681
EmotionsAnger (*)2.941.3300.144235
Anxiety (*)2.971.2000.043533
Sadness (*)3.161.260.33−0.063038
Loneliness (*)4.171.20−1.371177
Physical
Problems
TBI Effects (*)3.981.342.67−0.991766
Headaches (+)3.121.230.33−0.103139
Pain (+)3.421.441.33−0.412953
Clumsiness (*)3.031.4400.014141
Seeing/Hearing (*)3.771.380.33−0.722262
Other Injuries (*)3.191.331.33−0.173042
Note. M = mean, SD = standard deviation, SK = skewness, % = percent. Negative values indicate left-skewed distributions. (*) Items corresponding to items in the adult QOLIBRI version. (+) In the adult QOLIBRI version, Pain and Headaches were assessed in a single question.
Table A4. QOLIBRI-KID/ADO item descriptives for the children’s (KID) version.
Table A4. QOLIBRI-KID/ADO item descriptives for the children’s (KID) version.
ScaleItemMSD% MissingSK% Floor% Ceiling
CognitionConcentration (*)4.240.820−0.9484
Talking to Others (*)3.90.770−0.09269
Remembering (*)4.570.660−1.38192
Thinking Speed (*)4.740.580−2.27194
Planning (*)4.020.970−0.78571
Orientation (*)4.260.840−0.98382
Decision Between Two Things (*)4.050.920−0.92778
SelfAppearance (*)4.450.770−1.38188
Self-Esteem (*)4.70.50−1.35098
Accomplishment (*)4.320.760−0.79185
Future (*)4.50.660.66−1.11191
Energy (*)3.470.980−0.581252
Daily Life and Autonomy Manage at School (*)4.240.810−0.89484
Decision Making4.390.740−1.26189
Daily Independence4.230.820−0.87282
Getting out and About (*)4.60.660−1.64193
Social Activities (*)4.580.780−2.5393
Support from Others4.790.531.97−2.66194
Ability to Move4.590.80.66−2.14489
Social RelationshipsFamily Relationship (*)4.050.770−0.69380
Relationship with Friends (*)4.290.830−1.06384
Attitudes of Others (*)4.710.630.66−2.42294
Friendships4.720.580−2.36196
Open up to Others4.550.680−1.8194
Demands from Others4.340.730−1.22291
EmotionsAnger (*)2.851.3500.194332
Anxiety (*)2.881.2200.053730
Sadness (*)3.271.270−0.142640
Loneliness (*)4.081.250−1.171271
Physical ProblemsTBI Effects (*)3.861.421.97−0.852063
Headaches (+)3.111.260.66−0.133139
Pain (+)3.431.491.32−0.453055
Clumsiness (*)2.931.500.114539
Seeing/Hearing (*)3.851.380−0.812064
Other Injuries (*)3.021.391.320.043836
Note. M = mean, SD = standard deviation, SK = skewness, % = percent. (*) = Items corresponding to items in the adult QOLIBRI version. (+) = Pain and Headaches are assessed using a single question in the adult QOLIBRI version.
Table A5. QOLIBRI-KID/ADO item descriptives for the adolescents’ (ADO) version.
Table A5. QOLIBRI-KID/ADO item descriptives for the adolescents’ (ADO) version.
ScaleItemMSD% MissingSK% Floor% Ceiling
CognitionConcentration (*)3.90.893.38−0.88672
Talking to Others (*)3.620.923.38−0.74959
Remembering (*)4.20.920−1.27582
Thinking Speed (*)4.730.550−1.92095
Planning (*)3.661.032.03−0.511157
Orientation (*)3.611.10.68−0.591356
Decision Between Two Things (*)3.830.890−0.53869
SelfAppearance (*)3.950.960.68−0.78771
Self-Esteem (*)4.470.650−1.13194
Accomplishment (*)3.710.90.68−0.54762
Future (*)3.9810.68−0.85972
Energy (*)3.431.020−0.511651
Daily Life and Autonomy Manage at School (*)4.090.840.68−0.85580
Decision Making4.220.842.70−1.13381
Daily Independence4.10.831.35−0.91379
Getting out and About (*)4.530.660−1.76195
Social Activities (*)4.270.941.35−1.36581
Support from Others4.880.52.03−5.26196
Ability to Move4.460.92.03−1.7483
Social RelationshipsFamily Relationship (*)3.860.830−0.78674
Relationship with Friends (*)3.610.982.03−0.271355
Attitudes of Others (*)4.590.770.68−2.06389
Friendships4.490.760−1.71391
Open up to Others4.330.71.35−0.66187
Demands from Others3.950.981.35−0.65970
EmotionsAnger (*)3.041.300.094038
Anxiety (*)3.051.1800.053435
Sadness (*)3.041.250.680.033536
Loneliness (*)4.261.140−1.591182
Physical ProblemsTBI Effects (*)4.11.253.38−1.121469
Headaches (+)3.121.210−0.073038
Pain (+)3.411.391.35−0.352851
Clumsiness (*)3.141.380−0.073643
Seeing/Hearing (*)3.691.380.68−0.632461
Other Injuries (*)3.361.241.35−0.362348
Note. M = mean, SD = standard deviation, SK = skewness, % = percent. (*) = Items that correspond to items in the adult QOLIBRI version. (+) = Pain and Headaches are assessed using a single question in the adult QOLIBRI version.
Table A6. Descriptive statistics for QOLIBRI-KID/ADO, PedsQL, PHQ-9, and GAD-7 questionnaires by age group.
Table A6. Descriptive statistics for QOLIBRI-KID/ADO, PedsQL, PHQ-9, and GAD-7 questionnaires by age group.
ChildrenAdolescents
InstrumentScaleNMSDSKNMSDSK
QOLIBRI-KID/ADO Cognition15278.6411.64−0.4514871.6714.29−0.69
Self15286.3511.83−0.9314773.6216.41−0.80
Daily Life and Autonomy15288.7110.2−1.3514684.4712.24−1.46
Social Relationships15284.0512.24−1.0114879.2812.85−0.85
Emotions15252.5625.02−0.2214853.4323.080.10
Physical Problems15261.9423.47−0.3214865.1819.58−0.54
Psychosocial score15275.3711.1−0.3314571.1911.8−0.47
Total score15276.8510.71−0.4314572.5511.46−0.59
PedsQLPhysical functioning14782.6013.82−1.0314684.1213.02−1.14
Psychosocial functioning15279.1013.67−1.0514876.4413.88−0.65
Total functioning14779.9812.91−1.0314678.3712.64−0.66
PHQ-9Total score1473.943.351.091464.704.191.23
GAD-7Total score1473.563.070.881463.453.561.57
Note. N = absolute frequencies, M = mean, SD = standard deviation, SK = skewness, PedsQL = Pediatric Quality of Life Inventory, GAD-7 = Generalized Anxiety Disorder 7, PHQ-9 = Patient Health Questionnaire 9.

Appendix D. Internal Consistencies on Item Level

Table A7. Internal consistency of the QOLIBRI-KID/ADO scales on item level.
Table A7. Internal consistency of the QOLIBRI-KID/ADO scales on item level.
DimensionItemα If Item OmittedCITC
CognitionConcentration (*)0.650.60
Talking to Others (*)0.680.48
Remembering (*)0.670.50
Thinking Speed (*)0.630.66
Planning (*)0.680.45
Orientation (*)0.690.39
Decision Between Two Things (*)0.690.40
SelfAppearance (*)0.700.77
Self-Esteem (*)0.700.77
Accomplishment (*)0.780.48
Future (*)0.740.64
Energy (*)0.770.52
Daily Life and Autonomy Manage at School (*)0.680.40
Decision Making0.650.51
Daily Independence0.700.28
Getting out and About (*)0.650.56
Social Activities (*)0.630.63
Support from Others0.670.46
Ability to Move0.640.61
Social RelationshipsFamily Relationship (*)0.740.37
Relationship with Friends (*)0.680.63
Attitudes of Others (*)0.660.69
Friendships0.680.61
Open up to Others0.690.55
Demands from Others0.720.48
EmotionsAnger (*)0.690.67
Anxiety (*)0.680.67
Sadness (*)0.620.63
Loneliness (*)0.650.64
Physical ProblemsTBI Effects (*)0.730.74
Headaches (+)0.680.67
Pain (+)0.670.66
Clumsiness (*)0.690.69
Seeing/Hearing (*)0.690.69
Other Injuries (*)0.700.70
Note. α = Cronbach’s Alpha, CITC = corrected item-total correlation for items and their corresponding scale. (*) = Items that correspond to items in the adult QOLIBRI version. (+) = Pain and Headaches are assessed using a single question in the adult QOLIBRI version.

Appendix E. Model Parameters of the CFA on the QOLIBRI-KID/ADO Factors

Table A8. Fit indices and model comparison of the one-level and the two-level factorial solution.
Table A8. Fit indices and model comparison of the one-level and the two-level factorial solution.
Model Comparison
No. of Levelsχ²pCFITLIRMSEA (CI90%)SRMRdfχ²Δχ²ΔdfP
One874.64<0.001 ***0.970.970.05 (0.04–0.05)0.08545874.64---
Two1117.21<0.001 ***0.950.950.06 (0.06–0.07)0.095541117.21116.979<0.001 ***
Note. χ2-test of significance employs scaled statistics, whereas other statistics are unscaled. CFI = comparative fit index, TLI = Tucker–Lewis index, RMSEA (CI90%) = root mean square error of approximation with 90% confidence interval, SRMR = Standardized Root Mean Square Residual, df = degrees of freedom, χ2 = chi-square statistics, Δχ2 = difference in chi-square statistics after Satorra–Bentler (2001) correction, Δdf = difference in degrees of freedom, p = p-value (*** = p < 0.001).
Figure A1. CFA model of the structure of QOLIBRI items, scales (latent factors), and path coefficients.
Figure A1. CFA model of the structure of QOLIBRI items, scales (latent factors), and path coefficients.
Jcm 12 04898 g0a1

Appendix F. Association of QOLIBRI-KID/ADO Questionnaire with Clinical Characteristics

Table A9. Mean QOLIBRI-KID/ADO total and scale score differences between participants after mild TBI and moderate to severe TBI.
Table A9. Mean QOLIBRI-KID/ADO total and scale score differences between participants after mild TBI and moderate to severe TBI.
ScaleMmildSDmildMmoderate-severeSDmoderate-severedftpCohen’s d
Cognition75.9512.4773.3315.58128.691.380.2530.20
Self79.7615.3880.9316.22147.35−0.570.500−0.07
Daily Life and Autonomy86.9910.7885.7512.92133.060.780.4390.11
Social Relationships81.8511.9881.3114.58131.190.300.5000.04
Emotions52.1424.6855.1522.37168.91−1.020.500−0.12
Physical Problems64.4921.4261.1322.20149.281.190.2930.16
Total73.4911.3572.9312.33144.120.360.180 a0.05
Note. M = mean, SD = standard deviation, df = degrees of freedom, t = t-value, p = p-value. All p-values refer to one-tailed testing. a Non-adjusted p-values; all other p-values were adjusted using the Holm–Bonferroni method.

Appendix G. Association of Time since Injury with Neuro-Psychiatric Symptoms

Table A10. Mean time in years since TBI of participants with and without neuropsychiatric symptoms and statistical significance (t-test) of differences between groups.
Table A10. Mean time in years since TBI of participants with and without neuropsychiatric symptoms and statistical significance (t-test) of differences between groups.
SymptomsSymptoms PresentSymptoms Absentt-Test Parameters
M (SD)nM (SD)ntdfpd
Cognitive Problems after TBI4.21 (2.69)774.79 (2.89)2181.60142.540.1120.21
Mild to Severe Anxiety4.21 (2.65)854.86 (2.90)2081.85167.030.0660.23
Mild to Severe Depression4.22 (2.83)1064.93 (2.83)1872.06215.380.040 *0.25
Post-concussion Symptoms3.76 (2.59)344.90 (2.82)2232.3544.020.023 *0.41
Note. Post-concussion symptoms refer to a PCSI score that is one SD above the respective age average (see “Instrument” section). M = mean time since TBI in years, SD = standard deviation, df = degrees of freedom, t = t-value, p = p-value (* = p < 0.05), d = Cohen’s d.

References

  1. Gardner, M.T.; O’Meara, A.M.I.; Miller Ferguson, N. Pediatric Traumatic Brain Injury: An Update on Management. Curr. Pediatr. Rep. 2017, 5, 213–219. [Google Scholar] [CrossRef]
  2. Ellsäßer, G. Unfälle, Gewalt, Selbstverletzung Bei Kindern Und Jugendlichen—Ergebnisse Der Amtlichen Statistik Zum Verletzungsgeschehen 2014. Fachbericht; Statistisches Bundesamt: Wiesbaden, Germany, 2017; pp. 1–68. [Google Scholar]
  3. AWMF Das Schädel-Hirn-Trauma Im Kindes-Und Jugendalter. Available online: https://www.awmf.org/leitlinien/detail/ll/024-018.html (accessed on 11 March 2022).
  4. Dewan, M.C.; Mummareddy, N.; Wellons, J.C.; Bonfield, C.M. Epidemiology of Global Pediatric Traumatic Brain Injury: Qualitative Review. World Neurosurg. 2016, 91, 497–509.e1. [Google Scholar] [CrossRef] [PubMed]
  5. Burd, R.; Jensen, A.R.; VanBuren, J.M.; Alvey, J.S.; Richards, R.; Holubkov, R.; Pollack, M. Long-Term Outcomes after Pediatric Injury: Results of the Assessment of Functional Outcomes and Health-Related Quality of Life after Pediatric Trauma Study. J. Am. Coll. Surg. 2021, 233, 666–675.e2. [Google Scholar] [CrossRef] [PubMed]
  6. Lendt, M.; Müller, K. Langfristige psychosoziale Entwicklung nach schwerem Schädel-Hirn-Trauma im Kindesalter. Monatsschr. Kinderheilkd. 2014, 162, 420–427. [Google Scholar] [CrossRef]
  7. Babikian, T.; Merkley, T.; Savage, R.C.; Giza, C.C.; Levin, H. Chronic Aspects of Pediatric Traumatic Brain Injury: Review of the Literature. J. Neurotrauma 2015, 32, 1849–1860. [Google Scholar] [CrossRef]
  8. McCauley, S.R.; Wilde, E.A.; Anderson, V.A.; Bedell, G.; Beers, S.R.; Campbell, T.F.; Chapman, S.B.; Ewing-Cobbs, L.; Gerring, J.P.; Gioia, G.A.; et al. Recommendations for the Use of Common Outcome Measures in Pediatric Traumatic Brain Injury Research. J. Neurotrauma 2012, 29, 678–705. [Google Scholar] [CrossRef] [Green Version]
  9. World Health Organization. Division of Mental Health. WHOQOL-BREF: Introduction, Administration, Scoring and Generic Version of the Assessment: Field Trial Version; World Health Organization: Geneva, Switzerland, 1996; pp. 1–18. [Google Scholar]
  10. Ravens-Sieberer, U.; Erhart, M.; Wille, N.; Wetzel, R.; Nickel, J.; Bullinger, M. Generic Health-Related Quality-of-Life Assessment in Children and Adolescents. Pharmacoeconomics 2006, 24, 1199–1220. [Google Scholar] [CrossRef]
  11. Solans, M.; Pane, S.; Estrada, M.-D.; Serra-Sutton, V.; Berra, S.; Herdman, M.; Alonso, J.; Rajmil, L. Health-Related Quality of Life Measurement in Children and Adolescents: A Systematic Review of Generic and Disease-Specific Instruments. Value Health 2008, 11, 742–764. [Google Scholar] [CrossRef] [Green Version]
  12. Von Steinbuechel, N.; Covic, A.; Polinder, S.; Kohlmann, T.; Cepulyte, U.; Poinstingl, H.; Backhaus, J.; Bakx, W.; Bullinger, M.; Christensen, A.-L.; et al. Assessment of Health-Related Quality of Life after TBI: Comparison of a Disease-Specific (QOLIBRI) with a Generic (SF-36) Instrument. Behav. Neurol. 2016, 2016, 7928014. [Google Scholar] [CrossRef] [Green Version]
  13. Varni, J.W.; Seid, M.; Rode, C.A. The PedsQLTM: Measurement Model for the Pediatric Quality of Life InventoryTM. Med. Care 1999, 37, 126–139. [Google Scholar] [CrossRef]
  14. Krenz, U.; Timmermann, D.; Gorbunova, A.; Lendt, M.; Schmidt, S.; von Steinbuechel, N. Health-Related Quality of Life after Pediatric Traumatic Brain Injury: A Qualitative Comparison between Children’s and Parents’ Perspectives. PLoS ONE 2021, 16, e0246514. [Google Scholar] [CrossRef] [PubMed]
  15. Anderson, V.; Brown, S.; Newitt, H.; Hoile, H. Long-Term Outcome from Childhood Traumatic Brain Injury: Intellectual Ability, Personality, and Quality of Life. Neuropsychology 2011, 25, 176–184. [Google Scholar] [CrossRef] [PubMed]
  16. Holbrook, T.L.; Hoyt, D.B.; Coimbra, R.; Potenza, B.; Sise, M.J.; Sack, D.I.; Anderson, J.P. Trauma in Adolescents Causes Long-Term Marked Deficits in Quality of Life: Adolescent Children Do Not Recover Preinjury Quality of Life or Function up to Two Years Postinjury Compared to National Norms. J. Trauma Inj. Infect. Crit. Care 2007, 62, 577–583. [Google Scholar] [CrossRef] [PubMed]
  17. Michel, G.; Bisegger, C.; Fuhr, D.C.; Abel, T.; The Kidscreen Group. Age and Gender Differences in Health-Related Quality of Life of Children and Adolescents in Europe: A Multilevel Analysis. Qual. Life Res. 2009, 18, 1147–1157. [Google Scholar] [CrossRef] [Green Version]
  18. Di Battista, A.; Soo, C.; Catroppa, C.; Anderson, V. Quality of Life in Children and Adolescents Post-TBI: A Systematic Review and Meta-Analysis. J. Neurotrauma 2012, 29, 1717–1727. [Google Scholar] [CrossRef]
  19. de Vries, A.P.J.; Kassam-Adams, N.; Cnaan, A.; Sherman-Slate, E.; Gallagher, P.R.; Winston, F.K. Looking Beyond the Physical Injury: Posttraumatic Stress Disorder in Children and Parents After Pediatric Traffic Injury. Pediatrics 1999, 104, 1293–1299. [Google Scholar] [CrossRef]
  20. Di Battista, A.; Godfrey, C.; Soo, C.; Catroppa, C.; Anderson, V. Depression and Health Related Quality of Life in Adolescent Survivors of a Traumatic Brain Injury: A Pilot Study. PLoS ONE 2014, 9, e101842. [Google Scholar] [CrossRef]
  21. Riemann, L.; Voormolen, D.C.; Rauen, K.; Zweckberger, K.; Unterberg, A.; Younsi, A.; Åkerlund, C.; Amrein, K. Persistent Postconcussive Symptoms in Children and Adolescents with Mild Traumatic Brain Injury Receiving Initial Head Computed Tomography. J. Neurosurg. Pediatr. 2021, 27, 538–547. [Google Scholar] [CrossRef]
  22. Varni, J.W.; Limbers, C.A.; Burwinkle, T.M. How Young Can Children Reliably and Validly Self-Report Their Health-Related Quality of Life?: An Analysis of 8,591 Children across Age Subgroups with the PedsQLTM 4.0 Generic Core Scales. Health Qual. Life Outcomes 2007, 5, 1. [Google Scholar] [CrossRef] [Green Version]
  23. Leathem, J.M.; Murphy, L.J.; Flett, R.A. Self- and Informant-Ratings on the Patient Competency Rating Scale in Patients with Traumatic Brain Injury. J. Clin. Exp. Neuropsychol. 1998, 20, 694–705. [Google Scholar] [CrossRef]
  24. Ravens-Sieberer, U.; Patrick, P.D.; Benz, B.; Calaminus, G.; Flechtner, H.; Melchers, P.; Patrick, P.; Schäfer, B.; Suhr, L.; Schrod, L.; et al. Quality of Life in Children with Traumatic Brain Injury--Basic Issues, Assessment, and Recommendations. Restor. Neurol. Neurosci. 2002, 20, 151–159. [Google Scholar] [PubMed]
  25. Pieper, P.; Garvan, C. Concordance of Child and Parent Reports of Health-Related Quality of Life in Children With Mild Traumatic Brain or Non-Brain Injuries and in Uninjured Children: Longitudinal Evaluation. J. Pediatr. Health Care 2015, 29, 343–351. [Google Scholar] [CrossRef] [PubMed]
  26. Garcia, D.; Hungerford, G.M.; Bagner, D.M. Topical Review: Negative Behavioral and Cognitive Outcomes Following Traumatic Brain Injury in Early Childhood. J. Pediatr. Psychol. 2015, 40, 391–397. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Teasdale, G.; Jennett, B. Assessment of Coma and Impaired Consciousness. Lancet 1974, 2, 81–84. [Google Scholar] [CrossRef]
  28. World Health Organization. International Statistical Classification of Diseases and Related Health Problems (10th ed.). Available online: https://icd.who.int/browse10/2016/en (accessed on 15 March 2022).
  29. Mundfrom, D.J.; Shaw, D.G. Tian Lu Ke Minimum Sample Size Recommendations for Conducting Factor Analyses. Int. J. Test. 2005, 5, 159–168. [Google Scholar] [CrossRef]
  30. Williams, D.H.; Levin, H.S.; Eisenberg, H.M. Mild Head Injury Classification. Neurosurgery 1990, 27, 422. [Google Scholar] [CrossRef]
  31. Crouchman, M. A Practical Outcome Scale for Paediatric Head Injury. Arch. Dis. Child. 2001, 84, 120–124. [Google Scholar] [CrossRef] [Green Version]
  32. Spitzer, R.L.; Kroenke, K.; Williams, J.B.W.; Löwe, B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [Green Version]
  33. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders DSM-IV, 4th ed.; American Psychiatric Association: Washington, DC, USA, 1994. [Google Scholar]
  34. Kroenke, K.; Spitzer, R.L. The PHQ-9: A New Depression Diagnostic and Severity Measure. Psychiatr. Ann. 2002, 32, 509–515. [Google Scholar] [CrossRef] [Green Version]
  35. Sequeira, S.L.; Morrow, K.E.; Silk, J.S.; Kolko, D.J.; Pilkonis, P.A.; Lindhiem, O. National Norms and Correlates of the PHQ-8 and GAD-7 in Parents of School-Age Children. J. Child Fam. Stud. 2021, 30, 2303–2314. [Google Scholar] [CrossRef]
  36. Richardson, L.P.; McCauley, E.; Grossman, D.C.; McCarty, C.A.; Richards, J.; Russo, J.E.; Rockhill, C.; Katon, W. Evaluation of the Patient Health Questionnaire (PHQ-9) for Detecting Major Depression among Adolescents. Pediatrics 2010, 126, 1117–1123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Sady, M.D.; Vaughan, C.G.; Gioia, G.A. Psychometric Characteristics of the Postconcussion Symptom Inventory in Children and Adolescents. Arch. Clin. Neuropsychol. 2014, 29, 348–363. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Strauss, E.; Sherman, E.M.; Spreen, O. Rey Auditory Verbal Learning Test (RAVLT). In A Compendium of Neuropsychological Tests—Administration, Norms, and Commentary; Oxford University Press: New York, NY, USA, 2006; pp. 776–810. [Google Scholar]
  39. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C.W. The COSMIN Checklist for Assessing the Methodological Quality of Studies on Measurement Properties of Health Status Measurement Instruments: An International Delphi Study. Qual. Life Res. 2010, 19, 539–549. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Liu, Y.; Millsap, R.E.; West, S.G.; Tein, J.-Y.; Tanaka, R.; Grimm, K.J. Testing Measurement Invariance in Longitudinal Data with Ordered-Categorical Measures. Psychol. Methods 2017, 22, 486–506. [Google Scholar] [CrossRef]
  41. Cole, D.A. Utility of Confirmatory Factor Analysis in Test Validation Research. J. Consult. Clin. Psychol. 1987, 55, 584–594. [Google Scholar] [CrossRef]
  42. Hu, L.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  43. Steiger, J.H. Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivar. Behav. Res. 1990, 25, 173–180. [Google Scholar] [CrossRef] [Green Version]
  44. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics, 5th ed.; Allyn & Bacon/Pearson Education: Boston, MA, USA, 2007; ISBN 978-0-205-45938-4. [Google Scholar]
  45. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis; Pearson College Division: Hoboken, NJ, USA, 2010. [Google Scholar]
  46. Zumbo, B. A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-Type (Ordinal) Item Scores; Directorate of Human Resources Research and Evaluation, Department of National Defense: Ottawa, ON, USA, 1999. [Google Scholar]
  47. Kirk, R.E. Practical Significance: A Concept Whose Time Has Come. Educ. Psychol. Meas. 1996, 56, 746–759. [Google Scholar] [CrossRef]
  48. Bulmer, M.G. Principles of Statistics; Dover Publications: New York, NY, USA, 1979; ISBN 978-0-486-63760-0. [Google Scholar]
  49. von Steinbuechel, N.; Richter, S.; Morawetz, C.; Riemsma, R. Assessment of Subjective Health and Health-Related Quality of Life in Persons with Acquired or Degenerative Brain Injury. Curr. Opin. Neurol. 2005, 18, 681–691. [Google Scholar] [CrossRef]
  50. The Whoqol Group. The World Health Organization Quality of Life Assessment (WHOQOL): Development and General Psychometric Properties. Soc. Sci. Med. 1998, 46, 1569–1585. [Google Scholar] [CrossRef]
  51. Janssens, L.; Gorter, J.W.; Ketelaar, M.; Kramer, W.L.M.; Holtslag, H.R. Health-Related Quality-of-Life Measures for Long-Term Follow-up in Children after Major Trauma. Qual. Life Res. 2008, 17, 701–713. [Google Scholar] [CrossRef] [Green Version]
  52. Harvill, L.M. An NCME Instructional Module on. Standard Error of Measurement. Educ. Meas. Issues Pract. 1991, 10, 33–41. [Google Scholar] [CrossRef]
  53. Norman, G.R.; Sloan, J.A.; Wyrwich, K.W. Interpretation of Changes in Health-Related Quality of Life: The Remarkable Universality of Half a Standard Deviation. Med. Care 2003, 41, 12. [Google Scholar] [CrossRef] [PubMed]
  54. Van Baalen, B.; Odding, E.; van Woensel, M.P.; van Kessel, M.A.; Roebroeck, M.E.; Stam, H.J. Reliability and Sensitivity to Change of Measurement Instruments Used in a Traumatic Brain Injury Population. Clin. Rehabil. 2006, 20, 686–700. [Google Scholar] [CrossRef] [PubMed]
  55. Von Steinbuechel, N.; Wilson, L.; Gibbons, H.; Hawthorne, G.; Höfer, S.; Schmidt, S.; Bullinger, M.; Maas, A.; Neugebauer, E.; Powell, J.; et al. Quality of Life after Brain Injury (QOLIBRI): Scale Development and Metric Properties. J. Neurotrauma 2010, 27, 1167–1185. [Google Scholar] [CrossRef]
  56. Von Steinbuechel, N.; Wilson, L.; Gibbons, H.; Hawthorne, G.; Höfer, S.; Schmidt, S.; Bullinger, M.; Maas, A.; Neugebauer, E.; Powell, J.; et al. Quality of Life after Brain Injury (QOLIBRI): Scale Validity and Correlates of Quality of Life. J. Neurotrauma 2010, 27, 1157–1165. [Google Scholar] [CrossRef]
  57. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; L. Erlbaum Associates: Hillsdale, MI, USA, 1988; ISBN 978-0-8058-0283-2. [Google Scholar]
  58. Baumgarten, F.; Cohrdes, C.; Schienkiewitz, A.; Thamm, R.; Meyrose, A.-K.; Ravens-Sieberer, U. Gesundheitsbezogene Lebensqualität und Zusammenhänge mit chronischen Erkrankungen und psychischen Auffälligkeiten bei Kindern und Jugendlichen: Ergebnisse aus KiGGS Welle 2. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2019, 62, 1205–1214. [Google Scholar] [CrossRef]
  59. Fineblit, S.; Selci, E.; Loewen, H.; Ellis, M.; Russell, K. Health-Related Quality of Life after Pediatric Mild Traumatic Brain Injury/Concussion: A Systematic Review. J. Neurotrauma 2016, 33, 1561–1568. [Google Scholar] [CrossRef] [PubMed]
  60. Little, R.J.A. A Test of Missing Completely at Random for Multivariate Data with Missing Values. J. Am. Stat. Assoc. 1988, 83, 1198–1202. [Google Scholar] [CrossRef]
  61. Varni, J.W. PedsQL TM (Pediatric Quality of Life Inventory TM). Available online: https://www.pedsql.org/score.html (accessed on 6 July 2022).
  62. R Core Team R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2021.
  63. Tierney, N.J.; Cook, D.H. Expanding Tidy Data Principles to Facilitate Missing Data Exploration, Visualization and Assessment of Imputations. J. Stat. Softw. 2020, VV, 1–31. [Google Scholar] [CrossRef]
  64. Rosseel, Y. Lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012, 48, 1–36. [Google Scholar] [CrossRef] [Green Version]
  65. Choi, S.; Gibbons, L.; Crane, P. Lordif: An R Package for Detecting Differential Item Functioning Using Iterative Hybrid Ordinal Logistic Regression/Item Response Theory and Monte Carlo Simulations. J. Stat. Softw. 2011, 39, 1–30. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Revelle, W. Psych: Procedures for Personality and Psychological Research; Northwestern University: Evanston, IL, USA, 2021. [Google Scholar]
  67. Von Steinbüchel-Rheinwall, N.; Backhaus, J. Erhebung gesundheitsbezogener Lebensqualität: Gegenwärtiger Stand und Perspektiven. Z. Epileptol. 2015, 28, 102–110. [Google Scholar] [CrossRef]
  68. Pinquart, M. Health-Related Quality of Life of Young People With and Without Chronic Conditions. J. Pediatr. Psychol. 2020, 45, 780–792. [Google Scholar] [CrossRef] [PubMed]
  69. Babikian, T.; Asarnow, R. Neurocognitive Outcomes and Recovery after Pediatric TBI: Meta-Analytic Review of the Literature. Neuropsychology 2009, 23, 283–296. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  70. Brain Injury Australia. The Prevalence of Acquired Brain Injury among Victims and Perpetrators of Family Violence; Brain Injury Australia: Putney, NSW, Australia, 2018. [Google Scholar]
  71. Sbordone, R.J.; Seyranian, G.D.; Ruff, R.M. Are the Subjective Complaints of Traumatically Brain Injured Patients Reliable? Brain Inj. 1998, 12, 505–515. [Google Scholar] [CrossRef]
  72. Holmbeck, G.N.; Thill, A.W.; Bachanas, P.; Garber, J.; Miller, K.B.; Abad, M.; Bruno, E.F.; Carter, J.S.; David-Ferdon, C.; Jandasek, B.; et al. Evidence-Based Assessment in Pediatric Psychology: Measures of Psychosocial Adjustment and Psychopathology. J. Pediatr. Psychol. 2008, 33, 958–980. [Google Scholar] [CrossRef] [Green Version]
  73. Sasse, N.; Gibbons, H.; Wilson, L.; Martinez-Olivera, R.; Schmidt, H.; Hasselhorn, M.; von Wild, K.; von Steinbüchel, N. Self-Awareness and Health-Related Quality of Life after Traumatic Brain Injury. J. Head Trauma Rehabil. 2013, 28, 464–472. [Google Scholar] [CrossRef]
  74. Polit, D.F. Getting Serious about Test–Retest Reliability: A Critique of Retest Research and Some Recommendations. Qual. Life Res. 2014, 23, 1713–1720. [Google Scholar] [CrossRef]
  75. Gorbunova, A.; Zeldovich, M.; Voormolen, D.C.; Krenz, U.; Polinder, S.; Haagsma, J.A.; Hagmayer, Y.; Covic, A.; Real, R.G.L.; Asendorf, T.; et al. Reference Values of the QOLIBRI from General Population Samples in the United Kingdom and The Netherlands. J. Clin. Med. 2020, 9, 2100. [Google Scholar] [CrossRef]
  76. Krenz, U.; Greving, S.; Zeldovich, M.; Haagsma, J.; Polinder, S.; von Steinbuechel, N.; on behalf of the CENTER-TBI Participants and Investigators. Reference Values of the Quality of Life after Brain Injury (QOLIBRI) from a General Population Sample in Italy. J. Clin. Med. 2023, 12, 491. [Google Scholar] [CrossRef] [PubMed]
  77. Xia, Y.; Yang, Y. RMSEA, CFI, and TLI in Structural Equation Modeling with Ordered Categorical Data: The Story They Tell Depends on the Estimation Methods. Behav. Res. Methods 2019, 51, 409–428. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Pagulayan, K.F.; Hoffman, J.M.; Temkin, N.R.; Machamer, J.E.; Dikmen, S.S. Functional Limitations and Depression After Traumatic Brain Injury: Examination of the Temporal Relationship. Arch. Phys. Med. Rehabil. 2008, 89, 1887–1892. [Google Scholar] [CrossRef]
  79. Bradbury, K.R.; Williams, C.; Leonard, S.; Holding, E.; Turner, E.; Wagner, A.E.; Piantino, J.; Luther, M.; Hall, T.A. Emotional Aspects of Pediatric Post-Intensive Care Syndrome Following Traumatic Brain Injury. J. Child Adolesc. Trauma 2021, 14, 177–187. [Google Scholar] [CrossRef]
  80. Haugland, S.; Wold, B.; Stevenson, J.; Aaroe, L.E.; Woynarowska, B. Subjective Health Complaints in Adolescence. Eur. J. Public Health 2001, 11, 4–10. [Google Scholar] [CrossRef]
  81. Ryan, N.P.; Noone, K.; Godfrey, C.; Botchway, E.N.; Catroppa, C.; Anderson, V. Young Adults’ Perspectives on Health-Related Quality of Life after Paediatric Traumatic Brain Injury: A Prospective Cohort Study. Ann. Phys. Rehabil. Med. 2019, 62, 342–350. [Google Scholar] [CrossRef] [PubMed]
  82. Horneman, G.; Folkesson, P.; Sintonen, H.; von Wendt, L.; Emanuelson, I. Health-Related Quality of Life of Adolescents and Young Adults 10 Years after Serious Traumatic Brain Injury. Int. J. Rehabil. Res. Int. Z. Rehabil. Rev. Int. Rech. Readapt. 2005, 28, 245–249. [Google Scholar] [CrossRef]
  83. Andruszkow, H.; Deniz, E.; Urner, J.; Probst, C.; Grün, O.; Lohse, R.; Frink, M.; Krettek, C.; Zeckey, C.; Hildebrand, F. Physical and Psychological Long-Term Outcome after Traumatic Brain Injury in Children and Adult Patients. Health Qual. Life Outcomes 2014, 12, 26. [Google Scholar] [CrossRef] [Green Version]
  84. Barlow, K.M. Postconcussion Syndrome: A Review. J. Child Neurol. 2016, 31, 57–67. [Google Scholar] [CrossRef]
  85. Fried, E.; Balla, U.; Catalogna, M.; Kozer, E.; Oren-Amit, A.; Hadanny, A.; Efrati, S. Persistent Post-Concussive Syndrome in Children after Mild Traumatic Brain Injury Is Prevalent and Vastly Underdiagnosed. Sci. Rep. 2022, 12, 4364. [Google Scholar] [CrossRef]
  86. Lieu, J.E.C.; Dewan, K. Assessment of Self-Selection Bias in a Pediatric Unilateral Hearing Loss Study. Otolaryngol. Neck Surg. 2010, 142, 427–433. [Google Scholar] [CrossRef] [Green Version]
  87. Von Steinbuechel, N.; Rauen, K.; Krenz, U.; Wu, Y.-J.; Covic, A.; Plass, A.M.; Cunitz, K.; Mueller, I.; Bockhop, F.; Polinder, S.; et al. Translation and Linguistic Validation of Outcome Instruments for Traumatic Brain Injury Research and Clinical Practice: A Step-by-Step Approach within the Observational CENTER-TBI Study. J. Clin. Med. 2021, 10, 2863. [Google Scholar] [CrossRef]
  88. Hsu, C.-C.; Sandford, B.A. He Delphi Technique: Making Sense of Consensus. Pract. Assess. Res. Eval. 2007, 12, 1–8. [Google Scholar] [CrossRef]
  89. Weitzner, M.A.; Jacobsen, P.B.; Wagner, H., Jr.; Friedland, J.; Cox, C. The Caregiver Quality of Life Index-Cancer (CQOLC) Scale: Development and Validation of an Instrument to Measure Quality of Life of the Family Caregiver of Patients with Cancer. Qual. Life Res. 1998, 8, 55–63. [Google Scholar] [CrossRef] [PubMed]
  90. Waters, E.; Maher, E.; Salmon, L.; Reddihough, D.; Boyd, R. Development of a Condition-Specific Measure of Quality of Life for Children with Cerebral Palsy: Empirical Thematic Data Reported by Parents and Children. Child Care Health Dev. 2005, 31, 127–135. [Google Scholar] [CrossRef] [PubMed]
  91. Landgraf, J.M. Child Health Questionnaire (CHQ). In Encyclopedia of Quality of Life and Well-Being Research; Michalos, A.C., Ed.; Springer: Dordrecht, The Netherlands, 2014. [Google Scholar] [CrossRef]
  92. Maylath, N.S. Development of the Children’s Health Ratings Scale. Health Educ. Q. 1990, 17, 89–97. [Google Scholar] [CrossRef] [PubMed]
  93. Horsman, J.; Furlong, W.; Feeny, D.; Torrance, G. The Health Utilities Index (HUI®): Concepts, Measurement Properties and Applications. Health Qual. Life Outcomes 2003, 1, 54. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  94. Bullinger, M.; Schmidt, S.; Petersen, C.; Disabkids Group. Assessing Quality of Life of Children with Chronic Health Conditions and Disabilities: A European Approach. Int. J. Rehabil. Res. 2002, 25, 197–206. [Google Scholar] [CrossRef]
  95. Collier, J.; MacKinlay, D.; Phillips, D. Norm Values for the Generic Children’s Quality of Life Measure (GCQ) from a Large School-Based Sample. Qual. Life Res. 2000, 9, 617–623. [Google Scholar] [CrossRef]
  96. Ravens-Sieberer, U.; Auquier, P.; Erhart, M.; Gosch, A.; Rajmil, L.; Bruil, J.; Power, M.; Duer, W.; Cloetta, B.; Czemy, L.; et al. The KIDSCREEN-27 Quality of Life Measure for Children and Adolescents: Psychometric Results from a Cross-Cultural Survey in 13 European Countries. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehabil. 2007, 16, 1347–1356. [Google Scholar] [CrossRef]
  97. Ravens-Sieberer, U.; Bullinger, M. Assessing Health-Related Quality of Life in Chronically Ill Children with the German KINDL: First Psychometric and Content Analytical Results. Qual. Life Res. 1998, 7, 399–407. [Google Scholar] [CrossRef] [PubMed]
  98. Cella, D.; Lai, J.-S.; Nowinski, C.J.; Victorson, D.; Peterman, A.; Miller, D.; Bethoux, F.; Heinemann, A.; Rubin, S.; Cavazos, J.E.; et al. Neuro-QOL: Brief Measures of Health-Related Quality of Life for Clinical Research in Neurology. Neurology 2012, 78, 1860–1867. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  99. Bruil, J.; Fekkes, M.; Vogels, T. The Validity and Reliability of the TAAQOL: A Health-Related Quality of Life Instruments Comprising Health Status Weighted by the Impact of Problems on Well Being. Qual. Life Res. 2001, 10, 257. [Google Scholar]
  100. Cramer, J.A.; Westbrook, L.E.; Devinsky, O.; Perrine, K.; Glassman, M.B.; Camfield, C. Development of the Quality of Life in Epilepsy Inventory for Adolescents: The QOLIE-AD-48. Epilepsia 1999, 40, 1114–1121. [Google Scholar] [CrossRef]
  101. Apajasalo, M.; Rautonen, J.; Holmberg, C.; Sinkkonen, J.; Aalberg, V.; Pihko, H.; Siimes, M.A.; Kaitila, I.; Maekelae, A.; Erkkilae, K.; et al. Quality of Life in Pre-Adolescence: A 17-Dimensional Health-Related Measure (17D). Qual. Life Res. 1996, 5, 532–538. [Google Scholar] [CrossRef] [PubMed]
  102. Sapin, C.; Simeoni, M.-C.; El Khammar, M.; Antoniotti, S.; Auquier, P. Reliability and Validity of the VSP-A, a Health-Related Quality of Life Instrument for Ill and Healthy Adolescents. J. Adolesc. Health 2005, 36, 327–336. [Google Scholar] [CrossRef] [PubMed]
Table 1. Demographic and clinical characteristics of participants.
Table 1. Demographic and clinical characteristics of participants.
VariableGroup N (%)
GenderFemale120 (40%)
Male179 (60%)
Non-binary1(0%)
AgeChildren (8–12 years)152 (51%)
Adolescents (13–17 years)148 (49%)
Parents’ Highest Level of EducationPrimary school1 (0%)
Secondary school57 (19%)
Vocational school/college39 (13%)
University189 (63%)
Data missing14 (5%)
TBI SeverityMild215 (72%)
Moderate25 (8%)
Severe60 (20%)
Cerebral Lesion(s) Found in NeuroimagingNo208 (69%)
Yes86 (29%)
Data missing6 (2%)
KOSCHI Disability/Recovery Score3a0 (0%)
3b1 (0%)
4a8 (3%)
4b22 (7%)
5a40 (13%)
5b229 (76%)
Time Since TBI<1 year7 (2%)
1–<2 years44 (15%)
2–<4 years81 (27%)
4–10 years167 (56%)
Data missing1 (0%)
Physical, Sensory, and Cognitive Problems after TBI No196 (65%)
Yes100 (33%)
Data missing4 (1%)
Cognitive Problems after TBINo218 (73%)
Yes77 (26%)
Data missing5 (2%)
Learning Rate (RAVLT) Below average (M − 1SD)124 (41%)
Average (M)34 (11%)
Above average (M + 1SD)140 (47%)
Data missing2 (1%)
Anxiety (GAD-7)No anxiety (1–4)208 (69%)
Mild to severe anxiety (≥5)85 (28%)
Data missing7 (2%)
Depression (PHQ-9)No depression (1–4)187 (62%)
Mild to severe depression (≥5)106 (35%)
Data missing7 (2%)
Post-Concussion Symptoms
(PCSI-SR8/-SR13)
Fewer symptoms (M − 1SD)9 (3%)
Average (M)214 (71%)
More symptoms (M + 1SD)34 (11%)
Data missing43 (14%)
Note. N = absolute frequencies, % = percent, TBI = traumatic brain injury, KOSCHI = King’s Outcome Scale for Closed Head Injury, RAVLT = Rey Auditory Verbal Learning Test, GAD-7 = Generalized Anxiety Disorder 7, PHQ-9 = Patient Health Questionnaire 9, PCSI = Post-Concussion Symptom Inventory.
Table 2. Frequency of symptoms in individuals after mild or moderate to severe TBI.
Table 2. Frequency of symptoms in individuals after mild or moderate to severe TBI.
GroupMild TBI
N = 215 (100%)
Moderate/Severe TBI
N = 85 (100%)
Low Functional Recovery 111 (5%)20 (24%)
Physical, Sensory, and Cognitive Problems 255 (26%)45 (54%)
Mild to Severe Anxiety 3 53 (25%)32 (39%)
Mild to Severe Depression 465 (31%)41 (49%)
Post-Concussion Symptoms 5 24 (12%)9 (14%)
Low Learning Rate 681 (38%)43 (51%)
Note. N = absolute frequencies; % = percentage; 1 KOSCHI score < 5; 2 based on parent-report; 3 GAD-7 score ≥ 5; 4 PHQ-9 score ≥ 5; 5 PCSI-SR8/-SR13 symptoms (M + 1SD = impaired); 6 RAVLT low learning rate (M − 1SD = impaired).
Table 3. Psychometric properties of the 43 items before psychometric item reduction.
Table 3. Psychometric properties of the 43 items before psychometric item reduction.
Scale (Cronbach’s α a)Item OriginItemChanges in α If Omitted aCITC aItem Loadings (CFA)
Cognition(0.70)QOLIBRIConcentration−0.060.590.60
QOLIBRITalking to Others−0.030.480.67
QOLIBRIRemembering−0.040.500.50
QOLIBRIThinking Speed−0.070.660.68
QOLIBRIPlanning−0.030.450.60
QOLIBRIOrientation−0.010.390.52
QOLIBRIDecision Between Two Things−0.010.400.56
Self
(0.78)
QOLIBRIAppearance−0.080.770.74
QOLIBRISelf-Esteem−0.080.770.81
QOLIBRIAccomplishment 0.000.490.68
QOLIBRIEnergy−0.010.520.70
QOLIBRIFuture−0.050.640.66
Daily Life
and Autonomy
(0.73)
QOLIBRIManage at School−0.020.470.62
NewDecision Making−0.030.500.56
QOLIBRIDaily Independence 0.000.310.40
QOLIBRIDomestic Activities b 0.010.290.37
NewAbility to Move−0.030.550.61
QOLIBRIGetting Out and About−0.030.530.55
NewHelped by Family c−0.020.530.65
QOLIBRISocial Activities−0.040.570.68
NewSupport from Others−0.030.560.70
NewFinish What You Had Planned c−0.010.420.51
Social
Relationships
(0.77)
QOLIBRIFamily Relationship 0.000.350.45
NewSafe and Secure c−0.020.540.64
QOLIBRIRelationship with Friends−0.030.630.66
QOLIBRIAttitudes of Others−0.040.670.69
NewDemands from Others−0.020.490.68
NewCenter of Attention c 0.020.300.44
NewNumber of Friends d−0.020.550.57
NewFriendships−0.030.640.72
NewOpen up to Others−0.030.560.66
NewInternet/Social Media d−0.030.540.58
Emotions
(0.70)
QOLIBRIAnger−0.060.580.59
QOLIBRIAnxiety−0.050.550.62
QOLIBRIBoredom c 0.010.370.42
QOLIBRISadness−0.080.630.66
QOLIBRILoneliness−0.080.630.72
Physical
Problems
(0.73)
QOLIBRIHeadaches−0.060.650.68
New +Pain−0.070.680.62
QOLIBRITBI Effects 0.010.360.72
QOLIBRIClumsiness−0.040.570.71
QOLIBRISeeing/Hearing−0.040.550.68
QOLIBRIOther Injuries−0.030.530.54
Note. CITC = corrected item-total correlations, CFA = confirmatory factor analysis. Negative values in “Changes in α if omitted” indicate a decrease in a scale’s Cronbach’s α if this item is omitted, a Cronbach’s α for scales and CITC values on the basis of the assumed scale structure and 43 items, b Items that were excluded due to low factor loading (CFA), c Items that were excluded due to increase in Cronbach’s α if omitted, d Items that were excluded to reduce the questionnaire’s length, + In the adult QOLIBRI version, Pain and Headaches are assessed in a single question.
Table 4. Descriptive statistics for the total and scale scores of the QOLIBRI-KID/ADO, PedsQL, PHQ-9, and GAD-7.
Table 4. Descriptive statistics for the total and scale scores of the QOLIBRI-KID/ADO, PedsQL, PHQ-9, and GAD-7.
InstrumentScaleNMSDSK
QOLIBRI-KID/ADOCognition30075.2013.45−0.70
Self29980.0915.61−0.99
Daily Life and Autonomy29886.6311.42−1.47
Social Relationships30081.7012.75−0.91
Emotions30052.9924.05−0.08
Physical Problems30063.5421.66−0.44
Psychosocial Score29773.3311.62−0.42
Total Score29774.7511.27−0.53
PedsQLPhysical Functioning30083.3513.43−1.09
Psychosocial Functioning29877.8013.82−0.84
Total Functioning29879.1912.78−0.85
GAD-7Total Score2933.53.321.31
PHQ-9Total Score2934.323.811.26
Note. N = absolute frequencies, M = mean, SD = standard deviation, SK = skewness. Negative values indicate left-skewed distributions. PedsQL = Pediatric Quality of Life Inventory, GAD-7 = Generalized Anxiety Disorder 7, PHQ-9 = Patient Health Questionnaire 9.
Table 5. Cronbach’s α of total and scale scores of the QOLIBRI-KID/ADO for individuals with different TBI severity and with and without any actual symptom burden.
Table 5. Cronbach’s α of total and scale scores of the QOLIBRI-KID/ADO for individuals with different TBI severity and with and without any actual symptom burden.
Scale
SubgroupsNCognitionSelfDaily Life and Autonomy Social RelationshipsEmotionsPhysical ProblemsTotal Score
Total 0.700.800.700.730.710.730.89
Moderate/Severe TBI850.730.770.700.760.640.720.89
Mild TBI 2150.670.780.680.710.740.740.88
Low Functional Recovery 1310.570.800.620.660.760.570.84
Full Functional Recovery 12690.710.780.690.740.710.740.89
Physical, Sensory, and Cognitive Problems 21000.640.780.670.710.720.740.87
No Physical, Sensory, or Cognitive Problems 21960.710.780.700.730.700.680.88
Cognitive Problems 2770.660.800.650.730.730.730.88
No Cognitive Problems 22180.690.770.710.720.710.700.88
Mild to Severe Anxiety 3 850.740.790.710.700.680.670.87
No Anxiety 3 2080.640.760.620.720.720.720.88
Mild to Severe Depression 41060.680.770.650.710.700.690.86
No Depression 4 1870.660.770.620.710.720.710.88
Post-Concussion Symptoms 5 340.680.790.720.700.490.490.84
No Post-Concussion Symptoms 52230.670.720.580.670.700.700.85
Low Learning Rate 61240.730.810.710.750.730.730.90
High Learning Rate 61400.670.740.660.720.720.710.87
Note. N = absolute frequencies; 1 KOSCHI (low = 3a/b, 4a/b, high = 5a/5b; 2 based on parent-report; 3 GAD-7 (mild to severe ≥ 5, no < 5); 4 PHQ-9 (mild to severe ≥ 5, no < 5); 5 PCSI-SR8/-SR13 (symptoms = impaired: M + 1SD, not impaired = M and M − 1SD); 6 RAVLT (low learning rate = M − 1SD, not impaired: M and M + 1SD).
Table 6. Test-retest reliability.
Table 6. Test-retest reliability.
ScaleICC(2,1)SemMDC
Cognition0.644 (0.570–0.708)0.551.53
Self0.513 (0.403–0.609)0.581.60
Daily Life and Autonomy0.518 (0.426–0.599)0.461.27
Social Relationships0.424 (0.315–0.523)0.551.52
Emotions0.468 (0.335–0.583)0.882.44
Physical Problems0.539 (0.441–0.624)0.932.58
Total score0.577 (0.541–0.611)0.681.88
Note. ICC(2,1) = intraclass correlation coefficient, SEm = standard error of measurement, MDC = minimal detectable change.
Table 7. Pearson correlation coefficients between the QOLIBRI-KID/ADO total and scale scores with the PedsQL, GAD-7, and PHQ-9.
Table 7. Pearson correlation coefficients between the QOLIBRI-KID/ADO total and scale scores with the PedsQL, GAD-7, and PHQ-9.
PedsQLGAD-7PHQ-9
QOLIBRI-KID/ADOPhysical FunctioningSocial Scale Score Psycho-
Social
Functioning
Total Score
Cognition0.310.360.490.48−0.26−0.35
Self0.190.260.450.37−0.24−0.29
Daily Life and Autonomy0.410.540.540.55−0.24−0.30
Social Relationships0.270.470.490.47−0.23−0.26
Emotions0.310.250.430.43−0.18−0.15
Physical Problems0.530.380.490.54−0.21−0.27
Psychosocial Score0.370.430.600.59−0.30−0.33
Total Score0.500.530.670.67−0.31−0.36
Note. Values in bold emphasize correlations considered for convergent/construct (PedsQL) and discriminant (GAD-7 and PHQ-9) validity. Negative values indicate lower TBI-specific HRQoL (lower QOLIBRI-KID/ADO scores) associated with symptoms increase. PedsQL = Pediatric Quality of Life Inventory, GAD-7 = Generalized Anxiety Disorder 7, PHQ-9 = Patient Health Questionnaire 9.
Table 8. Mean QOLIBRI-KID/ADO scores for groups of participants stratified by sociodemographic and clinical characteristics.
Table 8. Mean QOLIBRI-KID/ADO scores for groups of participants stratified by sociodemographic and clinical characteristics.
QOLIBRI-KID/ADO
GroupMSDtdfpd
Children76.8510.713.34291.16<0.001 *0.39
Adolescents72.5511.46
Female72.8311.852.52234.980.006 *0.31
Male76.2110.52
TBI within the last four years72.7611.703.03288.180.003 *0.35
TBI more than four years ago76.6910.57
Low Functional Recovery 186.651.642.3937.180.012 *0.45
Full Functional Recovery 173.8711.51
Physical, Sensory, and Cognitive problems 2 70.58 11.674.04151.84<0.001 *0.54
No Physical, Sensory, and Cognitive problems 276.4810.65
Mild to Severe Anxiety3 69.9311.344.26152.79<0.001 *0.56
No Anxiety 3 75.2111.03
Mild to Severe Depression 4 68.8311.225.35211.40<0.001 *0.66
No Depression 476.0310.76
Post-Concussion Symptoms 5 59.8510.109.4042.64<0.001 *1.80
No Post-Concussion Symptoms 5 77.22 9.55
Low Learning Rate 6 75.0111.770.65296.260.5160.07
Higher Learning Rate 6 74.1610.68
Note. M = mean, SD = standard deviation, df = degrees of freedom, t = t-value, p = p-value (* = p < 0.05), d = Cohen’s d. 1 KOSCHI (low = 3a/b, 4a/b, high = 5a/5b; 2 based on parent-report; 3 GAD-7 (mild to severe ≥ 5, no < 5); 4 PHQ-9 (mild to severe ≥ 5, no < 5); 5 PCSI-SR8/-SR13 (symptoms = impaired: M + 1SD, not impaired = M and M − 1SD); 6 RAVLT (low learning rate = M − 1SD, not impaired: M and M + 1SD).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Von Steinbuechel, N.; Zeldovich, M.; Greving, S.; Olabarrieta-Landa, L.; Krenz, U.; Timmermann, D.; Koerte, I.K.; Bonfert, M.V.; Berweck, S.; Kieslich, M.; et al. Quality of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO)—The First Disease-Specific Self-Report Questionnaire after Traumatic Brain Injury. J. Clin. Med. 2023, 12, 4898. https://doi.org/10.3390/jcm12154898

AMA Style

Von Steinbuechel N, Zeldovich M, Greving S, Olabarrieta-Landa L, Krenz U, Timmermann D, Koerte IK, Bonfert MV, Berweck S, Kieslich M, et al. Quality of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO)—The First Disease-Specific Self-Report Questionnaire after Traumatic Brain Injury. Journal of Clinical Medicine. 2023; 12(15):4898. https://doi.org/10.3390/jcm12154898

Chicago/Turabian Style

Von Steinbuechel, Nicole, Marina Zeldovich, Sven Greving, Laiene Olabarrieta-Landa, Ugne Krenz, Dagmar Timmermann, Inga K. Koerte, Michaela Veronika Bonfert, Steffen Berweck, Matthias Kieslich, and et al. 2023. "Quality of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO)—The First Disease-Specific Self-Report Questionnaire after Traumatic Brain Injury" Journal of Clinical Medicine 12, no. 15: 4898. https://doi.org/10.3390/jcm12154898

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop