Next Article in Journal
Use of the Visceral Adiposity Index as an Indicator of Chronic Kidney Disease in Older Adults: Comparison with Body Mass Index
Previous Article in Journal
Ultrasound Can Be Usefully Integrated with the Clinical Assessment of Nail and Enthesis Involvement in Psoriasis and Psoriatic Arthritis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Importance of Monitoring Neurodevelopmental Outcomes for Preterm Infants: A Comparison of the AIMS, GMA, Pull to Sit Maneuver and ASQ-3

by
Roksana Malak
1,*,
Brittany Fechner
1,
Marta Stankowska
1,
Katarzyna Wiecheć
2,
Tomasz Szczapa
3,
Joanna Kasperkowicz
1,
Maja Matthews-Kozanecka
4,
Teresa Matthews Brzozowska
5,
Oskar Komisarek
6,7,
Przemysław Daroszewski
8,
Włodzimierz Samborski
1 and
Ewa Mojs
2
1
Department and Clinic of Rheumatology, Rehabilitation and Internal Medicine, Poznań University of Medical Sciences, 61-545 Poznan, Poland
2
Department of Clinical Psychology, Poznań University of Medical Sciences, 60-812 Poznan, Poland
3
Neonatal Biophysical Monitoring and Cardiopulmonary Therapies Research Unit, II Department of Neonatology, Poznan University of Medical Sciences, 60-535 Poznan, Poland
4
Department of Social Sciences and the Humanities, Poznan University of Medical Sciences, 60-806 Poznan, Poland
5
Department of Orthodontics and Masticatory Dysfunction, Poznan University of Medical Sciences, 60-812 Poznan, Poland
6
The Chair and Clinic of Maxillofacial Orthopaedics and Orthodontics, Poznan University of Medical Sciences, 60-812 Poznan, Poland
7
Department of Plastic, Reconstructive and Aesthetic Surgery, Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University in Torun, 85-821 Bydgoszcz, Poland
8
Department of Organization and Management in Health Care, Poznan University of Medical Sciences, 61-545 Poznan, Poland
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(21), 6295; https://doi.org/10.3390/jcm11216295
Submission received: 3 September 2022 / Revised: 4 October 2022 / Accepted: 24 October 2022 / Published: 26 October 2022
(This article belongs to the Section Obstetrics & Gynecology)

Abstract

:
Background: Clinicians and parents should closely monitor the neurodevelopment of very preterm infants. The aim of our study was to compare whether neurodevelopmental assessments completed by parents and those done by specialists yielded similar outcomes. We wanted to check whether the assessments completed by specialists and parents were comparable in outcomes to emphasize the important roles of early assessment of a child and of the parents in their child’s treatment and medical care. Another aim was to check whether or not the pull to sit maneuver from the Neonatal Behavioral Assessment Scale (NBAS) is still a parable item in well-known scales of neurodevelopment. Methods: We assessed 18 preterm neonates in the fourth month of corrected age with scales such as the General Movement Assessment (GMA), the Alberta Infant Motor Scale (AIMS), and the pull to sit maneuver from the NBAS. Finally, we asked parents to complete the Ages and Stages Questionnaire, Third Edition (ASQ-3). Results: We found that the respective assessments completed by specialists and parents are comparable in outcomes. We also found that the pull to sit item from the NBAS was still a valid test since it showed similar findings to those from the AIMS, the GMA, and the ASQ-3. Conclusions: The pull to sit item from the NBAS is an important item for assessment of very preterm infants. Specialists should also take into consideration the input and concerns of parents when planning for treatment and intervention.

1. Introduction

Children should be screened and monitored in respect to their neurodevelopment. The American Academy of Pediatrics’ (AAP) developmental screening policy states that the “Early identification of developmental disorders is critical to the well-being of children and their families” [1]. The early identification of any developmental problem is especially important for very preterm infants since it enables a clinician to apply early intervention strategies that are important for preterm neonates and their parents. This explains why motor repertoire should be assessed by methods such as Prechtl’s General Movements, (GMA) which has a very high sensitivity of about 82 to 100% for infants at three months post-term [2]. Postural patterns typical for this age may also be included in the assessment. Early detection of problems related to motor repertoire enables the clinician to apply proper early intervention [3]. Overall, very preterm infants present with poorer scores in their movement repertoires, observed postural patterns, and movement character [3]. Parents of neonates hospitalized in the neonatal intensive care unit (NICU) usually experience a sense of powerlessness due to preterm birth [4]. They may feel helpless due to a lack of adequate knowledge about how to interact with their infants in the NICU. This may then lead to adverse parent outcomes after hospitalization, such as depression and other dysfunctional parenting patterns [5,6,7,8]. Monitoring their infant’s health and behavior may empower parents in the everyday care of their child [9,10]. The best way to empower a parent is by having the parent assist with the early assessment of their child’s neurodevelopment. Therefore, there are special scales which enable them to do so, such as the International Classification of Functionality (ICF) and The Ages and Stages Questionnaire, Third Edition (ASQ-3).
This is extremely important, since neonates who are born at less than 32 weeks of gestational age and with a birth weight of less than 1500 g are at greater risk of having development delays [11]. The identification of the aspects that are delayed may help in applying appropriate therapeutic interventions that focus on improving special skills for these infants. Infants who are born preterm are more likely to have severe impairments, such as physical impairments, but a also to perform poorly regarding school-age function as a long-term risk factor [12]. Regarding short-term outcomes, more than a million preterm infants have died in the first month of life due to severe complications associated with premature birth [13,14]. Other short-term outcomes include intraventricular haemorrhage (IVH), necrotising enterocolitis (NEC), bronchopulmonary dysplasia (BPD), and retinopathy [15]. This is difficult because it tends to make parents of preterm children feel helpless, afraid, worried, powerless, guilty, and stressed. Therefore, the neurodevelopment of neonates should be assessed, monitored, and facilitated—firstly, in order to improve the development of the preterm child, and secondly, to help professionals empower parents [16]. There are many methods that can be used to detect difficulties or delays in a preterm neonate’s psychomotor development. It is important for a clinician to carefully consider the best methods that are both valid and useful for assessing very preterm neonates. We would like to describe the standardized assessments in the following order: The General Movement Assessment (GMA), the Alberta Infant Motor Scale (AIMS), the pull to sit maneuver from the Neonatal Behavioral Assessment Scale (NBAS), and the Ages and Stages Questionnaire, Third Edition (ASQ-3).
One such assessment is Heinz F. R. Prechtl’s GMA, which focuses on the movement repertoire of infants, and which has a high predictive power for the neurodevelopment of preterm and full-term infants presenting with various risk factors [17,18]. A reduced motor optimality score from the GMA is often associated with more severe motor impairments, even a few years later [17,18]. The GMA has a specificity of 91% (95% CI 83–95) for general movements (GMs) in prognosticating cerebral palsy. This is comparable to a cranial ultrasound, magnetic resonance imaging (MRI), and a neurological examination. GMs may be observed from early fetal life up to three months and no further than five months corrected age [17,18]. According to GM type, writhing movements are the first movements that appear in fetal life until two months corrected age after birth in typically developing infants [19]. Another type of normal GM is fidgety general movements. These are small and tiny movements most prominent between 11- and 16-weeks corrected age [12]. Types of GMs observed in atypically developing children, so-called abnormal GMs, include cramped synchronized (CS GMs), poor-repertoire (PR GMs), and chaotic (Ch GMs). Abnormal GMs, especially CS GMs, are some of the most reliable indicators of neurodevelopmental disorders [18].
Among the standardized assessment methods used to detect motor developmental abnormalities in at-risk preterm infants there is also the AIMS [12]. The AIMS enables clinicians to assess not only the level of motor development but also the quality of movement in infants [12]. The AIMS can be used in the assessment of children from birth until 18 months of life corrected age [19]. The AIMS consists of 58 items. In this assessment, the examiner observes an infant in the prone (21 items), supine (9 items), sitting (12 items), and standing (16 items) positions. The AIMS is one of the best predictive scales of atypical infant development [20]. The best sensitivity and specificity of the AIMS was recently observed at 4 months corrected age when a score below the 10th percentile provided a sensitivity of 77.3% and a specificity of 81.7% [20].
Another scale used to assess the neurodevelopment of preterm infants is the NBAS. It considers factors such as habituation, social interaction, the motor system, state regulation and organization, the autonomic nervous system (ANS), reflexes, and supplementary items [21]. The NBAS differentiates between six different types of behavioral states: deep sleep (I), light or active sleep (II), awake—drowsy (III), alert (IV), alert and active with increased motor activity (V), and crying (VI). The maximum sensitivity and specificity of the NBAS assessment of states were between 71.7 and 51.2%, respectively [22]. The NBAS can be used for infants up to 8 weeks postmenstrual age. According to Canals et al. (2011), the higher the NBAS scores in most of the items, the less the maternal anxiety that was observed in the 12th month [23]. Similarly, if mothers were less anxious during pregnancy, then most of the NBAS scores, for instance, Orientation Processes (Social—Interactive) and State—Organization, were assessed in neonates as ‘optimal’ [24]. We used the NBAS in previous studies and showed parents important aspects to consider in the everyday care of their child, including feeding [21,25,26,27]. In the present study, we preferred to only use the pull to sit item from the NBAS since Thomas Berry Brazelton, the creator of the NBAS, had described this assessment in detail. The NBAS, specifically the pull to sit item, may be a useful predictor of later developmental disabilities [28]. Furthermore, it measures axial tone of the neck and trunk and any appendicular tone of the shoulder, arms, and lower extremities [29].
Finally, another scale used to assess the neurodevelopment of preterm infants is the ASQ-3, which assesses five domains of development, including: gross motor, fine motor, problem-solving, personal-social, and communication. According to Fauls et al. (2020), “Domain scores are compared to normative scores, and cut-off points rate development in that domain as either ‘typical’ (<1 SD below mean), ‘monitor’ (≥1 SD to <2 SD below mean), or ‘refer for further assessment’ (‘refer’) (≥2 SD below mean)” [30]. Parents were asked to complete this developmental screening tool so they could trust their own observations and later present the results from this questionnaire to a specialist. The ASQ-3 may be used for children aged 0 to 66 months. This assessment is also valid in the identification of gross motor difficulties. The AAP reports that the ASQ-3 has a sensitivity range of 0.70 to 0.90 and a specificity range of 0.76 to 0.91 (the values above the 0.70 threshold represent a high sensitivity and specificity) [31]. The test-retest reliability of the ASQ-3 is 92%, with a sensitivity of 87.4% and a specificity of 95.7% [1].
The aim of our present study was to check whether the results from the ASQ-3 assessment completed by parents and the results from the same assessment completed by specialists produced similar outcomes. We decided to compare the assessments by parents to those by specialists in order to emphasize the important role of parents of preterm infants, who usually experience a sense of lack of control or powerlessness. Including parents as an important component in the care and treatment of their preterm child may help them in establishing full responsibility their care. Neurodevelopmental scales used by specialists (the GMA, the pull to sit maneuver from the NBAS, and the AIMS) as well as those used by parents (ASQ-3) help to detect children who are at risk of developmental delay. We did not want to show any particular delay in children but rather, to show that parents and specialists alike can detect an overall general delay in development. Another aim was to check to see if the pull to sit maneuver from the NBAS, which is the test performed by many pediatricians, neonatologists, and neurologists, is comparable to the assessment by parents.

2. Materials and Methods

The key objective of our study was to compare the assessment results of parents and specialists as well as to empower parents caring for their preterm infants. Due to our study taking place during the COVID-19 pandemic (May/June 2021), we included 18 infants in our study, but we managed to assess only 16 out of 18 of these preterm infants who were hospitalized at the Gynecology and Obstetrics Clinical Hospital. Inclusion criteria included infants born before the 32nd week of gestation and with a birth weight lower than 1500 g. All neonates presented with feeding problems. All parents provided us with their written consent to perform the examination of their child. The exclusion criteria included oxygen desaturation (SpO2 < 88%), a heart rate lower than 100 or higher than 205 beats per minute, active inflammation, sepsis, bone replacement, tumors, encephalopathy, hypotension, and lethal birth defects (e.g., Edwards, Patau, etc.)
We described the assessment of this same sample in a previous article [25]. We performed the second examination of these infants when they were in the fourth month of corrected age. The average age of gestation was 29 ± 2 weeks (minimum 25 weeks postmenstrual age and maximum 32 weeks postmenstrual age). The average birth weight was 1230 g ± 229 g. The average gestational age of the infants during the time of assessment was 4 months corrected age (6months calendar age). Most of the children in our study received an Apgar score of 8 points (min. 5, max. 9). The average value of the umbilical cord arterial pH was 7.23 (SD ± 0.13). Demographic data has been added below (Table 1).
We decided to observe infants in the fourth month of corrected age since this time period has a prognostic value [1,11,32,33,34,35,36]. Assessing GMs in the third to fourth month of corrected age may enable an examiner to determine increased risk factors for the development of minor neurological deficits, attention deficit hyper-activity disorder (ADHD), and maladaptive behavior even in 4- to 9-year-old children [35].

2.1. Methods

There were three tests (the GMA, AIMS, and ASQ-3) as well as the pull to sit maneuver from the NBAS which were performed over the span of two days by one qualified specialist who graduated from a course of each scale. The first test was the GMA, the second was the AIMS, and the third was the pull to sit maneuver from the NBAS. The next day parents completed the ASQ-3 in the presence of the specialist who had the knowledge to explain to parents how to complete the questionnaire.
We did not check the inter-rater reliability of these tests since one specialist completed the assessments for the study group and the intra-rater reliability of these methods had been described in previous studies. For instance, the intra-rater reliability for the GMA was 85.4% ± 0.1% and 95.4% ± 0.1%, respectively, for the two assessors [37] [for all AIMS scores, the observed intra-rater reliability was more than 75% [38] Lackovic]; for the Brazelton scale—NBAS it was 81% [10.1590/1984-0462/2021/39/2020034] and for the ASQ-3 it was approximately 98% for total ASQ-3, and the intra class correlations between the gold standard and examiners of the ASQ-3 Gross motor was approximately 97–99% [39].
Infants were first assessed using the GMA, a noninvasive method designed by Prechtl. A clinician who had graduated from an elementary and advanced course in the GMA performed the observation and assessment of each infant which lasted approximately 4 min. When considering the GMA, we observed whether a child presented with normal GMs, such as fidgety movements, or abnormal GMs, such as PR GMs, CS GMs, or Ch GMs [40].
The AIMS was the next test performed and was based on the observation of movements. Participants scored 1 point for each observed item and 0 points for a lack of movement. In order to perform the AIMS, a specialized course is not formally required. However, the clinician who performed this assessment for the purposes of this study is experienced in conducting the AIMS, and this was explained and elaborated upon in our previous study [41].
A qualified clinician, having taken the formal NBAS training course provided by the Cambridge Brazelton Centre in the United Kingdom, administered all the aforementioned scales as well as the pull to sit item of the NBAS Motor System cluster. Because of the age of the children (in the fourth month of corrected age), the clinician only performed the pull to sit item from the NBAS, and this maneuver lasted approximately one minute per participant. The NBAS is intended for children who are not older than eight weeks, but the pull to sit is normally performed during most pediatric and neurological visits. The notable head lag, especially during the first few weeks of life, is typical and normal until 3–4 months [42]. Therefore, we think that this concrete probe is more important in children who are older than 8 weeks because head lag should be absent by 3 to 4 months of age when infants typically experience an increased ability to control their neck muscles [42].
To perform the pull to sit maneuver, the clinician grasps the infant’s wrists in order to slowly pull him up from a supine into a sitting position [33]. We expected that in typically developing infants, the head would follow in line with the body when actively lifted, and that the arms would be moderately flexed at the elbows [33]. The score we gave was based on the description of the pull to sit item from the Motor System cluster of the NBAS since it contained many important details. The examiner considers the following factors for this maneuver: how a child attempts to bring his head forward; if a child brings his head to the midline; if it is possible for the child to maintain his head at the midline; how many seconds he could hold his head up; if the shoulder tone increases and neck tone is observed. The scoring system for this item is based on a 0-to-9-point scale, in which a higher number of points indicates better performance from the infant, including smoother movements, such as better head control, and limbs and trunk reaction in the pull to sit item. A lower score is due to lack of head control with no attempt to bring it up, flaccid muscle tone, and no observed shoulder and neck tone.
Finally, parents were asked to complete the ASQ-3 when their children were in the fourth month of corrected age. They answered each question of the questionnaire on a different day from the formal assessment performed by the specialist. However, they still completed the ASQ-3 in the presence of a specialist. The ASQ-3 was performed at home where parents could calmly complete all the tasks with the children (without the pressure of an unfamiliar environment such as at a clinic or office) and answer the items asked in the questionnaire. This scale is divided into the above-mentioned 5 domains (i.e., fine motor, gross motor, communication, problem solving, personal social). Each domain consists of 6 questions, to which the parent responded “yes” if the child performed a given activity, “sometimes” if he performed it rarely, or “not yet” if the behavior was not present. For all answers, “yes” was given 10 points, “sometimes” was given 5 points, and for the answer “not yet” no points were scored. A child could receive up to 60 points maximum in each cluster. Each parent completed the questionnaire in an average of 12–18 min. The results were then transferred to a table with ranges assessing the child’s development based on the cumulative points from all five domains. Although the ASQ-3 consists of 5 domains, only the gross motor and fine motor domains were compared with the specialist’s assessment. Those two clusters of the ASQ-3 refer to motor development as well as to the GMA, pull to sit maneuver from the NBAS, and AIMS.
Due to the differences in the type of measurement scales we used (nominal/ordinal/quantitative), all methods had to be reduced to one common measurement scale, which was the nominal scale. Each method mentioned contains qualitative items that have been quantified. For instance, a patient can receive zero points in the pull to sit maneuver from the NBAS if he cannot hold his head up independently, and one point if he can hold his head up without a problem, while his legs and arms remain active during the assessment. Each method was classified such that a value of 1 was correct, while a value of 0 was incorrect. The AIMS, the original results of which were presented in percentiles, was converted based on guidelines, where results less than or equal to the 25th percentile indicated abnormal development, and the 26th percentile and above indicated normal development [43]. In our present study, only one element from the NBAS was used—the pull to sit maneuver. The pull to sit maneuver of the NBAS and the ASQ-3 belong to a group of comprehensive tests, consisting of many separate components forming a whole. In order to use the results obtained from these two scales, the responses to them should be properly classified. Based on the recorded results in the zero-one system, clusters based on the similarity of responses were designated with the determination of Euclidean distances. The assignment of patients to individual clusters was based on combining common casings into groups.
In reference to assessing parental empowerment, we asked the following question from the Neonatal Satisfaction Survey (NSS-8): To what extent do you feel confident with managing the necessary follow-up care of your child/children after coming home? (i.e., breast feeding/nutrition, administering medication). Each parent could answer as either 1 point—“not at all”, 2—“to a small extent”, 3—“to some extent”, 4—“largely”, and 5—“to a very large extent”. When a child was hospitalized in the NICU, a parent completed all 51 questions of the NSS-8. The NSS-8 enables practitioners to measure the experiences of parents in eight spheres of care of their child: (1) “Your overall impression”, (2) Doctors, (3) Visit, (4) Facilities, (5) Siblings, (6) Information, (7) Parental anxiety, and (8) Discharge. Since the described assessment referred to the period of time when a child was discharged, we considered only the eighth sphere of care in our study.

2.2. Analytic Strategy

Statistical analysis was performed using Statistica Version 13 software (TIBCO Software, Tulsa, OK, USA). The difference between scales was measured using Cochran’s Q test and Dunn’s Test. Cochrane’s test was used for nominal dependent variables with more than three measurements. For the post hoc test we used Dunn’s test. A p-value of <0.05 was considered statistically significant. This study was approved by the Bioethics Committee, consent ref. No. 481/21.

3. Results

In reference to the GMA, eight of the children presented PR GMs (8 infants), six children presented normal fidgety GMs, and two infants presented with CS GMs.
The average value obtained from the AIMS was the 72nd percentile (SD ± 19). There were no children who presented with a score lower than the 10th percentile, which meant that there were no scores indicating a risk for neuromotor impairment in the fourth month according to the AIMS [44].
According to the pull to sit item probe, we used the descriptive method of scoring based on the NBAS in order to detect all abnormalities. The median score of this item was 7 (the lower Q = 6, the upper Q = 8; min. 2, max. 9).
Parents also described their children using the ASQ-3. On average, results from the gross motor domain included a score of 51 (SD ± 15) and for the fine motor domain a score of 48 (SD ± 12). For the gross motor domain two infants needed further assessment from the clinician (“refer range” > 2 SD); three infants should be involved in learning activities with parents where parents are taught how to position their child during everyday care, and encourage “tummy time” (putting a child down and lying him on his stomach with his weight on his forearms) under observation from a clinician (“monitor range” 1–2 SD below the mean); and the gross motor development of 11 infants appeared to be normal (“typical range” < 1 SD). For the fine motor system domain, two infants needed further assessment from the clinician (“refer range” > 2 SD), two infants were prescribed learning activities with parents and should be monitored (“monitor range” 1–2 SD below the mean); and for the fine motor development of 12 infants, results appeared to be normal (“typical range” < 1 SD). We then analyzed the motor functioning of the children (Table 2) to determine if there were any statistically significant differences between results from the AIMS, GMA, and pull to sit probe from the NBAS (Table 3), through the use of Dunn’s Test.
We also compared the AIMS, the pull to sit item from the NBAS, and the ASQ-3 for any differences. Similarly, Dunn’s test also revealed that there was no statistically significant difference between the results derived from the AIMS, GMA, pull to sit item from the NBAS, and ASQ-3 (p > 0.9999999).
According to Cochran’s Q Test where p > 0.05, we found that there was no significant difference between each of the compared scales (Table 4).

4. Discussion

The motor development of very preterm infants should be closely monitored. The observation of preterm children should include personal factors such as lability of states, peak of excitement or even temperament, body function, and structured domains based on atypical child development. These assessments, which are based on the biopsychological model, such as the International Classification of Function (ICF) and the NBAS, are recommended as a good tool to estimate a child’s level of functioning, disability, and health [45]. Although preterm infants are at a greater risk for developmental delay, and should receive regular assessment, they do not always benefit from systematic follow-up [46]. The AAP recommends performing ongoing developmental surveillance supplemented with standardized screening tools at specified ages in order to increase the accuracy in detecting developmental disorders.
It is generally well-known that the GMA and AIMS should be used in everyday practice. We wanted to see whether standardized scales of motor development provided similar results across both clinicians and parents. We wanted to compare the results of motor scales (the GMA and AIMS), and the pull to sit item from the NBAS with the ASQ-3. We decided to assess infants by all aforementioned methods in the fourth month of corrected age as other researchers have done [1,35,47]. Around the fourth month of corrected age, detecting atypical motor function is associated with neurological impairment, and is also well-recognized as a prognostic factor for ongoing disability [34]. Atypical motor function is an item found in many standardized scales such as the AIMS and NBAS. This then helps us to quantify relative head movements of an infant in relation to his or her trunk [48]. When the examination is performed in a typically developing infant, an infant should lift his or her head along with the torso. If a child presents with abnormal development, it would be impossible for him to lift his or her head along with the torso [48]. Abnormal performances on the pull to sit item of the NBAS have predictive significance throughout infancy in diagnosing developmental problems such as atypical outcomes of development (93%–100%), spasticity, cerebral palsy (a positive predictive value for CP is around 83%–88%), or autism spectrum disorder (ASD) (55%) [33].
Similarly, we showed that a parent’s observation of his or her child’s development is also valid and comparable to the assessment made by specialists. This information, as well as that from the ASQ-3 should help parents feel more empowered when interacting with their children. Parents of preterm infants experience a higher incidence of anxiety disorders along with altered parent-infant interactions which negatively impact their children [5]. Currently, popular and sometimes non-evidence-based information found online may make parents less aware and observant of certain important neurobehavioral signs from their infant and may exaggerate their anxieties and uncertainties. False-positive information may cause distress for some parents [49]. Online descriptions of any disorder may increase parental anxiety [50]. Rather, questionable information from the nternet could make some parents of preterm infants feel more anxious and depressed [51]. This is why the value of showing parents that it is worth it to observe their child and that their observations are comparable to that of the assessment of specialists should be more broadly acknowledged. Thanks to the ASQ-3, observing their child helps parents feel self-efficacious and certain that what they observe should be broached with a specialist, and vice versa.
For instance, the ASQ-3 has been one of the scales with the highest sensitivities and specificities in detecting developmental delay based on research from 2002 to 2009 [52,53,54]. In many publications it has been reported that the ASQ-3 is highly accurate in detecting underlying problems in children with certain risk factors [49,50,51]. Therefore, parents who detect problems in their child by their observation may systematize them by completing the ASQ-3. Seeing that a child presents any health problem, a parent may look for help from and make an appointment with a specialist in order to attain early intervention for their child [46]. The early detection of developmental problems in infants enables timely treatment with effectiveness [55].
The present study shows that specialists in neonatal care should seriously take into consideration what parents observe and say about their preterm infant during a visit to a clinician. The ASQ-3 helps make parents feel empowered. Empowering interventions and programs have a positive impact on the mental health of parents, especially mothers. These programs, containing infant behavior information, have been shown to reduce negative parent experiences such as stress, anxiety, or depressive symptoms, and have also produced self-efficacious and proper caregiving behaviors in parents. Establishing positive partnerships between clinicians and parents may help parents become better aware of their children’s development, alert them to any problems and concerns their child may present, help in the creation of goals and therapy plans, as well as provide an opportunity for parents to receive feedback from professionals about their efforts [51].
This is the second study where we found that if parents are confident and empowered in caring for their preterm child, there are many benefits. In our previous research we showed that 100% of children from the study group did not have to be fed via a tube following the provision of parental education on how to position a child, which pacifier on a bottle to use, and how to successfully facilitate breastfeeding [25]. Similarly, these same parents after six months of care, when their children were in the fourth month of corrected age, still felt confident in caring for their children in everyday life, referring to the answers from the NSS-8 questionnaire.
In a future study, we would like to see how very preterm infants not only develop their motor skills but also their psychosocial abilities. Using the ASQ-3 we would like to compare the problem-solving skills from this questionnaire as well as communication and personal-social skills. According to Hardy et al. (2015) and Vanvuchelen et al. (2017), the ASQ-3 is helpful in screening children at risk for developing ASD [55], [56]. This is important since very or extremely preterm infants are at a greater risk of developing ASD [57,58,59]. We would like to show that simple methods such as these may help to identify at-risk children and therefore allow them to access interventions earlier in life.
One limitation from our study was that the sample was small and not randomized due to the study occurring during the COVID-19 pandemic (May/June 2021). Further-more, we would like to investigate whether parents would be open to checking their children’s development using standardized developmental scales, such as the ones described here in our study.

5. Conclusions

In our study, we found that assessing motor development, including the pull to sit item of the NBAS, is important for very preterm infants. Furthermore, we showed that specialists should consider parental feedback and input. First, parent assessment is comparable to that of specialists, and second, specialists help make parents feel empowered, which can in turn build a parent’s self-confidence with their infant’s caregiving in everyday life. Parents, as the direct facilitators of their children’s upbringing, should be active and continuous participants in their assessment and care.

Author Contributions

R.M. and E.M.; methodology, M.S.; software, M.S.; validation, J.K., P.D. and O.K.; formal analysis, M.S., K.W. and M.M.-K.; investigation, R.M., K.W. and M.S.; resources, T.M.B.; data curation, W.S.; writing—original draft preparation, R.M.; writing—review and editing, R.M. and B.F.; visualization, T.S.; supervision, P.D.; project administration, W.S.; funding acquisition, E.M. and W.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially funded by the Association for Social Cooperatives, grant number 10/GEN/T1/2021.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (Ethics Committee) of Poznan University of Medical Sciences (Bioethics Committee, consent ref. No. 481/21.).

Informed Consent Statement

Informed consent was obtained from all parents of infants involved in the study.

Data Availability Statement

Data are available only under the permission of authors and parents of infants described in the manuscript.

Acknowledgments

This project was undertaken due to the contribution of nurses and neonatologists from the neonatology clinic who prepared each neonate for their neurobehavioral assessment.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Singh, A.; Yeh, C.J.; Blanchard, S.B. Ages and Stages Questionnaire: A global screening scale. Bol. Méd. Hosp. Infant. México 2017, 74, 5–12. [Google Scholar] [CrossRef] [PubMed]
  2. Hadders-Algra, M. Neural substrate and clinical significance of general movements: An update. Dev. Med. Child Neurol. 2018, 60, 39–46. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Salavati, S.; Berghuis, S.A.; Bosch, T.; Hitzert, M.M.; Baptist, D.H.; Mebius, M.J.; Bos, A.F. A comparison of the early motor repertoire of very preterm infants and term infants. Eur. J. Paediatr. Neurol. 2021, 32, 73–79. [Google Scholar] [CrossRef] [PubMed]
  4. Liu, C.-H.; Chao, Y.-H.; Huang, C.-M.; Wei, F.-C.; Chien, L.-Y. Effectiveness of applying empowerment strategies when establishing a support group for parents of preterm infants: Empowerment for parents of preterm infants. J. Clin. Nurs. 2010, 19, 1729–1737. [Google Scholar] [CrossRef]
  5. Melnyk, B.M.; Feinstein, N.F. Reducing Hospital Expenditures With the COPE (Creating Opportunities for Parent Empowerment) Program for Parents and Premature Infants: An Analysis of Direct Healthcare Neonatal Intensive Care Unit Costs and Savings. Nurs. Adm. Q. 2009, 33, 32–37. [Google Scholar] [CrossRef]
  6. Cusson, R.M. Factors Influencing Language Development in Preterm Infants. J. Obstet. Gynecol. Neonatal Nurs. 2003, 32, 402–409. [Google Scholar] [CrossRef]
  7. Miles, M.S.; Holditch-Davis, D.; Burchinal, P.; Nelson, D. Distress and Growth Outcomes in Mothers of Medically Fragile Infants. Nurs. Res. 1999, 48, 129–140. [Google Scholar] [CrossRef]
  8. Pinelli, J. Effects of Family Coping and Resources on Family Adjustment and Parental Stress in the Acute Phase of the NICU Experience. Neonatal Netw. 2000, 19, 27–37. [Google Scholar] [CrossRef]
  9. Power, N.; Franck, L. Parent participation in the care of hospitalized children: A systematic review. J. Adv. Nurs. 2008, 62, 622–641. [Google Scholar] [CrossRef]
  10. van der Pal, S.M.; Alpay, L.L.; van Steenbrugge, G.J.; Detmar, S.B. An Exploration of Parents’ Experiences and Empowerment in the Care for Preterm Born Children. J. Child Fam. Stud. 2013, 23, 1081–1089. [Google Scholar] [CrossRef]
  11. Fuentefria, R.d.N.; Silveira, R.C.; Procianoy, R.S. Motor development of preterm infants assessed by the Alberta Infant Motor Scale: Systematic review article. J. Pediatr. 2017, 93, 328–342. [Google Scholar] [CrossRef] [PubMed]
  12. Hoekstra, R.E.; Ferrara, T.B.; Couser, R.J.; Payne, N.R.; Connett, J.E. Survival and Long-Term Neurodevelopmental Outcome of Extremely Premature Infants Born at 23–26 Weeks’ Gestational Age at a Tertiary Center. Pediatrics 2004, 113, e1–e6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Wu, F.; Liu, G.; Feng, Z.; Tan, X.; Yang, C.; Ye, X.; Dai, Y.; Liang, W.; Ye, X.; Mo, J.; et al. Short-term outcomes of extremely preterm infants at discharge: A multicenter study from Guangdong province during 2008–2017. BMC Pediatr. 2019, 19, 405. [Google Scholar] [CrossRef]
  14. Blencowe, H.; Cousens, S.; Oestergaard, M.Z.; Chou, D.; Moller, A.-B.; Narwal, R.; Adler, A.; Garcia, C.V.; Rohde, S.; Say, L.; et al. National, regional, and worldwide estimates of preterm birth rates in the year 2010 with time trends since 1990 for selected countries: A systematic analysis and implications. Lancet 2012, 379, 2162–2172. [Google Scholar] [CrossRef] [Green Version]
  15. Banerjee, J.; Asamoah, F.K.; Singhvi, D.; Kwan, A.W.; Morris, J.K.; Aladangady, N. Haemoglobin level at birth is associated with short term outcomes and mortality in preterm infants. BMC Med. 2015, 13, 16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Widding, U.; Hägglöf, B.; Farooqi, A. Parents of preterm children narrate constructive aspects of their experiences. J. Clin. Nurs. 2019, 28, 4110–4118. [Google Scholar] [CrossRef] [PubMed]
  17. Aizawa, C.Y.P.; Einspieler, C.; Genovesi, F.F.; Ibidi, S.M.; Hasue, R.H. The general movement checklist: A guide to the assessment of general movements during preterm and term age. J. Pediatr. 2021, 97, 445–452. [Google Scholar] [CrossRef]
  18. Einspieler, C.; Marschik, P.B.; Pansy, J.; Scheuchenegger, A.; Krieber, M.; Yang, H.; Kornacka, M.K.; Rowinska, E.; Soloveichick, M.; Bos, A.F. The general movement optimality score: A detailed assessment of general movements during preterm and term age. Dev. Med. Child Neurol. 2016, 58, 361–368. [Google Scholar] [CrossRef] [Green Version]
  19. Gontijo, A.P.B.; Mambrini, J.V.d.; Mancini, M.C. Cross-country validity of the Alberta Infant Motor Scale using a Brazilian sample. Braz. J. Phys. Ther. 2021, 25, 444–449. [Google Scholar] [CrossRef]
  20. Harris, S.R.; Backman, C.L.; Mayson, T.A. Comparative predictive validity of the Harris Infant Neuromotor Test and the Alberta Infant Motor Scale: Predictive Validity of Infant Neuromotor Tests. Dev. Med. Child Neurol. 2009, 52, 462–467. [Google Scholar] [CrossRef]
  21. Malak, R.; Fechner, B.; Sikorska, D.; Rosołek, M.; Mojs, E.; Samborski, W.; Baum, E. Application of the Neonatal Behavioral Assessment Scale to Evaluate the Neurobehavior of Preterm Neonates. Brain Sci. 2021, 11, 1285. [Google Scholar] [CrossRef]
  22. Kodama, Y.; Okamoto, J.; Imai, K.; Asano, H.; Uchiyama, A.; Masamune, K.; Wada, M.; Muragaki, Y. Video-based neonatal state assessment method for timing of procedures. Pediatr. Int. 2021, 63, 685–692. [Google Scholar] [CrossRef]
  23. Canals, J.; Hernández-Martínez, C.; Esparó, G.; Fernández-Ballart, J. Neonatal Behavioral Assessment Scale as a predictor of cognitive development and IQ in full-term infants: A 6-year longitudinal study: Neonatal behaviour as early predictor of intelligence. Acta Paediatr. 2011, 100, 1331–1337. [Google Scholar] [CrossRef]
  24. Farber, E.A.; Vaughn, B.; Egeland, B. The relationship of prenatal maternal anxiety to infant behavior and moth-er-infant interaction during the first six months of life. Early Hum. Dev. 1981, 5, 267–277. [Google Scholar] [CrossRef]
  25. Malak, R.; Wiecheć, K.; Fechner, B.; Szczapa, T.; Kasperkowicz, J.; Matthews-Kozanecka, M.; Brzozowska, T.M.; Komisarek, O.; Samborski, W.; Mojs, E. The Influence of Parent Education on the Neurobehavior and Sucking Reflexes of Very Preterm Infants. Brain Sci. 2022, 12, 840. [Google Scholar] [CrossRef]
  26. Malak, R.; Sikorska, D.; Rosołek, M.; Baum, E.; Mojs, E.; Daroszewski, P.; Matecka, M.; Fechner, B.; Samborski, W. Impact of umbilical cord arterial pH, gestational age, and birth weight on neurodevelopmental outcomes for preterm neonates. Peer J. 2021, 9, e12043. [Google Scholar] [CrossRef]
  27. Malak, R.; Kozłowska, Z.; Owsiańska, Z.; Sikorska, D.; Andrusiewicz, M.; Szymankiewicz-Bręborowicz, M.; Samborski, W.; Szczapa, T. Cerebral tissue oxygenation during cranial osteopathic CV4 procedure in newborns. Adv. Clin. Exp. Med. 2020, 29, 1187–1191. [Google Scholar] [CrossRef]
  28. Ohgi, S.; Arisawa, K.; Takahashi, T.; Kusumoto, T.; Goto, Y.; Akiyama, T.; Saito, H. Neonatal behavioral assessment scale as a predictor of later developmental disabilities of low birth-weight and/or premature infants. Brain Dev. 2003, 25, 313–321. [Google Scholar] [CrossRef]
  29. Bodensteiner, J.B. The Evaluation of the Hypotonic Infant. Semin. Pediatr. Neurol. 2008, 15, 10–20. [Google Scholar] [CrossRef]
  30. Fauls, J.R.; Thompson, B.L.; Johnston, L.M. Validity of the Ages and Stages Questionnaire to identify young children with gross motor difficulties who require physiotherapy assessment. Dev. Med. Child Neurol. 2020, 62, 837–844. [Google Scholar] [CrossRef]
  31. Sheldrick, R.C.; Marakovitz, S.; Garfinkel, D.; Carter, A.S.; Perrin, E.C. Comparative Accuracy of Developmental Screening Questionnaires. JAMA Pediatr. 2020, 174, 366. [Google Scholar] [CrossRef]
  32. Bruggink, J.L.M.; Einspieler, C.; Butcher, P.R.; van Braeckel, K.N.J.A.; Prechtl, H.F.R.; Bos, A.F. The Quality of the Early Motor Repertoire in Preterm Infants Predicts Minor Neurologic Dysfunction at School Age. J. Pediatr. 2008, 153, 32–39. [Google Scholar] [CrossRef]
  33. Hamer, E.G.; Hadders-Algra, M. Prognostic significance of neurological signs in high-risk infants—A systematic review. Dev. Med. Child Neurol. 2016, 58, 53–60. [Google Scholar] [CrossRef] [Green Version]
  34. Danks, M.; Flynn, E.J.; Gray, P.H.; Hurrion, E.M. ‘Low-normal’ motor skills in infants at high risk for poor developmental outcomes: A prevalence and prognostic study. Dev. Med. Child Neurol. 2022, 10.1111, 15267. [Google Scholar] [CrossRef]
  35. Einspieler, C.; Prechtl, H.F.R. Prechtl’s assessment of general movements: A diagnostic tool for the func-tional assessment of the young nervous system. Ment. Retard. Dev. Disabil. Res. Rev. 2005, 11, 61–67. [Google Scholar] [CrossRef]
  36. Kilbride, H.W.; Aylward, G.P.; Doyle, L.W.; Singer, L.T.; Lantos, J. Prognostic neurodevelopmental testing of preterm infants: Do we need to change the paradigm? J. Perinatol. 2017, 37, 475–479. [Google Scholar] [CrossRef]
  37. Reich, S.; Zhang, D.; Kulviciuns, T.; Bölte, S.; Nielsen-Saines, K.; Pokorny, F.B.; Peharz, R.; Poustka, L.; Wörgötter, F.; Einspieler, C.; et al. Novel AI driven approach to classify infant motor functions. Sci. Rep. 2021, 11, 9888. [Google Scholar] [CrossRef]
  38. Lackovic, M.; Nikolic, D.; Filimonovic, D.; Petronic, I.; Mihajlovic, S.; Golubovic, Z.; Pavicevic, P.; Cirovic, D. Reliability, Consistency and Temporal Stability of Alberta Infant Motor Scale in Serbian Infants. Children 2020, 7, 16. [Google Scholar] [CrossRef] [Green Version]
  39. Kvestad, I.; Taneja, S.; Kumar, T.; Bhandari, N.; Strand, T.A.; Hysing, M. The assessment of developmental status using the Ages and Stages questionnaire-3 in nutritional research in north Indian young children. Nutr. J. 2013, 12, 50. [Google Scholar] [CrossRef] [Green Version]
  40. Malak, R.; Borek, J.; Sikorska, D.; Keczmer, P.; Samborski, W. Assessment of general movement among infants not at risk of developmental delay J. Med. Sci. 2020, 89, e393. [Google Scholar] [CrossRef]
  41. Tabaczyńska, A.; Malak, R.; Fechner, B.; Mojs, E.; Samborski, W.; Baum, E. The Comparison of Three Assessment Scales in a Neonatal Unit in Poland. Stud. Log. Gramm. Rhetor. 2021, 66, 635–646. [Google Scholar] [CrossRef]
  42. Osagie, I.E.; Givler, D.N. Infant Head Lag; StatPearls Publishing: Tampa, FL, USA, 2022. [Google Scholar]
  43. van Haastert, I.C.; de Vries, L.S.; Helders, P.J.M.; Jongmans, M.J. Early gross motor development of preterm infants according to the Alberta Infant Motor Scale. J. Pediatr. 2006, 149, 617–622. [Google Scholar] [CrossRef]
  44. Tupsila, R.; Bennett, S.; Mato, L.; Keeratisiroj, O.; Siritaratiwat, W. Gross motor development of Thai healthy full-term infants aged from birth to 14 months using the Alberta Infant Motor Scale: Inter individual variability. Early Hum. Dev. 2020, 151, 105169. [Google Scholar] [CrossRef]
  45. Filho, G.G.D.A.F.; Lopes, A.C.; Bezerra, R.B.; Candido, A.d.M.; Arrais, N.; Pereira, S.A.; Lindquist, A.R. Assessment of child development in premature babies based on the ICF biopsychosocial model. Eur. J. Phys. Rehabil. Med. 2021, 57, 585–592. [Google Scholar] [CrossRef]
  46. Simard, M.-N.; Luu, T.M.; Gosselin, J. Concurrent Validity of Ages and Stages Questionnaires in Preterm Infants. Pediatrics 2012, 130, e108–e114. [Google Scholar] [CrossRef] [Green Version]
  47. Mughal, M.K.; Ginn, C.S.; Magill-Evans, J.; Benzies, K.M. Parenting stress and development of late preterm infants at 4 months corrected age. Res. Nurs. Health 2017, 40, 414–423. [Google Scholar] [CrossRef]
  48. Dogra, D.P.; Majumdar, A.K.; Sural, S.; Mukherjee, J.; Mukherjee, S.; Singh, A. Toward Automating Hammersmith Pulled-To-Sit Examination of Infants Using Feature Point Based Video Object Tracking. IEEE Trans. Neural Syst. Rehabil. Eng. 2012, 20, 38–47. [Google Scholar] [CrossRef]
  49. Schmidt, J.L.; Castellanos-Brown, K.; Childress, S.; Bonhomme, N.; Oktay, J.S.; Sharon, F.T.; Kyler, P.; Davidoff, A.; Greene, C. The impact of false-positive newborn screening results on families: A qualitative study. Genet. Med. 2012, 14, 76–80. [Google Scholar] [CrossRef] [Green Version]
  50. DeLuca, J.M.; Kearney, M.H.; Norton, S.A.; Arnold, G.L. Internet use by parents of infants with positive newborn screens. J. Inherit. Metab. Dis. 2012, 35, 879–884. [Google Scholar] [CrossRef]
  51. Zhang, Q.; Wu, J.; Sheng, X.; Ni, Z. Empowerment programs for parental mental health of preterm infants: A meta-analysis. Patient Educ. Couns. 2021, 104, 1636–1643. [Google Scholar] [CrossRef]
  52. Armijo, I.; Schonhaut, L.; Cordero, M. Validation of the Chilean version of the Ages and Stages Questionnaire (ASQ-CL) in Community Health Settings. Early Hum. Dev. 2015, 91, 671–676. [Google Scholar] [CrossRef]
  53. Radecki, L.; Sand-Loud, N.; O’Connor, K.G.; Sharp, S.; Olson, L.M. Trends in the Use of Standardized Tools for Developmental Screening in Early Childhood: 2002–2009. Pediatrics 2011, 128, 14–19. [Google Scholar] [CrossRef]
  54. Limbos, M.M.; Joyce, D.P. Comparison of the ASQ and PEDS in Screening for Developmental Delay in Children Presenting for Primary Care. J. Dev. Behav. Pediatr. 2011, 32, 499–511. [Google Scholar] [CrossRef] [Green Version]
  55. Hardy, S.; Haisley, L.; Manning, C.; Fein, D. Can Screening with the Ages and Stages Questionnaire Detect Au-tism? J. Dev. Behav. Pediatr. 2015, 36, 536–543. [Google Scholar] [CrossRef] [Green Version]
  56. Vanvuchelen, M.; van Schuerbeeck, L.; Braeken, M.A. Screening accuracy of the parent-completed Ages and Stages Questionnaires—Second edition as a broadband screener for motor problems in preschoolers with autism spectrum disorders. Autism 2017, 21, 29–36. [Google Scholar] [CrossRef]
  57. Limperopoulos, C.; Bassan, H.; Sullivan, N.R.; Soul, J.S.; Robertson, R.L.; Moore, M.; Ringer, S.A.; Volpe, J.J.; du Plessis, A.J. Positive Screening for Autism in Ex-preterm Infants: Prevalence and Risk Factors. Pediatrics 2008, 121, 758–765. [Google Scholar] [CrossRef] [Green Version]
  58. Moore, T.; Johnson, S.; Hennessy, E.; Marlow, N. Screening for autism in extremely preterm infants: Problems in interpretation: Autism Screening in Extremely Preterm Infants. Dev. Med. Child Neurol. 2012, 54, 514–520. [Google Scholar] [CrossRef]
  59. Gray, P.H.; Edwards, D.M.; O’Callaghan, M.J.; Gibbons, K. Screening for autism spectrum disorder in very preterm infants during early childhood. Early Hum. Dev. 2015, 91, 271–276. [Google Scholar] [CrossRef]
Table 1. Demographic data of the participants.
Table 1. Demographic data of the participants.
Average age of gestation29 ± 2
Average birth weight1230 g ± 229
DeliveryNatural6
Cesarian section12
Apgar Score8
Umbilical cord arterial pH7.27 ± 1.82
DomicileTown13
Village5
Education of mothersMaster’s degree9
Vocational school education4
Secondary general education5
Education of fathersMaster’s degree6
Vocational school education8
Secondary general education4
Table 2. Motor functioning of the participants.
Table 2. Motor functioning of the participants.
GMACramped—synchronizedPoor—repertoireFidgety
286
ASQ-3Refer rangesMonitor—rangesTypical ranges
2311
Pull to sit (NBAS)<4 points3–6 points7–9 points
3310
AIMS72 ± 19.2 percentile
Table 3. Difference between the AIMS, GMA and pull to sit item, Dunn’s Test p = >0.999999.
Table 3. Difference between the AIMS, GMA and pull to sit item, Dunn’s Test p = >0.999999.
p-ValueAIMSGMAPull to Sit ManeuverGross Motor (ASQ-3)Fine Motor (ASQ-3)
AIMS 1111
GMA1 10.421
Pull to sit maneuver 11 11
Gross motor (ASQ-3)10.421 1
Fine Motor (ASQ-3) 1111
Table 4. Cochran’s Q Test for the AIMS, GMA and pull to sit probe.
Table 4. Cochran’s Q Test for the AIMS, GMA and pull to sit probe.
ANOVA Cochran’s Q Test AIMS, GMA, Pull to Sit, ASQ-3
Significance level0.05
Number of infants16
Degrees of freedom3
Statistics Q5.48
p value0.14
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Malak, R.; Fechner, B.; Stankowska, M.; Wiecheć, K.; Szczapa, T.; Kasperkowicz, J.; Matthews-Kozanecka, M.; Brzozowska, T.M.; Komisarek, O.; Daroszewski, P.; et al. The Importance of Monitoring Neurodevelopmental Outcomes for Preterm Infants: A Comparison of the AIMS, GMA, Pull to Sit Maneuver and ASQ-3. J. Clin. Med. 2022, 11, 6295. https://doi.org/10.3390/jcm11216295

AMA Style

Malak R, Fechner B, Stankowska M, Wiecheć K, Szczapa T, Kasperkowicz J, Matthews-Kozanecka M, Brzozowska TM, Komisarek O, Daroszewski P, et al. The Importance of Monitoring Neurodevelopmental Outcomes for Preterm Infants: A Comparison of the AIMS, GMA, Pull to Sit Maneuver and ASQ-3. Journal of Clinical Medicine. 2022; 11(21):6295. https://doi.org/10.3390/jcm11216295

Chicago/Turabian Style

Malak, Roksana, Brittany Fechner, Marta Stankowska, Katarzyna Wiecheć, Tomasz Szczapa, Joanna Kasperkowicz, Maja Matthews-Kozanecka, Teresa Matthews Brzozowska, Oskar Komisarek, Przemysław Daroszewski, and et al. 2022. "The Importance of Monitoring Neurodevelopmental Outcomes for Preterm Infants: A Comparison of the AIMS, GMA, Pull to Sit Maneuver and ASQ-3" Journal of Clinical Medicine 11, no. 21: 6295. https://doi.org/10.3390/jcm11216295

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop