Next Article in Journal
Nucleus Accumbens Chemogenetic Inhibition Suppresses Amphetamine-Induced Ultrasonic Vocalizations in Male and Female Rats
Next Article in Special Issue
Pain Processing in Cognitive Impairment and Its Association with Executive Function and Memory: Which Neurocognitive Factor Takes the Lead?
Previous Article in Journal
Rehabilitation Outcomes in Subjects with West Nile Neuro-Invasive Disease
Previous Article in Special Issue
Faces of Pain during Dental Procedures: Reliability of Scoring Facial Expressions in Print Art
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pain Behavior of People with Intellectual and Developmental Disabilities Coded with the New PAIC-15 and Validation of Its Arabic Translation

1
Department of Physical Therapy, School of Health Professions, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel
2
Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 69978, Israel
3
Department of Anatomy, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel
4
Sylvan Adams Sports Institute, Tel Aviv University, Tel Aviv 69978, Israel
5
Department of Psychology and Sociology, Medical Faculty, University of Augsburg, 86159 Augsburg, Germany
*
Author to whom correspondence should be addressed.
Equal contribution.
Brain Sci. 2021, 11(10), 1254; https://doi.org/10.3390/brainsci11101254
Submission received: 26 August 2021 / Revised: 16 September 2021 / Accepted: 20 September 2021 / Published: 22 September 2021
(This article belongs to the Special Issue Pain Assessment in Impaired Cognition)

Abstract

:
Pain management necessitates assessment of pain; the gold standard being self-report. Among individuals with intellectual and developmental disabilities (IDD), self-report may be limited and therefore indirect methods for pain assessment are required. A new, internationally agreed upon and user-friendly observational tool was recently published—the Pain Assessment in Impaired Cognition (PAIC-15). The current study’s aims were: to test the use of the PAIC-15 in assessing pain among people with IDD and to translate the PAIC-15 into Arabic for dissemination among Arabic-speaking professionals. Pain behavior following experimental pressure stimuli was analyzed among 30 individuals with IDD and 15 typically developing controls (TDCs). Translation of the PAIC followed the forward–backward approach; and reliability between the two versions and between raters was calculated. Observational scores with the PAIC-15 exhibited a stimulus–response relationship with pressure stimulation. Those of the IDD group were greater than those of the TDC group. The overall agreement between the English and Arabic versions was high (ICC = 0.89); single items exhibited moderate to high agreement levels. Inter-rater reliability was high (ICC = 0.92). Both versions of the PAIC-15 are feasible and reliable tools to record pain behavior in individuals with IDD. Future studies using these tools in clinical settings are warranted.

1. Introduction

Individuals with intellectual and developmental disabilities (IDD)—neurodevelopmental disorders that are characterized by intellectual difficulties and limitations in various aspects of living—are at an increased risk of acute and chronic pain compared to typically developing controls (TDCs) [1,2]. This risk entails, among other factors, a possible increased sensitivity to noxious stimuli [3,4], relatively high rates of injuries and falls [5,6], and secondary consequences of the IDD etiology related to painful diagnostic procedures, medical complications, use of assistive devices, etc. [7,8,9,10,11]. Consequently, the prevalence of pain among people with IDD is relatively high as concluded from proxy reports, e.g., [12,13,14].
The limited cognitive and communicative abilities of individuals with IDD present a major obstacle in quantifying their pain, which renders pain assessment and hence pain management a significant challenge [11,15]. In order not to have to rely on self-report alone, dozens of behavioral scales have been developed over the last two decades that aim to assess pain among non-communicative individuals, e.g., [16,17,18]. Although these scales are valid and reliable, some of them may require special expertise, and other scales may not necessarily be applicable to populations with differing cognitive impairments or ages, e.g., [19,20], thus limiting a comparison between populations. Furthermore, not all the scales are applicable to both acute/experimental and chronic pain states, potentially limiting the research on pain management interventions.
A very promising scale in this respect was developed via a European-funded international initiative (COST action TD1005) that took place between the years 2011 and 2017. A group of international (16 countries) and interdisciplinary researchers empirically investigated which items from established observational pain scales allowed for a reliable and valid assessment of pain in individuals with cognitive impairment (626 individuals with cognitive impairment of various etiologies and 59 controls were evaluated). The final product of this team was an internationally agreed-upon tool for Pain Assessment in Impaired Cognition (PAIC-15) [21,22]. The PAIC-15 was introduced as a meta-tool that can be used for diverse populations of individuals with cognitive impairments [22]. It also includes atypical behaviors such as freezing, that are frequent among individuals with IDD [11] but seldom appear in other scales.
However, to date, the use of the PAIC-15 has not been thoroughly examined among individuals with IDD. Therefore, one aim of this study was to compare pain behavior of individuals with IDD to that of TDCs, quantified by the PAIC-15. Based on previous studies, e.g., [3,4,23], we hypothesized that pain behavior of the former would be increased compared to TDCs. Due to the aforementioned advantages of the PAIC-15, it is important to disseminate its use worldwide. An imperative step in this direction is to translate the original English version into as many languages as possible. Thus far, the PAIC-15 has been translated into seven languages (https://paic15.com/, accessed on 21 September 2021). Therefore, another aim was to translate the PAIC-15 into Arabic and validate the translation.

2. Materials and Methods

2.1. Participants

This study included 45 adults: 30 individuals with IDD (IDD group, age 35.3 ± 6.2 years) and 15 typically developing controls (TDCs group, 31.3 ± 7.5 years). The rationale for the 2:1 allocation ratio was the much greater inter-subject variability among individuals with IDD in terms of IDD etiology and level. Individuals with IDD were recruited from day care centers for people with IDD (belonging to two organizations for people with disabilities: Alin and Elwyn). IDD was diagnosed according to clinical assessment and standardized testing of intelligence (including the Wechsler Intelligence Scale for Children-Revised and the Wechsler Preschool and Primary Scale of Intelligence) performed by a team from the Ministry of Social Affairs and Social Services, which supervises all services related to IDD. Individuals in this group had an estimated level of mild or moderate IDD and the ability to understand their mother tongue. TDCs were students and employees of Tel Aviv University or employees of the day care center for people with IDD. Exclusion criteria for all the participants were as follows: known acute or chronic pain, bruises or injuries in the testing regions (medical information on the participants with IDD was retrieved from their medical records by their legal guardian upon request, and additional information was also obtained from the primary caregiver).
This study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of Tel Aviv University (3012/2012), the institutional review board of the Ministry of Social Affairs and Social Services (201323-01), and by the legal guardians of the participants with IDD. Prior to entering this study, a written informed consent document was obtained from all the TDCs and from the legal guardians of all the individuals with IDD, after they had received an explanation of this study’s aims and protocols. In addition, the protocol was explained to the participants with IDD and their escorts upon their arrival at the lab, and each step of the protocol was carried out only after their oral consent was obtained.

2.2. Instruments

2.2.1. Pressure Algometer

Pressure stimuli were delivered using a hand-held pressure algometer (Somedic Sales AB, Algometer type II, Hörby, Sweden). The algometer has a built-in pressure transducer, an electronic recording and display unit, a power supply, and a subject-activated push button connected via a cable to the instrument. It has an accuracy of ±3%, and its unit of measurement is the kilopascal (kPa). The algometer operates by exerting a constantly increasing rate of pressure that is monitored by a cursor presented on the display. The size of the tip of the algometer that is pressed against the skin was 1 cm2. The algometer was calibrated before each measuring day.

2.2.2. PAIC-15

The behavioral response to pressure stimuli was analyzed using the PAIC-15 [22]. This tool consists of 15 items divided into three behavioral domains: five items for facial expressions, five items for body movements, and five items for vocalizations. Each item has a title and an explanation to ensure the understanding of each item’s meaning. The items are scored on a 0–3 scale for magnitude of appearance: 0 = not at all, 1 = slight degree, 2 = moderate degree, and 3 = great degree. There is an additional option of “not scorable” for each item. The sum score of all the items is the final PAIC-15 score. The higher the sum score, the higher the probability the person is in pain. These 15 items are: Frowning, Narrowing eyes, Raising upper lip, Opening mouth, Looking tense, Freezing, Guarding, Resisting care, Rubbing, Restlessness, Pain-related words, Shouting, Groaning, Mumbling, and Complaining. Note, one participant with IDD turned his head during noxious stimulation, which prevented us from scoring his face items. The sum score for this participant was calculated without these items.

3. Procedures

3.1. Stimulation and Recording Procedures

The experimental protocol was designed by the experimental pain working group of the European Cooperation in the Field of Scientific and Technical Research (COST), termed “Pain assessment in patients with impaired cognition, especially dementia” (action TD1005), of which this study’s authors are members. The aims of this international group are to raise awareness of the subject of pain among individuals with cognitive impairment and to develop a pain assessment toolkit for this population. The protocol was first tested on TDCs prior to testing individuals with IDD in order to verify the intensity of the pressure stimuli and the ability to endure them for the required duration [23]. Prior to actual testing, all the participants underwent a training session in which they were familiarized with the sensation delivered via the pressure algometer and were trained in rating pain sensation with various scales. For training, the participants received pressure stimuli in the thigh region (which was not stimulated further during testing) at the same intensities used during the actual testing. In addition, the participants were instructed how to maintain their head so that their expressions would be best captured by the camera.
After a five-minute break, the experiment began. The experimental setup is described at length in our previous study [24]. The examiner stood behind the subject in order not to interfere with videotaping and to properly administer the stimuli. Each subject received three pressure stimuli of 50, 200, and 400 kPa, applied with the pressure algometer, to the upper mid part of the trapezius muscle (halfway between the neck line and the shoulder line). These stimuli were chosen based on a preliminary experiment conducted on TDCs, which was aimed to search for one innocuous stimulus (for control), one mildly noxious stimulus, and one moderately noxious pressure sensation, respectively [23,25]. Each stimulus rose rapidly from a baseline of 0 kPa to the designated intensity and lasted seven seconds (a two-second increase from baseline and five seconds in the destination intensity). The inter-stimulus interval was four minutes, in order to avoid carry-over effects between stimuli and in order to provide sufficient time for the pain rating. In addition, the examiner moved the stimulation site by approximately 0.5 cm between stimuli.
The participants were videotaped throughout the entire protocol, and the behavioral responses were analyzed retrospectively, separately for each stimulation condition (four conditions in total (rest = no stimulation, 50, 200 and 400 kPa). At baseline, the subjects were not engaged in any specific activity; the analysis of the PAIC-15 was conducted for a random 15 s segment. During pressure stimulation, the analysis commenced immediately upon the examiner starting the stimulus, and it lasted the entire duration of stimulation. The coders for the original (English) version and the Arabic translation of the PAIC-15 worked separately. The coders for the original version had a background in neuroscience and one of them has been working for several years as a sport coach of people with IDD. Both were fluent in English (one was native English speaker). The two coders of the Arabic version had a background in health professions and one of them has been, and is currently working as a physical therapist for people with IDD. Both were native Arabic speakers. Among a subsample of 10 participants, an additional rater scored pain behavior in all four of the conditions (rest, 50, 200, and 400 kPa) with the Arabic version in order to calculate inter-rater reliability.

3.2. The Translation Process of the PAIC-15 from English to Arabic

In order to translate the PAIC-15 into Arabic, we followed the common forward–backward approach [26]. First, a native Arabic speaker, who is also a health professional, translated the PAIC-15 from English into Arabic. The translator consulted with two additional native Arabic speakers who were fluent in English, and they all agreed upon the most adequate wording. The Arabic version was then translated back into English by two independent people who were native speakers of both Arabic and English. The re-translated English version was compared to the original English version, and in the case of disagreement between these versions, a meeting was initiated between the members of the team in order to investigate the reason for the disagreement and to discuss solutions (e.g., agreeing on one of the options or looking for another option). This meeting also included external advisers who were fluent in Arabic and English, for further consultation. Upon agreement on all the items by each team, the Arabic version was confirmed.
In the next step, we showed the Arabic version of the PAIC-15 as well as the original English version to a group of people, comprising health professionals and Arabic teachers who were all native speakers of Arabic and fluent in English. After a close inspection of the translated version and discussions among the group, it was decided that although the translated version was adequate for local Arabic speakers, it was not suitable for worldwide dissemination, the reason being that dialects of spoken Arabic can differ between countries and even between regions within a country.
Therefore, in order to comply with as many Arabic-speaking countries as possible, it was decided to prepare another version that was adjusted to the use of the Arabic language in Arabic literature which is more uniform across countries. To achieve this purpose, the two PAIC-15 versions were analyzed by a native Arabic speaker who is an English literature professor with a degree in professional translation, who suggested substituting words for some of the items. This version was then analyzed by a second professional, an Arabic language professor who is an expert in dialects and writing and who made final adjustments. For example, the term تجميد which was the initial translation for the “freezing” item was replaced by تصلب in order to refer to people, not to objects. Furthermore, the initial translation for the item “jaw dropper” يتم اسقاط الفك was replaced by خفض الفك in order to better reflect a movement that occurs as a reaction. The back translation of this version was conducted by a professor of English literature and behavioral sciences, who is a native speaker of Arabic. The final Arabic translation was introduced to a group of health professionals (nurses, occupational therapists, and physical therapists) who were all native Arabic speakers, some of whom worked with people with IDD. Upon an open discussion of all the items of this version, they found the tool universally understood and feasible, as well as adequate. This final tool (available at https://paic15.com/www-PAIC15.com, accessed on 21 September 2021) was used to code the pain behavior of the participants following pressure stimulation.

4. Data Analysis

Data were analyzed with the IBM SPSS statistics software (version 25, IBM, New York, NY, USA). Whereas the sum scores of the 15 items of the PAIC-15 were considered continuous, single items were considered ordinal data. Thus, the effects of group type and stimulation condition on the sum score of the PAIC-15 as well as their interaction within each language were analyzed with a repeated-measures ANOVA and corrected post hoc comparisons. The correlation between stimulation intensities and the PAIC-15 sum scores were calculated with Pearson’s r, and a comparison between the original and translated versions of the PAIC-15 sum scores were calculated using t-tests. Agreement between the original and translated versions for all PAIC-15 items and for single items was calculated using the interclass correlation coefficient (ICC), and comparison between versions was conducted via the Mann–Whitney U test. Given that the PAIC-15 is aimed to measure pain behavior, a reliability assessment of the total PAIC score as well as of each of the 15 items was performed for the 400 kPa (noxious) stimulation. The inter-rater reliability of the PAIC-15 Arabic version was evaluated as well. Internal consistency was evaluated with Cronbach’s alphas. Two-tailed p-values are reported, and p < 0.05 was considered significant.

5. Results

5.1. The Study Groups

Table 1 presents the participants. The IDD group did not differ from the TDCs group in age (t-test: t = 1.81, p = 0.08) or sex distribution (Mann–Whitney U test: z = −0.09, p = 0.924). Among the IDD group, there were participants with cerebral palsy (CP), Down syndrome (DS), or an unspecified IDD (UIDD), and the majority of them had a mild impairment. Medication use among the IDD group included medication for hypothyroidism (seven participants/23.3%), psychotropic medications (6/20%), muscle relaxants (6/20%), and antiepileptics (2/6.66).

5.2. PAIC-15 Original Version: Comparison between the IDD and TDC Groups

Figure 1 presents the sum of the PAIC-15 scores in response to pressure stimulation for the IDD and TDC groups. A repeated-measures ANOVA revealed a significant global effect of group type (F(1,35) = 13.99, p < 0.001), and of condition (F(3,105) = 13.1, p < 0.0001) on the sum PAIC-15 scores. The interaction group type X condition was also significant (F(3,105) = 3.51, p < 0.018), suggesting that the increase in PAIC-15 sum scores across the stimulus intensities was not uniform in the two groups.
Post hoc tests revealed a significant group effect within every stimulation condition (p < 0.0001 for all four conditions): the scores for the IDD group were significantly higher in all four conditions—rest (t = 4.81, p < 0.0001), 50 kPa (t = 3.68, p < 0.001), 200 kPa (t = 2.99, p < 0.01), and 400 kPa (t = 3.47, p < 0.01) (Figure 1).
Table 2 presents the frequency of occurrence of each PAIC item in the IDD compared to the TDC groups during the 400 kPa stimulation. Overall, the IDD group was more behaviorally responsive during pain. The items “raising upper lip”, “opening mouth”, “looking tense”, and “freezing” occurred significantly more frequently among the IDD than among the TDC group. There were several items that appeared only in the IDD group, including guarding, shouting, groaning, and complaining. The rest of the items similarly occurred among both groups (Table 2).

5.3. PAIC-15 Original Version: Correlation between Its Scores and Stimulation Intensities within Groups

Among both the IDD and TDC groups, the PAIC-15 scores correlated moderately and significantly with pressure stimulation intensity (r = 0.55, p < 0.001 and r = 0.45, p < 0.001, respectively), suggesting a stimulus–response relation for the PAIC-15. Yet, the slopes of these stimulus–response functions were different among the groups, as can be seen in Figure 1: that of the IDD group was steeper than that of the TDC group (2.37, R2 = 0.96 vs. 0.75, R2 = 0.87), manifested also by the significant group X condition interaction.
The internal consistency of the original PAIC-15 version for the present sample was high (Cronbach’s α = 0.93).

5.4. PAIC-15 Arabic Version: Comparison between the IDD and TDC Groups

Figure 2 presents the sum scores of the PAIC-15 Arabic version for the IDD and TDC groups. A repeated-measures ANOVA of the scores in the Arabic version revealed a significant global effect of group type (F(1,34) = 8.6, p < 0.01) and of condition (F(3,102) = 17.8, p < 0.0001) on the PAIC-15 scores, similar to those of the English version. The interaction group type X condition showed a trend toward significance (F(3,102) = 2.75, p = 0.056). Similar to the results obtained with the English version, individuals with IDD had significantly higher PAIC-15 scores compared to those of TDCs at rest (t = 2.98, p < 0.01), 50 kPa (t = 2.63, p < 0.01), 200 kPa (t = 2.50, p < 0.016), and 400 kPa (t = 2.59, p < 0.022) (Figure 2).
Table 2 presents the frequency of occurrence of each PAIC item in the IDD compared to the TDC group during the 400 kPa stimulation. As found for the original PAIC version, the IDD group was more responsive during pain. The items “opening mouth” and “looking tense” were scored significantly more often among the IDD than among the TDC group. Approximately half of the items occurred only among people with IDD, and two items—shouting and mumbling—did not occur in either of the groups (Table 2).

5.5. PAIC-15 Arabic Version: Correlation between Its Scores and Stimulation Intensities within Groups

Among both the IDD and TDC groups, the PAIC-15 scores correlated moderately and significantly with stimulation intensity (r = 0.50, p < 0.001 and r = 0.61, p < 0.0001, respectively), suggesting a stimulus–response relation for the PAIC-15. As in the case of the scores with the original version, the slopes of these stimulus–response functions were different among the groups: That of the IDD group was steeper than that of the TDC group (1.88, R2 = 0.97 vs. 0.76, R2 = 0.81), as also manifested by the significant group X condition interaction (Figure 2).
The internal consistency of the translated version of PAIC-15 for the present sample was high (Cronbach’s α = 0.89).

5.6. Comparison between the Original (English) and the Translated (Arabic) PAIC-15 Versions

When comparing the scores of the English and Arabic versions within groups, the scores for the IDD group (Figure 3) via use of the Arabic version were significantly lower than those via use of the English version, for rest (t = 4.4, p < 0.01) and for 50 kPa (t = 2.5, p < 0.049). However, the PAIC-15 scores of the IDD group during stimulation were similar for the two languages—for 200 kPa (p = 0.132) and 400 kPa (p = 0.08)—even though a tendency toward lower scores with the Arabic version was observed. The scores for the TDC group with the English and Arabic versions were similar (not shown).
The overall agreement between the English and the Arabic version was high (ICC = 0.89). Table 2 presents the comparison between the versions for each PAIC-15 item separately, for 400 kPa. Agreement between the two languages as measured with the ICC ranged from moderate to high, with one item having weak agreement (looking tense). For two items—shouting and mumbling—it was impossible to calculate agreement because they appeared only when scoring was performed with the English version, albeit only in the IDD group and with low frequency (13.3%). The frequency of appearance of most of the items was similar between the languages, with three exceptions: The item “raising upper lip” appeared significantly more often when scored with the English version than with the Arabic version (p < 0.01), and the items “shouting” and “mumbling” appeared only when scored with the English version.

5.7. Inter-Rater Reliability of the Arabic PAIC-15

The overall agreement between the two raters as calculated with the ICC was very high (ICC = 0.92). The agreement between the two raters in each condition separately varied somewhat: It was high for rest (ICC = 1.0), 200 kPa (ICC = 0.98), and for 400 kPa (ICC = 0.86). However, it was weak for 50 kPa (ICC = 0.35).

6. Discussion

6.1. The PAIC-15 as a Measure of Pain for IDD

The first aim of this study was to evaluate pain behavior among individuals with IDD using the PAIC-15. The PAIC-15 has been used to code pain behavior among older persons with dementia in both experimental and clinical settings [21,22,27]. The current study is the first time in which the PAIC-15 was systematically used for the IDD population. The PAIC-15 was suitable for the task at hand; the coders could easily understand each item owing to the explanations provided on the scale and could decide whether or not a certain item appeared while they watched the videos, and whether it was scorable or not, as the latter possibility also exists in the scale.
The analysis of the PAIC-15 scores showed that, as hypothesized, people with IDD have increased pain behavior compared to TDCs during noxious pressure stimulation but also during innocuous stimulation (50 kPa) and at rest. In other words, people with IDD are overall more active in the face and body compared to people with typical development. Aligning with these results are results from previous experimental studies in which pain behavior during experimental noxious stimulation was scored with various behavioral tools. For example, we previously analyzed the same participants using the Facial Action Coding System (FACS) and found them to exhibit more facial actions compared to the control group [23,28]. Barney et al. (2015) also reported increased pain behavior among children and adolescents (average age 14.8 years, range 8–22) with Neuronal Ceroid Lipofuscinosis as compared to their siblings [29]. The same authors also reported increased reactivity to cutaneous stimuli among children with Global Developmental Delay compared to controls [30]. Increased and/or elongated behavioral responses among children and adults with IDD have also been reported in clinical settings, for example during vaccination [31,32,33,34] and painful medical procedures [35,36,37]. Although newborns with Down syndrome were slower to express pain during such procedures, their behavioral and physiological responses persisted for a longer durations and some of the responses were enhanced compared to typically developing newborns [38].
The underlying reasons for the increased pain behavior in IDD are not fully understood. It is also not clear whether the increased pain behavior reflects an increased perception of pain among these individuals or whether it incorporates a mixture of mental experiences that include, but are not restricted to pain such as anticipation, anxiety, and apprehension. Nevertheless, several studies have reported decreased pain thresholds among individuals with IDD in the laboratory setting, which suggests increased sensitivity to noxious stimuli [3,4,39,40], possibly explaining the increased behavioral responses. Others have reported similar pain thresholds among individuals with IDD and controls [41,42], suggesting that further study is needed in order to resolve this issue. Yet, increased cortical responses to noxious stimuli in IDD that were evident in imaging studies and evoked potential studies [28,43] support the aforementioned notion that individuals with IDD may be more sensitive and/or vulnerable to pain than typically developing individuals. Not mutually exclusive explanation is that the TDCs had reduced responses compared to the IDD group because they were more self-aware of being videotaped. Nevertheless, the possible impact of self-awareness may have decreased towards the actual experiment due to the long familiarization and training process in front of the camera.
Looking at the most painful stimulus—the 400 kPa—the items that were highly frequent among the participants were three from the “facial expression” subscale (raising upper lip, opening mouth, and looking tense), and one from the “body movement” subscale (freezing). These occurred among 60–73% of the participants with IDD. The “raising upper lip” and “opening mouth” items resemble the FACS items “lips part” and “lip raiser” which have also been reported to frequently appear among individuals with IDD in experimental [24,44] and clinical settings [32,33,34,45]. Freezing has also been reported as a frequent, seemingly atypical behavior among individuals with IDD during painful insults [31,44,46], and its formal incorporation in the PAIC-15 is reinforced by the present results. The item “narrowing eyes” was also frequent among the majority of the IDD group; however, its frequency was no different from its frequency in the TDC group. Notably, the relatively low frequency of other PAIC-15 items such as “resisting care”, “rubbing”, and “shouting” was probably due to the administration of experimental pain stimuli of low to moderate intensity and to the preparation and training process the participants underwent.

6.2. The Arabic Translation of the PAIC-15

The translation from English into Arabic was performed via known procedures as detailed by Sousa et al. [26]. Given that we used video recordings of the pain responses, it was possible to have several observers code the same material using either the original English version or the newly translated Arabic version of the PAIC-15 scale. This allowed us to test the validation of the translation by way of four analyses. First, there was a moderate significant correlation between stimulation intensity and the sum scores of the translated PAIC-15, which supports its criterion validity. Similar correlations were also calculated for the original English version. Second, the internal consistency of the translated version was high (0.89), as was that of the original version, which suggests its high reliability as a scale. Third, the agreement between the two raters who used the translated version was very high for the noxious stimulation conditions (200 and 400 kPa), suggesting that the tool provides reliable scores for pain behavior. The agreement was low for the innocuous stimulus (50 kPa), perhaps because the tool is not meant to score such a condition. Alternatively, the 50 kPa stimulation may have evoked apprehension among some of the participants, the signs of which were inconsistently detected by the raters. Fourth, the overall agreement between the original and translated version was high, and the agreement for single items ranged from moderate to high with only one of the 15 items showing low agreement (“looking tense”, ICC = 0.39). Thus, overall, the translated version demonstrated good reliability and agreement with its original version.
Interestingly, some subtle differences were observed between the English and Arabic versions. First, the item “raising upper lip” was scored significantly more often in the IDD group when using the English version compared to the Arabic version (60 vs. 16.6%). It seems unlikely that the professional or cultural background of the coders underlie this difference although this possibility cannot be dismissed. Nevertheless, the “opening mouth” item, which reflects a somewhat related action around the mouth, exhibited no differences between the versions. Two items were scored only by the original PAIC-15: shouting and mumbling. However, these items appeared among three to four participants with IDD out of the 30 participants, and mumbling appeared among one person from the TDC group. The difference in appearance between the English and the Arabic version in these items was not significant. Thus, it appears that the use of the English and Arabic versions of the PAIC-15 resulted in an overall similar identification of items that were more frequent than others, and of increased pain behavior in the IDD than the TDC group. The tendency toward somewhat lower scores in the Arabic version for the participants with IDD may have been coincidental, may be due to differences between the observers, or it may have resulted from subtle variations in the interpretation of the items in each language. Nevertheless, the translated version resulted in similar conclusions to those of the English version with regard to pain behavior among individuals with IDD.

6.3. Limitations

Several limitations should be considered. First, larger groups would have allowed an evaluation of whether gender affects pain behavior as coded with the PAIC-15. Second, the current study was an experimental study; hence, the results apply to acute pain behavior. Future studies may wish to test the usability of the PAIC-15 among individuals with IDD who suffer from chronic pain or during clinical pain conditions. Third, although we intended to prepare a PAIC version that would apply to all Arabic-speaking people regardless of their country of origin (hence the translation into Arabic literature), we acknowledge that there might be some variations between countries. The comparison of PAIC-15 scores between different countries/regions may provide data that would help improve the accuracy of the translation.

6.4. Conclusions and Clinical Implications

Although people with IDD are exposed more frequently than others to painful conditions, they tend not to report pain, or their reports may be toned down as compared to those of typically developing individuals [47,48,49]. Thus, the use of tools to analyze indirect indices of pain such as pain behavior is imperative in order to tailor adequate pain management to these individuals. The PAIC-15 has been proven to be valid and reliable in measuring pain among people with cognitive impairment due to dementia, and the present results support its use among people with IDD as well. The use of the PAIC-15 for different populations with cognitive impairment enables the implementation of a standardized approach in the study of pain perception, in identifying etiology-related unique pain responses, and in studying pain management guidelines for this population. The tool is user friendly, does not require special professional training for the observer, and can detect pain in a dose–response manner as shown herein. Considering the advantages of the PAIC-15, its dissemination is called for. As Arabic is the official or co-official language in approximately 25 countries around the world, the translation of the PAIC-15 into Arabic is another step in the right direction, not only for people with IDD but also for people with other types of cognitive impairment. Hopefully, this scale will aid Arabic-speaking caregivers to identify pain, assess its magnitude, and provide proper treatment in order to prevent suffering among these individuals.

Author Contributions

Conceptualization, R.D. and M.K.; methodology, R.D. and M.K.; software, R.D. and C.G.P.; data acquisition, H.B., K.H. and T.B.; analysis, R.D., T.B. and M.K.; resources, R.D. and C.G.P.; data curation, R.D., H.B., K.H. and T.B.; interpretation, R.D., H.B., T.B. and M.K.; writing—original draft preparation, R.D. and M.K.; writing—review and editing, R.D., M.K., H.B., K.H., T.B. and C.G.P.; visualization, R.D.; supervision, R.D. and C.G.P.; funding acquisition, R.D. and C.G.P. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a grant from the Shalem Fund for Development of Services for People with Intellectual Disabilities in the Local Councils—grant number 00094. The research was also supported in part by the Ari and Regine Aprijaskis Fund—grant number 347300-00; and the Miriam and Sheldon G. Adelson Center for the Biology of Addictive Diseases—grant number 601133461.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board the Ministry of Social Affairs and Social Services (201323-01) and the Ethics Committee of Tel Aviv University (3012/2012).

Informed Consent Statement

Informed consent document was obtained from all the TDCs and from the legal guardians of all the individuals with IDD.

Data Availability Statement

The data presented in this study are available on request from the corresponding author pending institutional approval.

Acknowledgments

The authors wish to thank the workers and residents of Elwin and Beit Noam. The authors also wish to thank all the people who helped us to back-translate the PAIC-15 and with whom we consulted in the process.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Oberlander, T.F.; Symons, F. The problem of pain in developmental disability. In Pain in Developmental Disabilities; Oberlander, T.F., Symons, F.J., Eds.; Paul H. Brookes Publishing Co. Inc.: Baltimore, MD, USA, 2006. [Google Scholar]
  2. McGuire, B.E.; Daly, P.; Smyth, F. Chronic pain in people with an intellectual disability: Under-recognised and under-treated? J. Intellect. Disabil. Res. 2010, 54, 240–245. [Google Scholar] [CrossRef] [PubMed]
  3. Defrin, R.; Pick, C.G.; Peretz, C.; Carmeli, E. A quantitative somatosensory testing of pain threshold in individuals with mental retardation. Pain 2004, 108, 58–66. [Google Scholar] [CrossRef] [PubMed]
  4. Valkenburg, A.J.; Tibboel, D.; van Dijk, M. Pain sensitivity of children with Down syndrome and their siblings: Quantitative sensory testing versus parental reports. Dev. Med. Child. Neurol. 2015, 57, 1049–1055. [Google Scholar] [CrossRef] [PubMed]
  5. Finlayson, J.; Morrison, J.; Jackson, A.; Mantry, D.; Cooper, S.A. Injuries, falls and accidents among adults with intellectual disabilities: Prospective cohort study. J. Intellect. Disabil. Res. 2010, 54, 966–980. [Google Scholar] [CrossRef] [PubMed]
  6. Ho, P.; Bulsara, M.; Downs, J.; Patman, S.; Bulsara, C.; Hill, A.M. Incidence and prevalence of falls in adults with intellectual disability living in the community: A systematic review. JBI Database Syst. Rev. Implement. Rep. 2019, 17, 390–413. [Google Scholar] [CrossRef] [Green Version]
  7. Henderson, A.; Lynch, S.A.; Wilkinson, S.; Hunter, M. Adults with Down’s syndrome: The prevalence of complications and health care in the community. Br. J. Gen. Pract. 2007, 57, 50–55. [Google Scholar]
  8. Turk, V.; Khattran, S.; Kerry, S.; Corney, R.; Painter, K. Reporting of health problems and pain by adults with an intellectual disability and by their carers. J. Appl. Res. Intellect. Disabil. 2012, 25, 155–165. [Google Scholar] [CrossRef]
  9. Kinnear, D.; Morrison, J.; Allan, L.; Henderson, A.; Smiley, E.; Cooper, S.A. Prevalence of physical conditions and multimorbidity in a cohort of adults with intellectual disabilities with and without Down syndrome: Cross-sectional study. BMJ Open 2018, 8, e018292. [Google Scholar] [CrossRef] [Green Version]
  10. Oviedo, G.R.; Tamulevicius, N.; Guerra-Balic, M. Physical activity and sedentary time in active and non-active adults with intellectual disability: A comparative study. Int. J. Environ. Res. Public Health 2019, 16, 1761. [Google Scholar] [CrossRef] [Green Version]
  11. Defrin, R. Pain in Other Types of Cognitive Impairment with a Focus on Developmental Disability. In Pain in Dementia; Lautenbacher, S., Gibson, S.J., Eds.; IASP Press, Wolter Kluwer: Amsterdam, The Netherlands, 2017; pp. 99–118. [Google Scholar]
  12. Walsh, M.; Morrison, T.G.; McGuire, B.E. Chronic pain in adults with an intellectual disability: Prevalence, impact, and health service use based on caregiver report. Pain 2011, 152, 1951–1957. [Google Scholar] [CrossRef]
  13. McGuire, B.; Kennedy, S. Pain in people with an intellectual disability. Curr. Opin. Psychiatry 2013, 26, 270–275. [Google Scholar] [CrossRef] [PubMed]
  14. van der Slot, W.M.A.; Benner, J.L.; Brunton, L.; Engel, J.M.; Gallien, P.; Hilberink, S.R.; Månum, G.; Morgan, P.; Opheim, A.; Riquelme, I.; et al. Pain in adults with cerebral palsy: A systematic review and meta-analysis of individual participant data. Ann. Phys. Rehabil. Med. 2020, 64. [Google Scholar] [CrossRef] [PubMed]
  15. Barney, C.C.; Andersen, R.D.; Defrin, R.; Genik, L.M.; McGuire, B.E.; Symons, F.J. Challenges in pain assessment and management among individuals with intellectual and developmental disabilities. Pain Rep. 2020, 5, e821. [Google Scholar] [CrossRef]
  16. Hadjistavropoulos, T.; Craig, K.D. A theoretical framework for understanding self-report and observational measures of pain: A communications model. Behav Res. Ther. 2002, 40, 551–570. [Google Scholar] [CrossRef]
  17. Cascella, M.; Bimonte, S.; Saettini, F.; Muzio, M.R. The challenge of pain assessment in children with cognitive disabilities: Features and clinical applicability of different observational tools. J. Paediatr. Child. Health 2019, 55, 129–135. [Google Scholar] [CrossRef]
  18. Sirsch, E.; Lukas, A.; Drebenstedt, C.; Gnass, I.; Laekeman, M.; Kopke, K.; Fischer, T.; Guideline workgroup. Pain Assessment for Older Persons in Nursing Home Care: An Evidence-Based Practice Guideline. J. Am. Med. Dir. Assoc. 2020, 21, 149–163. [Google Scholar] [CrossRef]
  19. van der Putten, A.; Vlaskamp, C. Pain assessment in people with profound intellectual and multiple disabilities; a pilot study into the use of the Pain Behaviour Checklist in everyday practice. Res. Dev. Disabil. 2011, 32, 1677–1684. [Google Scholar] [CrossRef]
  20. Breau, L.M.; Burkitt, C. Assessing pain in children with intellectual disabilities. Pain Res. Manag. 2009, 14, 116–120. [Google Scholar] [CrossRef] [PubMed]
  21. de Waal, M.W.M.; van Dalen-Kok, A.H.; de Vet, H.C.W.; Gimenez-Llort, L.; Konstantinovic, L.; de Tommaso, M.; Fischer, T.; Lukas, A.; Kunz, M.; Lautenbacher, S.; et al. Observational pain assessment in older persons with dementia in four countries: Observer agreement of items and factor structure of the Pain Assessment in Impaired Cognition. Eur. J. Pain. 2020, 24, 279–296. [Google Scholar] [CrossRef]
  22. Kunz, M.; de Waal, M.W.M.; Achterberg, W.P.; Gimenez-Llort, L.; Lobbezoo, F.; Sampson, E.L.; van Dalen-Kok, A.H.; Defrin, R.; Invitto, S.; Konstantinovic, L.; et al. The Pain Assessment in Impaired Cognition scale (PAIC15): A multidisciplinary and international approach to develop and test a meta-tool for pain assessment in impaired cognition, especially dementia. Eur. J. Pain 2020, 24, 192–208. [Google Scholar] [CrossRef] [Green Version]
  23. Benromano, T.; Pick, C.G.; Merick, J.; Defrin, R. Physiological and Behavioral Responses to Calibrated Noxious Stimuli Among Individuals with Cerebral Palsy and Intellectual Disability. Pain Med. 2017, 18, 441–453. [Google Scholar] [CrossRef]
  24. Defrin, R.; Benromano, T.; Pick, C.G. Specific Behavioral Responses Rather Than Autonomic Responses Can Indicate and Quantify Acute Pain among Individuals with Intellectual and Developmental Disabilities. Brain Sci. 2021, 11, 253. [Google Scholar] [CrossRef]
  25. Bunk, S.; Zuidema, S.; Koch, K.; Lautenbacher, S.; De Deyn, P.P.; Kunz, M. Pain processing in older adults with dementia-related cognitive impairment is associated with frontal neurodegeneration. Neurobiol. Aging 2021, 106, 139–152. [Google Scholar] [CrossRef]
  26. Sousa, V.D.; Rojjanasrirat, W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. J. Eval. Clin. Pract. 2011, 17, 268–274. [Google Scholar] [CrossRef]
  27. van Dalen-Kok, A.H.; Achterberg, W.P.; Rijkmans, W.E.; de Vet, H.C.; de Waal, M.W. Pain assessment in impaired cognition: Observer agreement in a long-term care setting in patients with dementia. Pain Manag. 2019, 9, 461–473. [Google Scholar] [CrossRef]
  28. Benromano, T.; Pick, C.G.; Granovsky, Y.; Defrin, R. Increased Evoked Potentials and Behavioral Indices in Response to Pain Among Individuals with Intellectual Disability. Pain Med. 2017, 18, 1715–1730. [Google Scholar] [CrossRef] [PubMed]
  29. Barney, C.C.; Hoch, J.; Byiers, B.; Dimian, A.; Symons, F.J. A Case-controlled Investigation of Pain Experience and Sensory Function in Neuronal Ceroid Lipofuscinosis. Clin. J. Pain 2015, 31, 998–1003. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Barney, C.C.; Tervo, R.; Wilcox, G.L.; Symons, F.J. A Case-Controlled Investigation of Tactile Reactivity in Young Children with and Without Global Developmental Delay. Am. J. Intellect. Dev. Disabil. 2017, 122, 409–421. [Google Scholar] [CrossRef] [PubMed]
  31. Defrin, R.; Lotan, M.; Pick, C.G. The evaluation of acute pain in individuals with cognitive impairment: A differential effect of the level of impairment. Pain 2006, 124, 312–320. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. La Chapelle, D.L.; Hadijistavropoulos, R.; Craig, K.D. Pain Measurement in Persons with Intellectual Disability. Clin. J. Pain 1999, 15, 13–23. [Google Scholar] [CrossRef] [PubMed]
  33. Rattaz, C.; Dubois, A.; Michelon, C.; Viellard, M.; Poinso, F.; Baghdadli, A. How do children with autism spectrum disorders express pain? A comparison with developmentally delayed and typically developing children. Pain 2013, 154, 2007–2013. [Google Scholar] [CrossRef] [PubMed]
  34. Breau, L.M.; McGrath, P.J.; Craig, K.D.; Santor, D.; Cassidy, K.L.; Reid, G.J. Facial expression of children receiving immunizations: A principal components analysis of the child facial coding system. Clin. J. Pain 2001, 17, 178–186. [Google Scholar] [CrossRef]
  35. Dubois, A.; Capdevila, X.; Bringuier, S.; Pry, R. Pain expression in children with an intellectual disability. Eur. J. Pain 2010, 14, 654–660. [Google Scholar] [CrossRef] [PubMed]
  36. Phan, A.; Edwards, C.L.; Robinson, E.L. The assessment of pain and discomfort in individuals with mental retardation. Res. Dev. Disabil. 2005, 26, 433–439. [Google Scholar] [CrossRef]
  37. Pascolo, P.; Peri, F.; Montico, M.; Funaro, M.; Parrino, R.; Vanadia, F.; Rusalen, F.; Vecchiato, L.; Benini, F.; Congedi, S.; et al. Needle-related pain and distress management during needle-related procedures in children with and without intellectual disability. Eur. J. Pediatr. 2018, 177, 1753–1760. [Google Scholar] [CrossRef] [PubMed]
  38. Aguilar Cordero, M.J.; Mur Villar, N.; García García, I. Evaluation of pain in healthy newborns and in newborns with developmental problems (Down syndrome). Pain Manag. Nurs. 2015, 16, 267–272. [Google Scholar] [CrossRef] [PubMed]
  39. Riquelme, I.; Montoya, P. Developmental changes in somatosensory processing in cerebral palsy and healthy individuals. Clin. Neurophysiol. 2010, 121, 1314–1320. [Google Scholar] [CrossRef] [PubMed]
  40. Cascio, C.; McGlone, F.; Folger, S.; Tannan, V.; Baranek, G.; Pelphrey, K.A.; Essick, G. Tactile perception in adults with autism: A multidimensional psychophysical study. J. Autism Dev. Disord 2008, 38, 127–137. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Hennequin, M.; Morin, C.; Feine, J.S. Pain expression and stimulus localisation in individuals with Down’s syndrome. Lancet 2000, 356, 1882–1887. [Google Scholar] [CrossRef]
  42. de Araújo Vitor, C.A.; de Oliveira Lira Ortega, A.; Ferreira, A.C.F.M.; da Silva, C.A.L.; Gallottini, M.H.C.; Santos, M.T.B.R. Pressure pain threshold of masticatory muscles in children and adolescents with and without intellectual disability: A pilot study. Eur. Arch. Paediatr. Dent. 2021, 22, 587–593. [Google Scholar] [CrossRef] [PubMed]
  43. Bembich, S.; Morabito, G.; Simeon, V.; Strajn, T.; Rutigliano, R.; Di Rocco, P.; Cont, G.; Risso, F.M.; Peri, F.; Barbi, E. Venipuncture activates the cerebral cortex in children with intellectual disability. Arch. Dis Child. 2020, 106, 167–172. [Google Scholar] [CrossRef] [PubMed]
  44. Symons, F.J.; Harper, V.; Shinde, S.K.; Clary, J.; Bodfish, J.W. Evaluating a sham-controlled sensory-testing protocol for nonverbal adults with neurodevelopmental disorders: Self-injury and gender effects. J. Pain 2010, 11, 773–781. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Bergström-Isacsson, M.; Lagerkvist, B.; Holck, U.; Gold, C. How facial expressions in a Rett syndrome population are recognised and interpreted by those around them as conveying emotions. Res. Dev. Disabil. 2013, 34, 788–794. [Google Scholar] [CrossRef] [PubMed]
  46. Weiner, D.; Peterson, B.; Keefe, F. Chronic pain-associated behaviors in the nursing home: Resident versus caregiver perceptions. Pain 1999, 80, 577–588. [Google Scholar] [CrossRef]
  47. de Knegt, N.C.; Lobbezoo, F.; Schuengel, C.; Evenhuis, H.M.; Scherder, E.J.A. Self-Reported Presence and Experience of Pain in Adults with Down Syndrome. Pain Med. 2017, 18, 1247–1263. [Google Scholar] [CrossRef] [Green Version]
  48. Amor-Salamanca, A.; Menchon, J.M. Pain underreporting associated with profound intellectual disability in emergency departments. J. Intellect. Disabil. Res. 2017, 61, 341–347. [Google Scholar] [CrossRef] [Green Version]
  49. Petigas, L.; Newman, C.J. Paediatricians’ Views on Pain in Children with Profound Intellectual and Multiple Disabilities. Brain Sci. 2021, 11, 408. [Google Scholar] [CrossRef]
Figure 1. The sum PAIC-15 scores of the English version for individuals with IDD and TDCs. The PAIC-15 scores of the IDD group were significantly higher than those of TDCs in all the stimulation conditions (* p < 0.01; ** p < 0.001, *** p < 0.0001). Values denote the group mean ± SEM.
Figure 1. The sum PAIC-15 scores of the English version for individuals with IDD and TDCs. The PAIC-15 scores of the IDD group were significantly higher than those of TDCs in all the stimulation conditions (* p < 0.01; ** p < 0.001, *** p < 0.0001). Values denote the group mean ± SEM.
Brainsci 11 01254 g001
Figure 2. The sum PAIC-15 scores of the Arabic version for individuals with IDD and TDCs. The PAIC-15 scores of the IDD group were significantly higher than those of TDCs in all the stimulation conditions (* p < 0.05; ** p < 0.01). Values denote the group mean ± SEM.
Figure 2. The sum PAIC-15 scores of the Arabic version for individuals with IDD and TDCs. The PAIC-15 scores of the IDD group were significantly higher than those of TDCs in all the stimulation conditions (* p < 0.05; ** p < 0.01). Values denote the group mean ± SEM.
Brainsci 11 01254 g002
Figure 3. The sum PAIC-15 scores of the English version as compared to those of the Arabic version for the entire cohort. The scores at rest and during 50 kPa were higher using the English version (between groups: * p < 0.05, *** p < 0.001). However, the scores during the noxious stimuli (200 and 400 kPa) were similar for the two versions. Values denote the group mean ± SEM.
Figure 3. The sum PAIC-15 scores of the English version as compared to those of the Arabic version for the entire cohort. The scores at rest and during 50 kPa were higher using the English version (between groups: * p < 0.05, *** p < 0.001). However, the scores during the noxious stimuli (200 and 400 kPa) were similar for the two versions. Values denote the group mean ± SEM.
Brainsci 11 01254 g003
Table 1. The study groups.
Table 1. The study groups.
Intellectual and Developmental DisabilityTypically Developing Controlsp-Value #
Number3015
Females (n, %)(53) 168 (53)1
Age (M, SD)35.5 (6)31.3 (8)0.07
IDD etiology (n, %):
Cerebral palsy13 (43)--
Down syndrome8 (27)--
Unspecified IDD9 (30)--
IDD level (n, %):
Mild16 (53)--
Mild–moderate7 (23)--
Moderate7 (23)--
# = Mann–Whitney test or t-test between groups.
Table 2. Frequency of occurrence of each PAIC-15 item during 400 kPa stimulation: comparison between groups and between the English and Arabic versions.
Table 2. Frequency of occurrence of each PAIC-15 item during 400 kPa stimulation: comparison between groups and between the English and Arabic versions.
EnglishArabicICC
IDDTDCsTotalIDDTDCsTotal
Frowning9 (30)4 (27)139 (30)4 (27)131.00
Narrowing eyes17 (57)5 (33)2214 (47)3 (20)170.86
Raising upper lip18 (60) **2 (13)205 (17)1 (7)60.49 ^^
Opening mouth22 (73) ***2 (13)2417 (57) **1 (7)180.86
Looking tense17 (57) **1 (7)1817 (57) *3 (20)200.39
Freezing18 (60) *4 (27)2214 (47)5 (33)190.58
Guarding3 (10)035 (17)050.65
Resisting care 2 (7)021 (3)010.70
Rubbing2 (7)024 (13)040.56
Restlessness 2 (7)022 (7)020.42
Pain-related words9 (30)1 (7)106 (20)060.89
Shouting4 (13)04000--- ^
Groaning5 (17)055 (17)050.75
Mumbling3 (10)1 (7)4000--- ^
Complaining4 (13)046 (20)060.47
SUM score (m ± SD)9.8(7) *2.4(3)6.1(4)6.5(4) *2.4(2)4.4(3)0.89
ICC = interclass correlation coefficients between the languages. For each PAIC item, the numbers in parentheses are % out of the individuals in each group and the asterisks signify the results of χ2 tests comparing the frequencies between the IDD and TDCs within each language (* p < 0.05; ** p < 0.01, *** p < 0.001). ^ are the results of χ2 tests comparing the total frequency (IDD and TDC) between languages (^ p < 0.05; ^^ p < 0.01). For the sum score, the numbers in parentheses are standard deviations and the asterisks signify the results of t-test between the IDD and TDCs within each language (* p < 0.05). The third column in each language is the average of the two groups.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Defrin, R.; Beshara, H.; Benromano, T.; Hssien, K.; Pick, C.G.; Kunz, M. Pain Behavior of People with Intellectual and Developmental Disabilities Coded with the New PAIC-15 and Validation of Its Arabic Translation. Brain Sci. 2021, 11, 1254. https://doi.org/10.3390/brainsci11101254

AMA Style

Defrin R, Beshara H, Benromano T, Hssien K, Pick CG, Kunz M. Pain Behavior of People with Intellectual and Developmental Disabilities Coded with the New PAIC-15 and Validation of Its Arabic Translation. Brain Sciences. 2021; 11(10):1254. https://doi.org/10.3390/brainsci11101254

Chicago/Turabian Style

Defrin, Ruth, Heba Beshara, Tali Benromano, Kutaiba Hssien, Chaim G. Pick, and Miriam Kunz. 2021. "Pain Behavior of People with Intellectual and Developmental Disabilities Coded with the New PAIC-15 and Validation of Its Arabic Translation" Brain Sciences 11, no. 10: 1254. https://doi.org/10.3390/brainsci11101254

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop