|
|
||||||||
Research Reports |
CH Wang, PT, BS, is Associate Professor, School of Physical Therapy, College of Medical Technology, Chung Shan Medical University, and Department of Physical Therapy, Chung Shan Medical University Rehabilitation Hospital, Taichung, Taiwan, Republic of China
IP Hsueh, OT, MA, is Lecturer, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan, Republic of China
CF Sheu, PhD, is Associate Professor, Department of Psychology, DePaul University, Chicago, Ill
G Yao, PhD, is Associate Professor, Department of Psychology, College of Science, National Taiwan University
CL Hsieh, OT, PhD, is Associate Professor and Chair, School of Occupational Therapy, College of Medicine, National Taiwan University, Chung-Shan S Rd, Taipei 100, Taiwan, Republic of China (mike26{at}ha.mc.ntu.edu.tw)
Address all correspondence to Dr Hsieh
Submitted August 24, 2003;
Accepted November 20, 2003
| Abstract |
|---|
Key Words: Balance Level of scaling Psychometric properties Stroke
| Introduction |
|---|
|
|
|---|
.95), high concurrent validity (the BBS scores were highly correlated with the PASS scores, with Spearman 
.92), and moderate to high responsiveness (effect size >.63). Although either the BBS or the PASS is suggested for measuring balance in patients with stroke,3,4 the usefulness of the levels of scaling of each measure was rarely investigated. Whether the level of scaling of the balance measures would influence their psychometric properties remains unknown. Some people believe that a scale with 4 or 5 levels of performance (eg, balance scale) has better psychometric properties than a 3-level measure,5 although data for such a claim are lacking. Evidence, however, often shows that increasing the level of scaling may not improve the psychometric properties of a measure.6,7 Thus, it might be reasonable to try to simplify a measure by reducing the levels without sacrificing its psychometric properties. We therefore proposed 2 simplified measures with reduced levels of scaling, a 3-level Berg Balance Scale (BBS-3P) rather than a 5-level scale and a 3-level Postural Assessment Scale for Stroke Patients (PASS-3P) rather than one that calls for 4 levels of measurement. The purpose of our study was to investigate whether these two 3-level measures have psychometric properties that are comparable to those of the measures on which they were based for patients with stroke.
| Method |
|---|
|
|
|---|
In the second part, additional psychometric properties (including predictive validity and responsiveness) of these measures were evaluated in subjects with stroke who were followed from the acute stage up to 90 days after the onset of stroke. The original BBS and PASS were administered to the subjects at 14, 30, and 90 days after the onset of stroke. The BI, which assesses the performance of activities of daily living (ADL), was administered 90 days after the onset of stroke. The degrees of responsiveness of the balance measures were calculated based on the changes occurring between 14 and 30 days after the onset of stroke, between 30 and 90 days after the onset of stroke, and between 14 and 90 days after the onset of stroke. All of these measures were administered by an occupational therapist who was not informed of the purpose of this study. Both of the simplified 3-level measures in this part of this study were achieved via the recoding schemes (the BBS-3P [024] was recoded from the BBS [01234]; the PASS-3P [01.53] was recoded from the PASS [0123]), and the resulting scores were used in the data analysis.
Instruments
The BBS1 is designed to evaluate a person's performance on 14 items (1 sitting item and 13 standing items) related to balance function tasks that are frequently encountered in everyday life. The scoring method is based on a 5-level scale of 0 to 4, with the total score ranging from 0 to 56. The BBS was originally developed for screening elderly people who are at risk for falling,1 but the psychometric properties of the BBS have been well supported for use in patients with stroke.35,8
The PASS2 was developed to be applicable to all patients with stroke, even for those with poor postural performance. The PASS contains twelve 4-level (03) items that are used to grade performance for situations of varying difficulty in maintaining or changing a given lying, sitting, or standing posture. The total score ranges from 0 to 36. The psychometric properties of the PASS have been reported to be satisfactory in patients with stroke.2,3
The BBS-3P was simplified from the original measure. In the first part of our study, the original scoring criteria for the BBS were used, except that the third and fourth levels of scoring on each BBS item were not used. That is, subjects who could fulfill the scoring criteria for the second easiest level but who could not pass the highest scoring criteria were awarded the middle level on each item of the measures. In the second part of our study, the BBS-3P scores were retrieved from the original BBS scores; the 3 levels in the center of the BBS were collapsed to a single level. To facilitate comparisons of versions, each item of the BBS-3P was recoded as 024, making the lowest and highest scores of the BBS-3P the same as those of the original BBS in both parts of the study.
The PASS-3P also was simplified from the original measure. In the first part of our study, the original scoring criteria for the PASS were used, except that the third level of scoring on each PASS item was not used. In the second part of our study, the PASS-3P scores were retrieved from the original PASS scores by collapsing the 2 levels in the center of the PASS to a single level. To facilitate comparisons of the versions, each item of the PASS-3P was recoded as 01.53, making the lowest and highest scores of the PASS-3P the same as those of the original PASS.
The BI is a measure of the severity of disability.9 The BI is used to evaluate 10 basic ADL items, and the total score ranges from 0 to 100. It has been shown to yield good interrater reliability (ICC=.94), high concurrent validity (Spearman 
.92) measurements of ADL in patients with stroke.10,11 The BI was used as an external criterion to examine convergent validity of data obtained with the balance measures in the first part of the study and to examine predictive validity for disability of data obtained with the measures in the second part of the study.
The Fugl-Meyer motor assessment (FM)12 is used mainly to measure motor impairment after stroke. The FM consists of 50 items of upper- and lower-extremity motor function. Each item is graded on a 3-level scale. The total possible score ranges from 0 to 100 points. It has been shown to have good interrater reliability (ICC
.92) and high concurrent validity (r
.99).1315 We used the FM score as an index of neurological severity for our subjects.
Subjects for the First Part of the Study
To select patients with broad range of balance deficits, subjects were recruited from 5 rehabilitation units in Taichung, Taiwan, from July to August 2002. Patients were included in the study if they met the following criteria: (1) diagnosis (International Classification of Diseases, 9th Revision, Clinical Modification16 [ICD-9] codes) of cerebral hemorrhage (ICD-9: 431) or cerebral infarction (ICD-9: 434) according to the medical records, (2) first onset of stroke without other major disease and the absence of a pre-existing disability, and (3) ability to follow instructions. Only patients who had a single stroke and were able to give informed consent personally or by proxy were included in this part of the study.
A total of 77 subjects with a wide spectrum of balance deficits, ranging from subjects without obvious neurological symptoms to subjects who were bedridden, participated in the concurrent validity and convergent validity parts of the study. Table 1 shows the characteristics of the subjects in the study.
|
A total of 226 subjects were included in this part of the study. A total of 685 patients were excluded because onset of their stroke was more than 14 days prior to admission, because the patient did not live in the greater Taipei area, because of recurrent stroke, or because of communication difficulties. The participants were 103 women and 123 men with a mean age of 69 years (SD=11.3, range=3395). More than half (72%) of these subjects had cerebral infarction, and the others had cerebral hemorrhage. The FM scores indicated that the subjects had a wide range of motor impairments (median FM score=54.5, interquartile range=16.891). Twenty-four subjects were lost to follow-up at 30 days after onset of stroke, and another 35 subjects were lost to follow-up at 90 days after onset of stroke. A total of 167 subjects completed follow-up at 90 days after onset of stroke.
Data Analysis
Concurrent validity.
The Bland-Altman method17 was used to examine agreement between data obtained with the original measures and data obtained with the simplified measures. In this method, the average scores of the original and simplified measures are plotted against the difference between scores. The extent of agreement was examined, like examining interrater agreement, using the ICC (1,1).18 Wilcoxon matched-pairs signed-rank tests were performed to determine the statistical significance of the differences between scores. In addition, the Spearman
was used to examine the interrelationships between data obtained with the simplified measures and data obtained with the original measures.
Convergent validity.
Convergent validity was determined by examining the relationships between data obtained with the measures and data obtained with instruments measuring similar constructs. The relationships between the total scores of the BBS-3P and PASS-3P and the BI were examined using the Spearman
.
Predictive validity.
The predictive validity of data obtained with both simplified balance measures was assessed by comparing the results at 14 and 30 days after onset of stroke with the results obtained with the BI at 90 days after onset of stroke using the Spearman
to determine whether the level of disability could be predicted by the data obtained from the balance measures.
Responsiveness.
Because there is no consensus regarding how best to assess the responsiveness of measurement instruments, we used 2 different approaches. First, the standardized response mean (SRM), one type of effect size, was calculated by dividing the mean change in scores by the standard deviation of the change in scores in the same subjects. Wilcoxon matched-pairs signed-rank tests were performed to determine the statistical significance of the change in scores. Furthermore, to determine whether the responsiveness of the measures varied depending on the initial stroke-induced deficits, we separated subjects into one of the following 3 groups based on their FM scores: 0 to 35 (severe stroke), 36 to 79 (moderate stroke), and 80 or greater (mild stroke).19
| Results |
|---|
|
|
|---|
|
|

.91 (P<.0001). These results indicated that both simplified measures demonstrated high concurrent validity. The correlations of the PASS-3P and BBS-3P scores with the BI scores were
=.82 and .87, respectively. The convergent validity of data obtained with both simplified balance measures was as good the original measures.
|
|
|

.75, P<.0001). The predictive validity of data obtained with the simplified 3-P measures was similar to that of data obtained with the original measures.
|
0.82; 3090 days after onset of stroke: SRM
0.67). The changes of the BBS-3P and PASS-3P at each stage were all significant (P
.0001). As shown in Table 7, the SRM of the simplified measures at different stages for subjects with different levels of stroke severity were larger than 0.37. The responsiveness of the recoded BBS-3P and PASS-3P measures was very similar to that of the original measures (Tabs. 6 and 7).
|
|
| Discussion |
|---|
|
|
|---|
There are other possible ways to simplify the level of scaling for both measures, such as changing 5- or 4-level scales to 2-level scales (eg, collapsing the lowest levels or highest levels). We believe this would make the results of the measures too prone to floor or ceiling effects and result in a loss of information. Furthermore, it could limit the discriminative power of the measures. Thus, we selected a 3-level scale.
There are several schemes to simplify a 4- or 5-level measure to a 3-level measure, such as collapsing the 3 center levels, or collapsing the 2 lowest levels and 2 highest levels, of a 01234 scale. The central levels of the BBS and PASS can be viewed generally as "partially completes the task (individual item)." In contrast, the lowest level means "cannot perform the task," and the highest level means "fully completes the task." Furthermore, as collapsing the lowest or highest levels would increase the floor or ceiling effects of the measures, we collapsed the middle levels of the 4- or 5-level scale in our simplifications.
The concurrent validity and convergent validity of data obtained with the BBS-3P and PASS-3P were as high as for the original measures. Furthermore, the high validity scores of both simplified balance scales were generally in accordance with the findings of previous studies examining scores from the original scales.2,3,5 The findings of our study demonstrate the validity of data obtained with the 2 simplified balance measures.
Responsiveness can be defined as the ability to detect minimal clinically important differences.21,22 The results of the SRM indicated that the simplified measures had fair to good levels of responsiveness before 90 days after onset of stroke for all of the subjects studied. The responsiveness of both simplified measures at different stages, in our opinion, also was acceptable for subjects with different levels of stroke severity. There are only 29 possible points for the BBS-3P and only 25 possible points for the PASS-3P, as compared with the scoring possibilities for their original counterparts of 57 (056) and 37 (036), respectively. Our results indicate that the simplified scoring for the BBS-3P and PASS-3P resulted in the same level of responsiveness as for the original scales. These simplified 3-level balance measures appeared, in our opinion, not to lose any sensitivity to clinically important changes of in contrast to the original measures.
The range of scores for the simplified 3-level measures was the same as for the original measures (eg, 024 for the BBS-3P and 01234 for the BBS) to facilitate comparisons of the versions. In clinical or research settings, the scoring scheme of each item could be changed to 012 for both the BBS-3P and the PASS-3P. Because such a change of scoring scheme is presumably linear, the psychometric properties of the measures should not be altered. In the future, analysis of these simplified measures using methods such as Item Response Theory23,24 may provide insight into their clinical applicability.
| Conclusion |
|---|
|
|
|---|
In our study, the interrater and intrarater reliability of data obtained with the simplified measures was not examined. Agreement between the simplified and original balance measures, however, was excellent (ICC
.97). Furthermore, in a previous study,3 it was reported that the BBS and PASS had high interrater reliability (ICC
.95). Therefore, we believe the interrater and intrarater reliability of data obtained with the simplified measures not to be a major concern. Because the data for the predictive validity and responsiveness parts of the study were recoded from the BBS and PASS according to the same set of data, the predictive validity and responsiveness of the simplified measures might have been overestimated. According to the results of the first part of the study, however, direct assessment of the simplified measures and the original measures showed excellent agreement (ICC
.97). Recoding data from the original measures, therefore, might not be an issue. In addition, the raters in this study reported that the simplified measures were easier to use because of simplicity of scoring level than the original measures. According to Wade,26 a simple-to-use measure will increase the patient and rater adherence to a simple scoring system. Future study is needed to investigate how much meaningful utility (eg, saving administration time and improving patient/rater adherence) can be gained with the simplified balance measures as compared with the original measures.
In summary, our results indicate that the level of scaling of the BBS and the PASS can be simplified without sacrificing their psychometric properties. A 3-level scale was found to be adequate for assessing balance in patients with stroke.
| Footnotes |
|---|
This study was approved by the institutional review board of Chung Shan Medical University Rehabilitation Hospital.
This study was supported by research grants from the National Science Council (NSC-90-2314-B-002-325) and Chung Shan Medical University (CSMU 91-OM-B-018).
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. Blum and N. Korner-Bitensky Usefulness of the Berg Balance Scale in Stroke Rehabilitation: A Systematic Review Physical Therapy, May 1, 2008; 88(5): 559 - 566. [Abstract] [Full Text] [PDF] |
||||
![]() |
C.-W. Chien, J.-H. Lin, C.-H. Wang, I-P. Hsueh, C.-F. Sheu, and C.-L. Hsieh Developing a Short Form of the Postural Assessment Scale for People With Stroke Neurorehabil Neural Repair, January 1, 2007; 21(1): 81 - 90. [Abstract] [PDF] |
||||
![]() |
I-P. Hsueh, W.-C. Wang, C.-H. Wang, C.-F. Sheu, S.-K. Lo, J.-H. Lin, and C.-L. Hsieh A Simplified Stroke Rehabilitation Assessment of Movement Instrument Physical Therapy, July 1, 2006; 86(7): 936 - 943. [Abstract] [Full Text] [PDF] |
||||
![]() |
C.-Y. Chou, C.-W. Chien, I-P. Hsueh, C.-F. Sheu, C.-H. Wang, and C.-L. Hsieh Developing a Short Form of the Berg Balance Scale for People With Stroke Physical Therapy, February 1, 2006; 86(2): 195 - 204. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |