| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
Research Reports |
CG Maher, PT, PhD, is Associate Professor, School of Physiotherapy, Faculty of Health Sciences, The University of Sydney, PO Box 170, Lidcombe, New South Wales 1825, Australia (C.Maher{at}fhs.usyd.edu.au). Address all correspondence to Dr Maher
C Sherrington, PT, PhD, is Research Officer, Prince of Wales Medical Research Institute, University of New South Wales, Sydney, New South Wales, Australia
RD Herbert, PT, PhD, is Senior Lecturer, School of Physiotherapy, The University of Sydney
AM Moseley, PT, PhD, is Lecturer, Rehabilitation Studies Unit, Department of Medicine, The University of Sydney
M Elkins, PT, M-HSc, is Research Physiotherapist, Department of Respiratory Medicine, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
Background and Purpose. Assessment of the quality of randomized controlled trials (RCTs) is common practice in systematic reviews. However, the reliability of data obtained with most quality assessment scales has not been established. This report describes 2 studies designed to investigate the reliability of data obtained with the Physiotherapy Evidence Database (PEDro) scale developed to rate the quality of RCTs evaluating physical therapist interventions. Method. In the first study, 11 raters independently rated 25 RCTs randomly selected from the PEDro database. In the second study, 2 raters rated 120 RCTs randomly selected from the PEDro database, and disagreements were resolved by a third rater; this generated a set of individual rater and consensus ratings. The process was repeated by independent raters to create a second set of individual and consensus ratings. Reliability of ratings of PEDro scale items was calculated using multirater kappas, and reliability of the total (summed) score was calculated using intraclass correlation coefficients (ICC [1,1]). Results. The kappa value for each of the 11 items ranged from .36 to .80 for individual assessors and from .50 to .79 for consensus ratings generated by groups of 2 or 3 raters. The ICC for the total score was .56 (95% confidence interval=.47–.65) for ratings by individuals, and the ICC for consensus ratings was .68 (95% confidence interval=.57–.76). Discussion and Conclusion. The reliability of ratings of PEDro scale items varied from "fair" to "substantial," and the reliability of the total PEDro score was "fair" to "good."
Key Words: Evidence-based medicine • Meta-analysis • Physical therapy • Randomized controlled trials
This article has been cited by other articles:
|
|
 |
|
  C. G Maher, A. M Moseley, C. Sherrington, M. R Elkins, and R. D Herbert A Description of the Trials, Reviews, and Practice Guidelines Indexed in the PEDro Database Physical Therapy, September 1, 2008; 88(9): 1068 - 1077. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Meilink, B. Hemmen, H. Seelen, and G. Kwakkel Impact of EMG-triggered neuromuscular stimulation of the wrist and finger extensors of the paretic hand after stroke: a systematic review of the literature Clinical Rehabilitation, April 1, 2008; 22(4): 291 - 305. [Abstract] [PDF]
|
|
|
|
 |
|
 R. L. Zemek, S. K. Bhogal, and F. M. Ducharme Systematic Review of Randomized Controlled Trials Examining Written Action Plans in Children: What Is the Plan? Arch Pediatr Adolesc Med, February 1, 2008; 162(2): 157 - 163. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. A. Olivo, L. G. Macedo, I. C. Gadotti, J. Fuentes, T. Stanton, and D. J Magee Scales to Assess the Quality of Randomized Controlled Trials: A Systematic Review Physical Therapy, February 1, 2008; 88(2): 156 - 175. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. D. Carnaby-Mann and M. A. Crary Examining the Evidence on Neuromuscular Electrical Stimulation for Swallowing: A Meta-analysis Arch Otolaryngol Head Neck Surg, June 1, 2007; 133(6): 564 - 571. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. Markovic and R. U Newton Does plyometric training improve vertical jump height? A meta-analytical review * Commentary Br. J. Sports Med., June 1, 2007; 41(6): 349 - 355. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. L Woodley, R. J Newsham-West, G D. Baxter, M Kjaer, and M S Koehle Chronic tendinopathy: effectiveness of eccentric exercise * COMMENTARY 1 * COMMENTARY 2 Br. J. Sports Med., April 1, 2007; 41(4): 188 - 198. [Full Text] [PDF]
|
|
|
|
|
|
N. A de Morton, J. L Keating, and K. Jeffs The effect of exercise on outcomes for older acute medical inpatients compared with control or alternative treatments: a systematic review of randomized controlled trials Clinical Rehabilitation, January 1, 2007; 21(1): 3 - 16. [Abstract] [PDF]
|
|
|
|
|
|
J A Radford, J Burns, R Buchbinder, K B Landorf, C Cook, and K Rome Does stretching increase ankle dorsiflexion range of motion? A systematic review * COMMENTARY Br. J. Sports Med., October 1, 2006; 40(10): 870 - 875. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. M. Levack, K. Taylor, R. J Siegert, S. G Dean, K. M McPherson, and M. Weatherall Is goal planning in rehabilitation effective? A systematic review Clinical Rehabilitation, September 1, 2006; 20(9): 739 - 755. [Abstract] [PDF]
|
|
|
|
|
|
N. C Foley, S. K Bhogal, R. W Teasell, Y. Bureau, and M. R Speechley Estimates of Quality and Reliability With the Physiotherapy Evidence-Based Database Scale to Assess the Methodology of Randomized Controlled Trials of Pharmacological and Nonpharmacological Interventions Physical Therapy, June 1, 2006; 86(6): 817 - 824. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Y. Pang, J. J Eng, A. S Dawson, and S. Gylfadottir The use of aerobic exercise training in improving aerobic capacity in individuals with stroke: a meta-analysis Clinical Rehabilitation, February 1, 2006; 20(2): 97 - 111. [Abstract] [PDF]
|
|
|
|
|
|
L Bisset, A Paungmali, B Vicenzino, E Beller, and R D Herbert A systematic review and meta-analysis of clinical trials on physical interventions for lateral epicondylalgia * Commentary Br. J. Sports Med., July 1, 2005; 39(7): 411 - 422. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. G Maher, C. Sherrington, M. Elkins, R. D Herbert, and A. M Moseley Challenges for Evidence-Based Physical Therapy: Accessing and Interpreting High-Quality Evidence on Therapy Physical Therapy, July 1, 2004; 84(7): 644 - 654. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N A Lannin and R D Herbert Is hand splinting effective for adults following stroke? A systematic review and methodological critique of published research Clinical Rehabilitation, August 1, 2003; 17(8): 807 - 816. [Abstract] [PDF]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
