|
|
||||||||
Perspectives |
| Abstract |
|---|
Key Words: Agenda American Physical Therapy Association Clinical research Profession
| Introduction |
|---|
|
|
|---|
The impact of a research agenda on research directions within a profession cannot be underestimated; yet, because of fear that a profession's agenda will devalue any one individual's own research program, the goal of having a single agenda to meet the needs of a profession can prove elusive. The Task Force on Medical Rehabilitation Research, convened by the National Institutes of Health in 1990, opined that although there was much research relevant to the interests and aims of rehabilitation medicine, the overall effort had no coherence.3 Physical therapy has faced a similar predicament. The Clinical Research Agenda presented in this article was not the first effort undertaken by APTA to develop such an agenda. The APTA attempted to generate a research agenda in December 1993 that would have aggregated research efforts into a cohesive effort. A panel of researchers, representing different clinical foci and levels of expertise, was convened to develop the agenda. The effort was not as successful as anticipated, as the group could not reach consensus on a clinical agenda that would be most beneficial to the profession as a whole. The group's conclusion was that each participant's own area of study was important, and no decisions could be made concerning the prescription of a program of research for the profession.
Individuals have continued since 1993 to conduct their own programs of research. However, neither the inability of physical therapy to identify a cohesive research plan nor the failure of other health care professions to develop such programs has diminished the need for a clinical research agenda for physical therapy. The problems that physical therapy addresses are problems of human potential thwarted by pathology, impairment, functional limitations, and disability. From the perspective of APTA, in order for the profession to justify itself as unique in the application of clinical sciences to the human condition, it is imperative to aggregate research efforts into a unified scientific program that maximizes the expenditure of individual efforts and produces an organized body of evidence for clinical practice.
Subsequent to APTA's initial effort to generate a research agenda in 1993, the health care environment changed substantially, and the need for evidence to support clinical practice has increased accordingly. Thus, when the idea of developing an agenda was reintroduced, APTA's paramount expectation was an agenda that would support, explain, and enhance physical therapist practice and result in research that is useful to clinicians from all areas of practice.
Once the decision to create an agenda was adopted, a number of formats were considered in the effort to ensure its development. Various disciplines and professions have published questions that could comprise an agenda in their professional journals and have invited comments about these questions and the relative priority of each.46 Others have commissioned written papers, which were then presented and responded to by a larger group of experts in the field.7 Another technique is to convene a panel of experts and, through a series of group processes, allow the panel to reach consensus on the most important research questions that need to be answered and that can be answered in the near term.8 The APTA adopted a process similar to the latter method and expanded it well beyond planning and conducting a series of conferences, using a number of different formats for communication so that maximum input from individuals representing both the research and clinical segments of the profession would have the opportunity to shape the final document (Fig. 1).
|
| Process of Agenda Development |
|---|
|
|
|---|
The first meeting of this group took place from August 30 to September 1, 1998. The intent of the meeting, as well as a second meeting held in December 1998, was to identify those clinical research questions that routinely challenge physical therapists. Participants were required to be able to identify how a physical therapist might use the answers to the questions in clinical situations in order for the questions to be included in the draft agenda. Furthermore, each question had to be one that was answerable within 5 years based on available technology and current state of knowledge. The initial clustering of questions generated at the first conference was created in accord with the systems orientation of the Guide to Physical Therapist Practice9 ("the Guide"). Conference participants were placed in groups according to their expertise, and questions were designed based on each of the 4 systems described in the Guide (ie, musculoskeletal, neuromuscular, cardiopulmonary, and integumentary). Guide language was maintained in each of the questions suggested by participants.
Prior to the second conference, a smaller editorial advisory panel (EAP), consisting of 4 member consultants and 3 APTA staff members, met to edit questions generated from the first conference. In addition to editing questions, the group chose a format for construction of the Clinical Research Agenda based on the patient/client management model adopted by the APTA House of Delegates (HOD 06-95-25-15) and described in the Guide. Rather than solely grouping questions based on the 4 systems delineated in the Guide, new categories within which questions were to be placed were selected using the elements of the patient/client management model. These new headings"Examination," "Evaluation and Diagnosis," "Prognosis," and "Intervention/ Outcomes"were incorporated following the outline of the Guide.
The EAP also decided at that time to incorporate a series of health services research questions that had been developed separately on another occasion by a group of member consultants and staff but that had never been published. The decision was made to publish a single, unified document based on the fact that many questions from the health services research agenda overlapped with questions that were being developed as part of the draft agenda. The EAP noted that, in fact, the distinction between health services and clinical research may be an artificial one. The decision to combine health services questions within this clinical research agenda was supported by other researchers outside of physical therapy. Cohen5 referred to health services research as "applied applied clinical research." Eisenberg10 included health services research as part of a continuum of health-related research and believes that the boundaries between biomedical and health services research are not sharp, nor should they be. Perhaps the most cogent description of the similarities between clinical and health services research has been expressed by Bennett,11 who cited a continuum developed by staff at Rockefeller University to describe clinical investigation. The continuum includes research questions anchored at one end by research to explore unresolved issues in human biology and at the other end by studies on the assessment of health care practices and delivery systems.
After categorization based on the new format using the patient/client management model, and the addition of the health services research questions, an edited draft agenda was sent to each of the individuals who were to participate in the second conference. A cover letter was included with this mailing that explained the tasks to be completed. Participants were informed that the revised structure of the agenda, based on the Guide, was essentially inviolate. The primary tasks to be completed during the second conference were (1) to select which research themes would serve as the protean structure for the research that the profession needed to conduct and (2) to refine the examples to give a broad overview of the research to be conducted in particular content areas. At the conclusion of the second conference, the scope of the edited questions was identified, broader questions included within research themes were developed, critical examples of researchable questions were placed within these broader categories, and a determination of which particular questions should be considered for inclusion was made.
Subsequent to the conference, the EAP was reconvened to review the work produced by conference participants and to ensure that questions considered for inclusion were clearly worded and relevant to the purpose of the agenda. The group met once on-site at APTA headquarters and conducted 5 conference calls to complete the task.
The final draft agenda of 128 questions was disseminated widely among the membership for comment. The field review version of the agenda was mailed to all members of the Section on Research, all academic administrators of physical therapist education programs, all component presidents, a random sample of 500 clinical specialists certified by the American Board of Physical Therapy Specialties (ABPTS), and a random sample of 500 additional members of APTA. Respondents' tasks were to rate each question based on the importance of the question to a clinician and how often the clinician would use the answer to a particular question in clinical practice. A total of 227 copies of the review form were returned, including forms from 22 components.
| Analysis of Field Review |
|---|
|
|
|---|
The formulation of a composite measure that could represent the overall research priority of a question was explored. Five different methods of calculating a composite score were evaluated. Three of these methods yielded scores that were sums of the number of individuals who rated each question at or above designated values on the scale. The first composite measure was a sum of the number of individuals who rated a question as "important" (4) or "extremely important" (5) on the importance measure plus the number of individuals who rated the question as "often" (4) or "very often" (5) on the frequency measure.
The second method for determining a composite score was based on a sum of individuals who rated a question at or above the midpoint of either rating scale (eg, "moderately important," "important," or "extremely important" on the importance scale or "sometimes," "often," or "very often" on the frequency scale). The third composite score was determined from the number of individuals who rated a question at the highest rating point on either scale (ie, 5). The fourth composite was an average of how each question ranked on the first 3 composite scores. For example, let us assume that a particular research question had the highest composite score (ie, a ranking of 1 on the first method), the second highest score (ie, a ranking of 2 on the second method), and the fourth highest score by the third method for calculating a composite score (ie, a ranking of 4). The average ranking for this particular question would be 2.33 (ie, [1+2+4]/3=2.33). The fifth scoring method calculated a sum of the average importance rating and the average frequency rating.
Despite the inherent differences in the construction of the composite scores, all scores were highly related in terms of what they measured. Composite 1 has a correlation (Pearson product moment correlation coefficient) with each of the other composites of over .92 (P<.01). Even the composite scores related the least (those developed from composites 2 and 3) had a correlation over .77 (P<.01). These correlations indicated that the assignment of priority level would change little as a result of the approach selected to construct a composite score. Composite 5 was ultimately selected because it was straightforward in its interpretation and because all scale points of the ratings were taken into account.
The initial approach adopted for the assignment of priority level was to rank the questions with respect to their score using the fifth method and then identify breaks or gaps among groups of questions. The intent of this procedure was to base the assignment of priority level on naturally occurring characteristics of the distribution of scores. However, most of the 128 questions were considered to be "very important" by most respondents and were considered to be related to issues that have frequent clinical application. Of a possible maximum score of 10 (ie, an average importance rating of 5 plus an average frequency rating of 5), the average for all questions was 7.6±.64. As result of this clustering of questions at the upper end of the distribution, the only breaks in the distribution appeared at the low end, and these breaks involved only a few of the research questions.
Because the spread of scores had insufficient gaps in distribution to justify assigning level of priority, scores were investigated for statistically significant differences among questions. This approach proved to be of little value. With the exception of the 9 questions that were ranked lowest, no significant differences among questions were evident. Therefore, it was decided that the proportion of respondents at various ratings would be incorporated into the assignment of priority level. That is, priority would be assigned on the basis of the percentage of respondents who gave a question a particular rating regardless of the score. For example, a question that was rated by 100% of the respondents as extremely important and as occurring very often in practice would be assigned to the highest priority.
Four levels of priority were used. All of the questions in levels 1 through 3 had summed average importance and average frequency above 6.6 (ie, on a scale from 1 to 10). Level 1 contained those questions for which 40% or more of the respondents rated the question as extremely clinically important and occurring very often in clinical practice. Level 3 contained those questions for which 10% or more of the respondents rated the questions as unimportant or occurring infrequently. The boundaries of level 2 were scores for questions that fell between the criteria for level 1 and level 3. The fourth level included questions that had score values of less than 6.6. This group was identified by a break in the distribution of the scores at the low end. These definitions resulted in 14 questions at priority level 1, 40 questions at priority level 2, 65 questions at priority level 3, and 9 questions at priority level 4.
The analysis described above was performed using all 227 respondents. In order to determine whether clinicians who were not members of the Section on Research had different research priorities than clinicians who were members of the Section on Research, the sample was split into 2 parts, and the entire analysis was repeated for each part. In order to ensure that no questions thought to be important by either group were omitted from the agenda, questions that received a priority ranking of 1 or 2 in at least 1 of the 3 analyses (ie, the whole sample, the clinicians, or the nonclinicians) were included in the final agenda. The Table presents the ratings for each of the items comprising the draft agenda. The Table depicts ratings among clinicians, researchers, and all respondents to the field review. Note that each item that was included in the draft agenda is presented. The boldfaced items represent the questions included in the final agenda. The 72 questions comprising the final agenda adopted and promulgated by APTA's Board of Directors are included in the Appendix. A summary of the process to develop the final agenda is presented in Figure 2.
|
|
| Discussion |
|---|
|
|
|---|
The final Clinical Research Agenda of 72 questions was organized according to the elements of the physical therapist patient/client management model. The content represented by the questions covers the entire spectrum of physical therapist practice. Although the scope of the agenda is broad, the agenda is held together by the use of the patient/client management model as the foundation for each of the questions. This model was designed to provide a framework for intervention that will lead to optimal outcomes. Thus, by having access to the answers to those questions comprising the agenda, clinicians will be able to practice through the use of evidence that is not currently available. This evidence can be used to build the scientific base of physical therapy, and clinical practice should be enhanced.
It is crucial to note that no element of physical therapist patient/client management is without a substantial number of questions. These 72 questions, although often particular to a disease, condition, or site, are universal to scientific clinical practice in all disciplines, including physical therapy. Therefore, the fact that there is a plethora of unanswered questions does not mean that there is a lack of scientific underpinning to the clinical care provided by physical therapists. On the contrary, most physical therapist practice has almost always been justifiable on the grounds of the biological plausibility of its intervention. Rather, the breadth of the Clinical Research Agenda indicates that the time-tested practice of physical therapists can evolve into a full-blown science of physical therapy. There is hope that the completion of this first Clinical Research Agenda will culminate in a radical change in the profession: the full metamorphosis of the physical therapist into a scientific practitioner.
Although the Clinical Research Agenda has been developed, the process for increasing the scientific base of the profession is far from complete. The APTA is now challenged to ensure that these questions generate appropriate and timely scientific investigations in the physical therapy profession as well as in other professions and disciplines. The Foundation for Physical Therapy has already committed itself to taking the necessary steps to ensure that the Foundation's research program will be driven by those questions comprising the Clinical Research Agenda. In fact, discussions have already begun to develop the most effective infrastructure to ensure that funded research will be undertaken to answer these questions.
Physical therapy cannot rely solely on the resources of the Foundation for Physical Therapy or APTA to answer these questions, however. Other funding agencies, as they attempt to fulfill their own research mission, should recognize the contribution of this agenda to the health of the nation.
For example, the APTA Clinical Research Agenda has highlighted a number of questions related to the care of individuals with dysfunction of the musculoskeletal system, specifically low back pain. Any merger of the research program of other funding agencies (eg, the National Institutes of Health, the National Institute for Disability Research and Rehabilitation, the Agency for Health Care Research and Quality, private foundations) and some of the 72 questions listed in this agenda should benefit patients and stimulate and influence the direction of scientific inquiry.
Strategies for implementation of the agenda remain to be determined. It will be incumbent upon physical therapist researchers to compare APTA's agenda with the programs of various agencies. The response to the agenda may entail collaborative efforts with colleagues from other professions or disciplines. Physical therapists may not necessarily be the primary investigator in these studies. It may also be necessary to involve those outside the profession in the conduct of studies to answer identified questions and have physical therapists serve as contributors of data or in some other consultative manner. These strategies can be articulated to a greater extent in the near future. What remains most important, however, is the fact that the APTA Clinical Research Agenda took a substantial commitment of time and effort, and the work devoted to the creation of the agenda must be continued to enhance the contribution that has been made thus far.
Data obtained by use of this agenda, in concert with data from studies examining questions not included in the agenda, should provide coherence to the clinical research effort with the profession. The clinically relevant questions that have been generated should, when answered, expand the scientific base of physical therapy and have an impact on the provision of physical therapy services. This should enhance the quality of the outcomes of this care. The Clinical Research Agenda can serve as a benchmark for the systematic progression of physical therapy science. It can, and will be, re-evaluated periodically by APTA and its members to assess its relevance and effectiveness in assisting the profession in refining and expanding the scientific basis for clinical practice. If answers to the 72 questions in the agenda can be obtained and generally incorporated into clinical practice in the immediate future, the scientific basis of physical therapy practice should be enhanced to an extent never before seen. In addition, practice will have been shaped by facts and data, and that will not only justify reimbursement but also allow therapists to apply the most effective interventions possible. Failure to make substantial progress toward completion of the agenda within the next 5 years, however, would hinder the scientific development of the profession. It would also mark physical therapy as a profession unwilling to examine itself and to be accountable for what it does, unlike other professions that now more than ever realize a need for evidence-based practice. This would be a detriment not just to the profession but also to patients.
The physical therapy profession has its roots in rehabilitation of those injured by national calamities, epidemic diseases, and wars. The profession grew out of national need to alleviate human suffering, and it continues to be recognized for the humanistic qualities of its members. A profession, such as physical therapy, that has been able to mobilize resources in times of national need should be able to respond to this call for research by the year 2005. To do less would betray the physical therapy profession's moral mission, a mission aimed at assisting in the achievement of optimal human function.
| Appendix |
|---|
|
|
|---|
|
| Footnotes |
|---|
APTA Board of Directors Liaisons to the Clinical Research Agenda Conferences and the conference participants were Jan K Richardson, PT, PhD, OCS, President, and Jayne L Snyder, PT, MA, Vice President.
The Editorial Advisory Panel consisted of Rebecca L Craik, PT, PhD, FAPTA; Janet Gwyer, PT, PhD; Diane U Jette, PT, ScD; Jules M Rothstein, PT, PhD, FAPTA; Ann F VanSant, PT, PhD. APTA staff who assisted in the development of the Agenda were: Andrew A. Guccione, PT, PhD, FAPTA; Marc Goldstein, EdD; Steven Elliott, PhD; M Scott Sullivan, PT, PhD; Lisa Culver, PT, MBA; Allen Wicken, PT, MS; Mary Jane Harris, PT, MS; Jody Gandy, PT, PhD; Tracy Temanson, MSLS; Michele Katsouros; Rene Malone; and Sarah C Miller.
Writing and statistical analysis were provided by Andrew A Guccione, PT, PhD, FAPTA, Senior Vice President, Division of Practice and Research, American Physical Therapy Association (APTA), Alexandria, Va (andrewguccione{at}apta.org); Marc Goldstein, EdD, Director, Research Services, APTA; and Steve Elliott, PhD, Director of Analytic Support, APTA.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
R. L Craik Never Satisfied Physical Therapy, November 1, 2005; 85(11): 1224 - 1237. [Full Text] [PDF] |
||||
![]() |
P. J Rundquist and P. M Ludewig Correlation of 3-Dimensional Shoulder Kinematics to Function in Subjects With Idiopathic Loss of Shoulder Range of Motion Physical Therapy, July 1, 2005; 85(7): 636 - 647. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. A Koumantakis, P. J Watson, and J. A Oldham Trunk Muscle Stabilization Training Plus General Exercise Versus General Exercise Only: Randomized Controlled Trial of Patients With Recurrent Low Back Pain Physical Therapy, March 1, 2005; 85(3): 209 - 225. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. L Swisher, J. W Beckstead, and M. J Bebeau Factor Analysis as a Tool for Survey Analysis Using a Professional Role Orientation Inventory as an Example Physical Therapy, September 1, 2004; 84(9): 784 - 799. [Abstract] [Full Text] [PDF] |
||||
![]() |
J Nijs, K De Meirleir, S Wolfs, and W Duquet Disability evaluation in chronic fatigue syndrome: associations between exercise capacity and activity limitations/participation restrictions Clinical Rehabilitation, February 1, 2004; 18(2): 139 - 148. [Abstract] [PDF] |
||||
![]() |
J. M Rothstein If the Only Journal You Read... Physical Therapy, February 1, 2003; 83(2): 110 - 111. [Full Text] |
||||
![]() |
A. M Jette Invited Commentary Physical Therapy, February 1, 2003; 83(2): 131 - 132. [Full Text] [PDF] |
||||
![]() |
E. M Frese, R. R Richter, and T. V Burlis Self-Reported Measurement of Heart Rate and Blood Pressure in Patients by Physical Therapy Clinical Instructors Physical Therapy, December 1, 2002; 82(12): 1192 - 1200. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. L Wolf "Look Forward, Walk Tall": Exploring Our "What If" Questions Physical Therapy, November 1, 2002; 82(11): 1108 - 1119. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. L. Swisher A Retrospective Analysis of Ethics Knowledge in Physical Therapy (1970-2000) Physical Therapy, July 1, 2002; 82(7): 692 - 706. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J Mueller and K. S Maluf Tissue Adaptation to Physical Stress: A Proposed "Physical Stress Theory" to Guide Physical Therapist Practice, Education, and Research Physical Therapy, April 1, 2002; 82(4): 383 - 403. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. F Massey Jr We Have Arrived! Physical Therapy, November 1, 2001; 81(11): 1830 - 1833. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M Fritz and R. S Wainner Examining Diagnostic Tests: An Evidence-Based Perspective Physical Therapy, September 1, 2001; 81(9): 1546 - 1564. [Abstract] [Full Text] [PDF] |
||||
![]() |
G K. Fitzgerald and A. Delitto Considerations for Planning and Conducting Clinic-Based Research in Physical Therapy Physical Therapy, August 1, 2001; 81(8): 1446 - 1454. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L Craik A Tolerance For Ambiguity Physical Therapy, July 1, 2001; 81(7): 1292 - 1294. [Full Text] |
||||
![]() |
J. M Rothstein Sick and Tired of Reliability? Physical Therapy, February 1, 2001; 81(2): 774 - 775. [Full Text] |
||||
![]() |
J. M Rothstein Election Night Lessons Physical Therapy, December 1, 2000; 80(12): 1162 - 1163. [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |