| 2008 JASN IMPACT FACTOR 7.505 | HOME AUTHOR INFO EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP | |||
| CURRENT ISSUE | ARCHIVES | JASN Express | ONLINE SUBMISSION | |
SPECIAL REPORT |

*
Yale University School of Medicine, New Haven, Connecticut
Mayo Clinic, Jacksonville, Florida
Correspondence to Dr. Alan S. Kliger, New Haven CAPD, 136 Sherman Avenue, New Haven, CT 06510. Phone: 203-773-0853; Fax: 203-776-2904; E-mail: AKliger{at}compuserv.com
Abstract
Abstract. Clinical practice guidelines (CPGs) for end-stage renal failure (ESRD) were recently published, and represent a comprehensive review of available literature and the considered judgment of experts in ESRD. To prioritize and implement these guidelines, the evidence underlying each guideline should be ranked and the attributes of each should be defined. Strategies to improve practice patterns should be tested. Focused information for each high priority guideline should be disseminated, including a synopsis and assessment of the underlying evidence, the evidence model used to develop that guideline, and suggested strategies for CPG implementation. Clinical performance measures should be developed and used to measure current practice, and the success of changing practice patterns on clinical outcomes. Individual practitioners and dialysis facilities should be encouraged to utilize continuous quality improvement techniques to put the guidelines into effect. Local implementation should proceed at the same time as a national project to convert high priority CPGs into clinical performance measures proceeds. Patients and patient care organizations should participate in this process, and professional organizations must make a strong commitment to educate clinicians in the methodology of CPG and performance measure development and the techniques of continuous quality improvement. Health care regulators should understand that CPGs are not standards, but are statements that assist practitioners and patients in making decisions.
The National Kidney Foundation (NKF) Dialysis Outcomes and Quality Initiative (DOQI) Clinical Practice Guidelines (CPGs) have been published recently (1,2). The 114 guideline statements represent the most comprehensive and systematic review of available literature on dialysis practice and outcomes yet published, covering the areas of hemodialysis adequacy, peritoneal dialysis adequacy, vascular access, and anemia management. Many of these guideline statements are based on published evidence, and where evidence was not available or was insufficient, on consensus opinion of expert work group members. A systematic review of the literature was performed, and an in-depth assessment of quality of the literature was done to guide panel deliberations. The practicing nephrologist, other nephrology professionals, and patients now will have several questions and issues to ponder as they focus on implementing practice guidelines:
The purpose of this special article is to explore these questions, to help provide renal disease professionals and patients with an approach to the use of CPGs in general, and to the NKF/DOQI publication in particular. Since many renal care teams are working with the DOQI CPGs, this is an opportune time to review the usefulness and the limitations of practice guidelines. We propose a strategy for implementing CPGs, including a national level collaborative effort of professional organizations, with a local effort to engage practitioners and patients by encouraging their participation in this process.
What are Clinical Practice Guidelines (CPGs)?
CPGs, as defined by the Institute of Medicine (3) and the American Medical Association (AMA) (4), are systematically developed statements based on current professional knowledge, which are not standards of care, but are intended to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances. In actual practice, each clinical circumstance is unique, and many factors other than published clinical results contribute to clinical decisions. These factors include patient and physician choices and characteristics including cultural beliefs, personal values, experiences, and education (5). Other factors contributing to clinical decisions are constraints, such as formal policies, laws, community standards, time, and reimbursement (5). Practice guidelines can help guide clinical decision-making in this complex environment. Just how powerful a tool a particular CPG can be to assist practitioner and patient decisions depends on the attributes of that guideline, and on the strength of the published evidence underlying it.
How were the NKF/DOQI CPGs developed? The authors state that criteria developed by the Agency for Health Care Policy and Research (AHCPR) were used to select guideline topics (1,2): (1) prevalence of the clinical condition; (2) morbidity and mortality associated with the condition; (3) costs of the condition to third party payers and patients; (4) variability in practice; (5) adequacy of scientific evidence related to the topic; and (6) likelihood of being able to change clinical practice. Based on these criteria, four topics for initial guideline development were chosen: hemodialysis adequacy, peritoneal dialysis adequacy, management of vascular access, and management of anemia. Work groups were assembled, including recognized experts in each field. The available literature was reviewed using a defined method, and each group developed a series of statements that were designated as evidence-based, opinion-based, or a combination of evidence and opinion, with a rationale given for each statement. A larger group of clinicians, experts, and organizations participated in the review of this work before publication.
The AHCPR methodology used in the development of these CPGs (6) suggests that for each CPG the domain of interest must be specifically defined and an evidence model should be developed that describes how clinical outcomes are influenced. The patient population studied by each CPG should be clearly defined by inclusion and exclusion criteria. A definition for admissible evidence should be established. Clinical measures in the domain of interest for each CPG should be defined and should be inherently "actionable" by the clinician. The scientific evidence underlying each CPG should be reviewed and ranked according to the quality of the study. Possible benefits and harms of implementing each CPG should also be described. Public policy considerations should include cost and feasibility of implementation, concerns of patients, practitioners and payers, and the potential use by regulatory agencies. These and other AHCPR guideline attributes are helpful in assuring clinicians that all of the appropriate issues have been considered. Despite the rigorous methodology of the DOQI CPG development, the unevenness of available literature in areas of guideline development produced a variable content with regard to these AHCPR criteria. Some guideline statements possess inherent qualities that can be measured, while others do not. Several guideline statements suggest interventions for the management of specific clinical circumstances, while others do not.
The following example illustrates how a guideline can be described using the AHCPR characteristics. Guideline 1 for Hemodialysis Adequacy concerns the regular measurement of the delivered dose of hemodialysis (evidence-based). It states, "The failure of a dialysis care team to routinely measure and monitor the delivered dose of hemodialysis is not an acceptable clinical practice." This guideline has strong support in the literature, with ample evidence that the clinical outcome for hemodialysis patients can be correlated to the delivered dose of dialysis. The population to be studied is all hemodialysis patients. The domain of interest is the measured delivered dose of dialysis. It can be measured, and the clinician has the inherent ability to increase the number of patients with regularly measured dose (e.g., Kt/V urea). The expected outcomes of a change in practice patterns to routinely measure delivered dose can be measured, as percent of patients each month with measured Kt/V urea. This guideline is defined clearly and can be implemented easily in clinical practice. A similar assessment of each CPG statement will help define how likely they are to improve clinical care. For those that do not contain the needed attributes, it is possible that further refinement will result in a guideline that will be acceptable to clinicians and useful in day-to-day practice.
Evaluating the Strength of Evidence
What is the strength of evidence underlying each guideline, and how can it be judged? Of the 114 DOQI guideline statements, 27 are evidence-based, 56 are opinion-based, and 31 are combined evidence- and opinion-based (1,2). Although the published DOQI guidelines do not detail the process used to review the scientific evidence underlying each CPG, critical appraisals of the quality of evidence were performed (Earl Steinberg, personal communication). A published classification or ranking of the evidence cited with each guideline statement would be helpful to integrate heterogeneous data sources (7). The AHCPR has published a methodology for ranking clinical studies and has suggested a hierarchy of types of evidence from randomized clinical trials to observational studies (8). The new discipline of evidence-based medicine likewise defines criteria that can be used to evaluate the strength of published information (9). Factors other than study design affect the strength of evidence, including sample size, recruitment bias, losses to follow-up, atypical patient groups, and impractical clinical settings (10). An evaluation of the evidence underlying each guideline would be helpful to nephrologists as they decide how to use these guidelines (11).
Prioritizing the Guidelines
With 114 guidelines, where do we start? How can a nephrologist and the care team select for implementation those CPGs most likely to result in improved patient care? In addition, how can we look nationwide at practice patterns to make excellent care more uniformly available? We believe that CPGs need to be prioritizedon a local level for focused quality improvement, and on a national level for identification of best practice models and dissemination of strategies to improve patient care. Practice guidelines can be ranked in several ways: (1) How clinically important is this guideline? Does it address a problem area? (2) How convincing is the underlying evidence or opinion supporting this guideline? (3) What are the ease of measurement and the practicality of implementing this guideline? Locally ranked guidelines can be used for CQI, while a national ranking will be used to develop clinical performance measures (tools that can be provided to local care teams to be used to measure performance in the domain of the CPG).
Implementing Practice Guidelines
Berwick writes that improving daily practice of medicine requires making changes in the processes of care (12). He suggests that individual clinicians have a powerful tool to do thisthe process of plan, do, study, and act that defines CQI. Nephrologists and care teams can use CPGs as a starting point in this process. To implement a CPG, several steps are necessary. First, current practice must be measured in the domain of interest, and compared to the CPG recommendation. If current clinical practice does not "measure up" to the recommendation, then a change in practice patterns that is expected to change in a positive way the measurable outcome must be designed (PLAN), then implemented (DO). The clinical outcome of this new practice pattern is then measured to see if it indeed was improved (STUDY). Results of these outcome measures are reviewed and practice patterns are refined as necessary (ACT). The process of CQI goes beyond the guidelines (13). Furthermore, the data generated by this process are used to review and revise the CPG. To perform this iterative process, the specific processes or outcomes must be defined for each guideline, and ways to measure them must be established. Clinical performance measures are being developed to quantify outcomes or processes defined by the CPGs.
Avoiding Misuse of Clinical Practice Guidelines
Clinical practice guidelines can be used for several different purposes. As
summaries of best available evidence and expert opinion about specific aspects
of care, they inform the care team and the patient for optimal decision-making
and prescription formulation. In this way, CPGs are used as information tools.
Furthermore, care teams use CPGs in their CQI activitiesas goals and
benchmarks of best-known care. There is a risk, however, that CPGs can be
misused. Regulators may use CPGs to define minimally acceptable standards of
care for licensing, accreditation, and even to determine reimbursement to
practitioners. In addition, selected guidelines may be incorporated into the
Health Care Financing Administration (HCFA) Conditions of Coverage for
dialysis facilities. It is indeed important that minimally acceptable
standards of care and conditions of coverage be established for dialysis care.
If CPGs are selected for these purposes, however, they must be defined
differently than CPGs used for quality improvement. CPGs defining standards of
care must have the strongest support of underlying evidence, must be easily
and serially measured with well defined measurement techniques, and must have
wide community support as appropriate standards of care. In comparison, if
CPGs are used for local quality improvement activities, they may be opinion-
or evidence-based, and local care teams can be creative in devising ways to
measure adherence to the guidelines. The best or most important guidelines for
quality improvement activities may be different from those selected for
standards of care or conditions of coverage. It is important that the HCFA,
state Departments of Health, and other regulators understand these differences
and not misuse CPGs. For example, if a delivered hemodialysis dose
(e.g., Kt/V urea 1.2) is used in quality improvement, patients
receiving a lower dose can be analyzed and factors identified that might
increase the urea clearance. If, on the other hand, Kt/V
1.2 is defined
as a minimal standard of care, patients receiving a lower dose (e.g.,
those declining longer dialysis time, or large patients with poor vascular
access) may be shunned by practitioners anxious to adhere to care standards,
or even denied care. Great care must be taken to select standards of care that
will ensure patient safety and encourage optimal care.
Engaging Patients in the Process
Eddy (14) has described medical decision-making as a two-step process: In step 1, facts are assembled and the evidence is analyzed. In step 2, each decision-maker (patient and caregiver) uses informed personal judgment about the importance of the outcomes and risks of each treatment option to make a medical decision. Elements of personal judgment include individual values, cultural beliefs, education, and previous experiences (5). The facts and evidence in step 1 are objective, while the judgments in step 2 are subjective. For this reason, each patient and caregiver given the same information in step 1 may come to a variety of conclusions and medical decisions in step 2. This observation on the anatomy of clinical decision-making has important practical implications in CPG development and implementation. First, patients and patient organizations should play an integral role in the process of guideline refinement and implementation. In this way, patients can be empowered to participate in a process to improve their health, an experience that is likely to inform their personal judgments. Several patients participated in the DOQI CPG development, and patient organizations participated in the peer review process. Second, it must be explicitly acknowledged that individual patients always have the right to make decisions about their care. Whatever the view of the expert community in a given CPG area, it is the patient who must live with the consequences of a medical decision, and his/her view must prevail (15). When clinicians and individual patients come to different conclusions about medical decisions, even after they have considered the same facts and evidence, the patient always makes the final decision. The process of CQI and oversight of clinical outcomes by dialysis centers, regulators and managed care organizations must make provisions to acknowledge this, and to measure the effect of patient autonomy and individual choice on cumulative outcomes. Of course, it is the responsibility of the clinician to inform each patient as best he can, and to explain the rationale for the clinician's best judgment. In most circumstances, patients and clinicians will come to the same conclusions about medical care as CPGs are implemented.
Where Do We Go from Here?
The publication of the NKF/DOQI is a major first step in the process of quality improvement. Although their work was extensive, it was not exhaustive. For example, although fluid removal is an important aspect of dialysis adequacy, it is not addressed in the current CPGs. Guidelines in other important areas are under consideration or in development, including nutrition, bone disease and calcium metabolism, initiation and withdrawal of dialysis, pediatric ESRD, and use of laboratory tests. To continue the quality improvement process for the current CPGs, we believe that we should:
Summary
The publication of the NKF/DOQI CPGs is an important first step in a process of quality improvement for dialysis patients. A review of these CPG statements using AHCPR methodology and a ranking of the underlying evidence for each guideline will help clinicians prioritize the guidelines and will help foster widespread implementation. An effective plan for implementation will include pilot testing strategies to change practice patterns, and using clinical performance measures to assess the success of these changes. Patients and patient organizations should be encouraged to participate in this process, and methods to measure the effects of patient judgments on outcome measures should be developed. Professional organizations such as the RPA, the NKF, the ASN, and the Forum of ESRD Networks should make a strong commitment to continuing education of clinicians in the methodology of CPG and clinical performance measure development, and the tools and techniques of CQI. If a process of quality improvement for our patients is to succeed, it will ultimately depend on local action by nephrologists, the care team, and the patients.
The entire renal community has a stake in this process. The development, implementation, and continuous refinement of CPGs will, if applied properly, result in improved survival and quality of life for ESRD patients. The success of quality improvement depends on the use of CPGs, performance measures, and CQI by individual nephrologists, care teams, and patients. Organizations of renal professionals, patients, and administrators also must work together toward this end. In the process of gaining such whole community "buy-in," we should not lose sight of the fact that every organization and individual comes to the table with its own unique perspective. By taking all of these perspectives together, and by drawing on our various skills and experiences, we can craft a process that will best serve our patients. The NKF has already published its commitment to the education of patients and ESRD professionals (18). The RPA and ASN, in collaboration with the Forum of ESRD Networks, has undertaken the task of organizing a community effort toward implementing this process. We are pleased that the American Association of Kidney Patients, the American Nephrology Nurses Association, and National Renal Administrators Association has joined this effort, and we hope that other individuals and organizations will follow.
Acknowledgments
Acknowledgments
The authors thank Drs. Chaim Charytan, Louis Diamond, Allen Nissenson, and Earl Steinberg for their suggestions and advice.
Footnotes
American Society of Nephrology
References
This article has been cited by other articles:
![]() |
C. Couchoud, K. J. Jager, C. Tomson, J.-F. Cabanne, F. Collart, P. Finne, A. de Francisco, L. Frimat, L. Garneata, T. Leivestad, et al. Assessment of urea removal in haemodialysis and the impact of the European Best Practice Guidelines Nephrol. Dial. Transplant., April 1, 2009; 24(4): 1267 - 1274. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. B. Patwardhan, D. B. Matchar, G. P. Samsa, and W. E. Haley Opportunities for Improving Management of Advanced Chronic Kidney Disease American Journal of Medical Quality, June 1, 2008; 23(3): 184 - 192. [Abstract] [PDF] |
||||
![]() |
F. Locatelli, S. Andrulli, and L. Del Vecchio Difficulties of implementing clinical guidelines in medical practice Nephrol. Dial. Transplant., September 1, 2000; 15(9): 1284 - 1287. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
HOME
CURRENT ISSUE
ARCHIVES
JASN Express
ONLINE SUBMISSION
AUTHOR INFO
EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP |