| 2008 JASN IMPACT FACTOR 7.505 | HOME AUTHOR INFO EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP | |||
| CURRENT ISSUE | ARCHIVES | JASN Express | ONLINE SUBMISSION | |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Clinical Nephrology |




* Cardiovascular Clinical Research,
Clinical Development, and
Medical Communications Department, Merck & Co., Inc., West Point, Pennsylvania;
Medical Department, Aarhus University Hospital, Aarhus, Denmark; || Clinical Pharmacology, University Medical Center Groningen, Groningen, Netherlands; and ¶ Renal Division, Brigham and Womens Hospital, Boston, Massachusetts
Address correspondence to: Dr. Zhongxin Zhang, Merck & Co., Inc., P.O. Box 4, BL 34, West Point, PA 19486. Phone: 484-344-3871; Fax: 484-344-4000; E-mail: zhongxin_zhang{at}merck.com
Received for publication August 3, 2004. Accepted for publication March 17, 2005.
| Abstract |
|---|
|
|
|---|
2000 mg/g, within the higher proteinuria stratum (
2000 mg/g), patients in the losartan group had a higher baseline mean proteinuria value. When the imbalance was adjusted, an increase in the magnitude and the significance of the risk reduction with losartan for each outcome was observed. No apparent interaction between treatment effect and baseline proteinuria was found, and there was no heterogeneity in the treatment response in patients with different baseline proteinuria levels. After proteinuria was adjusted as a continuous variable, greater treatment effects were observed in the RENAAL study. This effect was due solely to the imbalance in baseline proteinuria. Considering the importance of proteinuria as a risk factor, adjustment for baseline proteinuria as a continuous covariate should be prespecified in the design and analysis of clinical trials involving renal outcomes, even when patients are stratified on the basis of level of proteinuria. | Introduction |
|---|
|
|
|---|
An imbalance of an important covariate at baseline between treatment groups is of considerable concern if one treatment group is favored over another with respect to the primary (hypothesis testing) outcome. A recent survey of 50 clinical studies (1) showed that baseline covariate differences were noted in 17 (34%). In the International Conference on Harmonization 9 guidelines, investigators are advised to identify the covariates that may influence the primary outcome and to prespecify the method to be used to account for them to compensate for any imbalance between groups. A baseline covariate can be considered at two separate stages in a clinical trial: in the randomization process (using stratified randomization), or alternatively in the data analysis. Regardless of method used, it is important to identify covariates and to prespecify how they will be addressed. This important point is the subject of new guidelines released by the Committee for Proprietary Medicinal Products (The European Agency for the Evaluation of Medicinal Products) (2). The techniques used for adjusting a covariate in statistical analyses are dependent on the nature of the covariate or the outcome, the relationship between the covariate and the outcome variable, and the statistical model used in the analysis. For most time-to-event analyses, a Cox proportional hazards regression model is widely used. When a continuous covariate, such as proteinuria, is stratified at randomization, there are two ways to adjust for it in the analysis: Using the stratum factor to reflect the dependence of baseline hazard risk on the covariate or by including the continuous covariate in the model. Understanding the merits and limitations for each method is important for clinical trialists to plan an analysis in advance and to explain the results to clinicians.
To explore the effect of adjusting for baseline covariates in different ways, we used the Reduction in Endpoints in NIDDM with the Angiotensin II Antagonist Losartan (RENAAL) study as an example. It has been known for some time that proteinuria is a strong predictor of risk for the progression of renal disease to ESRD in patients both with and without diabetes (37). The RENAAL study examined the treatment effect of losartan on a composite endpoint that was composed of the doubling of the serum creatinine concentration, ESRD, or death. As such, the primary outcome and its renal components would be expected to be highly influenced by proteinuria levels. Therefore, the RENAAL study was designed to account for proteinuria as a covariate using stratified randomization (8). Patients were stratified into two groups according to their baseline proteinuria levels: <2000 mg/g and
2000 mg/g (determined as the ratio of milligrams of urinary albumin to grams of urinary creatinine). It was assumed that this stratification would sufficiently account for proteinuria as a covariate and would prevent any imbalance between the treatment groups.
The aim of this post hoc analysis was to explore the effect of adjusting for baseline proteinuria as a continuous variable compared with the original adjustment by proteinuria strata on the primary endpoint, the composite of ESRD or death, and ESRD alone in the RENAAL study. The potential reason for differences between the two methods was also examined.
| Materials and Methods |
|---|
|
|
|---|
-blockers, centrally acting agents, and diuretics, excluding angiotensin-converting enzyme inhibitors or other angiotensin receptor antagonists) were permitted to reach the goal BP of <140/90 mmHg (systolic/diastolic). Patients were followed for a mean of 3.4 yr (range 2.3 to 4.6). Because of a small number of patients expected to be enrolled at most investigative sites, a blocking factor of 2 was used in the generation of random numbers.
Patient Population
A total of 1513 patients with type 2 diabetes and nephropathy, aged 31 to 70 yr and of both genders, were randomized into the study. Nephropathy was defined by the presence on two occasions of a ratio of urinary albumin to urinary creatinine excretion in a morning specimen of 300 mg/g (or a rate of urinary protein excretion of at least 0.5 g/d) and serum creatinine values between 1.3 and 3.0 mg/dl, with a lower limit of 1.5 for male patients who weighed >60 kg. There was no upper limit of proteinuria required for patients who were randomized into the study.
Outcomes
The primary outcome of the RENAAL study was a composite of the doubling of serum creatinine, ESRD, or death from any cause. In addition, prespecified endpoints included the individual components (doubling of serum creatinine, ESRD, or death) as well as the composite endpoint of ESRD or death.
Statistical Analyses
The prespecified primary (original) analysis has been described elsewhere in detail (9). Briefly, intention-to-treat analysis using a stratified Cox regression model adjusted by treatment (losartan versus placebo) and region (North America, Latin America, Europe, and Asia) was performed. The baseline hazard function was stratified by baseline proteinuria levels (urinary albumin to creatinine ratio of <2000 or
2000 mg/g), in agreement with the randomization procedure. In addition, the interaction between treatment response and proteinuria stratum was explored.
Consistent with the prespecified analyses, post hoc analyses include all 1513 randomized participants in the RENAAL study. The relationship between baseline renal function (determined by level of proteinuria) with renal endpoints was explored. Baseline proteinuria was divided into four categories (<1000, 1000 to 2000, 2000 to 4000, and
4000 mg/g). The categories were chosen ad hoc, with the aim of providing a partition within each original prespecified proteinuria stratum. A multivariate Cox regression model was performed with indicators of proteinuria categories as covariates. The lowest category was used as a common reference to compute the hazard ratio and 95% confidence interval for the remainder of the categories.
To explore whether the response to treatment was homogeneous over all levels of renal impairment, we conducted two analyses: (1) The interaction of treatment effect and baseline proteinuria was examined using a multivariate Cox model with treatment group, region, continuous proteinuria, and the interaction of treatment group with proteinuria included in the model; and (2) the response to treatment effect across baseline proteinuria categories (<1000, 1000 to 2000, 2000 to 4000, and
4000 mg/g) was determined using a Cox model with region, proteinuria subgroup, and the interaction of treatment group with proteinuria category included in the model.
To determine whether baseline proteinuria was balanced between the treatment groups, we performed a comparison that included all patients within each randomization stratum in proteinuria. The P value was calculated using the Wilcoxon sum rank test.
To explore the effect of adjusting for baseline proteinuria as a continuous variable (referred to as the adjusted model) compared with the original adjustment by proteinuria strata (referred to as the original model), we used a Cox model; however, baseline proteinuria strata (<2000 or
2000 mg/g) was replaced with continuous proteinuria as an additional covariate. In contrast to the Kaplan-Meier curves without any adjustment, the event curves were also adjusted by continuous proteinuria at baseline using the Cox modelbased product-limit estimate (10).
All statistical analyses were performed using SAS version 8. All tests were two-tailed. The P value for statistical significance was P < 0.05, with the exception of the primary endpoint analyses, for which statistical significance was considered at P < 0.048, which is consistent with the originally published findings for the RENAAL study.
| Results |
|---|
|
|
|---|
4000 mg/g, the effect was even more pronounced, with a 16.8-fold increased risk for developing ESRD.
|
|
2000 mg/g proteinuria stratum, in which patients in the losartan group had a median protein excretion of 3460.3 mg/g, whereas those in the placebo group had a median protein excretion of 3136.5 mg/g (P = 0.0117). No significant difference in median baseline proteinuria was observed between the treatment groups for patients in the lower proteinuria stratum (<2000 mg/g; Figure 2).
|
|
|
2000 mg/g stratum. | Discussion |
|---|
|
|
|---|
The aim of a randomized clinical trial is not to determine the relationship between a covariate and the outcome variable; however, the relationship between a covariate and the outcome may affect the statistical analysis and thereby the interpretation of the results. The estimated treatment effect based on a model adjusted for a significant covariate may be influenced by any of the following factors: (1) The association of a covariate with the outcome, (2) an imbalance in the covariate between the treatment groups, (3) the interaction of treatment effect and covariate, and (4) inclusion of the covariate in the model. This analysis demonstrated that significant improvement in the treatment effect in the post hoc analysis was not due to a meaningful interaction between proteinuria and treatment effect, and there was not a significant effect of heterogeneity in treatment response to losartan. The greatest contributing factor to the difference in treatment response between the two analyses was the imbalance in baseline proteinuria.
On the basis of available outcomes data at the time of its design, the RENAAL study was designed to stratify proteinuria at randomization. Despite this, a higher mean level of baseline proteinuria was observed in the losartan group. The reason for the observed imbalance is not clear. However, few patients per site and many patients with large values of proteinuria may have increased the chance of an imbalance between the two treatment groups. In addition, the lack of an upper limit for proteinuria at baseline increased the likelihood that an imbalance might occur. In contrast to proteinuria, 14 other baseline covariates, which were prespecified in the original analysis, were not significantly different between the treatment groups. Furthermore, adjusting for the 14 variables in the analysis did not result in a change in the treatment effect despite some of them being strong predictors for the outcomes.
Because of the importance of baseline proteinuria on renal outcome, simple stratification may not result in balance. We propose that it be addressed by stratification at randomization with strata that have defined upper limits or better blocking paradigms or by treating proteinuria as a continuous variable in the Cox model. Regardless of which method is used, the decision should be prespecified at the time of study design. If adjustment for proteinuria occurs, then it is important to confirm that there is no meaningful interaction between proteinuria and treatment effect and that the response to treatment is consistent across all levels of baseline proteinuria. In studies with small numbers of patients, this is most easily achieved by an interaction test, whereas in larger studies, analysis by subgroup is more appropriate. Importantly, adjustment of baseline proteinuria as a continuous covariate when an imbalance occurs at baseline may not always improve the treatment effect, although it is likely to improve the estimate of the treatment effect. For example, if the imbalance had occurred in the placebo arm, then the adjustment would have resulted in a decrease in the treatment effect observed with losartan. Of interest, the RENAAL study is not the only large, randomized, double-blind, placebo-controlled renal outcomes study that has shown an imbalance in baseline proteinuria. Of seven major renal outcomes trials (9,1116) completed within the past 15 yr, an imbalance in baseline proteinuria was observed in two of the studies (9,14).
The intention of this article was not to correct the estimate of the treatment effect reported for the RENAAL study; the goal was to illustrate the conditions under which covariate adjustment should occur and how it can affect the estimate of the treatment effect. In future clinical studies on renal endpoints, every effort should be made to reduce and correct for the imbalance of baseline proteinuria that may occur by chance. Including proteinuria as a covariate in the analysis should be considered in the primary analysis even with stratification for proteinuria at randomization.
| Acknowledgments |
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
A. M. O'Hare, J. S. Kaufman, K. E. Covinsky, C. S. Landefeld, L. V. McFarland, and E. B. Larson Current Guidelines for Using Angiotensin-Converting Enzyme Inhibitors and Angiotensin II-Receptor Antagonists in Chronic Kidney Disease: Is the Evidence Base Relevant to Older Adults? Ann Intern Med, May 19, 2009; 150(10): 717 - 724. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Ruggenenti, E. Perticucci, P. Cravedi, V. Gambara, M. Costantini, S. K. Sharma, A. Perna, and G. Remuzzi Role of Remission Clinics in the Longitudinal Treatment of CKD J. Am. Soc. Nephrol., June 1, 2008; 19(6): 1213 - 1224. [Full Text] [PDF] |
||||
![]() |
A. T. Lely, F. G.H. van der Kleij, T. J. Kistemaker, A. J. Apperloo, P. E. de Jong, D. de Zeeuw, and G. Navis Impact of the Preintervention Rate of Renal Function Decline on Outcome of Renoprotective Intervention Clin. J. Am. Soc. Nephrol., January 1, 2008; 3(1): 54 - 60. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
HOME
CURRENT ISSUE
ARCHIVES
JASN Express
ONLINE SUBMISSION
AUTHOR INFO
EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP |