ISSN: 1885-5857 Impact factor 2023 7.2
Vol. 57. Num. 7.
Pages 644-651 (July 2004)

Effectiveness of a Quality Improvement Intervention in Reducing Cardiovascular Risk in Hypertensive Patients

Efectividad de una intervención de mejora de calidad en la reducción del riesgo cardiovascular en pacientes hipertensos

Luis García OrtizaIgnacio Santos RodríguezbPedro L Sánchez FernándezbMaría C Mora SantiagoaJosé Arganda MayaaMaría T Rodríguez Corrala

Options

Introduction and objectives. To evaluate the effect of a quality improvement intervention on the reduction of cardiovascular risk in patients with hypertension. Patients and method. Quasi-experimental study involving two primary care centres. One centre was assigned to implement a quality improvement intervention (n = 482 patients), while at the other center «usual care» procedures were followed (control group, n = 360 patients). The quality improvement intervention consisted of a combined program designed for the medical staff and comprising audit, feedback, training sessions and implementation of clinical practice guidelines during 6 months. The main outcome measures were blood pressure, lipid levels, diabetes, smoking and cardiovascular risk. These values were compared before the intervention and after one year. Results. The baseline characteristics of the patients were similar in both groups. Absolute cardiovascular risk decreased from 15.85% to 14.36% (P<.05) in the intervention group, and no significant change was observed in the control group (15.17% to 15.76%). The intervention led to a 2.07% decrease in cardiovascular risk (95%CI, 1.21-2.93; P<.05). The percentage of patients with high cardiovascular risk (> 20% at 10 years) decreased in the intervention group from 30% to 25%, and increased in the control group from 28% to 30%. Relative cardiovascular risk decreased from 2.03 to 1.75 (P<.05) in the intervention group, and from 1.98 to 1.92 (P>.05) in the control group. The intervention thus led to a 0.25 decrease in relative risk (95%CI: 0.14-0.35). Conclusions. Absolute and relative cardiovascular risk in patients with hypertension was reduced by a quality improvement intervention. The percentage of patients with high cardiovascular risk was also reduced.

Keywords

Hypertension
Coronary disease
Quality Assurance
Primary care

INTRODUCTION

Cardiovascular risk can be defined as the probability of developing a cardiovascular disease within a certain period of time, generally five or 10 years.1,2 This includes the probability of developing the most important forms of atherosclerotic disease, i.e., ischemic heart disease, cerebrovascular disease and peripheral arterial disease. Although risk prediction methods mainly calculate the risk of coronary artery disease or the probability of suffering ischemic heart disease, this provides a reasonable approximation of overall cardiovascular risk.3 This definition corresponds to the concept of absolute risk (AR).

Before taking clinical decisions, the evaluation of relative risk (RR) is also recommended. This is defined as the ratio between the absolute risk for the patient (or group of patients) and the risk of the same group considering only low risk factors.4 Individuals are considered to be at low risk of coronary artery disease when they are not diabetic, are non-smokers, their systolic blood pressure is <120 mm Hg and their diastolic pressure <80 mm Hg, when their total cholesterol values are between 160 mg/dL and 199 mg/dL, or when their low density lipoprotein cholesterol (LDL-C) values are between 100 mg/dL and 129 mg/dL and their high density lipoprotein cholesterol (HDL-C) levels are greater than 45 mg/dL in men and 55 mg/dL in women.4

A number of methods can be used for calculating cardiovascular risk. These all differ in the variables they take into account and are suited to particular age groups; indeed, some can only be used with men. The most commonly used methods are usually based on the findings of four large studies: the Framingham Heart Study, the British Regional Heart Study, the Scottish Heart Health Study and the PROCAM Study.3,5-7 In addition, the SCORE8,9 project includes data for the European population and provides cardiovascular death rate estimates. The best known and most used method is based on the findings of the Framingham Study (which has been in progress since the 1940s in the American town of the same name); from these findings the main cardiovascular risk estimation scales have been developed.3,10-13 Recently, the Framingham scale has been adapted for the Spanish population (known as the calibrated Framingham equation).14-15

Following the current recommendations of the main clinical guides for the management of high blood pressure,16-20 cardiovascular risk must be measured before deciding upon the intensity and objectives of the therapeutic approach. Changes in cardiovascular risk, both absolute and relative, can be used to assess the effectiveness of therapy.

The aim of this work was to assess the effectiveness of normal clinical care and of a quality improvement intervention in patients with high blood pressure, by recording the change in absolute and relative cardiovascular risk estimated using the Framingham scale (Wilson, 1998).10

MATERIALS AND METHODS

Design

This work involved a non-randomized, interventional, quality improvement study with an initially descriptive and quasi-experimental design. The study was undertaken in three stages.

Stage I

This was an observational, descriptive, and retrospective stage in which information on the selected hypertensive patients was collected. Data collection began with the first examination of the patients at their health center, followed by annual monitoring to record developments up until the start of the quasi-experimental study (pre-intervention assessment). Risk factors and cardiovascular risk factors were evaluated according to the Framingham scale (Wilson, 1998).10

Stage II

The attending health professionals (physicians and nurses) were enrolled in a 6 month-long quality improvement intervention program comprising the following activities:

1. Group sessions: 6 group education sessions combining the transmission of information, analysis by the participants, and the proposal of improvements. The content of these sessions included:

-­ Feedback of information: presentation and analysis of the initial general assessment of clinical records by the primary care team.

­- Analysis of the causes of the problems detected and recommendations for the overall improvement of quality.

­- Review of clinical guides: review of the recommendations made by the main clinical guides (Guía de Sociedad Española de Medicina de Familia y Comunitaria [semFYC]1, Segundo Consenso Europeo de Prevención Cardiovascular,12 JNC-VI,16 and OMS-9918) for the control and treatment of high blood pressure and cardiovascular diseases in general, plus the production of working summaries facilitating their use. Participants were also trained to use the Wilson scale.10

­- Documentation: handing in of supporting documents and reminders to facilitate the implementation of quality improvement activities.

2. Sessions with basic medical units/nurses. Each basic medical unit (comprised of a tenure physician, a resident physician and a nurse) took part in a session with the following content:

­- Presentation and analysis of results from initial assessments of clinical records (performed individually by basic medical unit).

­- Discussion and analysis of the causes of the problems detected and recommendations for improving individual quality.

­- Documentation: handing in of supporting documents and reminders to facilitate the implementation of quality improvement activities.

Stage 3

Finally, a new assessment of risk and cardiovascular risk was made 1 year after the intervention (post-intervention assessment).

Study Setting

The study involved 2 urban health centers (housed in the same building) of similar characteristics and which used similar work methods. Both had a stable staff (largely stable since 1990) of family doctors and nurses, plus medical interns in their third year of studies in family and community medicine.

The monitoring and follow-up protocols followed for patients with high blood pressure were similar in both centers. Continuing education sessions were normally organized jointly, although those forming part of the quality intervention study were undertaken separately.

Study Subjects

The patients selected for the study were between 34 and 70 years of age. All had high blood pressure and were normally monitored at the centers involved. Hypertensive patients normally monitored at other centers were excluded, as were those who had attended the participating clinics for less than 2 years. The intervention group was comprised of 482 patients; the control group included 360.

Variables and Assessment Criteria

Information was obtained from the patients' medical histories by 4 trained evaluators. As well as universal variables, associated diseases and follow-up times were recorded in order to assess the comparability of the different groups. The variables measured were: systolic and diastolic blood pressure, lipid levels, use of tobacco, presence of diabetes, presence of left ventricular hypertrophy (using the criteria of Cornell and Sokolof), body mass index, and absolute and relative cardiovascular risk (using the Framingham scale) (Wilson, 1988).10 Absolute and relative cardiovascular risk were used as assessment criteria.

Statistical Analysis

Means and proportions were calculated. The χ² test was used to analyze independent qualitative variables; the McNemar test was used to analyze paired qualitative variables. The Student t test was used to analyze independent and paired data for quantitative variables and twin category qualitative variables. A risk of α=.05 was established when testing the hypothesis. All calculations were performed using SPSS/PC+ v10.0 software. The CIA program was used to estimate confidence intervals.

RESULTS

Table 1 shows the patients' baseline characteristics; no significant differences were seen between the intervention and control groups. Mean monitoring time was 6.9 years in the intervention group and 6.8 years in the control group (P>.05), with a median of 6 years for both centers. Losses during follow-up after the pre-intervention assessment were 7% in the intervention group and 4% in the control group.

The number of patients with atherosclerotic disease (angina, myocardial infarction, cerebrovascular accident, or peripheral artery disease) was similar in both groups (10.4% in the intervention group, 9.2% in the control group; P>.05).

The initial mean absolute cardiovascular risk (the probability of suffering a coronary event in the next 10 years) at the beginning of monitoring of blood pressure was 16.6% (95% CI, 14.4%-15.7%) in the intervention group and 16.27% (95% CI, 15.2%-17.3%) in the control group (Table 2 and Figure 1).

Fig. 1. Change in absolute cardiovascular risk. Wilson scale, 1998. Pre-intervention, assessment of absolute cardiovascular risk before e quality improvement intervention; post-intervention, assessment of absolute cardiovascular risk after the intervention. P<.05.

A similar and significant (P<.05) reduction in risk was seen in both groups during the first year of monitoring (1.19 [95% CI, 0.7-1.6] in the intervention group and 1.27 [95% CI, 0.7-1.7 in the control group).

A slow increase in absolute risk was then seen (no significant difference between groups) until the time of the pre-intervention assessment (reaching 15.86% [95% CI, 15.07%-16.64%] in the intervention group and 15.46% [95% CI, 14.42%-16.49%] in the control group).

After the quality improvement intervention, the risk for the control group continued to increase (15.76%; 95% CI, 14.64%-16.87%) whereas this risk decreased for the intervention group (14.34%; 95% CI, 13.55%-15.13%) (significantly different to the pre-intervention assessment results and to the post-intervention risk for the control group; 1.41; 95% CI, 0.05-2.78).

Cardiovascular risk in the intervention group therefore decreased by 1.48 points (95% CI, 0.94-2.01) whereas in the control group it increased by 0.59 (95% CI, 0.09-1.28); this is the absolute reduction in risk (ARR). The intervention therefore reduced cardiovascular risk by 2.07 points (95% CI, 1.21-2.93) (P<.05); the number of patients needed to treat to avoid an event (NNT) was 48. The relative reduction in risk (RRR) between the pre- and post-intervention assessments was 3.8% (95% CI, 0.03%-7.8%) for the intervention group and ­13.4% (95% CI, -­7.7% to ­-19.1%) for the control group (P<.05).

More than 30% of the members of both groups of patients were at high cardiovascular risk (>20% risk of a cardiovascular event occurring in the next 10 years) at the beginning of the study. This proportion then decreased in the first year of monitoring, only to increase by the time of the pre-intervention assessment. Finally, in the control group it once again increased to 30% by the time of the post-intervention assessment. In the intervention group, however, a reduction in cardiovascular risk was seen from 30% (95% CI, 26%-34%) to 25% (95% CI, 21%-29%) (P<.05). However, the difference between the post-intervention control group and intervention group results was not significant.

Relative risk (RR) values (Table 4 and Figure 2) were also calculated and compared. The RR is the ratio between absolute risk and the risk of the low-risk population.3 This method of risk assessment removes the influence of age and sex, since a patient's risk is compared with that of a person of equal age and sex but with a low risk profile.

Fig. 2. Changes in relative cardiovascular risk. Wilson scale, 1998. Pre-intervention, assessment of absolute cardiovascular risk before the quality improvement intervention. Post-intervention, assessment of absolute cardiovascular risk after the intervention. P<.05.

Figure 2 shows how RR decreased continuously, although more so in the intervention group, following the quality intervention program. Significant differences were found between pre- and post-intervention RR in the intervention group (pre-intervention 2.04 [95% CI, 1.95-2.12], post-intervention 1.76 [95% CI, 1.67-1.84; difference 0.28 [95% CI, 0.21-0.34), and between the RR of the control group (1.93 [95% CI, 1.82-2.03]) and the intervention group (1.76 [95% CI, 1.67-1.84]) at the final assessment (difference in RR=0.10 [95% CI, 0.04-0.30]).

The mean reduction in RR following the intervention was 0.28 (95% CI, 0.22-0.35) in the intervention group and 0.03 (95% CI, ­0.05 to -­0.11) in the control group. The effect of the intervention was therefore a reduction in RR of 0.25 (95% CI, 0.14-0.35; P<.05).

DISCUSSION

The quantitative or qualitative estimation of cardiovascular risk is now a regular recommendation in clinical practice guides.1,2,16-22 This is based on the need for a stratified and multifactorial approach to treatment according to the level of risk. Interventions targeted at only 1 factor do not greatly reduce cardiovascular risk if unaccompanied by the simultaneous surveillance of other risk factors.23 It is also currently accepted that the aggressiveness with which risk factors should be tackled depends on the overall cardiovascular risk.9,12,16-22

In the present study we tried to assess cardiovascular risk in patients with high blood pressure, monitored at their usual clinics, using the 1998 Framingham (or Wilson) scale.10 The effectiveness of the intervention on the healthcare teams was also examined using cardiovascular risk as an overall marker of the modifications achieved in the different risk factors. It is common that small reductions in a number of risk factors can lead to a large reduction in cardiovascular risk.

In the pre-intervention stage, the mean 10 year cardiovascular risk at the beginning of the monitoring of patients was over 16%, both in the intervention and control clinic. This decreased greatly in the first year of monitoring to 15% at both centers. After this time, however, slow, parallel increases were seen at both centers until risk levels were once again around 16%. The patterns of change in cardiovascular risk according to sex were similar to the overall pattern, except for the fact that the risk for men was almost twice as high (males, 22.8%; women, 13.1%; overall, 16.6%).

Patients initially at high cardiovascular risk (>20% in 10 years) in both the intervention and control groups also experienced a similar initial reduction in risk, f ollowed by a return to starting levels before the intervention.

This apparent therapeutic failure of normal care can be explained by the effect of time; age is an important variable in cardiovascular risk scales. Over the first four years of monitoring, increasing age, and therefore increasing risk, tends to dampen any improvements that can be achieved with cardiovascular risk control measures.

The reduction in cardiovascular risk seen during the first year of monitoring agrees with that reported by Martell.24 The latter study also involved patients with high blood pressure who attended health centers; absolute cardiovascular risk decreased from an initial 18% to 14.8% in the first year of monitoring.

The proportion of hypertensive patients at high cardiovascular risk (>20% in 10 years) in the VERICA II25 and DIORISC26 studies was 47% and 61% respectively--much higher than in the present study (initially 32% in both groups and eventually 25% and 29.8% in the intervention and control groups respectively after the intervention). This discrepancy could be partly due to the risk scale used and the method of patient selection.

To assess the effectiveness of the quality improvement intervention on the healthcare professionals, absolute cardiovascular risk was used as a marker. An important reduction of 1.48% was seen in the intervention group compared to an increase of 0.59% in the control group. The variation in absolute risk in both groups was 2.07 (95% CI, 1.20-2.95); the NNT value was 48. This was due to the intervention since, not only was the increase in risk interrupted but a significant reduction was achieved in the intervention group whereas the risk for the control group patients continued to rise.

The RRR, ARR and NNT are good indicators of the effectiveness of interventions. The RR value provides information on the status of a patient compared to the low risk population of the same age and sex.4 Changes in RR can help evaluate the effectiveness of interventions since the influence of age, the main confounding factor, is removed.

In the present patients, RR continuously decreased in both the intervention group (from 2.49 to 1.75) and control group (from 2.52 to 1.92). No significant differences were recorded until the last assessment, in which the RR of the intervention group was significantly lower than that of the control group (0.17; 95% CI, 0.04-0.30). The mean pre- and post intervention difference in RR was also greater in the intervention group than in the control group (0.25; 95% CI, 0.14-0.35). This is explained by the influence of the intervention.

Lindholm et al27 assessed the effectiveness of 6 patient education sessions on the reduction of the main risk factors and cardiovascular risk factors, and found that although some factors were improved, overall cardiovascular risk remained unchanged. However, they also found that had the risk factors not been modified, the risk would have been substantially higher.

Similar results were obtained in the British Family Heart Study,28 in which nurses educated families about changes in lifestyle. Cardiovascular risk was reduced by 16% within 1 year (estimated using Dundee Risk scores).

The effectiveness of quality improvement interventions is not always that hoped for. Frequently, improvements in clinical practice do not achieve the expected results and improvements in patient health can be difficult to judge.

A number of systematic reviews29-31 on the effectiveness of interventions (based on information audit and feedback systems) conclude that they may improve patient attention to health but that any effects are generally small to moderate. Further, they may not be effective for all problems. They cannot, therefore, be used in a general way. In the present study, however, the intervention did seem to have an effect since a reduction of 2.07% was achieved in overall cardiovascular risk, as well as a reduction in RR of 0.25.

The conclusion of Oxman,32 who reviewed 102 intervention trials on the improvement of clinical practice, is here extended. There are no magic bullets for improving the quality of care, but there are many types of intervention available, which, when properly used, can lead to important improvements in patient health.

LIMITATIONS

The patients selected had all been monitored for a prolonged period by their family doctor; at least 2 years of such monitoring were required for inclusion. Patients between 34 and 74 years of age were selected so that the risk assessment scale could be appropriately used. However, this left out an important number of older patients normally monitored at the same study centers. Any possible interference caused by the geographic proximity of the intervention and control centers was insufficient to mask the effect of the intervention. The 7% and 4% loss of patients from the intervention and control groups respectively may have influenced the results somewhat, but probably only minimally (if at all) since the distribution of the risk factors and baseline risk levels were similar in both groups.

CONCLUSIONS

In conclusion, the reduction in absolute cardiovascular risk between the beginning of monitoring and the beginning of the intervention was minimal in both groups. After the intervention, absolute risk significantly decreased in the intervention group whereas it continued to increase in the control group. The change in RR, which is influenced by age, indicates that both ordinary care and the influence of the quality intervention were both effective in reducing cardiovascular risk. However, the reduction achieved in the intervention group was significantly greater than that achieved in the control group.

This study was supported by a grant from the Sociedad Castellano-Leonesa de Cardiología (SOCALEC).


Correspondence: Dr. L. García Ortiz.
Avda. Comuneros, 10-18, 4.o-2. 37007 Salamanca. España.
E-mail: lgarciao@usal.es

Bibliography
[1]
Grupo de prevención cardiovascular del programa de actividades preventivas y promoción de la salud (PAPPS) de la Socieda..
Guía de prevención cardiovascular. Madrid: Sersa.
Guía de prevención cardiovascular. Madrid: Sersa, (1996), pp. 12-6
[2]
Grupo de prevención cardiovascular del programa de actividades preventivas y promoción de la salud (PAPPS) de la Socieda..
Guía de prevención cardiovascular en atención primaria. Barcelona: semFYC.
Guía de prevención cardiovascular en atención primaria. Barcelona: semFYC, (2003), pp. 15-20
[3]
Anderson KM, Wilson PW.F, Odell PM, Kannel WB..
An update coronary risk profile. A statement for health professionals..
Circulation, (1991), 83 pp. 356-62
[4]
Grundy S, Pasternak R, Greenland P, Smith S, Fuster V..
Assessment of cardiovascular risk by use of multiple-risk-factor assessment equations. A statement for healthcare professionals from the American Heart Association and the American College of Cardiology..
Circulation, (1999), 100 pp. 1481-92
[5]
Shaper AG, Pococok SJ Philips AN, Walter M..
Identifying men at high risk of heart attacks: strategy for use in general practice..
Br Med J, (1986), 293 pp. 474-9
[6]
Tunstall-Pedoe H..
The Dundee coronary risk-disk for management of change in risk factors..
BMJ, (1991), 303 pp. 744-7
[7]
Assmann G, Cullen P, Schulte H..
The Munster Heart Study (PROCAM). Results of follow-up at 8 years..
Eur Heart J, (1998), 19 pp. 2-11
[8]
Conroy P, Pyörala K, Fitzgerald A, Sans S, Menotti A, de Backe.r, et al..
Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project..
Eur Heart J, (2003), 24 pp. 987-1003
[9]
de Baker G, Ambrossioni E, Borch-Johnsen K, Brotons C, Cifkova R, Dallongeville J, et al..
European guidelines on cardiovascular disease prevention in clinical practice..
Eur J Cardiovasc Prev Rehabil, (2003), 10 pp. 1-78
[10]
Wilson P, D'Agostino R, Levy D, Belanger A, Silbershatz H, Kannel W..
Prediction of coronary heart disease using risk factor categories..
Circulation, (1998), 97 pp. 1837-47
[11]
Grundy S..
Primary prevention of coronary heart disease: integrating risk assessment with intervention..
Circulation, (1999), 100 pp. 988-98
[12]
Wood D, de Backer G, Faergeman O, Graham I, Mancia G, Pyörälä K..
Prevention of coronary heart disease in clinical practice. Recommendations of the Second Joint Task Force of European and other Societies on Coronary Prevention..
Eur Heart J, (1998), 19 pp. 1434-503
[13]
Jackson R..
Update New Zealand cardiovascular disease risk-benefit prediction guide..
BMJ, (2000), 320 pp. 709-10
[14]
Marrugat J, Solanas P, D'Agostino R, Sullivan L, Ordovas J, Cordón F, et al..
Estimación del riesgo coronario en España mediante la ecuación de Framingham calibrada..
Rev Esp Cardiol, (2003), 56 pp. 253-61
[15]
Brotons C..
Mejoremos la predicción del riesgo coronario en España..
Rev Esp Cardiol, (2003), 56 pp. 225-7
[16]
Joint National Committee on Preventio.n, Detectio.n, Evaluatio.n, and Treatment of High Blood Pressure..
The Sixth Report of the Joint National Committee on Prevention, Detection, Evaluation and Treatment of High Blood Pressure (JNC VI)..
Arch Intern Med, (1997), 157 pp. 2413-46
[17]
Joint National Committee on Preventio.n, Detectio.n, Evaluatio.n, and Treatment of High Blood Pressure..
The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure (JNV 7)..
Hypertension, (2003), 42 pp. 1206-52
[18]
Guidelines subcommittee..
1999 World Health Organization-International Society of Hypertension Guidelines for the Management of Hypertension..
J Hypertens, (1999), 17 pp. 151-83
[19]
World Health Organizatio.n, International Society of Hypertension Writing Group..
2003 World Health Organization (WHO)/International Society of Hypertension (ISH) statement on management of hypertension..
[20]
Guidelines committee..
2003 European Society of Hypertension/European Society of Cardiology guidelines for the management of arterial hypertension..
[21]
Plaza I, Villar F, Mata P, Pérez F, Maiquez A, Casasnovas JA, et al..
Control de la Colesterolemia en España 2000. Un instrumento para la prevención cardiovascular..
Rev Esp Cardiol, (2000), 53 pp. 815-37
[22]
Executive Summary of the Third Report of the National Cholesterol Education Program (NCEP)..
Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) JAMA, (2001), 285 pp. 2486-97
[23]
Kannel WB..
Factores de riesgo en la enfermedad coronaria: experiencia del seguimiento durante tres décadas del estudio de Framingham..
Hipertens Arterioscl, (1989), 1 pp. 77-86
[24]
Mertell N, García F, Rodríguez A, Galgo A, López MD, Abad E, et al..
Riesgo cardiovascular absoluto en hipertensos y su evolución con el tratamiento antihipertensivo..
Hipertensión, (2001), 18 pp. 72-7
[25]
de la Sierra A, Ruilope LM, Coca A, Luque-Otero M, en representación del GEDEC (Grupo Español de Estudios Cardiovascular..
Relación entre el perfil de riesgo cardiovascular y la selección y utilización de los fármacos antihipertensivos..
Med Clin (Barc), (2000), 115 pp. 41-5
[26]
Barrios V, Campuzano R, Peña G, Guzmán G, Ruilope LM..
Estratificación del riesgo cardiovascular en hipertensos en atención primaria e impacto sobre el tratamiento antihipertensivo. Estudio DIORISC..
Hipertensión, (2002), 19 pp. 114-20
[27]
Lindholm LH, Ekbom T, Dash C, Eriksson M, Tibblin G, Schersten B..
The impact of health care advice given in primary care on cardiovascular risk..
BMJ, (1995), 310 pp. 1105-9
[28]
Family Heart Study Group..
Randomised controlled trial evaluating cardiovascular screening and intervention in general practice: principal results of British Family heart Study..
BMJ, (1994), 308 pp. 313-20
[29]
Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD..
Audit and feedback: effects on professional practice and health care outcomes..
Cochrane Database Syst Rev, (2003), 3 pp. CD000259
[30]
Thomson O'Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Hervey EL..
Audit and feedback versus alternative strategies: effects on professional practice and health care outcomes..
Cochrane Database Syst Rev, (2000), 2 pp. CD000260
[31]
Freemantle N, Hervey EL, Wolf F, Grimshaw JM, Grilli R, Bero LA..
Printed educational materials: effects on professional practice and health care outcomes..
Cochrane Database Syst Rev, (2000), 2 pp. CD000172
[32]
Oxman A, Thomson M, Davis D, Haynes B..
No magic bullets: systematic review of 102 trials of interventions to improve professional practice..
Can Med Assoc J, (1995), 153 pp. 1423-31
Are you a healthcare professional authorized to prescribe or dispense medications?