Rev Osteoporos Metab Miner. 2017; 9 (2): 53-4
Unidad de Metabolismo Óseo y Lipídico – Departamento de Medicina Interna – Hospital Marqués de Valdecilla-IDIVAL (Instituto de Investigación Marqués de Valdecilla) – Universidad de Cantabria – Santander (España)
Validation, both internal and external, is one of the keys to developing a risk calculator. In particular, external validation generalizes the scale to populations beyond those in which it was generated. The work of Reyes Domínguez et al.2, published in this issue of the Journal of Osteoporosis and Mineral Metabolism, is the first in Spain to validate the Garvan calculator in a sample of 121 individuals without basal densitometric osteoporosis, monitored over 10 years and who had not received anti-osteoporotic treatment during that time.
The GLOW study included 19,586 postmenopausal women 60 years of age or older without previous anti-osteoporotic treatment, recruited in 723 primary care centers in 10 countries and followed over a two-year period. Three predictive models that did not include the BMD value were evaluated; the FRAX®, the Garvan calculator, and a model that only considered the age and antecedent of a previous fracture. An AUC of 0.64 was found to predict major osteoporotic fracture and 0.76 for prediction of hip fracture. However, neither of the two models (FRAX® and Garvan) was better than the one that only included age and previous fracture, which fuels the debate about the utility of more complex risk scales4. Indeed, in a recent systematic review, tools that predict the risk of osteoporotic fracture and that include few risk factors, such as the Garvan calculator, often have equal or even greater discrimination capacity which include many risk factors (FRAX®, QFracture®)5.
In general, the predicted risk with the Garvan calculator in the validated work is close to or slightly higher than the observed risk of osteoporotic fracture and better predicts the risk of hip fracture than that of any fragility fracture1,3,4-8. In the work of Reyes Domínguez et al.2, the risk of hip fracture could not be analyzed because of the limited number of incident fractures in the analyzed population.
The significance of the absolute risk of fracture should be related to the threshold value of therapeutic intervention recommended in each country, to provide the patient with adequate information about their risk. In order to calculate the validity criteria of the Garvan calculator, Chen et al.9 used the American FRAX® cut-off points (20% in the case of the major osteoporotic fracture), finding a sensitivity of 20%, a specificity of 96% and a negative predictive value of 89%. In the study of Reyes Domínguez et al.2, the authors’ optimal cut off point considers a high risk of osteoporotic fracture to be 18.5%, with a sensitivity and specificity of 67% and a negative predictive value of 86%, similar to that found by Chen et al.9
In summary, the work of Reyes et al.2 has the importance of being the first to validate the Garvan calculator in Spain and, in addition, the interest of its possible use as a screening tool to identify subjects with low risk of fracture. Its greater discriminative capacity has been demonstrated with respect to the negative predictive value of any osteoporotic fracture. Its usefulness as a predictor of hip fracture has not been assessed in this study, as has already been noted.
Further validation studies of the simplest risk calculators, such as Garvan, are required, with prospective population cohorts including participants with different risk factors. Given that no predictive tool captures all the known risk factors for fragility fracture or temporal relationships, clinical judgment should remain a key factor in applying the results of these scales to an individual patient.
1. Dagan N, Cohen-Stavi C, Leventer-Roberts M, Balicer RD. External validation and comparison of three prediction tools for risk of osteoporotic fractures using data from population based electronic health records: retrospective cohort study. BMJ. 2017;356:i6755.
2. Reyes Dominguez AI, Sosa Cabrera N, Saavedra Santana P, Gómez de Tejada Romero MJ, Jódar Jimeno E, Sosa Henríquez M. Valoración de la capacidad predictiva de la calculadora Garvan del riesgo de fractura a 10 años en una población española. Rev Osteoporos Metab Miner. 2017;9(2):55-61.
3. Langsetmo L, Nguyen TV, Nguyen ND, Kovacs CS, Prior JC, Center JR, et al. Canadian Multicentre Osteoporosis Study Research Group. Independent external validation of nomograms for predicting risk of low-trauma fracture and hip fracture. CMAJ. 2011;183:E107-14.
4. Sambrook PN, Flahive J, Hooven FH, Boonen S, Chapurlat R, Lindsay R, et al. Predicting fractures in an international cohort using risk factor algorithms without BMD. J Bone Miner Res. 2011;26:2770-7.
5. Rubin KH, Friis-Holmberg T, Hermann AP, Abrahamsen B, Brixen K. Risk assessment tools to identify women with increased risk of osteoporotic fracture: complexity or simplicity? A systematic review. J Bone Miner Res. 2013;28:1701-17.
6. Ahmed LA, Nguyen ND, Bjørnerem Å, Joakimsen RM, Jørgensen L, Størmer J, et al. External validation of the Garvan nomograms for predicting absolute fracture risk: the Tromsø study. PLoS One. 2014;25;9:e107695.
7. Bolland MJ, Siu AT, Mason BH, Horne AM, Ames RW, Grey AB, et al. Evaluation of the FRAX and Garvan fracture risk calculators in older women. J Bone Miner Res. 2011;26:420-7.
8. van Geel TA, Eisman JA, Geusens PP, van den Bergh JP, Center JR, Dinant GJ. The utility of absolute risk prediction using FRAX® and Garvan Fracture Risk Calculator in daily practice. Maturitas. 2014;77(2):174-9.
9. Chen SJ, Chen YJ, Cheng CH, Hwang HF, Chen CY, Lin MR. Comparisons of different screening tools for identifying fracture/osteoporosis risk among community-dwelling older people. Medicine (Baltimore). 2016;95:e3415.