Since 1997 the Dutch Association for Cleft Palate and Craniofacial Anomalies (NVSCA) has maintained a national registry of congenital craniofacial anomalies. This study validates data on three common oral cleft categories (cleft lip/alveolus = CL/A; cleft lip/alveolus and palate = CL/AP; and cleft palate = CP) and general items.
Design
Retrospective observational study.
Setting
All 15 Dutch cleft palate teams registered presurgery patients with common oral clefts (n = 2553) from 1997 to 2003.
Patients
A random sample of 250 cases was used; 13 cases were excluded.
Main Outcome Measures
The corresponding medical data were reviewed; these medical data served to validate the NVSCA registry data. Prevalence comparisons, 2 × 2 tables and validity measures were performed.
Results
The cleft categories most accurately recorded were CL/A and CP. Both categories had an observed agreement of 98%, kappa of 0.94, and a sensitivity and specificity of 97%. Cleft lip/alveolus and palate had an observed agreement of 95%, kappa of 0.89, a sensitivity of 90%, and a specificity of 99%. Regarding the general items, observed agreement and kappa were highest for adoption/foster child (99%; 0.76) and lowest for remarks about pregnancy (63%; 0.20). Sensitivity ranged from 25% (consanguinity) to 97% (white mother) and specificity was high for all items (93%) except for white father and mother (approximately 35%).
Conclusions
The NVSCA registry is a valuable tool for quality improvement and research because validity on all three common oral cleft categories is very good. Validity on the general items is reasonable to satisfying and appears to be related to the type of information.
AminiH., AxelssonO., OllarsB., AnnerenG.The Swedish birth defects registry: ascertainment and incidence of spina bifida and cleft lip/palate.Acta Obstet Gynecol Scand.2009; 88: 654–659.
2.
AnthonyS., DorrepaalC.A., ZijlstraA.G., VerheijJBGM, De WalleH.E.K., Den OudenA.L.Aangeboren afwijkingen in Nederland: gebaseerd op de landelijke verloskunde en neonatologie registraties.Leiden: TNO-PG;2001.
3.
AnthonyS., JacobusseG.W., Vermeij-KeersC., WeijermanM.E., Van WouweJ.P., Van der Pal-de BruinK.M.Vergelijking van prevalenties uit de LVR/LNR registratie met afwijking specifieke registraties. In: AnthonyS., DorrepaalS.A., KatemanK., Van der Pal-de BruinK.M., eds. Aangeboren afwijkingen in Nederland 1996–2 003: gebaseerd op de landelijke verloskunde en neonatologie registraties.Leiden: TNO-kwaliteit van leven;2005: 41–59.
4.
BottoL.D., Robert-GnansiaE., SiffelC., HarrisJ., BormanB., MastroiacovoP.Fostering international collaboration in birth defects research and prevention: a perspective from the International Clearinghouse for Birth Defects Surveillance and Research.Am J Public Health.2006; 96: 774–780.
5.
BoydP.A., ArmstrongB., DolkH., BottingB., PattendenS., AbramskyL., RankinJ., VrijheidM., WellesleyD.Congenital anomaly surveillance in England—ascertainment deficiencies in the national system.BMJ.2005; 330: 27.
6.
CornelM.C., SpreenJ.A., MeijerI., SpauwenP.H., DharB.K., Ten KateL.P.Some epidemiological data on oral clefts in the Northern Netherlands, 1981–1988.J Craniomaxillofac Surg.1992; 20: 147–152.
7.
De CosterC., QuanH., FinlaysonA., GaoM., HalfonP., HumphriesK.H., JohansenH., LixL.M., LuthiJ.C., MaJ.. Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium.BMC Health Serv Res.2006; 6: 77.
8.
Dutch Association for Cleft Palate and Craniofacial Anomalies. NVSCA website. Available at http://www.schisis-cranio.nl. Accessed July 1, 2008.
9.
EricsonA., KallenB., WinbergJ.Surveillance of malformations at birth: a comparison of two record systems run in parallel.Int J Epidemiol.1977; 6: 35–41.
FeinsteinA.R., CicchettiD.V.High agreement but low kappa: I. The problems of two paradoxes.J Clin Epidemiol.1990; 43: 543–549.
12.
Felix-SchollaartB., Prahl-AndersenB., PuyenbroekJ.I., BoomsmaD.I.Incidence of cheilognathopalatoschisis in the Netherlands.Tijdschr Kindergeneeskd.1986; 54: 90–95.
13.
HarvilleE.W., WilcoxA.J., LieR.T., VindenesH., AbyholmF.Cleft lip and palate versus cleft lip only: are they distinct defects?Am J Epidemiol.2005; 162: 448–453.
14.
HoeksmaJ.B., Prahl-AndersenB., Van den AkkerA.M.Incidence of cleft lip, alveolus and palate in the Netherlands. In: KriensO., ed. What Is a Cleft Lip and Palate.New York: Thieme Medical Publishers; 1989: 38–39.
15.
HumphriesK.H., RankinJ.M., CarereR.G., BullerC.E., KielyF.M., SpinelliJ.J.Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review?J Clin Epidemiol.2000; 53: 343–349.
16.
ICBDSR.International Clearinghouse for Birth Defects Surveillance and Research. Annual Report 2006, with data for 2004.Rome: ICBDSR Centre;2006.
17.
JohnsenS.P., OvervadK., SorensenH.T., TjonnelandA., HustedS.E.Predictive value of stroke and transient ischemic attack discharge diagnoses in The Danish National Registry of Patients.J Clin Epidemiol.2002; 55: 602–607.
18.
KrapelsI.P., Vermeij-KeersC., MullerM., De KleinA., Steegers-TheunissenR.P.Nutrition and genes in the development of orofacial clefting.Nutr Rev.2006; 64: 280–288.
19.
KubonC., SivertsenA., VindenesH.A., AbyholmF., WilcoxA., LieR.T.Completeness of registration of oral clefts in a medical birth registry: a population-based study.Acta Obstet Gynecol Scand.2007; 86: 1453–1457.
20.
LandisJ.R., KochG.G.The measurement of observer agreement for categorical data.Biometrics.1977; 33: 159–174.
21.
LuijsterburgA.J.M., Vermeij-KeersC.Recording common oral clefts: a new descriptive system.Cleft Palate Craniofac J.2010 (Accepted).
22.
LuijsterburgA.J.M., Vermeij-KeersC.Recording and classification common oral clefts. In: LiljaJ., ed. Transactions, The 9th International Congress on Cleft Palate and Related Craniofacial Anomalies.Götenborg: Elanders Novum; 2001: 243–250.
23.
LuijsterburgA.J.M., Vermeij-KeersC.Recording form and manual for congenital malformations of the head/neck area.Rotterdam: Department of Plastic and Reconstructive Surgery, Erasmus MC, University Medical Center Rotterdam;1999.
24.
LuijsterburgA.J.M., Vermeij-KeersC.NVSCA-registration: Cleft lip/alveolus and cleft palate. Annual report 2003 of the Dutch Association for Cleft Palate and Craniofacial Anomalies.Rotterdam: Department of Plastic and Reconstructive Surgery, Erasmus MC, University Medical Center Rotterdam;2004.
25.
MisraT., DattaniN., MajeedA.Evaluation of the National Congenital Anomaly System in England and Wales.Arch Dis Child Fetal Neonatal Ed.2005; 90: F368–373.
26.
MosseyP.A., LittleJ.Epidemiology of oral clefts: an international perspective. In: WyszynskiD.F., ed. Cleft Lip and Palate: From Origin to Treatment.New York: Oxford University Press; 2002: 127–158.
27.
MurrayJ.C.Gene/environment causes of cleft lip and/or palate.Clin Genet.2002; 61: 248–256.
28.
QuanH., ParsonsG.A., GhaliW.A.Validity of procedure codes in International Classification of Diseases, 9th revision, clinical modification administrative data.Med Care.2004; 42: 801–809.
29.
RasmussenS.A., MooreC.A.Effective coding in birth defects surveillance.Teratology.2001; 64(suppl 1): S3–S7.
30.
RittlerM., Lopez-CameloJ.S., CastillaE.E., BermejoE., CocchiG., CorreaA., Csaky-SzunyoghM., DanderferR., De ViganC., De WalleH.. Preferential associations between oral clefts and other major congenital anomalies.Cleft Palate Craniofac J.2008; 45: 525–532.
31.
SekhoboJ.P., DruschelC.M.An evaluation of congenital malformations surveillance in New York State: an application of Centers for Disease Control and Prevention (CDC) guidelines for evaluating surveillance systems.Public Health Rep.2001; 116: 296–305.
32.
Van den BoogaardM.J., De CostaD., KrapelsI.P., LiuF., Van DuijnC., SinkeR.J., LindhoutD., Steegers-TheunissenR.P.The MSX1 allele 4 homozygous child exposed to smoking at periconception is most sensitive in developing nonsyndromic orofacial clefts.Hum Genet.2008; 124: 525–534.
33.
Van der MeulenJ., MazzolaR., StricklerM., RaphaelB.Classification of craniofacial malformations. In: StrickerM., Van der MeulenJ.C., RaphaelB., MazzolaR., TolhurstD.E., MurrayJ.E., eds. Craniofacial Malformations.Edinburgh: Churchill Livingstone;1990: 149–309.
34.
Vermeij-KeersC.Craniofacial embryology and morphogenesis: normal and abnormal. In: StrickerM., Van der MeulenJ.C., RaphaelB., MazzolaR., TolhurstD.E., MurrayJ.E., eds. Craniofacial Malformations.Edinburgh: Churchill Livingstone;1990: 27–60.
35.
World Health Organization.The development of registries to support birth defect research. In: MosseyP., CastillaE., eds. Global registry and database on craniofacial anomalies. Report of a WHO Registry Meeting on Craniofacial Anomalies.Geneva: World Health Organization;2003: 1–14.
World Health Organization.International Statistical Classification of Diseases and Related Health Problems, 10th revision. Version for 2007. Available at http://www.who.int/classifications/apps/icd/icd10online/. Accessed June 30, 2008b.
