The content validity ratio (Lawshe) is one of the earliest and most widely used methods for quantifying content validity. To correct and expand the table, critical values in unit steps and at multiple alpha levels were computed. Implications for content validation are discussed.
AllenM. J.YenW. M. (2002). Introduction to measurement theory (2nd ed.). Prospect Heights, IL: Waveland Press.
2.
AmsbergS.WredlingR.LinsP.AdamsonU.JohanssonU. (2008). The psychometric properties of the Swedish version of the problem areas in diabetes scale (swe-PAID-20): Scale development. International Journal of Nursing Studies, 45, 1319–1328. doi:10.1016/j.ijnurstu.2007.09.01010.1016/j.ijnurstu.2007.09.010
3.
AnastasiA.UrbinaS. (1997). Psychological testing (7th ed.). New York, NY: Prentice Hall.
4.
BashamA.SedlacekW. E. (2009). Validity. In American Counseling Association (Ed.), The ACA encyclopedia of counseling (p. 557). Alexandria, VA: American Counseling Association.
5.
BjorvellC.Thorell-EkstrandI.WredlingR. (2000). Development of an audit instrument for nursing care plans in the patient record. Quality Health Care, 9, 6–13. doi:10.1136/qhc.9.1.610.1136/qhc.9.1.6
6.
BoxG. E. P.HunterW. G.HunterJ. S. (1978). Statistics for experimenters: An introduction to design, data analysis, and model building. New York, NY: Wiley.
7.
ChangH.-L.YangC.-H. (2008a). Do airline self-service check-in kiosks meet the needs of passengers?Tourism Management, 29, 980–993. doi:10.1016/j.tourman.2007.12.00210.1016/j.tourman.2007.12.002
8.
ChangH.-L.YangC.-H. (2008b). Explore airlines’ brand niches through measuring passengers’ repurchase motivation: An application of Rasch measurement. Journal of Air Transport Management, 14, 105–112. doi:10.1016/j.jairtraman.2008.02.00410.1016/j.jairtraman.2008.02.004
9.
ChengH.-L.LinC. Y. Y. (2009). Do as the large enterprises do? Expatriate selection and overseas performance in emerging markets: The case of Taiwan SMEs. International Business Review, 18, 60–75. doi:10.1016/j.ibusrev.2008.12.00210.1016/j.ibusrev.2008.12.002
10.
ChoudrieJ.DwivediY. K.BrinkmanW. (2006). Development of a survey instrument to examine consumer adoption of broadband. Industrial Management & Data Systems, 106, 700–718. doi:10.1108/0263557061066645810.1108/02635570610666458
11.
CohenR. J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
12.
CohenR. J.SwerdlikM. E. (2005). Psychological testing and assessment. New York, NY: McGraw-Hill.
13.
CollardE. F. N. (1992). The impact of deming quality management on interdepartmental cooperation (Unpublished doctoral dissertation). University of Minnesota, Minneapolis.
14.
CortyE. W.AlthofS. E.WiederM. (2011). Measuring women’s satisfaction with treatment for sexual dysfunction: Development and initial validation of the Women’s Inventory of Treatment Satisfaction (WITS-9). Journal of Sexual Medicine, 8, 148–157. doi:10.1111/j.1743-6109.2010.01977.x10.1111/j.1743-6109.2010.01977.x
15.
DinevT.HartP. (2006). Privacy concerns and levels of information exchange: An empirical investigation of intended e-services use. e-Service Journal, 4(3), 25–60. doi:10.2979/ESJ.2006.4.3.2510.2979/ESJ.2006.4.3.25
16.
DistefanoM. K.PryerM. W.CraigS. H. (2006). Job-relatedness of a posttraining job knowledge criterion used to assess validity and test fairness. Personnel Psychology, 33, 785–793.
17.
DistefanoM. K.PryerM. W.ErffmeyerR. C. (2006). Application of content validity methods to the development of a job-related performance rating criterion. Personnel Psychology, 36, 621–631.
18.
DrossosD. A.FouskasK. G. (2010). The role of industry perceptions in competitive responses. Industrial Management & Data Systems, 110, 477–494. doi:10.1108/0263557101103898110.1108/02635571011038981
19.
ErdemM. (2009). Effects of learning style profile of team on quality of materials developed in collaborative learning processes. Active Learning in Higher Education, 10, 154–171. doi:10.1177/146978740910490210.1177/1469787409104902
20.
FischerR. G.FischerJ. M. (2007). The development of an emotional response to literature measure: The affective response to literature survey. Alberta Journal of Educational Research, 52, 265–276.
21.
FitzpatrickA. R. (1983). The meaning of content validity. Applied Psychological Measurement, 7, 3–13.
22.
FlintD.HaleyL. (2008). Content oriented development of a situational interview. The Business Review, Cambridge, 10(2), 21.
23.
FordJ. K.WrotenS. P. (2006). Introducing new methods for conducting training evaluation and for linking training evaluation to program redesign. Personnel Psychology, 37, 651–665.
24.
Gail-Hinckley HeitzerJ.McKenzieJ. F.AmschlerD. H.BockW. (2009). A descriptive analysis of patient education courses in undergraduate and graduate health education programs. Health Promotion Practice, 10, 244–253. doi:10.1177/152483990730904610.1177/1524839907309046
25.
GhazanfariZ.NiknamiS.GhofranipourF.HajizadehE.MontazeriA. (2010). Development and psychometric properties of a belief-based physical activity questionnaire for diabetic patients (PAQ-DP). BMC Medical Research Methodology, 10, 104.
26.
GuionR. M. (1974). Content validity conference. The Industrial-Organizational Psychologist (Newsletter), 12(1), 18.
27.
HallT.KrahnG. L.Horner-JohnsonW.LambG. (2011). Examining functional content in widely used health-related quality of life scales. Rehabilitation Psychology, 56, 94–99. doi:10.1037/a002305410.1037/a0023054
28.
HancT.BrzezinskaA. I. (2009). Intensity of ADHD symptoms and subjective feelings of competence in school age children. School Psychology International, 30, 491–506. doi:10.1177/014303430910706810.1177/0143034309107068
29.
HayesJ. A. (2004). The inner world of the psychotherapist: A program of research on countertransference. Psychotherapy Research, 14, 21–36. doi:10.1093/ptr/kph00210.1093/ptr/kph002
30.
HenardD. H.FrelingT. H.CrosnoJ. L. (2011). Brand personality appeal: Conceptualization and empirical validation. Journal of the Academy of Marketing Science, 39, 392–406. doi:10.1007/s11747-010-0208-310.1007/s11747-010-0208-3
31.
HuangJ.ZhaoC.LiJ. (2007). An empirical study on critical success factors for electronic commerce in the Chinese publishing industry. Frontiers of Business Research in China, 1, 50–66. doi:10.1007/s11782-007-0004-110.1007/s11782-007-0004-1
32.
HuangS.-M.HungY.-C.ChenH.-G.KuC.-Y. (2004). Transplanting the best practice for implementation of an ERP system: A structured inductive study of an international company. Journal of Computer Information Systems, 44(4), 101–110.
33.
HungY.HuangS.YenD. C. (2004). A study on decision factors in adopting an online stock trading system by brokers in Taiwan. Decision Support Systems, 40, 315–328. doi:10.1016/j.dss.2004.02.00410.1016/j.dss.2004.02.004
34.
JamesL. R.DemareeR. G.WolfG. (1993). Rwg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306–309.
35.
KerlingerF. N. (1986). Foundations of behavioral research (3rd ed.). New York, NY: Holt, Rinehart, & Winston.
36.
LawsheC. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.
37.
LindellM. K.BrandtC. J. (1999). Assessing interrater agreement on the job relevance of a test: A comparison of the CVI, T, rwg(j), and r*wg(j) indexes. Journal of Applied Psychology, 84, 640–647.
38.
LindellM. K.BrandtC. J.WhitneyD. J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, 127–135.
39.
MakD. C. S.TsangH. W. H.CheungL. C. C. (2006). Job termination among individuals with severe mental illness participating in a supported employment program. Psychiatry, 69, 239–248.
40.
MaplesP.FranksA.RayS.StevensA. B.WallaceL. S. (2010). Development and validation of a low-literacy chronic obstructive pulmonary disease knowledge questionnaire (COPD-Q). Patient Education and Counseling, 81, 19–22. doi:10.1016/j.pec.2010.11.02010.1016/j.pec.2010.11.020
41.
MathewsH.SmithS.HusseyJ.PlackM. M. (2010). Investigation of the preferred PT-PTA relationship in a 2:2 clinical education model. Journal of Physical Therapy Education, 24(3), 50–61.
42.
MoscosoS.SelgadoJ. F. (2001). Psychometric properties of a structured interview to hire private security personnel. Journal of Business and Psychology, 16, 51–59.
43.
NamisangoE.KatabiraE.KaramagiC.BagumaP. (2007). Validation of the Missoula-Vitas Quality-of-Life Index among patients with advanced AIDS in urban Kampala, Uganda. Journal of Pain and Symptom Management, 33, 189–202. doi:10.1016/j.jpainsymman.2006.11.00110.1016/j.jpainsymman.2006.11.001
44.
PolitD. F.BeckC. T. (2006). The content validity index: Are you sure you know what’s being reported?Research in Nursing & Health, 29, 489–497.
45.
PolitD. F.BeckC. T.OwenS. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30, 459–467.
46.
ReynoldsC. R.LivingstonR. B.WillsonV. (2009). Measurement and assessment in education (2nd ed.). Upper Saddle River, NJ: Pearson.
SarammaP. P.ThomasS. V. (2010). Child rearing knowledge and practice scales for women with epilepsy. Annals of Indian Academy of Neurology, 13, 171–179. doi:10.4103/0972-2327.7087710.4103/0972-2327.70877
49.
SendjayaS.SarrosJ. C.SantoraJ. C. (2008). Defining and measuring servant leadership behaviour in organizations. Journal of Management Studies, 45, 402–424. doi:10.1111/j.1467-6486.2007.00761.x10.1111/j.1467-6486.2007.00761.x
50.
StausmireJ. M. (2011). Interdisciplinary development of an adult intubation procedural checklist. Family Medicine, 43, 272–274.
51.
StellyD. J. (2006, May). An explication of statistical significance testing applied to minimum content validity ratio (CVR) values. 2006 Society for Industrial and Organizational Psychology Conference, Dallas, TX.
52.
TaiY. (2011). Perceived value for customers in information sharing services. Industrial Management & Data Systems, 111, 551–569. doi:10.1108/0263557111113354210.1108/02635571111133542
53.
TaiY.HoC. (2010). Effects of information sharing on customer relationship intention. Industrial Management & Data Systems, 110, 1385–1401. doi:10.1108/0263557101108744610.1108/02635571011087446
54.
TinsleyH. E. A.WeissD. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358–376.
55.
TsangH. W.WongA. (2005). Development and validation of the Chinese version of Indiana Job Satisfaction Scale (CV-IJSS) for people with mental illness. International Journal of Social Psychiatry, 51, 177–191. doi:10.1177/002076400505676610.1177/0020764005056766
56.
WallaceL. S.GregoryH. B.ParhamJ. S.BaldridgeR. E. (2003). Development and content validation of family practice residency recruitment questionnaires. Family Medicine, 35, 496–498.
57.
WeiC.-C. (2008). Evaluating the performance of an ERP system based on the knowledge of ERP implementation objectives. International Journal of Advanced Manufacturing Technology, 39, 168–181. doi:10.1007/s00170-007-1189-310.1007/s00170-007-1189-3
58.
YuS.NgC. S.ChangS.ChangI.YenD. C. (2011). An ERP system performance assessment model development based on the balanced scorecard approach. Information Systems Frontiers, 13, 429–450. doi:10.1007/s10796-009-9225-510.1007/s10796-009-9225-5
59.
ZiteN. B.WallaceL. S. (2007). Development and validation of a medicaid postpartum tubal sterilization knowledge questionnaire. Contraception, 76, 287–291. doi:10.1016/j.contraception.2007.06.01210.1016/j.contraception.2007.06.012