The purpose of this paper is to describe the process for developing reliable and valid measurement instruments that can be used in any hospitality industry field research setting. Many instances exist in which the researcher cannot find an adequate or appropriate existing scale to measure an important construct. In these situations it is necessary to create a new scale. Failure to carefully develop a measurement instrument can result in invalid and uninterpretable data. Hence, a systematic seven-step process is outlined here to assist researchers in devising usable scales. Examples from the authors' own research are used to illustrate some of the steps in the process.
Get full access to this article
View all access options for this article.
References
1.
BagozziR. P.YiYPhillipsL. W. (1991).Assessing construct validity in organizational research.Administrative Science Quarterly,36, 421–458
2.
BassB. M. (1985).Leadership and performance beyond expectations.New York: Free Press
3.
BassB. M.AvolioB. J. (1994).Improving organizational effectiveness through transformational leadership.Thousand Oaks, CA: Sage
4.
BollenK. A. (1989).Structural equations with latent variables.New York: John Wiley & Sons, Inc
5.
BurnsJ. M. (1978).Leadership.New York: Harper and Row
6.
CarmanJ. M. (1990).Consumer perceptions of service quality: An assessment of the SERVQUAL dimensions.Journal of Retailing, 66, 33–55
7.
CarminesE. G.MclverJ. (1981).Analyzing models with unobserved variables: Analysis of covariance structures. In BohrnstedtG.BorgattaE. (eds.) Social measurement: Current issues.Beverly Hills: Sage
8.
CarminesE. G.ZellerR. A. (1979).Reliability and validity assessment.Beverly Hills: Sage
9.
CattellR. B. (1966).The scree test for the number of factors.Multivariate Behavioral Research, 1: 245–276
10.
ChurchillG. A. (1979).A paradigm for developing better measures of marketing constructs.Journal of Marketing Research,16, 64–73
11.
CohenJ. (1969).Statistical power analysis for the behavioral sciences.New York: Academic Press
12.
CookJ. D.HepworthS. J.WallT. D.WarrP. B. (1981).The experience of work.San Diego: Academic Press
13.
FordJ. K.MacCallumR. C.TaitM. (1986).The application of exploratory factor analysis in applied psychology: A critical review and analysis.Personnel Psychology,39, 291–314
14.
GerbingD. W.AndersonJ. C. (1988).An updated paradigm for scale development incorporating unidimensionality and its assessment.Journal of Marketing Research,25, 186–192
15.
GettyJ. M.ThompsonK. N. (1994).A procedure for scaling perception of lodging quality.Hospitality Research Journal,18, 75–96
16.
GuadagnoliE.VelicerW. F. (1988).Relation of sample size to the stability of component patterns.Psychological Bulletin,103, 265–275
17.
GundersenM. G.HeideM.OlssonU. H. (1996).Hotel guest satisfaction among business travelers.Cornell Quarterly,376(2), 72–81
18.
HarrisonD. A.McLaughlinM. E. (1991).Exploring the cognitive processes underlying responses to self-report instruments: Effects of item content on work attitude measures.Proceedings of the 1991 Academy of Management annual meetings, 310–314
19.
HarrisonD. A.McLaughlinM. E. (1993).Cognitive processes in self-report responses: Tests of item context effects in work attitude measures.Journal of Applied Psychology,78, 129–140
20.
HarveyR. J.BillingsR. S.NilanK. J. (1985).Confirmatory factor analysis of the job diagnostic survey: Good news and bad news.Journal of Applied Psychology,70, 461–468
21.
HinkinT. R. (1995).A review of scale development practices in the study of organizations.Journal of Management,21, 967–988
22.
HinkinT. R.SchriesheimC. A. (1989).Development and application of new scales to measure the French and Raven (1959) bases of social power.Journal of Applied Psychology, 74(4), 561–567
23.
HinkinT. R.TraceyJ. B. (1994).Transformational leadership in the hospitality industry.Hospitality Research Journal,18,49–63
KimJ.MuellerC. W. (1978).Introduction to factor analysis: What it is and how to do it.Beverly Hills: Sage Publications
26.
KrzystofiakF.CardyR. L.NewmanJ. (1988)Implicit personality and performance appraisal: The influence of trait inferences on evaluation of behavior.Journal of Applied Psychology,73, 515–521
27.
LissitzR. W.GreenS. B. (1975).Effect of the number of scale points on reliability: A Monte Carlo approach.Journal of Applied Psychology,60, 10–13
28.
LongJ. S. (1983).Confirmatory factor analysis.Beverly Hills: Sage Publications
29.
MacKenzieS. B.PodsakoffP. M.FetterR. (1991).Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance.Organizational Behavior and Human Decision Processes,50, 123–150
30.
MedskerG. J.WilliamsL. J.HolohanP. J. (1994).A review of current practices for evaluating causal models in organizational behavior and human resources management research.Journal of Management,20, 439–464
31.
MuliakS.JamesL.Van AlstineJ.BennetN.LindS.StilwellC. (1989).Evaluation of goodness-of-fit indices for structural equation models.Psychological Bulletin,105, 430–445
32.
NunnallyJ. C. (1978).Psychometric theory (2nd ed.). NY: McGraw-Hill
33.
PriceJ. L.MuellerC. W. (1986).Handbook of organizational measurement.Marshfield, MA: Pitman Publishing
34.
RummelR. J. (1970).Applied factor analysis.Evanston, IL: Northwestern University Press
35.
SchmittN. W.KlimoskiR. J. (1991).Research methods in human resources management.Cincinnati, South-Westem Publishing
36.
SchmittN. W.StultsD. M. (1985).Factors defined by negatively keyed items: The results of careless respondents?Applied Psychological Measurement,9, 367–373
37.
SchriesheimC. A.PowersK. J.ScanduraT. A.GardinerC. C.LankauM. J. (1993).Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical adequacy of paper-and-pencil survey-type instruments.Journal of Management,19, 385–417
38.
SchwabD. P. (1980).Construct validity in organization behavior. In StawB. M.CummingsL. L. (eds.) Research in organizational behavior (Vol. 2, 3–43). Greenwich, CT: JAI Press
39.
SmithP. C.KendallL. M.HulinC. L. (1969).The measurement of satisfaction with work and retirement.Chicago: Rand McNally
40.
StoneE. (1978).Research methods in organizational behavior.Glenview, IL: Scott, Foresman and Company
41.
SweeneyP. D.McFarlinD. B. (1993).Workers' evaluation of the “ends” and the “means”: An examination of four models of distributive and procedural justice.Organizational Behavior and Human Decision Processes,55, 23–40
42.
ThackerJ. W.FieldsM. W.TetrickL. E. (1989).The factor structure of union commitment: An application of confirmatory factor analysis.Journal of Applied Psychology,74, 228–232
43.
TraceyJ. B.HinkinT. R. (1994).Transformational leaders in the hospitality industry.Cornell Hotel and Restaurant Administration Quarterly,35, 18–24
44.
TraceyJ. B.HinkinT. R. (1996).How transformational leaders lead in the hospitality industry.International Journal of Hospitality Management, 165–176
45.
ThurstoneL. L. (1947).Multiple-factor analysis.Chicago: University of Chicago Press
46.
WidamanK. F. (1985).Hierarchically nested covariance structure models for multitrait-multimethod data.Applied Psychological Measurement,9, 1–26
47.
YuklG. A. (1990).COMPASS: The Managerial Practices Survey.New York: Gary Yukl and Manus Associates
