Sage Journals: Discover world-class research

Abstract

Extending the discussion on replication in sociology and psychology, this article focuses on the adaption of scales in research. Drawing on a recently published scale, we highlight several validity issues in the scale’s composition and development. Using data from two empirical studies, we subsequently show how scales can be tested and adapted. In doing so, this article provides a blueprint for scale testing and helps avoid the use of inappropriate scales in research.

Keywords

scale development scale testing replication validity

Get full access to this article

View all access options for this article.

References

Batson

C. D.

Polycarpou

M. P.

Harmon-Jones

Imhoff

H. J.

Mitchener

E. C.

Bednar

L. L.

Klein

T. R.

Highberger

. 1997. “Empathy and Attitudes: Can Feeling for a Member of a Stigmatized Group Improve Feelings Toward the Group?” Journal of Personality and Social Psychology 72:105–18.

Barsalou

L. W.

Niedenthal

P. M.

Barbey

A. K.

Ruppert

J. A.

. 2003. “Social Embodiement.” Pp. 43–92 in The Psychology of Learning and Motivation: Advances in Research and Theory, edited by Ross

B. H.

. Amsterdam, the Netherlands: Academic Press.

Becker

J.-M.

Klein

Wetzels

. 2012. “Hierarchical Latent Variable Models in Pls-Sem: Guidelines for Using Reflective-Formative Type Models.” Long Range Planning 45:359–94.

Bell

1974. “Replication and Reality.” Futures 6:253–60.

Bello

Leung

Radebaugh

Tung

R. L.

van Witteloostuijn

. 2009. “From the Editors: Student Samples in International Business Research.” Journal of International Business Studies 40:361–64.

Bergkvist

Rossiter

J. R.

. 2009. “Tailor-Made Single-Item Measures of Doubly Concrete Constructs.” International Journal of Advertising 28:607–21.

Chin

W. W.

1998. “The Partial Least Squares Approach to Structural Equation Modeling.” Pp. 295–336 in Modern Business Research Methods: Methodology for Business and Management, edited by Marcoulides

. Mahwah, NJ: Lawrence Erlbaum.

Clark

L. A.

Watson

. 1995. “Constructing Validity: Basic Issues in Objective Scale Development.” Psychological Assessment 7:309–19.

Davis

M. H.

1980. “A Multidimensional Approach to Individual Differences in Empathy.” JSAS Catalog of Selected Documents in Psychology 10:85.

10.

Davis

M. H.

1983. “Measuring Individual Differences in Empathy: Evidence for a Multidimensional Approach.” Journal of Personality and Social Psychology 44:113–26.

11.

Diamantopoulos

Riefler

Roth

K. P.

. 2008. “Advancing Formative Measurement Models.” Journal of Business Research 61:1203–18.

12.

Diamantopoulos

Winklhofer

H. M.

. 2001. “Index Construction with Formative Indicators: An Alternative to Scale Development.” Journal of Marketing Research 38:269–77.

13.

Ekman

1992. “An Argument for Basic Emotions.” Cognition and Emotion 6:169–200.

14.

Flack

W. F.

2006. “Peripheral Feedback Effects of Facial Expressions, Bodily Postures, and Vocal Expressions on Emotional Feelings.” Cognition and Emotion 20:177–95.

15.

Flack

W. F.

Laird

J. D.

Cavallaro

L. A.

. 1999. “Separate and Combined Effects of Facial Expressions and Bodily Postures on Emotional Feelings.” European Journal of Social Psychology 29:203–17.

16.

Fornell

Larcker

D. F.

. 1981. “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error.” Journal of Marketing Research 18:39–50.

17.

Freese

2007. “Replication Standards for Quantitative Social Science: Why Not Sociology?” Sociological Methods & Research 36:153–72.

18.

Funder

D. C.

Levine

J. M.

Mackie

D. M.

Morf

C. C.

Sansone

Vazire

West

S. G.

. 2014. “Improving the Dependability of Research in Personality and Social Psychology: Recommendations for Research and Educational Practice.” Personality and Social Psychology Review 18:3–12.

19.

Furr

2011. Scale Construction and Psychometrics for Social and Personality Psychology. London, UK: Sage.

20.

Gefen

2003. “Assessing Unidimensionality through Lisrel: An Explanation and an Example.” Communications of the Association for Information Systems 12. Retrieved March 22, 2017 (http://aisel.aisnet.org/cais/vol12/iss1/2).

21.

Geisser

1974. “A Predictive Approach to the Random Effects Model.” Biometrika 61:101–07.

22.

Gilin

Maddux

W. W.

Carpenter

Galinsky

A. D.

. 2013. “When to Use Your Head and When to Use Your Heart: The Differential Value of Perspective-Taking Versus Empathy in Competitive Interactions.” Personality and Social Psychology Bulletin 39:3–16.

23.

Glorfeld

L. W.

1995. “An Improvement on Horn’s Parallel Analysis Methodology for Selecting the Correct Number of Factors to Retain.” Educational and Psychological Measurement 55:377–93.

24.

Goffman

1967. Interaction Ritual: Essays on Face-to-Face Interaction. Oxford, UK: Aldine.

25.

Gudergan

S. P.

Ringle

C. M.

Wende

Will

. 2008. “Confirmatory Tetrad Analysis in Pls Path Modeling.” Journal of Business Research 61:1238–49.

26.

Hair

J. F.

Anderson

R. E.

Tatham

R. L.

Black

W. C.

Babin

B. J.

. 2010. Multivariate Data Analysis. 7th Ed. Englewood Cliffs, NJ: Prentice-Hall.

27.

Hair

J. F.

Hult

G. T. M.

Ringle

C. M.

Sarstedt

. 2016. A Primer on Partial Least Squares Structural Equation Modeling. Thousand Oaks, CA: Sage.

28.

Hair

J. F.

Ringle

C. M.

Sarstedt

. 2011. “Pls-Sem: Indeed a Silver Bullet.” Journal of Marketing Theory and Practice 19:139–51.

29.

Hair

J. F.

Ringle

C. M.

Sarstedt

. 2013. “Partial Least Squares Structural Equation Modeling: Rigorous Applications, Better Results and Higher Acceptance.” Long Range Planning 46:1–12.

30.

Hair

J. F.

Sarstedt

Hopkins

Kuppelwieser

V. G.

. 2014. “Partial Least Squares Structural Equation Modeling (Pls-Sem): An Emerging Tool in Business Research.” European Business Review 26:106–21.

31.

Hair

J. F.

Sarstedt

Pieper

T. M.

Ringle

C. M.

. 2012. “The Use of Partial Least Squares Structural Equation Modeling in Strategic Management Research: A Review of Past Practices and Recommendations for Future Applications.” Long Range Planning 45:320–40.

32.

Hattie

1984. “An Empirical Study of Various Indices for Determining Unidimensionality.” Multivariate Behavioral Research 19:49–78.

33.

Hattie

1985. “Methodology Review: Assessing Unidimensionality of Tests and Ltenls.” Applied Psychological Measurement 9:139–64.

34.

Hawk

S. T.

Fischer

A. H.

van Kleef

G. A.

. 2011. “Taking Your Place or Matching Your Face: Two Paths to Empathic Embarrassment.” Emotion 11:502–13.

35.

Henseler

2012. “Pls-Mga: A Non-Parametric Approach to Partial Least Squares-Based Multi-Group Analysis.” Pp. 495–501 in Challenges at the Interface of Data Analysis, Computer Science, and Optimization, Studies in Classification, Data Analysis, and Knowledge Organization, edited by Gaul

, Berlin, Germany: Springer.

36.

Henseler

Dijkstra

T. K.

Sarstedt

Ringle

C. M.

Diamantopoulos

Straub

D. W.

Ketchen

D. J.

Hair

J. F.

Hult

G. T. M.

Calantone

R. J.

. 2014. “Common Beliefs and Reality About Pls: Comments on Rönkkö and Evermann (2013).” Organizational Research Methods 17:182–209.

37.

Henseler

Ringle

C. M.

Sarstedt

. 2015. “A New Criterion for Assessing Discriminant Validity in Variance-Based Structural Equation Modeling.” Journal of the Academy of Marketing Science 43:115–35.

38.

Henseler

Ringle

C. M.

Sinkovics

R. R.

. 2009. “The Use of Partial Least Squares Path Modeling in International Marketing.” Advances in International Marketing 20:277–319.

39.

Hinkin

T. R.

1995. “A Review of Scale Development Practices in the Study of Organizations.” Journal of Management 21:967–88.

40.

Hinkin

T. R.

1998. “A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires.” Organizational Research Methods 1:104–21.

41.

Hoffman

M. L.

2010. “Empathy and Prosocial Behavior.” Pp. 440–55 in Handbook of Emotions, edited by Lewis

Haviland-Jones

J. M.

Feldman Barrett

. New York: Guilford Press.

42.

Horn

J. L.

1965. “A Rationale and Test for the Number of Factors in Factor Analysis.” Psychometrika 32:179–85.

43.

Jackson

D. A.

1993. “Stopping Rules in Principal Components Analysis: A Comparison of Heuristical and Statistical Approaches.” Ecology 74:2204–14.

44.

Jarvis

C. B.

Mackenzie

S. B.

Podsakoff

P. M.

. 2003. “A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research.” Journal of Consumer Research 30:199–218.

45.

Kelly

K. M.

Jones

W. H.

. 1997. “Assessment of Dispositional Embarrassability.” Anxiety, Stress, & Coping 10:307–33.

46.

Keysers

Gazzola

. 2007. “Integrating Simulation and Theory of Mind: From Self to Social Cognition.” Trends in Cognitive Sciences 11:194–96.

47.

Krach

Cohrs

J. C.

de Echeverría Loebell

N. C.

Kircher

Sommer

Jansen

Paulus

F. M.

. 2011. “Your Flaws Are My Pain: Linking Empathy to Vicarious Embarrassment.” PLoS ONE 6:e18675.

48.

Kuppelwieser

V. G.

Sarstedt

. 2014. “Applying the Future Time Perspective Scale to Advertising Research.” International Journal of Advertising 33:113–36.

49.

Law

K. S.

Wong

C. S.

Mobley

W. H.

. 1998. “Toward a Taxonomy of Multidimensional Constructs.” Academy of Management Review 23:741–55.

50.

Leary

M. R.

1983. “A Brief Version of the Fear of Negative Evaluation Scale.” Personality and Social Psychology Bulletin 9:371–75.

51.

MacKenzie

S. B.

Podsakoff

P. M.

Podsakoff

N. P.

. 2011. “Construct Measurement and Validation Procedures in Mis and Behavioral Research: Integrating New and Existing Techniques.” MIS Quarterly 35:293–334.

52.

Makel

M. C.

2014. “The Empirical March: Making Science Better at Self-Correction.” Psychology of Aesthetics, Creativity, and the Arts 8:2–7.

53.

Maltby

Day

. 2000. “The Reliability and Validity of a Susceptibility to Embarrassment Scale among Adults.” Personality and Individual Differences 29:749–56.

54.

Marcus

D. K.

1999. “The Perception of “Live” Embarrassment: A Social Relations Analysis of Class Presentations.” Cognition and Emotion 13:105–17.

55.

Miller

R. S.

1987. “Empathic Embarrassment: Situational and Personal Determinants of Reactions to the Embarrassment of Another.” Journal of Personality and Social Psychology 53:1061–69.

56.

Müller-Pinzler

Paulus

F. M.

Stemmler

Krach

. 2012. “Increased Autonomic Activation in Vicarious Embarrassment.” International Journal of Psychophysiology 86:74–82.

57.

Netemeyer

R. G.

Bearden

W. O.

Sharma

. 2003. Scaling Procedures: Issues and Applications. Thousand Oaks, CA: Sage.

58.

Nosek

B. A.

Lakens

. 2014. “Registered Reports.” Social Psychology 45:137–41.

59.

Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349:1–8.

60.

Pashler

Wagenmakers

E. J.

. 2012. “Editors’ Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?” Perspectives on Psychological Science 7:528–30.

61.

Paulus

F. M.

Müller-Pinzler

Westermann

Krach

. 2013. “On the Distinction of Empathic and Vicarious Emotions.” Frontiers in Human Neuroscience 7:196.

62.

Peres-Neto

P. R.

Jackson

D. A.

Somers

K. M.

. 2005. “How Many Principal Components? Stopping Rules for Determining the Number of Non-Trivial Axes Revisited.” Computational Statistics & Data Analysis 49:974–97.

63.

Preston

S. D.

de Waal

F. B. M.

. 2002. “Empathy: Its Ultimate and Proximate Bases.” Behavioral and Brain Sciences 25:1–20.

64.

Ringle

C. M.

Wende

Becker

J.-M.

. 2015. Smartpls 3.0. Boenningstedt, Germany: SmartPLS GmbH. Retrieved (http://www.smartpls.com).

65.

Rosenberg

1965. Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press.

66.

Schmidt

2009. “Shall We Really Do It Again? The Powerful Concept of Replication Is Neglected in the Social Sciences.” Review of General Psychology 13:90–100.

67.

Shearn

Spellman

Meirick

Stryker

. 1999. “Empathic Blushing in Friends and Strangers.” Motivation and Emotion 23:307–16.

68.

Simmons

J. P.

Nelson

L. D.

Simonsohn

. 2011. “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science 22:1359–66.

69.

Singer

Lamm

. 2009. The Social Neuroscience of Empathy. Annals of the New York Academy of Sciences (Vol. 1156, pp. 81–96). doi: 10.1111/j.1749-6632.2009.04418.x

70.

Stocks

E. L.

Lishner

D. A.

Waits

B. L.

Downum

E. M.

. 2011. “I’m Embarrassed for You: The Effect of Valuing and Perspective Taking on Empathic Embarrassment and Empathic Concern.” Journal of Applied Social Psychology 41:1–26.

71.

Stone

1974. “Cross-Validatory Choice and Assessment of Statistical Predictions.” Journal of the Royal Statistical Society 36:111–47.

72.

Stroebe

Postmes

Spears

. 2012. “Scientific Misconduct and the Myth of Self-Correction in Science.” Perspectives on Psychological Science 7:670–88.

73.

Thompson

2014. “Personal and Vicarious Embarrassability.” Journal of Individual Differences 35:22–29.

74.

Tsui

A. S.

Nifadkar

S. S.

A. Y.

. 2007. “Cross-National, Cross-Cultural Organizational Behavior Research: Advances, Gaps, and Recommendations.” Journal of Management 33:426–78.

75.

Uysal

Akbaş

Helvacı

Metin

. 2014. “Validation and Correlates of the Vicarious Embarrassment Scale.” Personality and Individual Differences 60:48–53.

76.

Velicer

W. F.

1976. “Determining the Number of Components from the Matrix of Partial Correlations.” Psychometrika 41:321–27.

77.

Voorhees

C. M.

Brady

M. K.

Calantone

Ramirez

. 2016. “Discriminant Validity Testing in Marketing: An Analysis, Causes for Concern, and Proposed Remedies.” Journal of the Academy of Marketing Science 44:119–34.

78.

Watson

Clark

L. A.

Tellegen

. 1988. “Development and Validation of Brief Measures of Positive and Negative Affect: The Panas Scales.” Journal of Personality and Social Psychology 54:1063–70.

79.

Winship

2007. “Introduction to the Special Section on Replication and Data Access.” Sociological Methods & Research 36:151–52.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.41 MB

Toward Application and Testing of Measurement Scales and an Example

Abstract

Keywords

Get full access to this article

References

Supplementary Material