Sage Journals: Discover world-class research

Abstract

Dyadic similarity effect hypotheses state that the (dis)similarity between dyad members (e.g. the similarity on a personality dimension) is related to a dyadic outcome variable (e.g. the relationship satisfaction of both partners). Typically, these hypotheses have been investigated by using difference scores or other profile similarity indices as predictors of the outcome variables. These approaches, however, have been vigorously criticized for their conceptual and statistical shortcomings. Here, we introduce a statistical method that is based on polynomial regression and addresses most of these shortcomings: dyadic response surface analysis. This model is tailored for similarity effect hypotheses and fully accounts for the dyadic nature of relationship data. Furthermore, we provide a tutorial with an illustrative example and reproducible R and Mplus scripts that should assist substantive researchers in precisely formulating, testing, and interpreting their dyadic similarity effect hypotheses. © 2018 European Association of Personality Psychology

Keywords

Get full access to this article

View all access options for this article.

References

Ackerman

R. A.

, & Kenny

D. A.

(2016). APIMPowerR: An interactive tool for actor–partner interdependence model power analysis. https://robert–a–ackerman.shinyapps.io/APIMPowerRdis/

Aiken

L. S.

, & West

S. G.

(1991). Multiple regression: Testing and interpreting interactions. Sage Publications, Inc.

Back

M. D.

, & Vazire

(2015). The social consequences of personality: Six suggestions for future research. European Journal of Personality, 29, 296–307. https://doi.org/10.1002/per.1998.

Barranti

, Carlson

E. N.

, & Côté

(2017). How to test questions about similarity in personality and social psychology research: Description and empirical demonstration of response surface analysis. Social Psychological and Personality Science, 8, 465–475. https://doi.org/10.1177/1948550617698204.

Baumeister

R. F.

(1989). The optimal margin of illusion. Journal of Social and Clinical Psychology, 8, 176–189. https://doi.org/10.1521/jscp.1989.8.2.176.

Benjamini

, & Hochberg

(1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B: Methodological, 57, 289–300.

Blanton

, Jaccard

, Gonzales

P. M.

, & Christie

(2006). Decoding the implicit association test: Implications for criterion prediction. Journal of Experimental Social Psychology, 42, 192–212. https://doi.org/10.1016/j.jesp.2005.07.003.

Bleidorn

, Schönbrodt

, Gebauer

J. E.

, Rentfrow

P. J.

, Potter

, & Gosling

S. D.

(2016). To live among like–minded others: Exploring the links between person–city personality fit and self–esteem. Psychological Science, 27, 419–427. https://doi.org/10.1177/0956797615627133.

Boele

, Sijtsema

J. J.

, Klimstra

T. A.

, Denissen

J. J.

, & Meeus

W. H.

(2017). Person–group dissimilarity in personality and peer victimization. European Journal of Personality, 31, 220–233. https://doi.org/10.1002/per.2105.

10.

Bollen

K. A.

, & Jackman

R. W.

(1985). Regression diagnostics: An expository treatment of outliers and influential cases. Sociological Methods & Research, 13, 510–542.

11.

Bonferroni

C. E.

(1935). Il Calcolo Delle Assicurazioni Su Gruppi Di Teste. Tipografia del Senato.

12.

Burnham

K. P.

, & Anderson

D. R.

(1998). Model selection and multimodel inference: A practical information–theoretic approach. Springer Science & Business Media.

13.

Burnham

K. P.

, & Anderson

D. R.

(2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33, 261–304. https://doi.org/10.1177/0049124104268644.

14.

Burnham

K. P.

, Anderson

D. R.

, & Huyvaert

K. P.

(2010). AIC model selection and multimodel inference in behavioral ecology: Some background, observations, and comparisons. Behavioral Ecology and Sociobiology, 65, 23–35.

15.

Collins

L. M.

, Schafer

J. L.

, & Kam

C. M.

(2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330–351.

16.

Cronbach

L. J.

(1955). Processes affecting scores on understanding of others and assumed similarity. Psychological Bulletin, 52, 177–193. https://doi.org/10.1037/h0044919.

17.

Cronbach

L. J.

, & Gleser

G. C.

(1953). Assessing similarity between profiles. Psychological Bulletin, 50, 456–473. https://doi.org/10.1037/h0057173.

18.

Dyrenforth

P. S.

, Kashy

D. A.

, Donnellan

M. B.

, & Lucas

R. E.

(2010). Predicting relationship and life satisfaction from personality in nationally representative samples from three countries: The relative importance of actor, partner, and similarity effects. Journal of Personality and Social Psychology, 99, 690–702.

19.

Dziak

J. J.

, Coffman

D. L.

, Lanza

S. T.

, & Li

(2012). Sensitivity and specificity of information criteria. Pennsylvania State University. Retrieved from https://methodology.psu.edu/media/techreports/12–119.pdf

20.

Edwards

J. R.

(1994). The study of congruence in organizational behavior research: Critique and a proposed alternative. Organizational Behavior and Human Decision Processes, 58, 51–100.

21.

Edwards

J. R.

(2001). Ten difference score myths. Organizational Research Methods, 4, 265–287. https://doi.org/10.1177/109442810143005.

22.

Edwards

J. R.

(2002). Alternatives to difference scores: Polynomial regression analysis and response surface methodology. In Drasgow

, & Schmitt

N. W.

(Eds.), Advances in measurement and data analysis (pp. 350–400). Jossey–Bass.

23.

Edwards

J. R.

(2007). Polynomial regression and response surface methodology. In Ostroff

, & Judge

T. A.

(Eds.), Perspectives on organizational fit (pp. 361–372). San Francisco: Jossey–Bass.

24.

Edwards

J. R.

, & Parry

M. E.

(1993). On the use of polynomial regression equations as an alternative to difference scores in organizational research. Academy of Management Journal, 36, 1577–1613.

25.

Edwards

J. R.

, & Shipp

A. J.

(2007). The relationship between person–environment fit and outcomes: An integrative theoretical framework. In Ostroff

, & Judge

T. A.

(Eds.), Perspectives on organizational fit (pp. 209–258), The organizational frontiers series. Lawrence Erlbaum Associates Publishers.

26.

Franken

, Laceulle

O. M.

, Van Aken

M. A.

, & Ormel

(2017). Using response surface analysis to interpret the impact of parent–offspring personality similarity on adolescent externalizing problems. European Journal of Personality, 31, 104–117. https://doi.org/10.1002/per.2088.

27.

Garamszegi

L. G.

(2011). Information–theoretic approaches to statistical analysis in behavioural ecology: An introduction. Behavioral Ecology and Sociobiology, 65, 1–11. https://doi.org/10.1007/s00265–010–1028–7.

28.

Gonzalez

, & Griffin

(1999). The correlational analysis of dyad–level data in the distinguishable case. Personal Relationships, 6, 449–469.

29.

Goodman

(2008). A dirty dozen: Twelve p–value misconceptions. Seminars in Hematology, 45, 135–140.

30.

Harring

J. R.

, Weiss

B. A.

, & Hsu

J. C.

(2012). A comparison of methods for estimating quadratic effects in nonlinear structural equation models. Psychological Methods, 17, 193–214.

31.

Humberg

, Nestler

, & Back

M. D.

(2018). Response surface analysis in personality and social psychology: Checklist and clarifications for the case of congruence hypotheses. Social Psychological and Personality Science. https://doi.org/10.1177/1948550618757600

32.

Ilmarinen

V.–J.

, Vainikainen

M.–P.

, Verkasalo

M. J.

, & Lönnqvist

J.–E.

(2017). Homophilous friendship assortment based on personality traits and cognitive ability in middle childhood: The moderating effect of peer network size. European Journal of Personality, 31, 208–219. https://doi.org/10.1002/per.2095.

33.

Johns

(1981). Difference score measures of organizational behavior variables: A critique. Organizational Behavior and Human Performance, 27, 443–463. https://doi.org/10.1016/0030–5073(81)90033–7.

34.

Kenny

D. A.

, & Acitelli

L. K.

(1994). Measuring similarity in couples. Journal of Family Psychology, 8, 417–431. https://doi.org/10.1037/0893–3200.8.4.417.

35.

Kenny

D. A.

, & Cook

(1999). Partner effects in relationship research: Conceptual issues, analytic difficulties, and illustrations. Personal Relationships, 6, 433–448.

36.

Kenny

D. A.

, Kashy

D. A.

, & Cook

W. L.

(2006). Dyadic data analysis. Guilford.

37.

Kenny

D. A.

, & Ledermann

(2010). Detecting, measuring, and testing dyadic patterns in the actor–partner interdependence model. Journal of Family Psychology, 24, 359–366.

38.

McClelland

G. H.

, & Judd

C. M.

(1993). Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin, 114, 376–390. https://doi.org/10.1037/0033–2909.114.2.376.

39.

Meredith

, & Teresi

J. A.

(2006). An essay on measurement and factorial invariance. Medical Care, 44, S69–S77. https://doi.org/10.1097/01.mlr.0000245438.73837.89.

40.

Montgomery

D. C.

, Peck

E. A.

, & Vining

G. G.

(1982). Introduction to linear regression analysis. John Wiley & Sons.

41.

Nestler

, Grimm

K. J.

, & Schönbrodt

F. D.

(2015). The social consequences and mechanisms of personality: How to analyse longitudinal data from individual, dyadic, round–robin and network designs. European Journal of Personality, 29, 272–295.

42.

Olderbak

S. G.

, Malter

, Wolf

P. S. A.

, Jones

D. N.

, & Figueredo

A. J.

(2017). Predicting romantic interest at zero acquaintance: Evidence of sex differences in trait perception but not in predictors of interest. European Journal of Personality, 31, 42–62. https://doi.org/10.1002/per.2087.

43.

Olsen

J. A.

, & Kenny

D. A.

(2006). Structural equation modeling with interchangeable dyads. Psychological Methods, 11, 127–141.

44.

Peter

J. P.

, Churchill

G. A.

, & Brown

T. J.

(1993). Caution in the use of difference scores in consumer research. Journal of Consumer Research, 19, 655–662. https://doi.org/10.1086/209329.

45.

R Core Team (2015). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.

46.

Rogers

K. H.

, Wood

, & Furr

R. M.

(2018). Assessment of similarity and self–other agreement in dyadic relationships: A guide to best practices. Journal of Social and Personal Relationships, 35, 112–134. https://doi.org/10.1177/0265407517712615.

47.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.

48.

Rousseeuw

P. J.

, Ruts

, & Tukey

J. W.

(1999). The bagplot: A bivariate boxplot. Journal of the American Statistician, 53, 382–387.

49.

Schafer

J. L.

, & Graham

J. W.

(2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.

50.

Schönbrodt

F. D.

(2016). Testing fit patterns with polynomial regression models. https://doi.org/10.31219/osf.io/ndggf

51.

Schönbrodt

F. D.

, & Humberg

(2018). RSA: An R package for response surface analysis (version 0.9.12). https://CRAN.R–project.org/package=RSA

52.

Shanock

L. R.

, Baran

B. E.

, Gentry

W. A.

, Pattison

S. C.

, & Heggestad

E. D.

(2010). Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 25, 543–554.

53.

Strauss

J. P.

, Barrick

M. R.

, & Connerley

M. L.

(2001). An investigation of personality similarity effects (relational and perceived) on peer and supervisor ratings and the role of familiarity and liking. Journal of Occupational and Organizational Psychology, 74, 637–657.

54.

Symonds

M. R. E.

, & Moussalli

(2011). A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike's information criterion. Behavioral Ecology and Sociobiology, 65, 13–21.

55.

Tufte

E. R.

(1983). The visual display of quantitative information (2nd ed.). Graphics Press.

56.

Weidmann

, Schönbrodt

F. D.

, Ledermann

, & Grob

(2017). Concurrent and longitudinal dyadic polynomial regression analyses of Big Five traits and relationship satisfaction: Does similarity matter? Journal of Research in Personality, 70, 6–15.

57.

Wilkinson

, & Task Force on Statistical Inference (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.08 MB

Testing Similarity Effects with Dyadic Response Surface Analysis

Abstract

Keywords

Get full access to this article

References

Supplementary Material