Exponential random graph models (ERGM) have been widely applied in the social sciences in the past 10 years. However, diagnostics for ERGM have lagged behind their use. Collinearity-type problems can emerge without detection when fitting ERGM, yielding inconsistent model estimates and problematizing inference from parameters. This article provides a method to detect multicollinearity in ERGM. It outlines the problem and provides a method to calculate the variance inflation factor (VIF) from ERGM parameters. It then evaluates the method with a Monte Carlo simulation, fitting 216,000 ERGMs and calculating the VIFs for each model. The distribution of VIFs is analyzed using multilevel regression to determine what network characteristics lend themselves to collinearity-type problems. The relationship between VIFs and unstable standard errors (a standard sign of collinearity) is also examined. The method is shown to effectively detect multicollinearity, and guidelines for interpretation are discussed.
AnWeihua. 2016. “Fitting ERGMs on Big Networks.” Social Science Research59:107–19.
2.
BarabasiAlbert-LaszloAlbertReka. 1999. “Emergence of Scaling in Random Networks.” Science286:509–12.
3.
ChandrasekharArun GJacksonMatthew O.. 2014. “Tractable and Consistent Random Graph Models.” Physics and Society. doi: arXiv:1210.7375v4.
4.
ChatterjeeSampritPriceBertram. 1991. Regression Analysis by Example. New York: Wiley.
5.
FaustKatherine. 2007. “Very Local Structure in Social Networks.” Sociological Methodology37(1):209–56.
6.
FoxJohn. 2008. Applied Regression Analysis and Generalized Linear Models. Thousand Oaks, CA: Sage.
7.
FoxJohnMonetteGeorges. 1992. “Generalized Collinearity Diagnostics.” Journal of the American Statistical Association87(417):178–83.
8.
FrankOveStraussDavid. 1986. “Markov Graphs.” Journal of the American Statistical Association81:832–42.
9.
GeyerCharles J.ThompsonElizabeth A.. 1992. “Constrained Monte Carlo Maximum Likelihood for Dependent Data.” Journal of the Royal Statistical Society Series B54(3):657–99.
GoodreauSteven M.KittsJames A.MorrisMartina. 2009. “Birds of a Feather, or Friend of a Friend? Using Exponential Random Graph Models to Investigate Adolescent Social Networks.” Demography46(1):103–25.
12.
HanakiNobuyukiPeterhanslAlexanderDoddsPeter S.WattsDuncan J.. 2007. “Cooperation in Evolving Social Networks.” Management Science53(7):1036–50.
13.
HandcockMark S.2003. “Statistical Models for Social Networks: Degeneracy and Inference.” Pp. 229–40 in Dynamic Social Network Modeling and Analysis, edited by BreigerRonaldPattisonPhillipa. Washington, DC: National Academies Press.
14.
HandcockMark S.HunterDavid R.ButtsCarter T.GoodreauSteven M.MorrisMartina. 2003. Statnet: Software tools for the Statistical Modeling of Network Data. Retrieved May 22, 2017 (http://statnetproject.org).
15.
HandcockMark S.RobinsGarrySnijdersTomMoodyJimBesagJulian. 2003. “Assessing Degeneracy in Statistical Models of Social Networks.” Journal of the American Statistical Association76:33–50.
16.
HannekeSteveFuWenjieXingEric P.. 2010. “Discrete Temporal Models of Social Networks.” Electronic Journal of Statistics4:585–605.
17.
HarrellFranke E.2001. Regression Modeling Strategies with Application to Linear Models, Logistic Regression, and Survival Analysis. New York: Springer-Verlag.
18.
HarrisJenine K.2014. An Introduction to Exponential Random Graph Modeling. Thousand Oaks, CA: Sage.
19.
HippJohn R.ButtsCarter T.ActonRyanNagleNicholas N.BoessenAdam. 2013. “Extrapolative Simulation of Neighborhood Networks Based on Population Spatial Distribution: Do they Predict Crime?” Social Networks35:614–25.
20.
HollandPaul W.LeinhardtSamuel. 1981. “An Exponential Family of Probability Distributions for Directed Graphs.” Journal of the American Statistical Association76(737):33–50.
21.
HunterDavid R. 2007. “Curved Exponential Family Models for Social Networks.” Social Networks29(2):216–30.
22.
HunterDavid R.GoodreauSteven M.HandcockMark S.. 2008. “Goodness of Fit of Social Network Models.” Journal of the American Statistical Association103(481):248–58.
23.
HyojoungKimBearmanPeter S.. 1997. “The Structure and Dynamics of Movement Participation.” American Sociological Review62(1):70–93.
24.
KoskinenJohanSnijdersTom A. B.. 2013. “Simulation, Estimation, and Goodness of Fit.” Pp. 141–66 in Exponential Random Graph Models for Social Networks: Theory Methods and Applications, edited by LusherDeanKoskinenJohanRobinsGarry. Cambridge, England: Cambridge University Press.
25.
KreagerDerek A.YoungJacob T. N.HaynieDana L.BouchardMartinSchaeferDavid R.ZajacGary. 2017. “Where ‘Old Heads’ Prevail: Inmate Hierarchy in a Men’s Prison Unit.” American Sociological Review82(4):685–718.
26.
KrivitskyPavel N.HandcockMark S.. 2014. “A separable model for dynamic networks.” Journal of the Royal Statistical Society B76(1):29–46.
LusherDeanKoskinenJohanRobinsGarry. 2013. Exponential Random Graph Models for Social Networks: Theory, Methods, and Applications. Cambridge, England: Cambridge Press.
29.
MooneyChristopher Z.1997. Monte Carlo Simulation. Thousand Oaks, CA: Sage.
30.
NewmanMark E. J. 2002. “Assortative Mixing in Networks.” Physical Review Letters89:208701.
31.
NewmanMark E. J.StrogatzSteven H.WattsDuncan J.. 2001. “Random Graphs with Arbitrary Degree Distributions.” Phyiscal Reviews E64:026118.
32.
O’BrienRobert M.2007. “A Caution Regarding Rules of Thumb for Variance Inflation Factors.” Quality and Quantity41:673–90.
33.
O’MalleyJames A.OnnelaJukka-Pekka. 2014. “Topics in Social Network Analysis and Network Science.” Physics and Society. doi: arXiv:1404.0067v1.
34.
PadgettJohn F.AnsellChristopher K.. 1993. “Robust Action and the Rise of the Medici, 1400-1434.” American Journal of Sociology98(6):1259–319.
35.
PapachristosAndrew V.2009. “Murder by Structure: Dominance Relations and the Social Structure of Gang Homicide.” American Journal of Sociology115(1):74–128.
36.
PapachristosAndrew V.HureauDavidBragaAnthony. 2013. “The Corner and the Crew: The Influence of Geography and Social Networks on Gang Violence.” American Sociological Review78(3):417–47.
37.
RencherAlvin C.2002. Methods of Multivariate Analysis. 2nd ed. Hoboken, NJ: John Wiley.
RobinsGarryPattisonPipKalishYuvalLusherDean. 2007. “An Introduction to Exponential Random Graph (p*) Models for Social Networks.” Social Networks29(2):173–91.
40.
Salter-TownshendMichaelMurphyThomas Brendan. 2015. “Role Analysis in Networks using Mixtures of Exponential Random Graph Models.” Journal of Computational Graph Statistics24(2):520–38.
41.
ShoreJesseLubinBenjamin. 2015. “Spectral Goodness of fit for Network Models.” Social Networks43:16–27.
42.
SnijdersTom A. B. 2002. “Markov Chain Monte Carlo Estimation of Exponential Random Graph Models.” Journal of Social Structure3(2):1–40.
43.
SnijdersTom A. B.BoskerRoel J.. [1999] 2008. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. 3rd ed. London, England: Sage.
44.
SnijdersTom A. B.PattisonPhillipa E.RobinsGarry L.HandcockMark S.. 2006. “New Specifications for Exponential Random Graph Models.” Sociological Methodology36(1):99–153.
45.
SnijdersTom A. B.van de BuntGerhard G.SteglichChristian E. G.. 2010. “Introduction to Actor-based Models for Network Dynamics.” Social Networks32:44–60.
46.
SteglichChristianSnijdersTom A. B.PearsonMichael. 2010. “Dynamic Networks and Behavior: Separating Selection from Influence.” Sociological Methodology40(1):329–93.
47.
WattsDuncan J.StrogatzSteven H.. 1998. “Collective Dynamics of ‘Small-world’ Networks.” Nature393:440–42.
48.
WimmerAndreasLewisKevin. 2010. “Beyond and Below Racial Homophily: ERG Models of a Friendship Network Documented on Facebook.” American Journal Sociology116(2):583–642.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
