Sage Journals: Discover world-class research

Abstract

Social network analysis (SNA) is becoming a prevalent method in education research and practice. But criticism has been voiced against the heavy reliance on quantification within SNA. Recent work suggests combining quantitative and qualitative approaches in SNA—mixed methods social network analysis (MMSNA)—as a remedy. MMSNA is helpful for addressing research questions related to the formal or structural side of relationships and networks, but it also attends to more qualitative questions such as the meaning of interactions or the variability of social relationships. In this chapter, we describe how researchers have applied and presented MMSNA in publications from the perspective of general mixed methods research. Based on a systematic review, we summarize the different applications within the field of education and learning research, point to potential shortcomings of the methods and its presentation, and develop an agenda to support researchers in conducting future MMSNA research.

Beginning in the 1990s, education researchers, policy makers, and practitioners have become interested in relationships and collaboration in educational settings. In response, social network analysis (SNA) was proposed as a theoretical and methodological framework, offering theory and tools to explore relationships in depth. Compared to then existing approaches for studying interactions and interdependencies among, for example, teachers or pupils, SNA allows one to capture these relationships in a more nuanced way, by focusing on the patterns and qualities of relationships (Borgatti et al., 2009). SNA offers valuable insights into whether and to what degree interactions and collaboration take place in education. Another key strength of SNA is that it offers several tools to visualize relationships (Hogan et al., 2007), which creates opportunities for visual analysis and feedback aimed at improving practice. No other methodological framework is as focused on the in-depth exploration of relationships and structures in learning and instruction (Moolenaar, 2012; Sweet, 2016).

The surge in SNA publications across the academic disciplines is largely driven by quantitative SNA studies (Freeman, 2004). Despite its merits, authors such as Fuhse and Mützel (2011) or Hollstein (2011) have criticized this formalized approach to network analysis for a lack of attention to the qualitative aspects of relationships. Recent work addresses these concerns by combining quantitative and qualitative approaches in SNA to what we call mixed methods social network analysis (MMSNA; Froehlich, Rehm, et al., 2020; Hollstein, 2014). MMSNA is helpful for addressing research questions related to the formal or structural side of relationships and networks, but it also attends to questions related to the actual content and meaning of interactions, the day-to-day variability of social relationships, the developments of nodes and ties, and agency (Crossley, 2010; Crossley & Edwards, 2016).

In this chapter, we describe how researchers have applied and presented MMSNA in publications from the perspective of general mixed methods research. Based on a systematic review, we (a) summarize the different applications within the field of education and learning research, (b) point to potential shortcomings of the methods and its presentation, and (c) develop an agenda to support researchers in conducting future MMSNA research. We tailored the review for a diverse audience. For social network and mixed method researchers, the review details the use of mixed methods within SNA, sets forward a framework for quality reporting practices, and hints at potential pitfalls. For education researchers, the review illustrates how MMSNA is being applied when studying relationships and collaboration within educational settings.

Background

Social Network Theory and Analysis

Networks are a way of thinking about social systems that focus our attention on the web of relationships that surrounds actors. Networks are composed of actors (nodes) and their relationships (ties). Actors can be individuals, for example, pupils in a classroom or teachers in a school, or collectivities, such as teams, organizations, or countries. Ties include relationships or transfers such as conversations between pupils or information exchanges among teachers. The central focus of social network theory is on relationships among actors to explain actor and network outcomes. Over the years, there have been discussions about whether social network theory is an actual “theory,” a collection of methods, or a metaphor (Wellman, 1988). Initially, many social capital theorists drew on SNA as a methodological approach and a means to capturing relevant features of interaction only. Today, several scholars argue that this claim is not a valid stance anymore (Borgatti et al., 2014; Brass et al., 2014). To date, a solid body of work has been developed, comprising theoretical concepts such as structural holes (Burt, 1992), centrality (Freeman, 1978), the strength of ties (Granovetter, 1973), and structural equivalence (Lorrain & White, 1971). Network researchers use the tools offered by SNA to study the relationships and structural features of social networks (Wellman, 1983).

A Social Network Perspective in Education Research

The urge to capitalize on relationships, interaction, and collaboration within educational settings is reflected by a growing number of concepts, such as communities of practice, organizational shared and collaborative learning, and professional (learning) communities (Louis & Marks, 1998; McLaughlin & Talbert, 2006; Wenger et al., 2002). Indeed, researchers have established the usefulness of SNA in examining the role of relationships for student achievement (Daly et al., 2014; Pil & Leana, 2009), teacher learning (Baker-Doyle, 2015; Fox et al., 2011), reform and improvement (Moolenaar et al., 2012; Penuel et al., 2016), policy implementation (Coburn et al., 2012; Frank et al., 2011), leadership (Daly & Finnigan, 2011; Spillane & Shirrell, 2017), and professional development programs (Baker-Doyle & Yoon, 2010; Hofman & Dijkstra, 2010; Penuel et al., 2012).

These new lines of research have led to greater interest in the research on relationships in education. However, also conceptual and methodological challenges exist with this approach that SNA attempts to overcome. For example, the focus on particular communities can be limiting, as a student or teacher is often embedded in a network of relationships that span subgroups and include individuals inside and outside institutional boundaries (Penuel et al., 2009; Spillane, 2005). Also, the growing body of research on relationships has concentrated on social interactions. One problem of the extant literature is the precision of measurement (Coburn et al., 2012). Often, an “average” of a relationship between one individual and the rest of the group is being measured, for instance, how many times a teacher reports a certain interaction, irrespective of the specific interaction partner. A more fine-grained exploration of interaction, taking a relational view, could yield a better understanding of these phenomena.¹

Mixed Methods SNA

The nature of SNA within discussions about quantitative, qualitative, and mixed methodologies is ambiguous. Most researchers consider SNA a formal or quantitative technique (Crossley & Edwards, 2016; Hollstein, 2014). This definition is in stark contrast to the historical roots of SNA, which are qualitative (Freeman, 2004). Onwuegbuzie and Hitchcock (2015) highlight the potential to integrate qualitative and quantitative methods of network research and describe the method as quantitative-dominant crossover mixed analysis. Put differently, they view it as an inherently mixed analysis.

An increasing number of social network researchers makes use of mixed methods to generate their findings (Froehlich, Rehm, et al., 2020). This surge in interest has come with the realization that quantitative (or formal) and qualitative SNA each have their respective sets of strengths and weaknesses (Crossley, 2010). For example, qualitative SNA often lacks an overview of the structural properties of a network. Conversely, quantitative network analysis is often too abstract to consider the content being exchanged, the fluctuations of the relationships over time, or the role of agency (Crossley, 2010). This makes MMSNA relevant in gauging the social complexities found within education and learning research.

We define MMSNA as any SNA study drawing from both qualitative and quantitative data or using qualitative and quantitative methods of analysis. This definition is in line with definitions of mixed methods in general (Johnson et al., 2007; Johnson & Onwuegbuzie, 2004). These different methods need to be thoughtfully integrated. This can mean studies (a) that mix within SNA or (b) that include SNA as one element in the overall research design. In the former, qualitative and quantitative relational data are being used or qualitative and quantitative social network analytic approaches are being applied. The latter includes any mixed methods study featuring one component of SNA such as triangulating quantitative SNA with nonrelational, qualitative data.

Describing MMSNA Studies

In his seminal article “Describing Mixed Methods Research,” Guest (2013) states that “two dimensions are enough [to describe mixed methods designs]—the timing and the purpose of integration” (p. 147). These two dimensions thus form the basis for this review. But for any review, it is important not only to look at what is being done but also to assess the quality of research (cf. Siddaway et al., 2019). Therefore, we assess the quality of mixing in addition to the purpose(s) of mixing and its timing.

Purpose(s) of Mixing in MMSNA

Every use of mixed methods has a specific purpose of mixing, which is based on the researchers’ wish to raise the scope, power, and/or quality of their study (Schoonenboom et al., 2018). In this review, we follow the perspective of Schoonenboom et al. (2018) by focusing on “purposes of mixing at a detailed level” (p. 272). To aid the aggregation of the data for this review, we use three major categories of purposes of mixing: follow-up, comparison, and development. If the purpose is follow-up, methods are being used to expand on findings, for example, to aim for more generalizable findings, to find explanations for results, or to replicate findings. For example, researchers might combine a quantitative analysis using survey data with qualitative analysis of interviews “intended to deepen the understandings of the structural network analysis findings” (Rodway, 2015, p. 8). Comparison as a purpose refers to answering complementary research questions and triangulations throughout the research process. Last, development as a purpose for mixing aims at further informing the main research through a prestudy. For example, researchers may conduct cognitive interviews to improve a survey instrument or a sampling procedure.

Timing in MMSNA

Mixed methods research, in general, and MMSNA, in particular, is characterized by design features related to timing. Timing has two dimensions (Schoonenboom & Johnson, 2017):

Simultaneity: A case of mixing is concurrent when both elements involved are performed in parallel (Dingyloudi & Strijbos, 2018), and it is sequential when one element follows the other (Liou & Daly, 2014).

Dependence: A case of mixing is independent when both elements involved are performed without mutual influence (Dingyloudi & Strijbos, 2018), and it is dependent when one element influences the outcome of performance of the other element (Liou & Daly, 2014).

Quality in MMSNA

Hong et al. (2018) developed the Mixed Methods Appraisal Tool (MMAT) as a review tool for mixed studies in 2006 and since then have repeatedly improved it. The MMAT serves as a validated appraisal tool for the methodological quality of either qualitative, quantitative, or mixed methods studies. The MMAT questionnaire has two parts. Two preliminary screening questions confirm the suitability of the study to be evaluated using the MMAT. Next, five criteria for assessing mixed methods studies are applied to studies that include at least one qualitative and one quantitative method. We present the specificities of the coding procedure in the Method section.

Method

In this review, we follow the PRISMA statement² (Moher et al., 2009) and other texts describing the state of the art of doing literature reviews (Siddaway et al., 2019; Van Tulder et al., 2003) to identify and screen records, check their eligibility, and code them. This literature is then evaluated to answer the guiding question of this chapter of how MMSNA is being applied in contemporary education research. This process is depicted in Figure 1.

Figure 1

Overview of the Search Process

Identification of Records

We have followed two major strategies for identifying relevant literature. The first and arguably most important strategy involves the search in scientific databases with a predefined set of keywords. We focused on databases commonly referenced in learning and education: Education Resources Information Center, Education Full Text, PsycARTICLES, PsycINFO, and the Social Sciences Citation Index. PsycARTICLES was later dropped from the search to safeguard consistency, as the search terms turned out to be very imprecise for this database. Discussions with peers in the field confirmed that these are the most relevant databases for this review.

We searched these databases using three blocks of search terms that are connected to each other through “AND” operators. Figure 2 shows the lists of search terms.

Figure 2

Search Terms

In addition to this search, we followed a set of alternative strategies for identifying relevant literature to produce a comprehensive list of records. This includes back-tracking,³ forward-tracking,⁴ and consulting peers. Neither back-tracking nor forward-tracking returned additional records. This most likely has to do with the nature of the review that is not focused on a content-related theme, which would produce a narrative that could be traced in the reference list, but on a method. The consultation of peers, where we addressed colleagues and an international, informal research group about SNA in learning and education produced a list of 29 records before deleting duplicates.

Screening of Records

After the initial identification of 454 potentially relevant records, we created one database that contained the meta-information, including titles and abstracts, from all identified texts. First, we screened this list for duplicates and deleted 65 records. For the remainder of 389 records, two of the authors screened the titles and abstracts to make an initial decision about the relevance of the records. Relevance was determined based on four inclusion criteria. Specifically, the record needed

To report empirical research; conceptual contributions or reviews were excluded

To apply SNA based on our loose definition of MMSNA described in the background section

To use qualitative and quantitative data or apply qualitative and quantitative methods of data analysis

To be situated in education

During screening we excluded 296 records for an initial pool of 93 potential studies. To safeguard reliability of this process, a subset of 14 randomly selected records was coded by all authors and two independent researchers. Exact Kappa (Conger, 1980) was calculated. The result of κ = .75 (p < .01) indicated substantial agreement among the coders.

Eligibility of Records

For all records that passed the screening stage, the complete texts were accessed to confirm eligibility. For the vast majority of records, the reading of the full texts confirmed the initial assessment in the screening phase. One important deviation was found in methodologically oriented texts (e.g., Martínez et al., 2006) that—strictly speaking—did fulfill all inclusion criteria, but were found to be too shallow in the reporting of the empirical results for our purpose. Since this made a thorough review infeasible, these records were excluded. Also, for two records, no complete text could be retrieved, so they were excluded from further review. In total, 41 texts were removed from the literature review after reading the complete texts for a final list of 52 studies to be reviewed. With 52 studies left from an initial pool of 389 records, the precision of the search amounts to 13%. This number is rather low given that the term social network is used in very different ways, most notably in terms of social network sites, which cannot be excluded from the search because relevant research may be carried out using social networking site data. We kept the search rather broad to have greater confidence in not having filtered out relevant studies.

Coding of Included Studies

Three authors coded the following information of each of the eligible texts: publication meta-data, an assessment of the methodological quality of the empirical analysis, and features of the research design and integration. Next to this, memos and qualitative comments were written during the coding procedure.

Publication Meta-Data

Information required for documentation purposes, such as the names of the authors, the publication date, the publication type, and so forth, were coded. Additionally, we coded the theme and context of the article on a broad level.

Purpose(s) of Mixing in MMSNA

In line with our theoretical background, we have categorized the studies based on their purpose(s) of mixing in terms of follow-up, comparison, and development (Schoonenboom et al., 2018). This was done based on the research design, and we did not rely on authors’ statements about what they perceived as the purpose(s) of mixing.⁵

Timing in MMSNA

The two dimensions of timing—simultaneity and dependency—were coded for each study. This information was used to form four types of research: parallel and dependent, parallel and independent, sequential and dependent, and sequential and independent. Both design features have been defined and described in the background section. This cross tabulation helped examine the relationships between the dimensions of timing.

Quality in MMSNA

The methodological quality was rated according to the MMAT evaluation instrument (Hong et al., 2018). The MMAT provides five methodological quality criteria to evaluate mixed method studies that are rated as either 1 = present/yes or 0 = not present/no. Specifically, we coded whether

The purpose for applying a mixed methods approach has been stated.

The different components of the study were effectively integrated to provide a response to the research question. As integration is considered an essential component of mixed method research, the MMAT suggest to closely inspecting the used methods to integrate qualitative and quantitative phases, results, and data.

Meta-interference, the overall conclusion arrived at through integrating each of the methods’ inferences (Teddlie & Tashakkori, 2009), added value.

Divergences and inconsistencies between quantitative and qualitative results occurred and were adequately addressed.

The quality criteria of each applied method was adhered to. The MMAT considers high-quality components without exception as a requirement for mixed methods studies of good quality.

Reliability of the Coding Procedure

The coding was again checked in terms of reliability. This time, three of the authors simultaneously coded three records. The result of κ = .62 (p < .01) indicated that there was substantial agreement between the coders’ ratings.

Results

Table 1 summarizes the studies reviewed including information about the theme, identified purpose and timing according to the previously mentioned categories, and the overall score on the MMAT. The table also illustrates the breadth of themes that MMSNA was used to research. In terms of context, it was often applied in K–12 (23 studies, 44%), higher education (18 studies, 35%), or school administration (three studies, 6%).

Table 1

Overview of the Included Studies

#	Study	Theme	Context	Purpose			Timing	MMAT Score
#	Study	Theme	Context	F	C	D	Timing	MMAT Score
1	Ardoin et al. (2017)	Peer trust in environmental education	K–12	—	✔	—	SD	3
2	Baird et al. (2014)	Interactive decision making	Administration	✔	✔	—	PI	3
3	Baker-Doyle & Petchauer (2015)	Teacher preparation for licensure exam	K–12	✔	✔	—	SD	3
4	Bozkurt & Keefer (2018)	Learning communities in MOOCs	Various	—	—	✔	SD	0
5	Bozkurt et al. (2016)	Learning communities in MOOCs	Various	✔	✔	—	SD	5
6	Carhill-Poza (2015)	Student–peer interaction and language learning	HE	✔	✔	—	SI	4
7	Cornelissen et al. (2014)	School–university research networks	Various	✔	—	—	PD	5
8	Cornelissen et al. (2015)	Development, sharing, and usage of research-based knowledge	HE	✔	—	—	SD	5
9	Cross et al. (2009)	Interagency collaboration	K–12	✔	✔	—	PI	3
10	Daly & Finnigan (2010)	Communication and knowledge networks	Administration	✔	—	—	SD	5
11	Daly & Finnigan (2011)	Communication and knowledge networks	Administration	✔	—	✔	SD	5
12	Daly et al. (2010)	School reform	K–12	✔	—	—	SD	5
13	Dingyloudi & Strijbos (2018)	Peer feedback	HE	✔	✔	—	PI	2
14	Finnigan & Daly (2012)	Organizational learning and improvement	Administration	✔	—	—	SD	4
15	Finnigan et al. (2013)	District reform	K–12	✔	—	—	SD	5
16	Goggins et al. (2011)	Online group formation	HE	✔	✔	—	PI	4
17	Häussling (2010)	Social positions in class	K–12	—	✔	—	PI	5
18	Hoffman & Silverberg (2015)	Peer interaction	HE	—	—	—	SI	0
19	Honeychurch et al. (2017)	Community development in MOOCs	K–12	✔	—	✔	SD	1
20	Hopkins & Spillane (2014)	Support of beginning teachers	K–12	✔	—	—	PI	4
21	Hopkins et al. (2015)	District infrastructure and language learning	K–12	✔	—	—	PI	3
22	Kellogg et al. (2014)	Teacher-peer support in MOOCs	K–12	?	?	?	PI	1
23	Kortemeyer & Kortemeyer (2018)	Student collaboration	HE	✔	—	—	SI	1
24	Langhout et al. (2014)	Relational empowerment	K–12	—	✔	—	PI	1
25	Lee et al. (2014)	Interracial peer relationships	K–12	?	?	?	SI	1
26	Liou & Daly (2014)	Professional learning communities	K–12	✔	✔	—	PI	5
27	Liou et al. (2014)	Distributed leadership and data-driven professional networks	K–12	?	?	?	SD	3
28	Lu & Churchill (2014)	Collaborative learning	HE	—	✔	—	SD	5
29	Penuel et al. (2009)	Teacher professional communities	K–12	✔	—	—	PI	3
30	Pifer (2011)	Departmental networks	HE	✔	—	—	SD	5
31	Rienties & Hosein (2015)	Teacher interaction in academic development	HE	—	✔	—	SD	5
32	Rienties & Kinchin (2014)	Interactions in academic development	HE	—	✔	—	PI	4
33	Rienties et al. (2014)	Computer-mediated communication	HE	—	✔	—	SD	3
34	Rienties et al. (2013)	Student intercultural learning interactions	HE	✔	—	—	SD	3
35	Rienties et al. (2015)	Cross-cultural learning	HE	—	✔	—	SD	4
36	Risser (2013)	Twittering in mentoring relationships	K–12	—	—	✔	PD	3
37	Rodriguez-Medina et al. (2018)	Friendship relationships and autism	K12	—	✔	—	PI	3
38	Rodway (2015)	Research brokering networks	Health	✔	—	—	SD	2
39	Sánchez et al. (2011)	Mentoring relationships	K–12	✔	—	—	SI	5
40	Schiff et al. (2015)	Teacher collaboration	K–12	✔	—	—	SD	5
41	Smith (2010)	Learning communities	HE	✔	—	—	SI	0
42	Smith (2015)	Student learning communities	HE	✔	—	—	PI	5
43	Spillane et al. (2015)	Intra- and interschool interactions	K–12	✔	—	—	SD	5
44	Spillane et al. (2018)	Teacher performance	K–12	✔	—	—	SD	4
45	Tirado et al. (2015)	Discussion fora in writing environments	HE	?	?	?	PD	3
46	Ugurlu (2016)	Interorganizational collaboration in districts	K–12	—	✔	—	SD	5
47	Van Gasse et al. (2017)	Teacher interaction	Various	✔	—	—	SD	5
48	Van Waes et al. (2015)	Teacher interaction in academic development	HE	—	✔	—	PI	5
49	Vanwynsberghe et al. (2014)	Support of social media experts	Library	✔	—	—	SD	1
50	Wise & Cui (2018)	Learning communities in MOOCs	HE	✔	—	—	SD	3
51	Wong-Hooker (2016)	Teacher collaboration in special education	K–12	—	✔	—	SD	5
52	Yessis et al. (2013)	Interorganizational relationships and brokering	Health	—	✔	—	SD	0

Note. Abbreviations in context: HE = higher education; abbreviations for the purposes: F = follow-up, C = comparison, D = development. MMAT = Mixed Methods Appraisal Tool; PD = parallel and dependent; PI = parallel and independent; SD = sequential and dependent; SI = sequential and independent; MOOC = massive open online course.

Purpose(s) of Mixing in MMSNA

We evaluated the major purposes of mixing.⁶ In 32 studies (62%), the purpose of mixing was identified as follow-up. Of almost equal prominence, 21 studies (40%) used different methods for the purpose of comparison. In eight studies (15%), follow-up and comparison were simultaneously present as the purposes of mixing. Four studies (8%) used one method to develop another. In four studies (8%) the purpose remained unclear, even after reading the full text.

We also intended to check for congruence between the purpose(s) of mixing identified by us and the purpose(s) stated by the respective study authors. Given that the vast majority of studies did not allow to us to observe the authors’ thinking and line of argumentation (see Quality in MMSNA below), the alignment between what the authors stated and what was done could not be coded.

Timing in MMSNA

Eighteen studies (35%) contained parallel designs. One example is the study by Dingyloudi and Strijbos (2018), who collected and analyzed quantitative social network data and video data in parallel. An example of a sequential MMSNA design is Rodway (2015), where a quantitative, sociocentric strand of survey research was executed before a qualitative investigation. Thirty-one studies (60%) used methods that were dependent on each other. However, this number for dependency needs to be interpreted with caution, as it represents a frequency count that does not say anything about the strength of the dependency. “Dependency” often referred to a minor interface between the two methods only. For example, researchers used metrics derived from sociocentric network data to inform the qualitative data collection through purposeful sampling procedures or by using network maps as interview material (e.g., Daly & Finnigan, 2010).

As described above, we aggregated these data into four types (see Table 2). Designs that combined sequential timing with dependency (28 studies, 54%) or parallel timing with independency (15 studies, 29%) made up the vast majority of the sample. This was to be expected in so far that sequential designs that are dependent rather than independent make better use of the information that is already available in the research project, which naturally leads to a higher prevalence. Likewise, parallel timing is more complex in its implementation when the methods are referring to each other (i.e., dependency).

Table 2

Overview of Timing

	Parallel	Sequential
Dependent	3 (6%)	28 (54%)
Independent	15 (29%)	6 (12%)

Quality in MMSNA

Concerning the quality of the studies, we comment on our observations regarding the five aspects of the MMAT. First, we observed whether the purpose of mixing was explicitly stated. Of the 52 studies, 38 (73%) made their purpose(s) of mixing explicit, while in more than one quarter of the reviewed studies, the researchers did not state their reasons for using quantitative and qualitative data and/or methods. Even for those that did, this discussion was often short and most often referred to “triangulation” or a “case study” without more detailed explanations.

Second, when it came to the integration of the different methods used in a MMSNA design, we looked at whether the methods were effectively integrated to answer the posed research question. For most studies (42 studies, 81%), this was done in a sufficiently clear manner. Third, compared to the above figure of integration of 81%, the adequate integration of outputs (“meta-inference”) was only present in 27 studies (52%). In other words, often, the information gained in one strand of research was not used at all or not sufficiently integrated with the other findings when forming conclusions. This is a missed opportunity to improve the quality of integration and of the overall study.

Fourth, another opportunity to enhance the quality of MMSNA studies is the discussion of how the findings from the quantitative and qualitative data relate to each other. For 36 studies (69%), there were either no differences to be discussed or these divergences were adequately addressed in the discussion. This means that 31% failed to address conflicting findings in meaningful ways. It is important to note that—in line with the coding instructions of the used instrument—we only coded “absence” when differences were observed but not discussed.

Fifth, concerning the overall adherence to quality criteria, we coded 35 studies (68%) as being in line with the quality criteria associated with each of the methods being used. While this number is high compared to the other metrics coded in this review, it is important to note that meeting methodological quality criteria should be a lower level indicator of quality for a study; it does not say anything about the effectiveness of integration or the actual answering the research question. Associated with this criterion, one comment that was often repeated in the memos we wrote during the coding process was that the word limitations of journals made it difficult for authors to comply with the reporting standards of the underlying methods.

Few studies explicitly addressed convergences or divergences and (in)consistencies between results. Most studies discussed the different methods’ findings next to each other and had little or no mixing in the Discussion section. One positive example is the study by Spillane et al. (2018), which integrated the outputs of the different data—interviews with teachers, network surveys, student test scores, and teacher performance data—to investigate how teacher performance predicts interaction. The authors discussed how the interview data offered additional interpretative power on how the school district’s educational infrastructure influenced teachers’ notions about expert teachers. They also addressed how student test scores did not support findings in predicting expert teaching performance and how the interview data helped to inform this finding.

Post Hoc Observations

In this section, we present two post hoc observations that were not part of the deductive coding scheme but that nevertheless seem important. During coding, we observed that many of the MMSNA studies used network maps as a way to illustrate the findings. For instance, Hoffman and Silverberg’s (2015) study on peer interactions in a higher education setting used a network map for the single purpose of illustrating instances of joint work in student collaboration. However, visuals were also used in several studies as feedback to participants or as a basis to develop interventions. For example, Rienties and Kinchin (2014) showed network maps to participants in a professional development program and asked participants to reflect on the patterns and structures as part of a free-response exercise. Van Waes et al. (2015) used a concentric circle method (Hogan et al., 2007; Van Waes & Van den Bossche, 2020) to provide feedback about change over time in personal teaching networks during interviews. The visuals of the personal network maps were used to gain insight into supporting and constraining mechanisms for network change as a complement to longitudinal network surveys. This visual approach (also see Shannon-Baker & Edwards, 2018; Shannon-Baker & Hilpert, 2020) to MMSNA may offer a basis for the design of network interventions where the network awareness of participants is being fostered (Palonen & Froehlich, 2020; Van Waes et al., 2018).

Another post hoc observation is related to the point of integration. The point of integration is the stage of research where two methods are brought together (Schoonenboom & Johnson, 2017). Often, two methods were connected at the sampling stage. Specifically, the quantitative, often sociometric data were used to inform the selection of participants for further, in-depth, and often egocentric data collection (e.g., Rienties & Kinchin, 2014). Other prominent points of integration were at the stages of results/analysis (e.g., Rodríguez-Medina et al., 2018) or in the discussion/conclusion (e.g., Hopkins & Spillane, 2014).

Discussion and Conclusion

As outlined in the introduction, this systematic review aims to (a) give an overview of the different applications of MMSNA within the field of education and learning research, (b) point to challenges of the methods and their presentation, and (c) develop an agenda to support researchers in conducting future MMSNA research. We will now discuss these three themes.

Applications of MMSNA in Education and Learning Research

Overall, our review showed mixing of various methods and data in the eligible MMSNA studies. The surveyed literature shows a great variety of different data sources and analytical methods being used. For example, Häussling (2010) analyzed video recordings of classroom interactions using SNA to uncover social structures, dynamics such as interaction sequences, and the emotional expressions involved. These data were triangulated with responses on networks surveys and interviews. Bokhove (2018) argues how a mixed method approach to classroom interaction may benefit from an SNA lens. He modeled temporal interactions of students and teachers in the classroom combining SNA and video data. However, we did not find examples of mixed data obtained with alternative devices, such as tracking interactions with sociometric badges (Kim et al., 2012). Although we observed some variety in terms of data sources and methods, researchers used network surveys and qualitative interviews most frequently. Similarly, the versatility of MMSNA is illustrated by the range of the themes addressed in the studies we reviewed, which cover diverse topics such as school reform (Daly & Finnigan, 2010), learning in MOOCs (Wise & Cui, 2018), informal mentoring (Risser, 2013), or trust (Ardoin et al., 2017).

Challenges of MMSNA Linked to a Future Research Agenda

We also identified challenges in conducting and reporting MMSNA research from which we try to derive an agenda for further MMSNA research. We recommend to (a) further explore the richness of MMSNA designs, (b) improve reporting practices concerning purpose and design, (c) increase integration, and (d) attends to validity issues identified in MMSNA research.

Variability of MMSNA Designs

We have noted a hegemony of a few MMSNA designs in terms of timing. This is interesting when considering the plethora of different topics and research questions present in the reviewed studies. In consequence, this raises the question whether the designs have indeed been properly fitted to the specific research questions at stake, or whether the designs of published studies have been used overused as blueprints. This observation also extends to the purpose(s) of mixing coded in the studies. While we could name very different purposes of mixing we also noted that explanation, a variant of follow-up, and triangulation, a variant of comparison, were especially prevalent. This complements the findings of Froehlich (2020b) that show a similar trend in MMSNA when it comes to the pairing of specific methods. As such, future research could tap into the richness offered by novel combinations of methods of social network research. For instance, qualitative methods could be used to inform quantitative data collection and analysis. This is especially true for more advanced quantitative techniques such as exponential random graph models or stochastic actor-based model, which play a large role in contemporary quantitative SNA research, but did not appear in the reviewed MMSNA studies.

Improving Reporting

We found that over one quarter of the observed MMSNA studies did not explicate their purpose(s) of mixing. Given that mixing has no value on its own, it is important to communicate the rationale for using multiple methods to the readers. We urge authors of future MMSNA studies to explicate their purpose(s) of mixing and the reasoning behind it. The studies that did report the purpose of mixing often did so in an overly concise manner. The reviewed MMSNA studies used labels such as case study or triangulation without clarifying what these terms meant in the context of the studies. We recommend to explain the arguments behind mixing rather than just labelling them.

As an example, we present the study of Cornelissen et al. (2014). The authors studied partnerships between schools and universities using a social network perspective to find out in what ways knowledge generated from students’ research is developed, shared, and used in their observed school-university network. The authors describe their approach as a longitudinal multimethod case study design and used a purposeful sampling procedure to identify four cases: two students and their respective research advisors. Data were collected via questionnaires and selected cases were queried at multiple time points about their personal networks. Additionally, logs were collected and interviews conducted. The researchers analyzed the data at the ego, dyad, and whole network levels. Describing this research design as a case study may be appropriate, but it does not adequately characterize the actual richness of the mixing involved. A more detailed description about the reasons that have led to the design could be helpful in developing an even more nuanced research design. Specifically, the authors’ interest in studying multiple units of analysis at the same time presents an immediate reason to interweave qualitative and quantitative approaches to network analysis. This is because both approaches have complementary strengths and weaknesses. The higher level questions related to structures could not easily be answered with qualitative methods, whereas quantitative methods often cannot process the details going on at the lower levels of units of analysis. These include why a dyad is functional or not or what an individual’s history is in relation to the network (Froehlich, Mejeh, et al., 2020).

Design decisions such as the timing of a specific study should also be explicated. Take the study of Spillane et al. (2018), in which the design is made very explicit: “Our analysis is based on data from a longitudinal, mixed methods study that used a sequential explanatory mixed methods design” (p. 590). Specifically, they used a sequential design as they sampled people for interviews based on network survey results. They purposefully sampled teaching staffs in schools to maximize variation in formal position, social network position (e.g., more or less central in their schools’ mathematics network), and level (primary or upper grade teachers). They also explicitly state their purpose of mixing: “We sought to interview a broad range of staff, to maximize opportunities for verification (or contradiction) of our theorizing about school staff interactions about mathematics instruction” (p. 591). These statements allow the reader to make inferences about sequence, dependence, and the purpose. Additionally, they provide information about the underlying argumentation.

Another interesting observation regarding reporting practices focuses on the research questions. While all sampled studies used mixed methods, not all studies reflected this in their research questions. While this is certainly not needed for some purposes of mixing, it may point to a lack of alignment between the research questions and the research design. For some studies, it may help pose a research question that transcends the scope of one individual method or research done at one level of analysis. As mentioned in the background section, qualitative and quantitative methods of SNA are complementary and this should be reflected in the research questions (Plano Clark & Badiee, 2010).

Increasing Integration

While some form of integration did happen in most studies, one avenue for further improvement of MMSNA could be a more explicit focus on meta-inferences (Teddlie & Tashakkori, 2009). This means that combined interpretations should be formulated based on both qualitative and quantitative findings. Meta-inferences show the added value of mixing over two separate studies more clearly and emphasize the purpose of mixing. Also, the explicit discussion of divergent findings could help improve integration within MMSNA. The majority of the sampled studies either did not identify any divergent findings worthy of being discussed or did not adequately address such findings. Another suggestion for increased integration was offered by Toraman and Plano Clark (2020), who recommend the thoughtful use of joint displays, where qualitative and quantitative results are presented in one figure or table.

Considering Validity

Analysis of the coding indicated that one third of all samples studies did not adhere to the basic validity requirements of the methods used. Importantly, this does not refer to validity requirements of MMSNA—which still need to be developed and agreed upon—but rather on the individual methods used in the design. There are two pathways in addressing this challenge. A part of the problem could be competence-related. Given that SNA is a complex method to begin with, this complexity increases when embedding it into a mixed methods design. Therefore, it is advisable to strengthen human capital within the authorship teams, either by increasing individuals’ methodological competencies or by adding co-authors with the specific competences in demand.

The root of the problem of validity presented above may also be institutional. We noted that the word limitations of journals and other publication outlets are one potential reason why the authors of many studies in this review (30%) failed to meet the quality criteria of the underlying qualitative and quantitative methods. In general, this is a frequently discussed problem in the mixed methods literature (Leech, 2012). However, we argue that this issue is exacerbated when presenting MMSNA research for two major reasons. First, quantitative approaches to SNA tend to be perceived as more technically challenging and in need of more elaborated methodological explanations. This could be traced back to the methodological training of researchers, which is often focused on statistics at the expense of other quantitative methods (cf. Froehlich, Mamas, et al., 2020). Reporting about qualitative procedures is by no means less problematic. Here, it is our impression that the problem lies in the rather vague guidelines of how to do qualitative SNA. While some exceptions exist—most notably the work of Herz et al. (2015) on qualitative structural analysis—a common language of doing and reporting qualitative SNA is absent (Froehlich, 2020a). Further research may mitigate this problem by developing a clearer conceptualization of how to execute and report qualitative SNA. As SNA is becoming more and more visible especially in the educational domain (Daly, 2010; Moolenaar, 2012; Sweet, 2016), it is our hope that the basic approaches to analyzing social networks will require less argumentation—and hence alleviate this challenge.

General Conclusion

We have written this review based on the observation that SNA is becoming a standard method of education research, but that purely quantitative SNA approaches are often found to be too superficial for many of the phenomena studied in this field. While the call for MMSNA was voiced by the books of Domínguez and Hollstein (2014) and Froehlich, Rehm, et al. (2020), information about why and how MMSNA is being used in research practice did not exist. In this review, we studied—among others—the purpose(s) of mixing and the designs used as presented in contemporary education research. Through the systematically gathered data and the presentation of illustrative examples, we elaborated on how researchers may use MMSNA to study relationships and interactions within educational settings. This contributes to further research in two ways. First, we have proposed an agenda for further research that tackles the challenges identified through the review. Put differently, we laid out a plan of how MMSNA as a research approach could be improved collectively. Second, and on the level of an individual researcher, this chapter may provide guidance throughout the research process by providing a reference to what has worked well before and what did not.

Footnotes

ORCID iDs

Dominik E. Froehlich

Sara Van Waes

Notes

References

Ardoin

N. M.

DiGiano

M. L.

O’Connor

Podkul

T. E.

(2017). The development of trust in residential environmental education programs. Environmental Education Research, 23(9), 1335–1355. https://doi.org/10.1080/13504622.2016.1144176

Baird

Plummer

Haug

Huitema

(2014). Learning effects of interactive decision-making processes for climate change adaptation. Global Environmental Change, 27, 51–63. https://doi.org/10.1016/j.gloenvcha.2014.04.019

Baker-Doyle

K. J.

(2015). Stories in networks and networks in stories: A tri-modal model for mixed-methods social network research on teachers. International Journal of Research & Method in Education, 38(1), 72–82. https://doi.org/10.1080/1743727X.2014.911838

Baker-Doyle

K. J.

Petchauer

(2015). Rumor has it: Investigating teacher licensure exam advice networks. Teacher Education Quarterly, 42(3), 3–32.

Baker-Doyle

K. J.

Yoon

S. A.

(2010). Making expertise transparent: Using technology to strengthen social networks in teacher professional development. Social Network Theory and Educational Change, 2010, 115–126.

Barton

A. H.

(1968). Survey research and macro-methodology. American Behavioral Scientist, 12(2), 1–9. https://doi.org/10.1177/000276426801200201

Bokhove

(2018). Exploring classroom interaction with dynamic social network analysis. International Journal of Research & Method in Education, 41(1), 17–37.

Borgatti

S. P.

Brass

D. J.

Halgin

D. S.

(2014). Social network research: Confusions, criticisms, and controversies. In Brass

D. J.

Labianca

Mehra

Halgin

D. S.

Borgatti

S. P.

(Eds.), Research in the sociology of organizations (Vol. 40, pp. 1–29). Emerald. https://doi.org/10.1108/S0733-558X(2014)0000040001

Borgatti

S. P.

Mehra

Brass

D. J.

Labianca

(2009). Network analysis in the social sciences. Science, 323(5916), 892–895. https://doi.org/10.1126/science.1165821

10.

Bozkurt

Honeychurch

Caines

Maha

Koutropoulos

Cormier

(2016). Community tracking in a cMOOC and nomadic learner behavior identification on a connectivist rhizomatic learning network. Turkish Online Journal of Distance Education, 17(4), Article 1. https://doi.org/10.17718/tojde.09231

11.

Bozkurt

Keefer

(2018). Participatory learning culture and community formation in connectivist MOOCs. Interactive Learning Environments, 26(6), 776–788. https://doi.org/10.1080/10494820.2017.1412988

12.

Brass

D. J.

Borgatti

S. P.

Halgin

D. S.

Labianca

Mehra

(2014). Contemporary perspectives on organizational social networks. http://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=705225

13.

Burt

R. S.

(1992). Structural holes: The structure of social capital competition. Harvard University Press.

14.

Carhill-Poza

(2015). Opportunities and outcomes: The role of peers in developing the oral academic English proficiency of adolescent English learners. Modern Language Journal, 99(4), 678–695. https://doi.org/10.1111/modl.12271

15.

Coburn

C. E.

Russell

J. L.

Kaufman

J. H.

Stein

M. K.

(2012). Supporting sustainability: Teachers’ advice networks and ambitious instructional reform. American Journal of Education, 119(1), 137–182. https://doi.org/10.1086/667699

16.

Conger

A. J.

(1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322–328. https://doi.org/10.1037/0033-2909.88.2.322

17.

Cornelissen

Daly

A. J.

Liou

Y.-H.

van Swet

Beijaard

Bergen

T. C. M.

(2014). More than a master: Developing, sharing, and using knowledge in school–university research networks. Cambridge Journal of Education, 44(1), 35–57. https://doi.org/10.1080/0305764X.2013.855170

18.

Cornelissen

Daly

A. J.

Liou

Y.-H.

Van Swet

Beijaard

Bergen

T. C.

(2015). Leveraging the relationship: Knowledge processes in school–university research networks of master’s programmes. Research Papers in Education, 30(3), 366–392. https://doi.org/10.1080/02671522.2014.919522

19.

Cross

J. E.

Dickmann

Newman-Gonchar

Fagan

J. M.

(2009). Using mixed-method design and network analysis to measure development of interagency collaboration. American Journal of Evaluation, 30(3), 310–329. https://doi.org/10.1177/1098214009340044

20.

Crossley

(2010). The social world of the network: Combining qualitative and quantitative elements in social network analysis. Sociologica, 1. https://doi.org/10.2383/32049

21.

Crossley

Edwards

(2016). Cases, mechanisms and the real: The theory and methodology of mixed-method social network analysis. Sociological Research Online, 21(2), 1–15. https://doi.org/10.5153/sro.3920

22.

Daly

A. J.

(2010). Social network theory and educational change. Harvard Education Press.

23.

Daly

A. J.

Finnigan

K. S.

(2010). A bridge between worlds: Understanding network structure to understand change strategy. Journal of Educational Change, 11(2), 111–138. https://doi.org/10.1007/s10833-009-9102-5

24.

Daly

A. J.

Finnigan

K. S.

(2011). The ebb and flow of social network ties between district leaders under high-stakes accountability. American Educational Research Journal, 48(1), 39–79. https://doi.org/10.3102/0002831210368990

25.

Daly

A. J.

Moolenaar

N. M.

Bolivar

J. M.

Burke

(2010). Relationships in reform: The role of teachers’ social networks. Journal of Educational Administration, 48(3), 359–391. https://doi.org/10.1108/09578231011041062

26.

Daly

A. J.

Moolenaar

Der-Martirosian

Liou

Y.-H.

(2014). Accessing capital resources: Investigating the effects of teacher human and social capital on student achievement. Teachers College Record, 116(7).

27.

Dingyloudi

Strijbos

J.-W.

(2018). Just plain peers across social networks: Peer-feedback networks nested in personal and academic networks in higher education. Learning, Culture and Social Interaction, 18, 86–112. https://doi.org/10.1016/j.lcsi.2018.02.002

28.

Domínguez

Hollstein

(2014). Mixed methods social networks research: Design and applications ( Domínguez

Hollstein

, Eds.). Cambridge University Press.

29.

Finnigan

K. S.

Daly

A. J.

(2012). Mind the gap: Organizational learning and improvement in an underperforming urban system. American Journal of Education, 119(1), 41–71. https://doi.org/10.1086/667700

30.

Finnigan

K. S.

Daly

A. J.

Che

(2013). Systemwide reform in districts under pressure: The role of social networks in defining, acquiring, using, and diffusing research evidence. Journal of Educational Administration, 51(4), 476–497. https://doi.org/10.1108/09578231311325668

31.

Fox

Wilson

Deaney

(2011). Beginning teachers’ workplace experiences: Perceptions of and use of support. Vocations and Learning, 4(1), 1–24. https://doi.org/10.1007/s12186-010-9046-1

32.

Frank

K. A.

Zhao

Penuel

W. R.

Ellefson

Porter

(2011). Focus, fiddle, and friends: Experiences that transform knowledge for the implementation of innovations. Sociology of Education, 84(2), 137–156.

33.

Freeman

L. C.

(1978). Centrality in social networks conceptual clarification. Social Networks, 1(3), 215–239. https://doi.org/10.1016/0378-8733(78)90021-7

34.

Freeman

L. C.

(2004). The development of social network analysis. http://aris.ss.uci.edu/lin/book.pdf

35.

Froehlich

D. E.

(2020a). Exploring social relationships in “a mixed way”: Mixed structural analysis. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 126–138). Routledge.

36.

Froehlich

D. E.

(2020b). Mapping mixed methods approaches to social network analysis in learning and education. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 13–24). Routledge.

37.

Froehlich

D. E.

Mamas

Schneider

H. W.

(2020). Automation and the journey to mixed methods social network analysis. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 219–230). Routledge.

38.

Froehlich

D. E.

Mejeh

Galey

Schoonenboom

(2020). Integrating units of analysis: Applying mixed methods social network analysis. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 38–48). Routledge.

39.

Froehlich

D. E.

Rehm

Rienties

B. C.

(2020). Mixed methods social network analysis. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 1–10). Routledge.

40.

Fuhse

Mützel

(2011). Tackling connections, structure, and meaning in networks: Quantitative and qualitative methods in sociological network research. Quality & Quantity, 45(5), 1067–1089. https://doi.org/10.1007/s11135-011-9492-3

41.

Goggins

S. P.

Laffey

Gallagher

(2011). Completely online group formation and development: Small groups as socio-technical systems. Information Technology & People, 24(2), 104–133. https://doi.org/10.1108/09593841111137322

42.

Granovetter

M. S.

(1973). The strength of weak ties. American Journal of Sociology, 78(6), 1360–1380. https://doi.org/10.1086/225469

43.

Guest

(2013). Describing mixed methods research: An alternative to typologies. Journal of Mixed Methods Research, 7(2), 141–151. https://doi.org/10.1177/1558689812461179

44.

Häussling

(2010). Allocation to social positions in class: Interactions and relationships in first grade school classes and their consequences. Current Sociology, 58(1), 119–138. https://doi.org/10.1177/0011392109349286

45.

Herz

Peters

Truschkat

(2015). How to do qualitative structural analysis: The qualitative interpretation of network maps and narrative interviews. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 16(1). https://doi.org/10.17169/fqs-16.1.2092

46.

Hofman

R. H.

Dijkstra

B. J.

(2010). Effective teacher professionalization in networks? Teaching and Teacher Education, 26(4), 1031–1040. https://doi.org/10.1016/j.tate.2009.10.046

47.

Hoffman

S. J.

Silverberg

S. L.

(2015). Training the next generation of global health advocates through experiential education: A mixed-methods case study evaluation. Canadian Journal of Public Health, 106(6), e442–e449. https://doi.org/10.17269/CJPH.106.5099

48.

Hogan

Carrasco

J. A.

Wellman

(2007). Visualizing personal networks: Working with participant-aided sociograms. Field Methods, 19(2), 116–144. https://doi.org/10.1177/1525822X06298589

49.

Hollstein

(2011). Qualitative approaches to social reality: The search for meaning. In Scott

Carrington

P. J.

(Eds.), The Sage handbook of social network analysis (pp. 404–416). Sage.

50.

Hollstein

(2014). Mixed methods social networks research: An introduction. In Domínguez

Hollstein

(Eds.), Mixed methods social networks research: Design and applications (pp. 3–34). Cambridge University Press.

51.

Honeychurch

Bozkurt

Singh

Koutropoulos

(2017). Learners on the periphery: Lurkers as invisible learners. European Journal of Open, Distance and E-Learning, 20(1), 192–212. https://doi.org/10.1515/eurodl-2017-0012

52.

Hong

Q. N.

Gonzalez-Reyes

Pluye

(2018). Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the Mixed Methods Appraisal Tool (MMAT). Journal of Evaluation in Clinical Practice, 24(3), 459–467. https://doi.org/10.1111/jep.12884

53.

Hopkins

Lowenhaupt

Sweet

T. M.

(2015). Organizing English learner instruction in new immigrant destinations: District infrastructure and subject-specific school practice. American Educational Research Journal, 52(3), 408–439.

54.

Hopkins

Spillane

J. P.

(2014). Schoolhouse teacher educators: Structuring beginning teachers’ opportunities to learn about instruction. Journal of Teacher Education, 65(4), 327–339. https://doi.org/10.1177/0022487114534483

55.

Johnson

R. B.

Onwuegbuzie

A. J.

(2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26.

56.

Johnson

R. B.

Onwuegbuzie

A. J.

Turner

L. A.

(2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133. https://doi.org/10.1177/1558689806298224

57.

Kellogg

Booth

Oliver

(2014). A social network perspective on peer supported learning in MOOCs for educators. International Review of Research in Open and Distributed Learning, 15(5), 263–289. https://doi.org/10.19173/irrodl.v15i5.1852

58.

Kim

McFee

Olguin

D. O.

Waber

Pentland

(2012). Sociometric badges: Using sensor technology to capture new forms of collaboration. Journal of Organizational Behavior, 33(3), 412–427. https://doi.org/10.1002/job.1776

59.

Kortemeyer

A. F.

(2018). The nature of collaborations on programming assignments in introductory physics courses: A case study. European Journal of Physics, 39(5), 055705. https://doi.org/10.1088/1361-6404/aad511

60.

Langhout

R. D.

Collins

Ellison

E. R.

(2014). Examining relational empowerment for elementary school students in a yPAR program. American Journal of Community Psychology, 53(3–4), 369–381. https://doi.org/10.1007/s10464-013-9617-z

61.

Lee

Madyun

Lam

B. O.

Jumale

(2014). School contexts and “acting white” peer networks of Somali immigrant youths in an Afrocentric charter school. Schools, 11(1), 122–155. https://doi.org/10.1086/675752

62.

Leech

N. L.

(2012). Writing mixed research reports. American Behavioral Scientist, 56(6), 866–881. https://doi.org/10.1177/0002764211433800

63.

Liou

Y.-H.

Daly

A. J.

(2014). Closer to learning: Social networks, trust, and professional communities. Journal of School Leadership, 24(4), 753–795. https://doi.org/10.1177/105268461402400407

64.

Liou

Y.-H.

Grigg

Halverson

(2014). Leadership and the design of data-driven professional networks in schools. Journal of Educational Leadership and Management, 2(1), 29–73. https://doi.org/10.4471/ijelm.2014.08

65.

Lorrain

White

H. C.

(1971). Structural equivalence of individuals in social networks. Journal of Mathematical Sociology, 1(1), 49–80. https://doi.org/10.1080/0022250X.1971.9989788

66.

Louis

K. S.

Marks

H. M.

(1998). Does professional community affect the classroom? Teachers’ work and student experiences in restructuring schools. American Journal of Education, 106(4), 532–575. https://doi.org/10.1086/444197

67.

Churchill

(2014). The effect of social interaction on learning engagement in a social networking environment. Interactive Learning Environments, 22(4), 401–417.

68.

Martínez

Dimitriadis

Gómez-Sánchez

Rubia-Avi

Jorrín-Abellán

Marcos

J. A.

(2006). Studying participation networks in collaboration using mixed methods. International Journal of Computer-Supported Collaborative Learning, 1(3), 383–408. https://doi.org/10.1007/s11412-006-8705-6

69.

McLaughlin

M. W.

Talbert

J. E.

(2006). Building school-based teacher learning communities: Professional strategies to improve student achievement (Series on school reform Book 45). Teachers College Press.

70.

Moher

Liberati

Tetzlaff

Altman

D. G.

, & PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLOS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097

71.

Moolenaar

N. M.

(2012). A social network perspective on teacher collaboration in schools: Theory, methodology, and applications. American Journal of Education, 119(1), 7–39. https://doi.org/10.1086/667715

72.

Moolenaar

N. M.

Sleegers

P. J. C.

Daly

A. J.

(2012). Teaming up: Linking collaboration networks, collective efficacy, and student achievement. Teaching and Teacher Education, 28(2), 251–262. https://doi.org/10.1016/j.tate.2011.10.001

73.

Onwuegbuzie

A. J.

Hitchcock

J. H.

(2015). Advanced mixed analysis approaches. In Hesse-Biber

Johnson

R. B.

(Eds.), The Oxford handbook of multimethod and mixed methods research inquiry (pp. 275–295). Oxford University Press.

74.

Palonen

Froehlich

D. E.

(2020). Mixed methods social network analysis to drive organizational development. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 87–100). Routledge.

75.

Penuel

W. R.

Bell

Bevan

Buffington

Falk

(2016). Enhancing use of learning sciences research in planning for and supporting educational change: Leveraging and building social networks. Journal of Educational Change, 17(2), 251–278. https://doi.org/10.1007/s10833-015-9266-0

76.

Penuel

W. R.

Riel

Krause

A. E.

Frank

K. A.

(2009). Analyzing teachers’ professional interactions in a school as social capital: A social network approach. Teachers College Record, 111(1), 124–163. https://eric.ed.gov/?id=EJ826000

77.

Penuel

W. R.

Sun

Frank

K. A.

Gallagher

H. A.

(2012). Using social network analysis to study how collegial interactions can augment teacher learning from external professional development. American Journal of Education, 119(1), 103–136. https://doi.org/10.1086/667756

78.

Pifer

M. J.

(2011). Intersectionality in context: A mixed-methods approach to researching the faculty experience. New Directions for Institutional Research, 2011(151), 27.

79.

Pil

F. K.

Leana

(2009). Applying organizational research to public school reform: The effects of teacher human and social capital on student performance. Academy of Management Journal, 52(6), 1101–1124. https://doi.org/10.5465/amj.2009.47084647

80.

Plano Clark

V. L.

Badiee

(2010). Research questions in mixed methods research. In Tashakkori

Teddlie

(Eds.), Sage handbook of mixed methods in social and behavioral research (pp. 275–304). Sage. https://doi.org/10.4135/9781506335193.n12

81.

Rienties

Hosein

(2015). Unpacking (in) formal learning in an academic development programme: A mixed-method social network perspective. International Journal for Academic Development, 20(2), 163–177. https://doi.org/10.1080/1360144x.2015.1029928

82.

Rienties

Johan

Jindal-Snape

(2015). Bridge building potential in cross-cultural learning: A mixed method study. Asia Pacific Education Review, 16(1), 37–48. https://doi.org/10.1007/s12564-014-9352-7

83.

Rienties

Kinchin

(2014). Understanding (in)formal learning in an academic development programme: A social network perspective. Teaching and Teacher Education, 39(2014), 123–135. https://doi.org/10.1016/j.tate.2014.01.004

84.

Rienties

Tempelaar

Giesbers

Segers

Gijselaers

(2014). A dynamic analysis of why learners develop a preference for autonomous learners in computer-mediated communication. Interactive Learning Environments, 22(5), 631–648. https://doi.org/10.1080/10494820.2012.707127

85.

Risser

H. S.

(2013). Virtual induction: A novice teacher’s use of Twitter to form an informal mentoring network. Teaching and Teacher Education, 35(2013), 25–33. https://doi.org/10.1016/j.tate.2013.05.001

86.

Rodríguez-Medina

Rodríguez-Navarro

Arias

Anguera

M. T.

(2018). Non-reciprocal friendships in a school-age boy with autism: The ties that build? Journal of Autism and Developmental Disorders, 48(9), 2980–2994. https://doi.org/10.1007/s10803-018-3575-0

87.

Rodway

(2015). Connecting the dots: Understanding the flow of research knowledge within a research brokering network. Education Policy Analysis Archives, 23(123). https://doi.org/10.14507/epaa.v23.2180

88.

Sánchez

Esparza

Berardi

Pryce

(2011). Mentoring in the context of Latino youth’s broader village during their transition from high school. Youth & Society, 43(1), 225–252. https://doi.org/10.1177/0044118x10363774

89.

Schiff

Herzog

Farley-Ripple

Iannuccilli

L. T.

(2015). Teacher networks in Philadelphia: Landscape, engagement, and value. Penn GSE Perspectives on Urban Education, 12(1).

90.

Schoonenboom

Johnson

R. B.

(2017). How to construct a mixed methods research design. KZfSS Kölner Zeitschrift Für Soziologie Und Sozialpsychologie, 69(Suppl. 2), 107–131. https://doi.org/10.1007/s11577-017-0454-1

91.

Schoonenboom

Johnson

R. B.

Froehlich

D. E.

(2018). Combining multiple purposes of mixing within a mixed methods research design. International Journal of Multiple Research Approaches, 10(1), 271–282. https://doi.org/10.29034/ijmra.v10n1a17

92.

Shannon-Baker

Edwards

(2018). The affordances and challenges to incorporating visual methods in mixed methods research. American Behavioral Scientist, 62(7), 935–955. https://doi.org/10.1177/0002764218772671

93.

Shannon-Baker

Hilpert

J. C.

(2020). Visual methods and representations in mixed methods (and) social network research: A discussion. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 49–57). Routledge.

94.

Siddaway

A. P.

Wood

A. M.

Hedges

L. V.

(2019). How to do a systematic review: A best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses. Annual Review of Psychology, 70(1), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803

95.

Smith

R. A.

(2010). “Only connect”: A mixed methods study of how first-year students create residential academic and social networks. Syracuse University.

96.

Smith

R. A.

(2015). Magnets and seekers: A network perspective on academic integration inside two residential communities. Journal of Higher Education, 86(6), 893–922. https://doi.org/10.1353/jhe.2015.0033

97.

Spillane

J. P.

(2005). Distributed leadership. Educational Forum, 69(2), 143–150. https://doi.org/10.1080/00131720508984678

98.

Spillane

J. P.

Hopkins

Sweet

T. M.

(2015). Intra-and interschool interactions about instruction: Exploring the conditions for social capital development. American Journal of Education, 122(1), 71–110. https://doi.org/10.1086/683292

99.

Spillane

J. P.

Shirrell

(2017). Breaking up isn’t hard to do: Exploring the dissolution of teachers’ and school leaders’ work-related ties. Educational Administration Quarterly, 53(4), 616–648. https://doi.org/10.1177/0013161X17696557

100.

Spillane

J. P.

Shirrell

Adhikari

(2018). Constructing “experts” among peers: Educational infrastructure, test data, and teachers’ interactions about teaching. Educational Evaluation and Policy Analysis, 40(4), 586–612. https://doi.org/10.3102/0162373718785764

101.

Sweet

T. M.

(2016). Social network methods for the educational and psychological sciences. Educational Psychologist, 51(3–4), 381–394. https://doi.org/10.1080/00461520.2016.1208093

102.

Teddlie

Tashakkori

(2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Sage.

103.

Tirado

Hernando

Á.

Aguaded

J. I.

(2015). The effect of centralization and cohesion on the social construction of knowledge in discussion forums. Interactive Learning Environments, 23(3), 293–316. https://doi.org/10.1080/10494820.2012.745437

104.

Toraman

Plano Clark

V. L.

(2020). Reflections about intersecting mixed methods research with social network analysis. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 175–188). Routledge.

105.

Ugurlu

(2016). The effect of the position of educational organizations within the social network on their collaboration levels. Universal Journal of Educational Research, 4(12A), 226–254. https://doi.org/10.13189/ujer.2016.041328

106.

Van Gasse

Vanlommel

Vanhoof

Van Petegem

(2017). The impact of collaboration on teachers’ individual data use. School Effectiveness and School Improvement, 28(3), 489–504. https://doi.org/10.1080/09243453.2017.1321555

107.

Van Tulder

Furlan

Bombardier

Bouter

(2003). Updated method guidelines for systematic reviews in the Cochrane collaboration back review group. Spine, 28(12), 1290–1299. https://doi.org/10.1097/01.BRS.0000065484.95996.AF

108.

Van Waes

De Maeyer

Moolenaar

N. M.

Van Petegem

Van den Bossche

(2018). Strengthening networks: A social network intervention among higher education teachers. Learning and Instruction, 53, 34–49.

109.

Van Waes

Van den Bossche

(2020). Around and around: The concentric circles method as powerful tool to collect mixed method network data. In Froehlich

D. E.

Rehm

Rienties

B. C.

(Eds.), Mixed methods social network analysis: Theories and methodologies in learning and education (pp. 159–174). Routledge.

110.

Van Waes

Van den Bossche

Moolenaar

N. M.

Stes

Van Petegem

(2015). Uncovering changes in university teachers’ professional networks during an instructional development program. Studies in Educational Evaluation, 46(2015), 11–28. https://doi.org/10.1016/j.stueduc.2015.02.003

111.

Vanwynsberghe

Boudry

Vanderlinde

Verdegem

(2014). Experts as facilitators for the implementation of social media in the library? A social network approach. Library Hi Tech, 32(3), 529–545. https://doi.org/10.1108/lht-02-2014-0015

112.

Wellman

(1983). Network analysis: Some basic principles. Sociological Theory, 1(1), 155–200. https://doi.org/10.2307/202050

113.

Wellman

(1988). Structural analysis: From method and metaphor to theory and substance. In Wellman

Berkowitz

S. D.

(Eds.), Structural analysis in the social sciences: Vol. 2. Social structures: A network approach (pp. 19–61). Cambridge University Press.

114.

Wenger

McDermott

R. A.

Snyder

(2002). Cultivating communities of practice: A guide to managing knowledge. Harvard Business Press.

115.

Wise

A. F.

Cui

(2018). Learning communities in the crowd: Characteristics of content related interactions and social relationships in MOOC discussion forums. Computers & Education, 122(2018), 221–242. https://doi.org/10.1016/j.compedu.2018.03.021

116.

Wong-Hooker

A. M.

(2016). How the formal and informal social networks of special education teachers shape their practice [PhD Thesis, UC San Diego]. https://eric.ed.gov/?id=ED570587

117.

Yessis

Riley

Stockton

Brodovsky

Von Sychowski

(2013). Interorganizational relationships in the Heart and Stroke Foundation’s Spark Together for Healthy Kids^TM: Insights from using network analysis. Health Education & Behavior, 40(1 Suppl.), 43S–50S. https://doi.org/10.1177/1090198113490724

Linking Quantitative and Qualitative Network Approaches: A Review of Mixed Methods Social Network Analysis in Education Research

Abstract

Background

Social Network Theory and Analysis

A Social Network Perspective in Education Research

Mixed Methods SNA

Describing MMSNA Studies

Purpose(s) of Mixing in MMSNA

Timing in MMSNA

Quality in MMSNA

Method

Identification of Records

Screening of Records

Eligibility of Records

Coding of Included Studies

Publication Meta-Data

Purpose(s) of Mixing in MMSNA

Timing in MMSNA

Quality in MMSNA

Reliability of the Coding Procedure

Results

Purpose(s) of Mixing in MMSNA

Timing in MMSNA

Quality in MMSNA

Post Hoc Observations

Discussion and Conclusion

Applications of MMSNA in Education and Learning Research

Challenges of MMSNA Linked to a Future Research Agenda

Variability of MMSNA Designs

Improving Reporting

Increasing Integration

Considering Validity

General Conclusion

Footnotes

ORCID iDs

Notes

References