Although group interaction is a rich source of data, it offers many challenges for analysis. We discuss how pretesting can solve many coding and reliability issues before the actual data collection and analysis. We also consider how coding schemes can be developed, how coders can be trained, and how coder reliability can be ascertained. We examine the properties of different estimates of intercoder reliability and detail how these relate to decisions about the data.
BabbieEarl R.2010. The Practice of Social Research, 12th ed. Belmont, CA: Wadsworth.
2.
BalesR. F.1950. “A Set of Categories for the Analysis of Small Group Interaction.” American Sociological Review15:257–63.
3.
BalesR. F.1953. “The Equilibrium Problem in Small Groups.” Pp. 111–61 in Working Papers on the Theory of Action, edited by ParsonsT.BalesR.ShilsE. H.Glencoe, IL: Free Press.
4.
BalesR. F.SlaterP.1955. “Role Differentiation in Small Decision-Making Groups.” Pp. 259–306 in Family, Socialization and Interaction Process, edited by ParsonsT.BalesR. F.Glencoe, IL: Free Press.
5.
BalesR. F.StrodbeckF. L.MillsT. M.RoseboroughM. E.1951. “Channels of Communication in Small Groups.” American Sociological Review16:461–68.
6.
BergerJoseph2007. “The Standardized Experimental Situation in Expectation States Research: Notes on History, Uses, and Special Features.” Pp. 333–78 in Laboratory Experiments in the Social Sciences, edited by WebsterMurrayJr.SellJane. Amsterdam, Netherlands: Elsevier.
7.
BerkePhilipGodschalkDavid. 2009. “Searching for the Good Plan: A Meta-Analysis of Plan Quality Studies.” Journal of Planning Literature24:227–40.
8.
BurkePeter. 1974. “Participation and Leadership in Small Groups.” American Sociological Review39:832–43.
DiamondShari SeidmanRoseMary R.MurphyBethSmithSven. 2006. “Juror Questions during Trial: A Window into Juror Thinking.” Vanderbilt Law Review59:1927–72.
11.
DiamondShari S.VidmarNeilRoseMaryEllisLeslieMurphyBeth2003. “Juror Discussions during Civil Trials: Studying an Arizona Innovation.” Arizona Law Review45:1–82.
12.
FisekM. H.OfsheR.1970. “The Process of Status Evolution.” Sociometry33:287–304.
13.
FleissJ. L.1978. “Reply to Klaus Krippendorff’s ‘Reliability of Binary Attribute Data.’” Biometrics34:144.
14.
GallagherTimothy J.GregoryStanford W.Jr.BianchiAlison J.HartungPaul J.HarknessSarah. 2005. “Examining Medical Interview Asymmetry Using the Expectations States Approach.” Social Psychology Quarterly68:187–203.
15.
GibsonDavid R.2003. “Participation Shifts: Order and Differentiation in Group Conversation.” Social Forces81:1335–81.
16.
GibsonDavid R.2005. “Taking Turns and Talking Ties: Networks and Conversational Interaction.” American Journal of Sociology110:1561–97.
17.
GoarCarlaSellJane. 2005. “Decreasing Racial Inequality in Task Groups through Task Definition.” Sociological Quarterly46:525–43.
18.
GuetzkowHarold. 1950. “Unitizing and Categorizing Problems in Coding Qualitative Data.” Journal of Clinical Psychology6:47–58.
19.
GwetKilem Li. 2008. “Computing Inter-rater Reliability and Its Variance in the Presence of High Agreement.” British Journal of Mathematical and Statistical Psychology61:29–48.
20.
HarawayDonna. 1989. Primate Visions: Gender, Race and Nature in the World of Modern Science. New York: Routledge.
21.
HaysWilliam L.1973. Statistics for the Social Sciences. 2nd ed. New York: Holt, Rinehart and Winston.
22.
HunzikerSabinaJohanssonAnna C.TschanFranziskaSemmerNorbert K.RockLauraHowellMichael D.MarschStephan. 2011. “Teamwork and Leadership in Cardiopulmonary Resuscitation.” Journal of the American College of Cardiology57:2381–88.
23.
KingLaura A.2004. “Measures and Meanings: The Use of Qualitative Data in Social and Personality Psychology.” Pp.173–94 in Handbook of Methods in Social Psychology, edited by SansoneC.MorfC.PanterA. T.Thousand Oaks, CA: Sage.
24.
KrippendorffKlus. 2004a. Content Analysis: An Introduction to Its Methodology. Thousand Oaks, CA: Sage.
25.
KrippendorffKlus. 2004b. “Reliability in Content Analysis.” Human Communication Research30:411–33.
26.
KuipersKathy J.HysomStuart. 2007. “Common Problems and Solutions.” Pp. 289–324 in Laboratory Experiments in the Social Sciences, edited by WebsterMurrayJr.SellJane. Amsterdam, Netherlands: Elsevier.
27.
LenthRussell V.2001. “Some Practical Guidelines for Effective Sample Size Determination.” American Statistician55:187–93.
LombardM.Snyder-DuchJ.BrakenC. C.2002. “Content Analysis in Mass Communication Research: An Assessment and Reporting of Intercoder Reliability.” Human Communication Research28:587–472.
30.
PotterW. JamesLevine-DonnersteinDeborah. 1999. “Rethinking Validity and Reliability in Content Analysis.” Journal of Applied Communications Research27:258–84.
31.
ProppKathleen M.1995. “An Experimental Explanation of Biological Sex as a Status Cue in Decision-Making Groups and Its Influence on Information Use.” Small Group Research26:451–74.
32.
RashotteLisa S.WebsterMurrayWhitmeyerJoseph. 2005. “Pretesting Experimental Instructions.” Pp. 163–87 in Sociological Methodology, vol. 35, edited by StolzenbergRoss M.Boston, MA: Blackwell Publishing.
33.
RosenthalRobertRosnowRalph L.1984. Essentials of Behavioral Research: Methods and Data Analysis. New York: McGraw-Hill.
34.
SaksM. J.RisengerR. M.RosenthalR.ThompsonW. C.2003. “Context Effects in Forensic Sciences: Review and Application of the Science of Science to Crime Laboratory Practice in the United States. Science and Justice43:77–90.
35.
ScholandAndrew J.YlaR.TausczikR.PennebakerJames W.2010. “Assessing Group Interaction with Social Language Network Analysis.” Advances in Social Computing6007:248–55.
36.
SellJaneKnottnerusJ. DavidEllisonChristopherMundtHeather2000. “Reproducing Social Structure in Task Groups: The Role of Structural Ritualization.” Social Forces79:1243–64.
37.
ShellyRobert K.2007. “Training Interviewers and Experimenters.” Pp. 267–88 in Laboratory Experiments in the Social Sciences, edited by WebsterMurrayJr.SellJane. Amsterdam, Netherlands: Elsevier.
38.
ShellyRobert K.MunroePaul T.1999. “Do Women Engage in Less Task Behavior than Men?”Sociological Perspectives42:49–67.
39.
ShellyRobert K.ShellyAnn C.2009. “Speech Content and the Emergence of Inequality in Task Groups.” Journal of Social Issues65:307–33.
40.
ShellyRobert K.TroyerLisa2001a. “Emergence and Completion of Structure in Partially Defined Groups.” Social Psychology Quarterly64:318–32.
41.
ShellyRobert K.TroyerLisa2001b. “Speech Duration and Dependencies in Initially Structured and Unstructured Groups.” Sociological Perspectives44:419–44.
TanfordSarahPenrodSteven. 2006. “Jury Deliberations: Discussion Content and Influence Processes in Jury Decision Making.” Journal of Applied Social Psychology16:322–47.
45.
ThyeShane R.2000. “Reliability in Experimental Sociology.” Social Forces78:1277–309.
46.
WallerMary J.GuptaNainaGiambatistaRobert C.2004. “Effects of Adaptive Behaviors and Shared Mental Models on Control Crew Performance.” Management Science50:1534–44.
47.
WebsterMurrayJr.SellJane. 2007. “Theory and Experimentation in the Social Sciences.” Pp. 190–207 in Laboratory Experiments in the Social Sciences, edited by WebsterMurrayJr.SellJane. Amsterdam, Netherlands: Elsevier.
48.
WebsterMurrayJr.SellJane. Forthcoming. “Institutions, Structures and Processes.” In New Blackwell Companion to Sociology, edited by RitzerGeorge. Hoboken, NJ: Wiley.
