Despite the recent and ongoing progress in using text-mining tools to automatically analyze large text corpora, there remains significant potential to facilitate the study of social action in social science research. In this context, particularly the disambiguation (who is referred to in a text?) and specification (which demographic characteristics are present?) of social actors—currently a manual job—remains a challenge. This article demonstrates a reliable and accurate software architecture for social scientists who are interested in automatically detecting, disambiguating, and demographically specifying social actors (i.e., persons and organizations) in large text collections. The backbone of our software architecture is the online encyclopedia Wikipedia as a currently unexploited data source of a large amount of accurately prepared information. We illustrate how our software architecture detects and disambiguates social actors in large text corpora and retrieves their respective demographic information. Overall, we evaluate the reliability and accuracy of our software architecture across seven different social settings and facilitate an intuitive sense of the comprehensive applicability of our software architecture. We end by not only highlighting the benefits of our software architecture for social science research but also pointing to the limitations of using Wikipedia as a data source.
AdamsJuliaBrücknerHannah. 2015. “Wikipedia, Sociology, and the Promise and Pitfalls of Big Data.” Big Data & Society2(2):1–5.
2.
BadkeWilliam. 2008. “What to Do with Wikipedia.” Online32(2):48–50.
3.
Baeza-YatesRichardoRibeiroBerthier de Araújo Neto. 2004. Modern Information Retrieval. Harlow, England: Pearson Addison-Wesley.
4.
BailChristopher A.2012. “The Fringe Effect: Civil Society Organizations and the Evolution of Media Discourse about Islam since the September 11th Attacks.” American Sociological Review77(6):855–79.
5.
BailChristopher A.2015. “Taming Big Data: Using App Technology to Study Organizational Behavior on Social Media.” Sociological Methods & Research46(2):189–217.
6.
BaytiyehHodaPfaffmanJay. 2010. “Volunteers in Wikipedia: Why the Community Matters.” Educational Technology and Society13(2):128–40.
7.
BizerChristianKobilarovGeorgiLehmannJensCyganiakRichardIvesZachary. 2007. “DBpedia: A Nucleus for a Web of Open Data.” Pp. 722–35 in The Semantic Web. Lecture Notes in Computer Science, vol 4825. Berlin, Germany: Springer.
8.
BraguesGeorge. 2009. “Wiki-philosophizing in a Marketplace of Ideas: Evaluating Wikipedia’s Entries on Seven Great Minds.” MediaTropes2(1):117–59.
9.
BrownAdam R.2011. “Wikipedia as a Data Source for Political Scientists: Accuracy and Completeness of Coverage.” Political Science & Politics44(2):339–43.
10.
ChangRay M.KauffmanRobert J.KwonYoungok. 2014. “Understanding the Paradigm Shift to Computational Social Science in the Presence of Big Data.” Decision Support Systems63(1):67–80.
11.
ClausonKevin A.PolenHyla H.BoulosMaged N. KamelDzenowagisJoan H.. 2008. “Scope, Completeness, and Accuracy of Drug Information in Wikipedia.” Annals of Pharmacotherapy42(12):1814–21.
12.
CornelissenJoep P.WernerMirjam D.. 2014. “Putting Framing in Perspective: A Review of Framing and Frame Analysis across the Management and Organizational Literature.” Academy of Management Annals8(1):181–235.
13.
DaiberJoachimJakobMaxHokampChrisMendesPablo N.. 2013. “Improving Efficiency and Accuracy in Multilingual Entity Extraction.” Pp. 121–24 in Proceedings of the 9th International Conference on Semantic Systems-I-SEMANTICS ‘13. New York, NY: Association for Computing Machinery.
14.
DavisAeron. 2003. “Whither Mass Media and Power? Evidence for a Critical Elite Theory Alternative.” Media, Culture & Society25(5):669–90.
15.
DevganLaraPoweNeilBlakeyBrittonyMakaryMartin. 2007. “Wiki-surgery? Internal Validity of Wikipedia as a Medical and Surgical Reference.” Journal of the American College of Surgeons205(3):76–77.
16.
DomingueJohnFenselDieterHendlerJames A.. 2011. “Introduction to the Semantic Web Technologies.” Pp. 3–42 in Handbook of Semantic Web Technologies, edited by DomingueJ.FenselD.HendlerJ. A.. Berlin, Germany: Springer-Verlag.
17.
EdelmannA.MohrJ. W.. 2018. “Formal Studies of Culture: Issues, Challenges, and Current Trends.” Poetics68(1):1–9.
18.
EvansJames A.AcevesPedro. 2016. “Machine Translation: Mining Text for Social Theory.” Annual Review of Sociology42(1):21–50.
19.
FallisDon. 2008. “Toward an Epistemology of Wikipedia.” Journal of the American Society for Information Science and Technology59(10):1662–74.
20.
FerronMichelaMassaPaolo. 2014. “Beyond the Encyclopedia: Collective Memories in Wikipedia.” Memory Studies7(1):22–45.
21.
FinkelJ. R.GrenagerTrondManningChristopher. 2005. “Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling.” Pp. 363–70 in Proceedings of the 43nd Annual Meeting of the Association for Computational Linguistics-ACL 2005. Stroudsburg, Pennsylvania: Association for Computational Linguistics.
22.
FissPeer C.HirschPaul M.. 2005. “The Discourse of Globalization: Framing and Sensemaking of an Emerging Concept.” American Sociological Review70(1):29–52.
23.
FligsteinNeilBrundageJonah S.SchultzMichael. 2017. “Seeing Like the Fed: Culture, Cognition, and Framing in the Failure to Anticipate the Financial Crisis of 2008.” American Sociological Review82(5):879–909.
24.
FlorianRaduIttycheriahAbeJingHongyanZhangTong. 2003. “Named Entity Recognition through Classifier Combination.” Proceedings of the 7th Conference on Natural Language Learning (HLT-NAACL)4:168–71.
25.
FranzosiRoberto. 1989. “From Words to Numbers: A Generalized and Linguistics-based Coding Procedure for Collecting Textual Data.” Sociological Methodology19(1989):263–98.
26.
FranzosiRoberto. 1990. “Computer-assisted Coding of Textual Data: An Application to Semantic Grammars.” Sociological Methods & Research19(2):225–57.
27.
FranzosiRoberto. 2010. Quantitative Narrative Analysis. Los Angeles, CA: Sage.
28.
FranzosiRobertoFazioGianluca deVicariStefania. 2012. “Ways of Measuring Agency: An Application of Quantitative Narrative Analysis to Lynchings in Georgia (1875-1930).” Sociological Methodology42(1):1–42.
29.
GentzkowMatthewShapiroJesse M.. 2010. “What Drives Media Slant? Evidence from US Daily Newspapers.” Econometrica78(1):35–71.
30.
GeorgeGerardHaasMartine R.PentlandAlex. 2014. “Big Data and Management.” Academy of Management Journal57(2):321–26.
31.
GeorgeGerardOsingaErnst C.LavieDovevScottBrent A.. 2016. “Big Data and Data Science Methods for Management Research.” Academy of Management Journal59(5):1493–1507.
32.
GilesJim. 2005. “Internet Encyclopaedias Go Head to Head.” Nature438(7070):900–901.
33.
GoldensteinJanPoschmannPhilipp. 2019. “Analyzing Meaning in Big Data: Performing a Map Analysis Using Grammatical Parsing and Topic Modeling.” Sociological Methodology49(1):83–131.
34.
GoldensteinJanPoschmannPhilippHändschkeSebastian G.M.WalgenbachPeter. 2019. “Global and Local Orientation in Organisational Actorhood: A Comparative Study of Large Corporations from Germany, the United Kingdom, and the United States.” European Journal of Cultural and Political Sociology6(2):201–236.
35.
HeilmanJames MKemmannEckhardBonertMichaelChatterjeeAnweshRagarBrentBeardsGraham MIberriDavid JHarveyMatthewThomasBrendanStompWouterMartoneMichael FLodgeDaniel JVondracekAndreaWolffJacob F deLiberCasimirGroverSamir CVickersTim JMeskóBertalanLaurentMichaël R.. 2011. “Wikipedia: A Key Tool for Global Public Health Promotion.” Journal of Medical Internet Research13(1):153–64.
36.
JancsaryDennisMeyerRenate E.HöllererMarkus A.BarberioVitaliano. 2017. “Toward a Structural Model of Organizational-level Institutional Pluralism and Logic Interconnectedness.” Organization Science28(6):1150–67.
37.
JavanmardiSaraLopesCristina. 2010. “Statistical Measure of Quality in Wikipedia.” Pp. 132–38 in Proceedings of the First Workshop on Social Media Analytics (SOMA ‘10). New York, NY: Association for Computing Machinery.
38.
KennedyMark T.2008. “Getting Counted: Markets, Media, and Reality.” American Sociological Review73(2):270–95.
39.
LazerD.KennedyR.KingG.VespignaniA.. 2014. “The Parable of Google Flue: Traps in Big Data Analysis.” Science343:1203–5.
40.
LehmannJensIseleRobertJakobMaxJentzschAnjaKontokostasDimitrisMendesPablo N.HellmannSebastianMorseyMohamedKleefPatrick vanAuerSörenBizerChristian. 2015. “DBpedia: A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia.” Semantic Web6(2):167–95.
41.
LuoWeiAdamsJuliaBrücknerHannah. 2018. “The Ladies Vanish? American Sociology and the Genealogy of Its Missing Women on Wikipedia.” Comparative Sociology17(5):519–56.
42.
MagnusP. D. 2006. “Epistemology and the Wikipedia.” Pp. 1–8 in Presented at North American Computing and Philosophy Conference.
43.
ManningChristopher D.SchützeHinrich. 2000. Foundations of Natural Language Processing. 4th ed. Cambridge, MA: MIT Press.
44.
ManningChristopher D.SurdeanuMihaiBauerJohnFinkelJenny. 2014. “The Stanford CoreNLP Natural Language Processing Toolkit.” Pp. 55–60 in Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Baltimore, Maryland: Association for Computational Linguistics.
45.
McCormickTyler H.LeeHedwigCesareNinaShojaieAliSpiroEmma S.. 2015. “Using Twitter for Demographic and Social Science Research: Tools for Data Collection and Processing.” Sociological Methods & Research46(3):390–421.
46.
MedelyanOlenaMilneDavidLeggCatherineWittenIan H.. 2009. “Mining Meaning from Wikipedia.” International Journal of Human Computer Studies67(9):716–54.
47.
MesgariMostafaOkoliChituMehdiMohamadNielsenFinn ÅrupLanamäkiArto. 2015. “‘The Sum of All Human Knowledge’: A Systematic Review of Scholarly Research on the Content of Wikipedia.” Journal of the Association for Information Science and Technology66(2):219–45.
48.
MeyerRenate E.HöllererMarkus A.. 2010. “Meaning Structures in a Contested Issue Field: A Topographic Map of Shareholder Value in Austria.” Academy of Management Journal53(6):1241–62.
49.
MohrJohn W.BogdanovPetko. 2013. “Introduction Topic Models: What They Are and Why They Matter.” Poetics41(6):545–69.
50.
MohrJohn W.Wagner-PacificiRobinBreigerRonald L.. 2015. “Toward a Computational Hermeneutics.” Big Data & Society2(2):1–8.
51.
MohrJohn W.Wagner-PacificiRobinBreigerRonald L.BogdanovPetko. 2013. “Graphing the Grammar of Motives in National Security Strategies: Cultural Interpretation, Automated Text Analysis and the Drama of Global Politics.” Poetics41(6):670–700.
52.
NickelsHenri Charles. 2007. “Framing Asylum Discourse in Luxembourg.” Journal of Refugee Studies20(1):37–59.
53.
PellowDavid N. 1999. “Framing Emerging Environmental Movement Tactics: Mobilizing Consensus, Demobilizing Conflict.” Sociological Forum14(4):659–83.
54.
PentzoldChristian. 2009. “Fixing the Floating Gap: The Online Encyclopaedia Wikipedia as a Global Memory Place.” Memory Studies2(2):255–72.
55.
PiezunkaH.DahlanderL.. 2015. “Distant Search, Narrow Attention: How Crowding Alters Organizations’ Filtering of Suggestions in Crowdsourcing.” Academy of Management Journal58(3):856–80.
56.
PowellWalter W.HorvathAaronBrandtnerChristof. 2016. “Click and Mortar: Organizations on the Web.” Research in Organizational Behavior36:101–120.
57.
RatinovLevRothDanDowneyDougAndersonMike. 2011. “Local and Global Algorithms for Disambiguation to Wikipedia.” Pp. 1375–84 in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. Portland, OR: Association for Computational Linguistics.
58.
ReagleJosephRhueLauren. 2011. “Gender Bias in Wikipedia and Britannica.” International Journal of Communication5(1):1138–58.
59.
ReavleyN. J. A.MackinnonJ.MorganA. J.Alvarez-JimenezM.HetrickS. E.KillackeyE.NelsonB.PurcellR.YapM. B.JormA. F.. 2012. “Quality of Information Sources about Mental Disorders: A Comparison of Wikipedia with Centrally Controlled Web and Printed Sources.” Psychological Medicine42(08):1753–62.
60.
RobertsCarl W.1997. “A Generic Semantic Grammar for Quantitative Text Analysis: Applications to East and West Berlin Radio News Content from 1979.” Sociological Methodology27(1):89–129.
61.
SchützeHinrich. 1998. “Automatic Word Sense Discrimination.” Computational Linguistics24(1):97–123.
62.
SudhaharSaatvigaFazioGianluca deFranzosiRobertoCristianiniNello. 2013. “Network Analysis of Narrative Content in Large Corpora.” Natural Language Engineering21(1):81–112.
63.
TempleNorman J.FraserJoy. 2014. “How Accurate Are Wikipedia Articles in Health, Nutrition, and Medicine?” The Canadian Journal of Information and Library Science38(1):37–52.
64.
vanAtteveldtWouterKleinnijenhuisJanRuigrokNel. 2008. “Parsing, Semantic Networks, and Political Authority: Using Syntactic Analysis to Extract Semantic Relations from Dutch Newspaper Articles.” Political Analysis16(4):428–46.
65.
VicariStefania. 2010. “Measuring Collective Action Frames: A Linguistic Approach to Frame Analysis.” Poetics38(5):504–25.
66.
ViégasFernanda B.WattenbergMartinKrissJesseHamFrank Van. 2007. “Talk before You Type: Coordination in Wikipedia.” in Proceedings of the Annual Hawaii International Conference on System Sciences. Piscataway, New Jersey, NJ: IEEE.
67.
ViseurRobert. 2014. “Reliability of User-generated Data: The Case of Biographical Data in Wikipedia.” in Proceedings of The International Symposium on Open Collaboration - OpenSym ‘14. New York, NY: Association for Computing Machinery.
68.
VliegenthartRensZoonenLiesbet van. 2011. “Power to the Frame: Bringing Sociology Back to Frame Analysis.” European Journal of Communication26(2):101–115.
69.
Wagner-PacificiRobinMohrJohn W.BreigerRonald L.. 2015. “Ontologies, Methodologies, and New Uses of Big Data in the Social and Cultural Sciences.” Big Data & Society2(2):1–11.
70.
WueestBrunoFossatiFlavia. 2015. “Quantitative Discursive Institutionalism: A Comparison of Labour Market Policy Discourse across Western Europe.” Journal of European Public Policy22(5):708–30.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
