As text databases increasingly become available to researchers, the limits to human cognition are rapidly reached. Focusing on examining objective realities, this paper introduces the latent categorization method, a novel new research method for analysis of large and midsize data sets. This method clusters text artifacts and extracts the words that were most important in creating the clusters. Further, it demonstrates a set of techniques for extracting knowledge from a representative data set involving 6135 abstracts from a variety of business-related journals.
Get full access to this article
View all access options for this article.
References
1.
AldenderferMark S.BlashfieldRoger K.. 1984. Cluster Analysis, edited by Lewis-BeckM. S.. Newbury Park, CA: Sage Publications.
2.
AnderbergMichael R.1973. Cluster Analysis for Applications, edited by BirnbaumZ. W.LukacsE.. New York: Academic Press.
3.
BabbieEarl. 1998. The Practice of Social Research. Belmont, CA: Wadsworth.
4.
BartellB. T.CottrellG. W.BelewR. K.. 1995. “Representing Documents Using an Explicity Model of Their Similarities.”Journal of the American Society for Information Science46:251–71.
5.
BelewRichard K.2000. Finding Out About: A Cognitive Perspective on Search Engine Technology and the WWW. Cambridge, England: Cambridge University Press.
6.
BerryMichael W.BrowneMurray. 1999. Understanding Search Engines: Mathematical Modeling and Text Retrieval. Philadelphia, PA: Society for Industrial and Applied Mathematics.
7.
BerryM. W.DrmacZ.JessupE. R.. 1999. “Matrices, Vector Spaces, and Information Retrieval.”SI AM Review41:335–62.
8.
BerryM. W.DumaisS. T.O'BrienG. W.1995. “Using Linear Algebra for Intelligent Information Retrieval.”SI AM Review37:573–95.
9.
CardinalL. B.2001. “Technological Innovation in the Pharmaceutical Industry: The Use of Organizational Control in Managing Research and Development.”Organization Science12:19–36.
10.
ChandyR. K.TellisG. J.. 1998. “Organizing for Radical Product Innovation: The Overlooked Role of Willingness to Cannibalize.”Journal of Marketing Research35:474–87.
11.
ChandyR. K.TellisG. J.. 2000. “The Incumbent's Curse? Incumbency, Size, and Radical Product Innovation.”Journal of Marketing64:1–17.
12.
ChengY. T.Vande VenA. H.1996. “Learning the Innovation Journey: Order Out of Chaos?”Organization Science7:593–614.
13.
CohenJ.1960. “A Coefficient of Agreement for Nominal Scales.”Educational and Psychological Measurement20:37–46.
14.
CohenJ.1968. “Weighted Kappa: Nominal Scale Agreement with Provision for Scaled Disagreement or Partial Credit.”Psychological Bulletin70:213–20.
15.
DeerwesterS.DumaisS.FurnasG.LandauerT.HarshmanR.. 1990. “Indexing by Latent Semantic Analysis.”Journal of the American Society for Information Science41:391–407.
16.
DrazinR.SchoonhovenC. B.. 1996. “Community, Population, and Organization Effects on Innovation: A Multilevel Perspective.”Academy of Management Journal39:1065–83.
17.
EckartC.YoungG.. 1936. “The Approximation of One Matrix by Another of Lower Rank.”Psychometrika1:211–18.
18.
EstesW. K.1994. Classification and Cognition, Vol. 22. New York: Oxford University Press.
19.
GordonA. D.1999. Classification. London, England: Chapman and Hall/CRC.
20.
HamptonJ. A.1995. “Testing the Prototype Theory of Concepts.”Journal of Memory and Language34:686–708.
21.
HullD. A.1996. “Stemming Algorithms — A Case Study for Detailed Evaluation.”Journal of the American Society for Information Science47:70–84.
22.
HullD. A.GrefenstetteG.. 1966. A Detailed Analysis of English Stemming Algorithms. Rank Xerox Research Centre Europe, Meylan, France.
23.
HusbandsParrySimonHorstDingChris. 2000. “On the Use of Singular Value Decomposition for Text Retrieval.” In SIAM Comp. Info. Retrieval Workshop. Raleigh, NC: Society for Industrial and Applied Mathematics.
24.
KleinK. J.SorraJ. S.. 1996. “The Challenge of Innovation Implementation.”Academy of Management Review21:1055–80.
25.
KontostathisAprilPottengerWilliam M.. 2002. “Detecting Patterns in the LSI Term-Term Matrix.” Presented at the Workshop on Foundations of Data Mining and Discovery at the IEEE International Conference on Data Mining, Maebashi City, Japan.
26.
KrovetzRobert. 1993. “Viewing Morphology as an Inference Process.” Presented at the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Pittsburgh, PA.
27.
KruschhkeJ. K.1992. “ALCOVE: An Exemplar Based Connectionist Model of Category Learning.”Psychological Review99:22–44.
28.
KruskalJ. B.1964. “Multidimensional Scaling by Optimizing Goodness-of-Fit to a Nonmetric Hypothesis.”Psychometrika29:28–42.
29.
KuesterS.HomburgC.RobertsonT. S.. 1999. “Retaliatory Behavior to New Product Entry.”Journal of Marketing63:90–106.
30.
LakoffGeorge. 1990. Women, Fire, and Dangerous Things: What Categories Reveal About the Mind. Chicago, IL: University of Chicago Press.
31.
LibuttiL.2000. “Building Competitive Skills in Small and Medium-Sized Enterprises Through Innovation Management Techniques: Overview of an Italian Experience.”Journal of Information Science26:413–19.
32.
LovinsJ. B.1968. “Development of a Stemming Algorithm.”Mechanical Translation and Computational Linguistics11:22–31.
33.
LuhnH. P.1957. “A Statistical Approach to Mechanized Encoding and Searching of Literary Information.”IBM Journal of Research and Development1:309–17.
34.
MackensenKarstenWilleUta. 1999. “Qualitative Text Analysis Supported By Conceptual Data Systems.”Quality and Quantity33:135–56.
35.
MandelbrotBenoit. 1983. The Fractal Geometry of Nature: New York: Freeman.
36.
McLaughlinMary E.CarnevalePeterLimRodney G.. 1991. “Professional Mediators' Judgments of Mediation Tactics: Multidimensional Scaling and Cluster Analyses.”Journal of Applied Psychology76:465–72.
37.
MilesMatthew B.MichaelHuberman A.. 1994. Qualitative Data Analysis: An Expanded Sourcebook. Beverly Hills, CA: Sage Publications.
38.
MoneM. A.McKinleyW.BarkerV. L.. 1998. “Organizational Decline and Innovation: A Contingency Framework.”Academy of Management Review23:115–32.
39.
MongeP. R.CozzensM. D.ContractorN. S.. 1992. “Communication and Motivational Predictors of the Dynamics of Organizational Innovation.”Organization Science3:250–74.
40.
NunnallyJum C.BernsteinIra H.. 1994. Psychometric Theory. New York: McGraw-Hill.
41.
PorterM. F.1980. “An Algorithm for Suffix Stripping.”Program14:130–37.
42.
RepenningN. P.2002. “A Simulation-Based Approach to Understanding the Dynamics of Innovation Implementation.”Organization Science13:109–27.
43.
RichardsTomRichardsLyn. 1995. “Using Hierarchical Categories in Qualitative Data Analysis.” Pp. 80–95 in Computer-Aided Qualitative Data Analysis: Theory, Methods and Practice, edited by KelleU.. London, England: Sage Publications.
44.
RobertsonS.WalkerS.. 1994. “Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval.” Pp. 232–41 in Proceedings of the 17th Annual International ACM SIGIR Conference on R&D in Information Retrieval, edited by CroftW.van RijsbergenC.: New York: Springer-Verlag.
45.
RobertsonS. E.1997. “Overview of the OKAPI Projects.”Journal of Documentation53:3–7.
46.
RoschE.1978. Cognition and Categorization. New York: Lawrence Erlbaum.
47.
SaltonG.WongA.YangC.. 1975. “A Vector Space Model for Automatic Indexing.”Communications of the ACM18:613–20.
48.
SaltonGerardBuckleyChristopher. 1998. “Term-Weighting Approaches in Automatic Text Retrieval.”Information Processing and Management24:513–23.
49.
SlomanSteven A.MaltBarbara C.FridmanArthur. 2001. “Categorization Versus Similarity: The Case of Container Names.” Pp. 73–86 in Similarity and Categorization, edited by HahnU.RamscarM.. Oxford, England: Oxford University Press.
50.
SorensenJ. B.StuartT. E.. 2000. “Aging, Obsolescence, and Organizational Innovation.”Administrative Science Quarterly45:81–112.
51.
SubramaniManiWaldenEric A.. 2001. “The Impact of E-Commerce Announcements on the Market Value of Firms.”Information Systems Research12:135–54.
52.
SwansonE. Burton. 1994. “Information Systems Innovation Among Organizations.”Management Science40:1069–92.
53.
WhittingtonR.PettigrewA.PeckS.FentonE.ConyonM.. 1999. “Change and Complementarities in the New Competitive Landscape: A European Panel Study, 1992–1996.”Organization Science10:583–600.
54.
YinR. K.2003. Case Study Research, Design and Methods. Beverly Hills, CA: Sage Publications.
55.
ZipfG. K.1949. Human Behavior and the Principle of Least Effort. Reading, MA: Addison-Wesley.
