In this paper the empirical findings and basic frameworks used in the evaluation of GIS are reviewed. In the studies reviewed, a variety of evaluation criteria are employed, but they still contribute sporadic, unsystematic, and inconclusive evidence. Going beyond a discussion about the need for measuring GIS impacts, and an uncritical and unselective adoption of computerized tools, I emphasize here the importance of assessment and feedback for better adaptation of GIS technology to the needs of urban planning. Comprehensive, multidimensional, context-based, and process-based evaluations can contribute valuable information to guide the developments in GIS technology and to facilitate efforts in GIS implementation in public and private organizations.
Get full access to this article
View all access options for this article.
References
1.
AntenucciJ CBrownKCroswellP L, 1991Geographic Information Systems—A Guide to the Technology (Van No strand Reinhold, New York)
2.
AzadB, 1993, “Theory and measurement in GIS implementation research: Critique and proposals”, in Proceedings of the 3rd International Conference on Computers in Urban Planning and Urban Management Eds KlostermanR EFrenchS P, City Planning Program, Georgia Institute of Technology, Atlanta, GA, pp 51–87
3.
BattyMXieY, 1994, “Modelling inside GIS. Part 1: Model structures, exploratory spatial data analysis and aggregation”International Journal of Geographical Information Systems8291–307
4.
BiksonT KGutekB AMankinD A, 1987, “Implementing computerized procedures in office settings: Influences and outcomes”, technical report, Rand Institute for Research on Interactive Systems, Rand Corporation, Santa Monica, CA
5.
BrownK, 1990Local Government Benefits from GISPlanGraphics Inc., Lexington, KY
6.
BrownM M, 1997, “An empirical assessment of the hurdles to geographic information system success in local governments”State and Local Government Review28 (3) 193–204
7.
BudićZ D, 1993, “GIS use among southeastern local governmentJournal of the Urban and Regional Information Systems Association54–17
8.
BudićZ D, 1994, “Effectiveness of geographic information systems in local planning”Journal of the American Planning Association60244–263
9.
CalkinsH WObermeyerN J, 1991, “Taxonomy for surveying the use and value of geographical information”International Journal of Geographical Information Systems5341–351
10.
CampbellH J, 1994, “How effective are GIS in practice? A case study of British local government”International Journal of Geographical Information Systems8309–325
11.
CampbellHMasserI, 1992, “GIS in local government: Some findings from Great Britain”International Journal of Geographical Information Systems6529–546
12.
CSR, 1992Mapping Application in Virginia: Results of a Survey on Geographic Information SystemsCentre for Survey Research, Blacksburg, VA
13.
ClappJ LMcLaughlinJ DSullivanJ GVonderoheAP, 1989, “Toward a method for the evaluation of multipurpose land information systems”Journal of the Urban and Regional Information Systems Association139–45
14.
CouclelisH, 1991, “Requirements for planning-relevant GIS”Papers in Regional Science70(1) 9–20
15.
CroswellP L, 1991, “Obstacles to GIS implementation and guidelines to increase the opportunities for success”Journal of the Urban and Regional Information Systems Association3(1) 43–56
16.
DanzigerJ N, 1979, “Technology and productivity: A contingency analysis of computers in local government”Administration and Society11144–171
17.
DavisF D, 1989, “Perceived usefulness, perceived ease of use, and user acceptance of information technology”MIS Quarterly13319–339
18.
DeLoneHMcLeanE R, 1992, “Information systems success: The quest for the dependent variable”Information Systems Research3(1) 60–95
19.
DickinsonH JCalkinsH W, 1988, “The economic evaluation of implementing GIS”International Journal of Geographic Information Systems2307–327
20.
FeldmanM SMarchJ G, 1981, “Information in organizations as signal and symbol”Administrative Science Quarterly26171–186
21.
FonsecaAGouveiaCCamaraASilvaJ P, 1995, “Environmental impact assessment with multimedia spatial information systems”Environment and Planning B: Planning and Design22637–648
22.
FrenchS PSkilesA E, 1996, “Organizational structures for GIS implementation”, in URISA Proceedings Ed. SailingM J, Urban and Regional Information Systems Association, 900 2nd Street NE, Washington, DC 20009, pp 280–293
23.
FrenchS PWigginsL L, 1990, “California Planning Agency experiences with automated mapping and geographic information systems”Environment and Planning B: Planning and Design17441–450
24.
GillespieS R, 1992, “The value of GIS to the federal government” in GIS/LIS '92 Conference Proceedings American Society for Photogrammetry and Remote Sensing—American Congress on Surveying and Mapping, S410 Grosvenor Lane, Bethesda, MD 20814–2160, USA
25.
GillespieS R, 1994, “Measuring the benefits of GIS use: Two transportation case studies”Journal of the Urban and Regional Information Systems Association6(2) 62–67
26.
GoodchildM R, 1987, “A spatial analytical perspective on geographical information systems”International Journal of Geographical Information Systems1327–334
27.
HarrisBBattyM, 1993, “Locational models, geographic information and planning support systems”Journal of Planning Education and Research12184–198
28.
HeffronF, 1989Organizational Theory and Public Organizations: The Political Connection (Prentice Hall, Englewood Cliffs, NJ)
29.
HittL MBrynjolfssonE, 1996, “Productivity, business profitability, and consumer surplus: Three different measures of information value”MIS Quarterly20(2) 121–142
30.
HuxholdW ELevinsohnA G, 1995Managing Geographic Information System Projects (Oxford University Press, New York)
31.
JohnsonJ P, 1995, “Case studies of dissemination policy in local government GIS agencies”Computers, Environment and Urban Systems19373–390
32.
JordanJ MSutherlandS L, 1979, “Assessing the results of public expenditures”Canadian Public Administration22581–609
33.
KaiserE JGodschalkD RChapinS FJr, 1995Urban Land Use Planning (University of Illinois Press, Urbana, IL)
34.
KarimiH ABlaisJ A R R, 1996, “Current and future directions in GIS”Computers, Environment and Urban Systems20(2) 85–97
35.
KlostermanR E, 1990, “Microcomputers in urban and regional planning: Lessons from the past, directions for the future”Computers, Environment and Urban Systems14177–185
36.
KottemannJ EDavisF DRemusW E, 1994, “Computer-assisted decision making: Performance, beliefs, and the illusion of control”Organizational Behavior and Human Decision Processes5726–37
37.
LandauerK, 1995The Trouble with Computers (MIT Press, Cambridge MA)
38.
LandisJ D, 1994, “The California urban futures model: A new generation of metropolitan simulation models”Environment and Planning B: Planning and Design21399–420
39.
MasserICragliaM, 1997, “The diffusion of GIS in local government in Europe”, in Geographic Information Research: Bridging the Atlantic Eds CragliaMCouclelisH (Taylor and Francis, London) pp 95–110
40.
MayJ WSmithDKutchTVadayG, 1994Computers, Mapping and GIS: A Look at Florida's Local Planning Agencies (Florida Institute of Government, Tallahassee, FL)
41.
MoneyATrompDWegnerT, 1988, “The quantification of decision support benefits within the context of value analysis”MIS Quarterly12(2) 223–236
42.
MundelM E, 1983Improving Productivity and Effectiveness (Prentice-Hall, Englewood Cliffs, NJ)
43.
Nedović-BudićZ, 1995, “Evaluating benefits from GIS technology”, presentation at the 37th Annual Conference of the Association of Collegiate Schools of Planning, October, Detroit, MI; copy available from the author
44.
NewcombeT, 1993, “GIS: Beyond pipes and plates”Governing7(3) 25–26
45.
NorthropAKraemerK LDunkleD, 1990, “Payoffs from computerization: Lessons over time”Public Administration Review50505–514
46.
ObermayerN J, 1994, “Spatial conflicts in the information age” in URISA Proceedings Ed. SailingM, Urban and Regional Information Systems Association, 900 2nd Street NE, Washington, DC 20009, USA, pp 269–282
47.
OnsrudH J, 1992, “In support of open access for publicly held geographic information”GIS Law1(1) 3–6
48.
OnsrudH JJohnsonJWinneckiJ, 1996“GIS dissemination policy: Two surveys and a suggested approach”Journal of the Urban and Regional Information Systems Association8(2) 8–23
49.
OnsrudH JPintoJ K, 1993, “Evaluating correlates of GIS adoption success and the decision process of GIS acquisition”Journal of the Urban and Regional Information Systems Association5(1) 18–39
50.
PicklesJ, 1995Ground Truth: The Social Implications of Geographic Information Systems (Guilford Press, New York)
51.
PintoJ KOnsrudH J, 1997, “In search of the dependent variable: Toward synthesis in GIS implementation research”, in Geographic Information Research: Bridging the Atlantic Eds CragliaMCouclelisH, (Taylor and Francis, London)
52.
Plan it!, LLC, 1997What if? Planning Support System software developed by Plan it!, LLC (a DCI/LDR/CAPS—owned company), 9175 Guilford Road, Suite 100, Columbia, MD 21046, USA; http://www.dcigis.com/whatif/.
53.
SawickiD S and CraigW J, 1996, “The democratization of data: Bridging the gap for community groups”Journal of the American Planning Association62512–523
54.
SieberR E, 1997Computers in the grassroots: Environmentalists, geographic information systems, and public policy PhD thesis, Edward J Bloustein School of Planning and Public Policy, Rutgers University, New Brunswick, NJ
55.
SmithD ATomlinsonR F, 1992, “Assessing costs and benefits of geographical information systems: Methodological and implementation issues”International Journal of Geographical Information Systems6247–256
56.
ThompsonB, 1989, “The dazzling benefits (and hidden costs) of computerized mapping”Governing340–46
57.
TullochD LNiemannB JJrEpsteinE FLimpW FJohnsonS, 1996a, “Comparative study of multipurpose land information systems development in Arkansas, Ohio, and Wisconsin”, in GIS/LIS '96 Conference Proceedings American Society for Photogrammetry and Remote Sensing—American Congress on Surveying and Mapping, 5410 Grosvenor Lane, Bethesda, MD 20814–2160, USA, pp 128–141
58.
TullochD LNiemannB JJrEpsteinE F, 1996b, “A model of multipurpose land information system development in communities: Forces, factors, stages, indicators, and benefits” in GIS/LIS '96 Conference Proceedings American Society for Photogrammetry and Remote Sensing—American Congress on Surveying and Mapping, 5410 Grosvenor Lane, Bethesda, MD 20814–2160, USA, pp 325–348
59.
TveitdalSHesjedalO, 1991, “GIS in the Nordic countries”, in GIS Applications in National Resources Eds HeitMShortreidA (GIS World, Fort Collins, CO) pp 75–81
60.
WorrallL, 1994, “The role of GIS-based spatial analysis in strategic management in local management”Computers, Environment and Urban Systems18323–332
61.
YouJNedović-BudićZKimT J, 1997a, “Part 1. A GIS-based traffic analysis zone design: Technique”Transportation Planning and Technology2145–68
62.
YouJNedović-BudićZKimT J, 1997b, “Part 2. A GIS-based traffic analysis zone design: Implementation and evaluation”Transportation Planning and Technology2169–91
