The valid and reliable measurement of perceived influence over executive agencies is vital to understanding bureaucratic behavior. Using a survey of 540 state agency heads in 15 states, we evaluate two such measures—a standard free-standing measure and a paired-comparison measure—in terms of conceptual clarity, theoretical utility, and susceptibility to systematic measurement error. Our results indicate that while a paired-comparison measure may be theoretically superior to a free-standing measure, missing responses, intransitivities, and respondent fatigue make the paired-comparison method less practical.
Get full access to this article
View all access options for this article.
References
1.
AbneyGlennLauthThomas P.. 1983. “The Governor as Chief Administrator.” Public Administration Review43: 40–9.
2.
AllenMaryYenWendy. 2001. Introduction to Measurement Theory. Long Grove, IL: Waveland Press.
3.
BaranowskiMichael. 2001. “Legislative Professionalism and Influence on State Agencies.” Politics & Policy29: 147–62.
4.
BarrilleauxCharles. 1999. “Governors, Bureaus, and State Policymaking.” State and Local Government Review31: 53–9.
5.
BendorJohnTaylorSergeVan GaalenRoland. 1987. “Politicians, Bureaucrats, and Asymmetric Information.” American Journal of Political Science31: 796–828.
6.
BeyleThad. 1999. “The Governors.” In Politics in the American States, eds. GrayVirginiaHansonRussell L.JacobHerbert. 7th ed. Washington, DC: CQ Press.
7.
BrudneyJeffrey L.Ted HebertF.. 1987. “State Agencies and Their Environments: Examining the Influence of Important External Actors.” Journal of Politics49: 186–206.
8.
CarminesEdwardZellerRichard. 1979. Reliability and Validity Assessment. Beverly Hills, CA: Sage.
9.
DeVellisRobert. 2003. Scale Development. Beverly Hills, CA: Sage.
10.
DometriusNelson C.1979. “Measuring Gubernatorial Power.” Journal of Politics41: 589–610.
11.
DometriusNelson C.2002. “Gubernatorial Approval and Administrative Influence.” State Politics and Policy Quarterly2: 251–67.
EllingRichard C.1992. Public Management in the States. Westport, CT: Praeger.
14.
FreemanJ.L.1965. The Political Process. New York: Random House.
15.
HammKeith. 1983. “Patterns of Influence among Committees, Agencies, and Interest Groups.” Legislative Studies Quarterly8: 379–426.
16.
HebertF. TedBrudneyJeffrey L.WrightDeil S.. 1983. “Gubernatorial Influence and State Bureaucracy.” American Politics Quarterly11: 243–64.
17.
HuntingtonSamuel P.1952. “The Marasmus of the ICC: The Commission, the Railroads, and the Public Interest.” Yale Law Journal61: 467–509.
18.
JacobyWilliam. 1991. Data Theory and Dimensional Analysis. Newbury Park, CA: Sage.
19.
KingJames D.2000. “Changes in Professionalism in U.S. State Legislatures.” Legislative Studies Quarterly25: 327–44.
20.
McIverJohnCarminesEdward1981. Unidimensional Scaling. Newbury Park, CA: Sage.
21.
MoeTerry. 1984. “The New Economics of Organization.” American Journal of Political Science28: 739–77.
22.
NunnallyJum C.BersteinIra. 1994. Psychometric Theory. New York: McGraw-Hill.
23.
PotoskiMatthewWoodsNeal D.. 2001. “Designing State Clean Air Agencies: Administrative Procedures and Bureaucratic Autonomy.” Journal of Public Administration Research and Theory11: 203–21.
SigelmanLeeDometriusNelson C.. 1988. “Governors as Chief Administrators: The Linkage between Formal Powers and Informal Influence.” American Politics Quarterly16: 157–70.
26.
SquirePeverill. 1992. “Legislative Professionalism and Membership Diversity in State Legislatures.” Legislative Studies Quarterly17: 69–79.
27.
ThurstoneL.L.1927. “A Method of Paired-comparisons for Social Values.” Journal of Abnormal Social Psychology21: 384–400.
28.
ThurstoneL.L.1929. “Theory of Attitude Measurement.” Psychological Review36: 222–41.
29.
TorgersonWarren. 1958. Theory and Methods of Scaling. New York: John Wiley.
30.
WatermanRichard W.RouseAmeliaWrightRobert. 1998. “The Venues of Influence: A New Theory of Political Control of the Bureaucracy.” Journal of Public Administration Research and Theory8: 13–38.
31.
WatermanRichard W.RouseAmeliaWrightRobert. 1999. “The Determinants of Political Control of the Bureaucracy and the Venues of Influence.” Journal of Public Administration Research and Theory9: 527–69.
32.
WoodDan B.WatermanRichard W.. 1991. “The Dynamics of Political Control of the Bureaucracy.” American Political Science Review85: 801–28.
33.
WrightDeil S.ChoChung-Lae. 2001. American State Administrators Project (ASAP) Overview: Major Features of the ASAP Surveys 1964-1998. Chapel Hill, NC: University of North Carolina-Chapel Hill, Odom Institute for Research in Social Science.
