This study examines the perceptions of data-driven decision making (DDDM) activities and culture in organizations driven by a social mission. Analysis of survey information from multiple stakeholders in each of eight social enterprises highlights the wide divergence in views of DDDM. Within an organization, managerial and nonmanagerial staff working for the organization and staff from a prominent funder all expressed different perceptions of the same organization’s DDDM activities and culture. Study findings also provide insights into how to improve an organization’s capacity to build and use performance management systems, which include building a common understanding about what activities are—or are not—being undertaken. Finally, findings provide insights about structuring research on DDDM, which indicate that information from only one respondent in an organization or only one organization might not be reliable or generalizable.
AlaimoS. P. (2008). Nonprofits and evaluation: Managing expectations from the leader’s perspective. New Directions for Evaluation, 119, 73–92.
2.
BehnR. D. (2003). Why measure performance? Different purposes require different measures. Public Administration Review, 63, 586–606.
3.
BehnR. D. (2004). Performance leadership: 11 better practices that can ratchet up performance. Washington, DC: IBM Center for the Business of Government.
4.
BenjaminL. M. (2012). Nonprofit organizations and outcome measurement from tracking program activities to focusing on frontline work. American Journal of Evaluation, 33, 431–447.
5.
BoyleR.LemaireD.RistR. C. (1999). Introduction: Building evaluation capacity. In BoyleR.LemaireD. (Eds.), Building effective evaluation capacity (pp. 1–19). New Brunswick, NJ: Transaction.
6.
BrynjolfssonE.HittL. M.KimH. H. (2011, 422). Strength in numbers: How does data-driven decisionmaking affect firm performance?Retrieved June 13, 2013, fromhttp://dx.doi.org/10.2139/ssrn.1819486
CairnsB.HarrisM.HutchisonR.TrickerM. (2005). Improving performance? The adoption and implementation of quality systems in UK nonprofits. Nonprofit Management and Leadership, 16, 135.
9.
CarmanJ. G. (2007). Evaluation practice among community-based organizations: Research into the reality. American Journal of Evaluation, 28, 60–75.
10.
CarmanJ. G.FredericksK. A. (2008). Nonprofits and evaluation: Empirical evidence from the field. New Directions for Evaluation, 119, 51–71.
11.
CarmanJ. G.FredericksK. A. (2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full?American Journal of Evaluation, 31, 84–104.
12.
CarrilioT. E.PackardT.ClappJ. D. (2003). Nothing in—nothing out: Barriers to the use of performance data in social service programs. Administration in Social Work, 27, 61–75.
13.
DavenportT. H. (2006). Competing on analytics. Harvard Business Review, 84, 98–107.
HatryH. P. (2014, 7). Transforming performance measurement for the 21st century. Washington, DC: The Urban Institute.
16.
HendricksM.PlantzM. C.PritchardK. J. (2008). Measuring outcomes of United Way funded programs: Expectations and reality. New Directions for Evaluation, 119, 13–35.
17.
HooleE.PattersonT. E. (2008). Voices from the field: Evaluation as part of a learning culture. New Directions for Evaluation, 119, 93–113.
18.
HuffmanD.LawrenzF.ThomasK.ClarksonL. (2006). Collaborative evaluation communities in urban schools: A model of evaluation capacity building for STEM education. New Directions for Evaluation, 109, 73–85.
19.
HwangH.PowellW. W. (2009). The rationalization of charity: The influences of professionalism in the nonprofit sector. Administrative Science Quarterly, 54, 268–298.
20.
IkemotoG. S.MarshJ. A. (2007). Cutting through the “data-driven” mantra: Different conceptions of data-driven decision making. Retrieved October 18, 2013, fromhttp://www.rand.org/pubs/reprints/RP1372.html
21.
JulnesP. D.HolzerM. (2001). Promoting the utilization of performance measures in public organizations: An empirical study of factors affecting adoption and implementation. Public Administration Review, 61, 693–708.
22.
KaplanR. S. (2001). Strategic performance measurement and management in nonprofit organizations. Nonprofit Management & Leadership, 11, 353–370.
23.
KiernanN. E.AlterT. R. (2004). Can a web site be used as a vehicle for organizational learning about evaluation?Journal of Higher Education Outreach and Engagement, 10, 121–134.
24.
KingJ. A.VolkovB. (2005). A framework for building evaluation capacity based on the experiences of three organizations. CURA Reporter, 35, 10–16.
25.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
26.
LaValleS.LesserE.ShockleyR.HopkinsM. S.KruschwitzN. (2010). Big data, analytics and the path from insights to value. MIT Sloan Management Review, 52, 21–31.
27.
LeRouxK.WrightN. S. (2010). Does performance measurement improve strategic decision making? Findings from a national survey of nonprofit social service agencies. Nonprofit and Voluntary Sector Quarterly, 39, 571–587.
28.
LiketK. C.Rey-GarciaM.MaasK. E. H. (2014). Why aren’t evaluations working and what to do about it: A framework for negotiating meaningful evaluation in nonprofits. American Journal of Evaluation, 35, 171–188.
29.
MalaniA.PhilipsonT.DavidG. (2003). Theories of firm behavior in the nonprofit sector. A synthesis and empirical evaluation. In GlaeserE. (Ed.), The governance of not-for-profit organizations (pp. 181–216). Chicago, IL: University of Chicago Press.
McDonaldB.RogersP.KeffordB. (2003). Teaching people to fish? Building evaluation capacity of public sector organizations. Evaluation, 9, 9–29.
33.
MoynihanD. P.PandeyS. K.WrightB. E. (2012). Prosocial values and performance management theory: Linking perceived social impact and performance information use. Governance, 25, 463–483.
SeldenS.SowaJ. E. (2011). Performance management and appraisal in human service organizations: Management and staff perspectives. Public Personnel Management, 40, 251–264.
SpeckbacherG. (2003). The economics of performance management in nonprofit organizations. Nonprofit Management & Leadership, 13, 267–281.
41.
TautS. (2007). Studying evaluation capacity building in a large international development organization. American Journal of Evaluation, 28, 45–59.
42.
ZimmermanJ. A. M.StevensB. W. (2006). The use of performance measurement in South Carolina nonprofits. Nonprofit Management & Leadership, 16, 315–327.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
