The continued prevalence of different forms of collaborative working within public policy requires adaption in evaluation practices. In recent years evaluation toolkits, audits and guides have migrated online, but with varying success. At their worst, such tools can offer a disengaging user experience, limited coverage of issues or normative bias. This article outlines POETQ, designed to be engaging, comprehensive and methodologically robust. An overview of this approach is set out alongside an analysis of its merits. The article concludes by reflecting on the kinds of evidence that policy makers actually want to generate in relation to the topic of collaboration.
AbbottDTownsleyRWatsonD (2005) Multi-agency working in services for disabled children: What impact does it have on professionals?Health and Social Care in the Community13: 155–163.
2.
AbendsternMReillySHughesJ. (2006) Levels of integration and specialisation within professional community teams for people with dementia. International Journal of Geriatric Psychiatry21: 77–85.
3.
Appleton-DyerSClintonJCarswellP. (2012) Understanding evaluation influence within public sector partnerships: A conceptual model. American Journal of Evaluation33: 532–546.
4.
BallRForbesTParrisM. (2010) The evaluation of partnership working in the delivery of health and social care. Public Policy and Administration25: 387–407.
5.
BarnesMBauldLBenezevalM. (2005) Health Action Zones: Partnerships for Health Equity. London: Routledge.
6.
BrownLTuckerCDomokosT (2003) Evaluating the impact of integrated health and social care teams on older people living in the community. Health and Social Care in the Community11: 85–94.
7.
BrownLDFeinbergMEGreenbergMT (2012) Measuring coalition functioning: Refining constructs through factor analysis. Health Education and Behavior39: 486–497.
8.
BrownS (1980a) Political Subjectivity. New Haven, CT: Yale University Press.
9.
BrownS (1980b) Political Subjectivity: Applications of Q Methodology in Political Science. New Haven, CT: Yale University Press.
10.
CarnwellRBuchananJ (2005) Learning from partnerships: Themes and issues. In: CarnwellRBuchananJ (eds) Effective Practice in Health and Social Care: A Partnership Approach. Maidenhead: Open University Press, pp. 281–287.
11.
DickinsonH (2006) The evaluation of health and social care partnerships: An analysis of approaches and synthesis for the future. Health and Social Care in the Community14(5): 375–383
12.
DickinsonH (2008) Evaluating Outcomes in Health and Social Care. Bristol: Policy Press.
13.
DickinsonH (2010) The importance of being efficacious: English health and social care partnerships and service user outcomes. International Journal of Integrated Care10: 346.
14.
DickinsonH (2014) Performing Governance: Partnerships, Culture and New Labour. Basingstoke: Palgrave Macmillan
15.
DickinsonHGlasbyJNicholdsA. (2013a) Joint commissioning in health and social care: An exploration of definitons, processes, services and outcomes. NIHR Service Delivery and Organisation programme, September. Retrieved from: http://www.netscc.ac.uk/hsdr/projdetails.php?ref=08-1806-260
16.
DickinsonHJeffaresSNicholdsA. (2013b) Beyond the Berlin Wall?Public Management Review. Epub ahead of print. DOI: 10.1080/14719037.2012.757353.
17.
DowlingBPowellMGlendinningC (2004) Conceptualising successful partnerships. Health and Social Care in the Community12: 309–317.
18.
EdenSDonaldsonAWalkerG (2005) Structuring subjectivities? Using Q methodology in human geography. Area37: 413–422.
El AnsariWWeissES (2006) Quality of research on community partnerships: Developing the evidence base. Health Education Research21: 175–180.
21.
FisherRA (1971) The Design of Experiments. New York: Hafner Publishing Company.
22.
GajdaR (2004) Utilizing collaboration theory to evaluate strategic alliances. American Journal of Evaluation25: 65–77.
23.
GalesicMBosnjakM (2009) Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly73: 349–360.
24.
GreigRPoxtonR (2001) From joint commissioning to partnership working – will the new policy framework make a difference?Managing Community Care9: 32–38.
25.
HardyBHudsonBWaddingtonE (2003) Assessing Strategic Partnership: The Partnership Assessment Tool. London: Office of the Deputy Prime Minister.
HoggettP (2006) Conflict, ambivalence, and the contested purpose of public organizations. Human Relations59: 175–194.
28.
HughesJWeissJ (2007) Simple rules for making alliances work. Harvard Business Review14: 1–10.
29.
HuxhamCVangenS (2005) Managing to Collaborate: The Theory and Practice of Collaborative Advantage. Abingdon: Routledge.
30.
JacksonM (1989) Assumptional analysis. Systems Practice14: 11–28.
31.
JeffaresSSullivanHBovairdT (2012) Beyond the Contract: The Challenge of Evaluating the Performance(s) of Public-Private Partnerships. In: GreveCHodgeG (eds) Rethinking Public-Private Partnerships: Strategies for Turbulent Times. London: Routledge, pp. 166–187.
32.
JeffaresSBovairdT (2010) Partnership beyond the contract: unpublished final report of the evaluation of the Service Birmingham Partnership. Birmingham: University of Birmingham.
33.
JeffaresSSkelcherC (2011) Democratic subjectivities in network governance: a Q methodology study of English and Dutch public managers. Public Administration89: 1253–1273.
34.
KelmanS (2007) The transformation of government in the decade ahead. In: KettlDFKelmanS (eds) Reflections on 21st Century Government Management. Washington, DC: IBM Center for the Business of Government, pp. 33–63.
35.
LeutzW (1999) Five laws for integrating Medical and Social Services: Lessons from the United Stated and the United Kingdom. The Milbank Quarterly77: 77–110.
36.
MarcusBBosnjakMLindnerS. (2007) Compensating for low topic interest and long surveys: A field experiment in nonresponse in web surveys. Social Science Computer Review25: 372–383.
37.
MarekLIBrockDPSavlaJ (2014) Evaluating collaboration for effectiveness: Conceptualization and measurement. American Journal of Evaluation1–19.
MelhuishEBelskyJLeylandA. (2008) Effects of fully-established Sure Start Local programmes on children and their families living in England: A quasi-experimental observational study. Lancet372: 1641–1647.
40.
NewmanJ (2001) Modernising Governance: New Labour, Policy and Society. London: SAGE.
Office of the Deputy Prime Minister and Department of Transport (2006) National evaluation of Local Strategic Partnerships: Formative evaluation and action research programme, 2002–2005. London. Retrieved from: https://www.gov.uk/government/publications.
43.
O’FlynnJ (2014) Crossing boundaries: The fundamental questions in public management and policy. In: O’FlynnJBlackmanDHalliganJ (eds) Crossing Boundaries in Public Management and Policy: The International Experience. London: Routledge, pp. 11–44.
44.
ProvanKMilwardH (2001) Do networks really work? A framework for evaluating public-sector organizational networks. Public Administration Review61: 414–423.
45.
ProvanKGSydowJ (2008) Evaluating inter-organizational relationships. In: CropperSEbersMHuxhamC. (eds) The Oxford Handbook of Inter-organizational Relations. Oxford: Oxford University Press, pp. 691–718.
46.
ReberBKaufmanSCroppF (2000) Assessing Q-assessor: A validation study of Q-assessor computer-based Q-sorts versus paper sorts. Operant Subjectivity23: 192–209.
SullivanH (2003) New forms of local accountability: Coming to terms with ‘many hands’. Policy and Politics31: 353–370.
49.
SullivanH (2011) ‘Truth’ junkies: Using evaluation in UK public policy. Policy and Politics39: 499–512.
50.
SullivanHSkelcherC (2002) Working across Boundaries: Collaboration in Public Services. Basingstoke: Palgrave Macmillan.
51.
SullivanHBarnesMMatkaE (2006) Collaborative capacity and strategies in area-based initiatives. Public Administration84: 289–310.
52.
SullivanHWilliamsPJeffaresS (2012) Leadership for collaboration. Public Management Review14: 41–66.
53.
Van ExcelJBakerRMasonH. (2015) Public views on principles for health care priority setting: Findings of a European cross-country study using Q methodology. Social Science and Medicine126: 128–137.
54.
WattsSStennerP (2005) Doing Q-methodology: Theory, method and interpretation. Qualitative Research in Psychology2: 67–91.
55.
WilliamsPSullivanH (2009) Faces of integration. International Journal of Integrated Care9: 1–13.
56.
WoodlandRHHuttonMS (2012) Evaluating organizational collaborations: Suggested entry points and strategies. American Journal of Evaluation33: 366–383.
