This article uses reflective practice and social interdependence theory to unpack the ways in which our practice as internal evaluators was impacted by the COVID-19 pandemic, using the development of a monitoring and evaluation framework as a case study. The reflections are separated into six stages: description, feelings, evaluation, analysis, conclusion and action plan. Initial reflections on the impact of COVID-19 drew out the negative effects of the pandemic and associated restrictions, which limited our ability to build rapport and stretched our capacity to balance work and home commitments. Deeper investigation revealed that the disaster pushed us to develop new ways of working that will augment and improve our future efforts. We foresee that these learnings will enable a future with greater ability to offer hybrid online/face-to-face collaborative opportunities that will enhance inclusion and active participation, thereby promoting monitoring and evaluation with greater collective ownership and relevance to a wider audience.
Al-HabaibehA.WatkinsM.WariedK.JavareshkM. (2021). Challenges and opportunities of remotely working from home during COVID-19 pandemic. Global Transitions, 3, 99-108. https://doi.org/10.1016/j.glt.2021.11.001.
2.
AxtellC.FleckS.TurnerN. (2004). Virtual teams: Collaborating across distance. International Review of Industrial and Organizational Psychology, 19, 205-248.
3.
BassotB. (2015). The reflective practice guide: An interdisciplinary approach to critical reflection. Routledge.
4.
BeekharryM. (2017). Applying agile project management methodology to natural disaster projects. [Doctoral Thesis. University of South Australia.
BourgeoisI.HartR.TownsendS.GagneM. (2011). Using hybrid models to support the development of organizational evaluation capacity: A case narrative. Evaluation and Program Planning, 34(3), 228–235. https://doi.org/10.1016/j.evalprogplan.2011.03.003
7.
BrookfieldS. (1995). Becoming a critically reflective teacher. Jossey-Bass.
8.
DeutschM. (1949). An experimental study of the effects of cooperation and competition upon group process. Human Relations, 2(3), 199–231. https://doi.org/10.1177/001872674900200301
FloraH. K.ChandeS. V. (2014). A systematic study on agile software development methodologies and practices. International Journal of Computer Science and Information Technologies, 5(3), 3626–3637.
11.
FookJ.GardnerF. (2007). Practising critical reflection: A resource handbook. McGraw-Hill.
12.
GibbsG. (1988). Learning by doing: A guide to teaching and learning methods. Further Education Unit.
13.
HertelG.GeisterS.KonradtU. (2005). Managing virtual teams: A review of current empirical research. Human Resource Management Review, 15(1), 69–95. https://doi.org/10.1016/j.hrmr.2005.01.002
14.
HertelG.KonradtU.OrlikowskiB. (2004). Managing distance by interdependence: Goal setting, task interdependence, and teams-based rewards in virtual teams. European Journal of Work and Organizational Psychology, 13(1), 1–28. https://doi.org/10.1080/13594320344000228
15.
JohnsC. (2009). Becoming a reflective practitioner (3rd ed.). Wiley Blackwell.
16.
JohnsonD. (2003). Social interdependence: Interrelationships among theory, research, and practice. American Psychologist, 58(11), 934–945. https://doi.org/10.1037/0003-066x.58.11.934
17.
JohnsonD.JohnsonR. (2003). Training for cooperative group work. In WestM.TjosvoldD.SmithK. (Eds), International handbook of organizational teamwork and cooperative working (pp. 167–184). John Wiley & Sons.
18.
JohnsonD.JohnsonR.StevahnL. (2011). Social interdependence and program evaluation. In MarkM.DonaldsonS.CampbellB. (Eds), Social psychology and evaluation (pp. 228–317). Guilford Press.
19.
KellyL. (2021). Evaluation in small development non-profits: Deadends, victories, and alternative routes. Palgrave Macmillan. https://doi.org/10.1007/978-3-030-58979-0
20.
KellyL.GoodallJ.LombardiL. (2022). Developing a monitoring and evaluation framework in a humanitarian non-profit organisation using agile methodology. Disaster Prevention and Management. https://doi.org/10.1108/DPM-11-2021-0312. Epub ahead of print.
21.
KellyL.RogersA. (2022). Internal evaluation in non-profit organisations: Practitioner perspectives on theory, research and practice. Routledge. https://doi.org/10.4324/9781003183006
22.
KingJ. (2007). Developing evaluation capacity through process use. New Directions for Evaluation, 2007(116), 45–59. https://doi.org/10.1002/ev.242
23.
KolbD. (1984). Experiential learning: Experience as the source of learning and development. Prentice-Hall.
24.
KumarS. (2002). Methods for community participation: A complete guide for practitioners. Practical Action Publishing.
25.
LabinS.DuffyJ.MeyersD.WandersmanA.LesesneC. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33(3), 307–338. https://doi.org/10.1177/1098214011434608
26.
LoveA. (1991). Internal evaluation: Building organizations from within. SAGE Publications.
MarkiewiczA.PatrickI. (2016). Developing monitoring and evaluation frameworks. SAGE Publications.
29.
MaznevskiM.ChudobaK. (2000). Bridging space over time: Global virtual team dynamics and effectiveness. Organization Science, 11(5), 473–585. https://doi.org/10.1287/orsc.11.5.473.15200
30.
McCoyA.RoseD.ConnollyM. (2013). Developing evaluation cultures in human service organisations. Evaluation Journal of Australasia, 13(1), 15-20. https://doi.org/10.1177/1035719x1301300103
31.
MulwaF.NguluuS. (2003). Participatory monitoring and evaluation: A strategy for organisation strengthening. Zapf Chancery.
OnyangoR. O. (2018). Participatory monitoring and evaluation: An overview of guiding pedagogical principles and implications on development. International Journal of Novel Research in Humanity and Social Sciences, 5(4), 428–433. https://doi.org/10.14738/assrj.510.5291
34.
PattonM. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. Guilford Press.
35.
PattonM. Q. (2012). Essentials of utilization-focused evaluation. SAGE Publications.
36.
PattonM. Q. (2015). Qualitative research and evaluation methods (4th ed.). SAGE Publications.
37.
RogersA. (2021). Competitive champions versus cooperative advocates: Understanding evaluation advocates in Australian non-profit organisations [Doctoral thesis, University of Melbourne]. https://minerva-access.unimelb.edu.au/handle/11343/288857
38.
RogersA.KellyL.McCoyA. (2019). Evaluation literacy: Perspectives of internal evaluators in non-government organizations. Canadian Journal of Program Evaluation, 34(1), 1–20. https://doi.org/10.3138/cjpe.42190
39.
RogersA.KellyL.McCoyA. (2021). Using social psychology to constructively involve colleagues in internal evaluation. American Journal of Evaluation, 42(4), 541–558. https://doi.org/10.1177/1098214020959465
40.
ŞentürkE.SağaltıcıE.GenişB.Günday TokerÖ. (2021). Predictors of depression, anxiety and stress among remote workers during the COVID-19 pandemic. Work, 70(1), 41–51. https://doi.org/10.3233/WOR-210082
41.
SonnichsenR. (2000). High impact internal evaluation: A practitioner’s guide to evaluation and consulting inside organisations. SAGE Publications.
42.
TindaleR.AndersonE. (2002). Small group research and applied social psychology. In TindaleR.HeathL.EdwardsJ.PosavacE.BryantF.Suarez-BalcazarY.Henderson-KingE.MyersJ. (Eds), Theory and research on small groups (pp. 1–8). Kluwer Academic Publishers.
43.
UpadhyayA.MukhutyS.KumariS.Garza-ReyesJ.ShuklaV. (2022). A review of lean and agile management in humanitarian supply chains: Analysing the pre-disaster and post-disaster phases, and future directions. Production Planning & Control, 33(6–7), 641–654. https://doi.org/10.1080/09537287.2020.1834133
44.
VolkovB. (2008). A bumpy journey to evaluation capacity: A case study of evaluation capacity building in a private foundation. Canadian Journal of Program Evaluation, 23(3), 175–197.
45.
VolkovB. (2011). Beyond being an evaluator: The multiplicity of roles of the internal evaluator. New Directions for Evaluation, 132(132), 25–42. https://doi.org/10.1002/ev.394
46.
WadsworthY. (2011). Everyday evaluation on the run (3rd ed.). Allen & Unwin.
47.
WangB.LiuY.QianJ.ParkerS. K. (2021). Achieving effective remote working during the COVID-19 pandemic: A work design perspective. Applied Psychology, 70(1), 16–59. https://doi.org/10.1111/apps.12290
48.
WhillansA.PerlowL.TurekA. (2021). Experimenting during the shift to virtual team work: Learning from how teams adapted their activities during the COVID-19 pandemic. Information and Organization, 31(1), 1–12. https://doi.org/10.1016/j.infoandorg.2021.100343
49.
YangL.HoltzD.JaffeS.SuriS.SinhaS.WestonJ.JoyceC.ShahN.ShermanK.HechtB.TeevanJ. (2022). The effects of remote work on collaboration among information workers. Nature Human Behaviour, 6(1), 43–54. https://doi.org/10.1038/s41562-021-01196-4
50.
YusaA.HynieM.MitchellS. (2016). Utilization of internal evaluation results by community mental health organizations: Credibility in different forms. Evaluation and Program Planning, 54(3–4), 11–18. https://doi.org/10.1016/j.evalprogplan.2015.09.006
