Education and engagement programs for Aboriginal young people tend to propagate Western, colonial paradigms: Aboriginal populations are targeted, yet Aboriginal voices are rarely heard throughout the planning, delivery, and evaluation stages of program implementation. It is essential that the voices of program participants – and the communities within which these programs serve – are provided a platform to determine what those outcomes are to be, and how they are to be achieved. Shooting Stars is a holistic engagement program for Aboriginal and Torres Strait Islander girls based in 20 remote and regional schools in Western Australia and South Australia. Shooting Stars staff (85% Aboriginal and Torres Strait Islander) facilitate yarning circles with program participants, local steering committees, and broader community groups in order to tailor program delivery to local needs and assess the effectiveness of the program. From 2020 to 2021, we yarned with our participants, communities, and localised steering committees about their definitions of success and how Shooting Stars can help to grow successful young women. In this article, we explore a complex, multidimensional definition of success defined by program participants and their communities, and describe how we are reflecting and implementing this definition across program delivery and evaluation.
AltmanJ.RussellS. (2012). Too much dreaming: Evaluations of the NTER intervention 2007-2012. Evidence Base, 3, 1–24. https://doi.org/10.21307/eb-2012-003
2.
AndrewsS. (2021). Qualitative analysis at the interface of Indigenous and Western knowledge systems: TheHerringbone stitch model. Qualitative Research, 21(6), 939–956.
3.
AraiL. (2003). Low expectations, sexual attitudes and knowledge: Explaining teenage pregnancy and fertility in English communities. Insights from qualitative research. The Sociological Review, 51(2), 199–217. https://doi.org/10.1111/1467-954X.00415
4.
AseronJ.GreymorningS. N.MillerA.WildeS. (2013). Cultural safety circles and indigenous peoples perspectives: inclusive practices for participation in higher education. Issues in Education Research (CIER), 6(4), 409–416.
BerrymanM.EleyE. (2017). Succeeding as Māori: Māori students’ views on our stepping up to the Ka Hikitia challenge. New Zealand Journal of Educational Studies, 52(1), 93–107. https://doi.org/10.1007/s40841-017-0076-1
9.
BessarabD.Ng’anduB. (2010). Yarning about yarning as a legitimate method in indigenous research. International Journal of Critical Indigenous Studies, 3(1), 37–50. https://doi.org/10.5204/ijcis.v3i1.57
10.
BirdS.WilesJ. L.OkalikL.KilabukJ.EgelandG. M. (2009). Methodological consideration of story telling in qualitative research involving indigenous peoples. Global Health Promotion, 16(4), 16–26. https://doi.org/10.1177/1757975909348111
11.
Bodkin-AndrewsG.CarlsonB. (2016). The legacy of racism and Indigenous Australian identity within education. Race, Ethnicity and Education, 19(4), 784–807. https://doi.org/10.1080/13613324.2014.969224
12.
CargoM.Potaka-OsborneG.CvitanovicL.WarnerL.ClarkeS.JuddJ.ChakrabortyA.BoultonA. (2019). Strategies to support culturally safe health and wellbeing evaluations in Indigenous settings in Australia and New Zealand: A concept mapping study. International Journal for Equity in Health, 18(1), 194. https://doi.org/10.1186/s12939-019-1094-z
13.
CarlsonB.FrazerR. (2018). Yarning circles and social media activism. Media International Australia, 169(1), 43–53.
14.
CastellanoM. B. (2004). Ethics of Aboriginal research. Journal of Aboriginal Health, 1(1), 98–114.
15.
ChandnaK.VineM. M.SnellingS.HarrisR.SmylieJ.MansonH. (2019). Principles, approaches, and methods for evaluation in Indigenous contexts: A grey literature scoping review. Canadian Journal of Program Evaluation, 34(1), 21–47. https://doi.org/10.3138/cjpe.43050
ChouinardJ. A.CousinsJ. B. (2007). Culturally competent evaluation for Aboriginal communities: A review of the empirical literature. Journal of MultiDisciplinary Evaluation, 4(8), 40–57. https://doi.org/10.56645/jmde.v4i8.30
18.
CramF. (2016). Lessons on decolonizing evaluation from Kaupapa Māori evaluation. Canadian Journal of Program Evaluation, 30(3), 296–312. https://doi.org/10.3138/cjpe.30.3.04
19.
CramF.ChilisaB.MertensD. M. (2013). The journey begins. In MertensD. M.CramF.ChilisaB. (Eds.), Indigenous pathways into social research: Voices of a new generation (pp. 11–40). Left Coast Press.
20.
DavidsonE. J. (2005). Evaluation methodology basics: The nuts and bolts of sound evaluation. Sage Publications.
DenzinN. K.LincolnY. S. (2008). Introduction: The discipline and practice of qualitative research. In DenzinN. K.LincolnY. S.SmithL. T. (Eds.), Handbook of critical and indigenous methodologies (pp. 939–956). Sage.
23.
DiGregorioK. D.FarringtonS.PageS. (2000). Listening to our students: Understanding the factors that affect Aboriginal and Torres Strait Islander students’ academic success. Higher Education Research and Development, 19(3), 297–309. https://doi.org/10.1080/758484344
24.
DonovanM. J. (2015). Aboriginal student stories, the missing voice to guide us towards change. Australian Educational Researcher, 42(5), 613–625. https://doi.org/10.1007/s13384-015-0182-3
25.
DurieM. (2001). A framework for considering Māori educational advancement: The Hui Taumata Matauranga. Massey University.
26.
DwyerJ. M.LavoieJ.O'DonnellK.MarlinaU.SullivanP. (2011). Contracting for Indigenous health care: Towards mutual accountability. Australian Journal of Public Administration, 70(1), 34–46. https://doi.org/10.1111/j.1467-8500.2011.00715.x
27.
EldridgeL. A. (2008). Indigenous research methodologies in art education. Journal of Cultural Research in Art Education, 26, 40–50.
28.
FoleyD. (2003). Indigenous epistemology and Indigenous standpoint theory. Social Alternatives, 22(1), 44–52.
29.
FournierD. M. (1995). Establishing evaluative conclusions: A distinction between general and working logic. New Directions for Evaluation, 1995(68), 15–32. https://doi.org/10.1002/ev.1017
30.
FredericksB.AdamsK.FinlayS.FletcherG.AndyS.BriggsL.HallR. (2011). Engaging the practice of indigenous yarning in action research. Action Learning and Action Research Journal, 17(2), 12–24.
31.
GeiaL.HayesB.UsherK. (2013). Yarning/Aboriginal storytelling: Towards an understanding of an Indigenous perspective and its implications for research practice. Contemporary Nurse, 46(1), 13–17. https://doi.org/10.5172/conu.2013.46.1.13
32.
GeronimusA. T. (2003). Damned if you do: Culture, identity, privilege, and teenage childbearing in the United States. Social Science & Medicine, 57(5), 881–893. https://doi.org/10.1016/S0277-9536(02)00456-2
33.
GreenJ. (2017). Taking more account of indigenous feminism, an introduction. In GreenJ. (Ed.), Making space for indigenous feminism (2nd ed., pp. 1–2). Fernwood Publishing.
34.
GreeneJ. (2005). Evaluators as stewards of the public good. In HoodS.HopsonR.FriersonH. (Eds.), The role of culture and cultural context in evaluation: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice (pp. 87–104). Information Age.
35.
GreyK.YamaguchiJ.WilliamsE.DavisV.FosterD.GibsonJ.DunnettD. (2018). The strength of Indigenous Australian evaluators and indigenous evaluation: A snapshot of “Ways of Knowing and Doing” reflecting on the 2014 Darwin conference of the Australasian Evaluation Society. New Directions for Evaluation, 2018(159), 79–95. https://doi.org/10.1002/ev.20330
36.
GroverJ. G. (2010). Challenges in applying Indigenous evaluation practices in mainstream grant programs to indigenous communities. Canadian Journal of Program Evaluation, 23(2), 33–50. https://doi.org/10.3138/cjpe.23.004
HaswellM.KavanaghD.TseyK.ReillyL.Cadet-JamesY.LaliberteA.WilsonA.DoranC. (2010). Psychometric validation of the Growth and Empowerment Measure (GEM) applied with Indigenous Australians. Australian and New Zealand Journal of Psychiatry, 44(9), 791–799. https://doi.org/10.3109/00048674.2010.482919
39.
HavilandM.PillsburyW. J. (2012). Challenges faced when evaluating the Jalaris kids future club. Evaluation Journal of Australasia, 12(1), 26–31. https://doi.org/10.1177/1035719X1201200104
40.
HeidemannG.CederbaumJ. A.MartinezS. (2016). Beyond recidivism: How formerly incarcerated women define success. Affilia, 31(1), 24–40. https://doi.org/10.1177/0886109915581702
41.
HoodS.HopsonR.FriersonH. (Eds.). (2005). The role of culture and cultural context in evaluation: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice. Information Age.
42.
HopsonR. (2009). Reclaiming knowledge at the margins: Culturally responsive evaluation in the current evaluation moment. In RyanK. F.CousinsB. J. (Eds.). The Sage international handbook of educational evaluation (pp. 429–446). Sage.
JulnesG. (2012). Developing policies to support valuing in the public interest. New Directions for Evaluation, 2012(133), 109–129. https://doi.org/10.1002/ev.20012
46.
Kickett-TuckerC.CoffinJ. (2011). Aboriginal selfconcept and racial identity: Practical solutions for teachers. In PurdieN.MilgateG.BellH. (Eds.), Two way teaching and learning: Toward culturally reflective and relevant education (pp. 155–172). ACER Press.
KirkhartK. E. (2005). Through a cultural lens: Reflections on validity and theory in evaluation. In HoodS.HopsonR.FriersonH. (Eds.), The role of culture and cultural context in evaluation: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice (pp. 21–39). Information Age.
49.
KovachM. (2010a). Indigenous methodologies: Characteristics, conversations, and contexts. University of Toronto Press.
LarkinsS. L.PageR. P.PanarettoK. S.MitchellM.AlbertsV.McGintyS.VeitchP. C. (2011). The transformative potential of young motherhood for disadvantaged Aboriginal and Torres Strait Islander women in Townsville, Australia. Medical Journal of Australia, 194(10), 551–555. https://doi.org/10.5694/j.1326-5377.2011.tb03100.x
52.
LennieJ.TacchiJ.WilmoreM.KoiralaB. (2015). A holistic, learning-centred approach to building evaluation capacity in development organizations. Evaluation, 21(3), 325–343. https://doi.org/10.1177/1356389015590219
53.
MarkiewiczA. (2012). Closing the gap through respect, relevance, reciprocity and responsibility: Issues in the evaluation of programs for Indigenous communities in Australia. Evaluation Journal of Australasia, 12(1), 19–25. https://doi.org/10.1177/1035719X1201200103
54.
MartinK. (2003). Ways of knowing, being and doing: A theoretical framework and methods for indigenous and indigenist re‐search. Journal of Australian Studies, 27(76), 203–214. https://doi.org/10.1080/14443050309387838
55.
MartinK. L. (2008). Please knock before you enter: Aboriginal regulation of outsiders and the implications for researchers. Post Pressed.
56.
Masters-AwatereB.NikoraL. W. (2017). Indigenous programmes and evaluation: An excluded worldview. Evaluation Matters, 3, 40–66. https://doi.org/10.18296/em.0020
57.
McCauslandR. (2019). ‘I’m sorry but I can’t take a photo of someone’s capacity being built’: Reflections on evaluation of indigenous policy and programmes. Evaluation Journal of Australasia, 19(2), 64–78. https://doi.org/10.1177/1035719X19848529
58.
McCoyA.RoseD.ConnollyM. (2013). Developing evaluation cultures in human service organisations. Evaluation Journal of Australasia, 13(1), 15–20. https://doi.org/10.1177/1035719X1301300103
59.
McIntyre-MillsJ.RommN.Corcoran-NantesY. (Eds.). (2017). Balancing individualism and collectivism: Social and environmental justice. Springer.
60.
McMichaelC. (2013). Unplanned but not unwanted? Teen pregnancy and parenthood among young people with refugee backgrounds. Journal of Youth Studies, 16(5), 663–678. https://doi.org/10.1080/13676261.2012.744813
MitchellJ.HowlettS. (2022). Shooting Stars Way practice framework. Centre for Excellence in Therapeutic Care, Australian Childhood Foundation.
63.
MoodieN.MaxwellJ.RudolphS. (2019). The impact of racism on the schooling experiences of Aboriginal and Torres Strait Islander students: A systematic review. Australian Educational Researcher, 46(2), 273–295. https://doi.org/10.1007/s13384-019-00312-8
64.
Moreton-RobinsonA. (2000). Talkin’ up to the white woman: Indigenous women and feminism. University of Queensland Press.
OberC.DingleK.ClavarinoA.NajmanJ. M.AlatiR.HeffernanE. B. (2013). Validating a screening tool for mental health and substance use risk in an Indigenous prison population. Drug and Alcohol Review, 32(6), 611–617. https://doi.org/10.1111/dar.12063
67.
OsborneS.GuentherJ. (2013). Red dirt thinking on aspiration and success. The Australian Journal of Indigenous Education, 42(2), 88–99. https://doi.org/10.1017/jie.2013.17
68.
ParkesA.McRae-WilliamsE.TedmansonD. (2015). Dreams and aspirations of mobile young Aboriginal Australian people. Journal of Youth Studies, 18(6), 763–776. https://doi.org/10.1080/13676261.2014.992314
69.
ParkesA.ZuffereyC. (2019). Aboriginal mothering in the Australian context. In ZuffereyC.BuchananF. (Eds.), Intersections of mothering: Feminist accounts (pp. 104–116). Routledge.
70.
PholiK.BlackD.RichardsC. (2009). Is ‘Close the Gap’ a useful approach to improving the health and wellbeing of Indigenous Australians?Australian Review of Public Affairs, 9(2), 1–13.
71.
PriceM.McCoyB.MafiS. (2012). Progressing the dialogue about a framework for Aboriginal evaluations: Sharing methods and key learnings. Evaluation Journal of Australasia, 12(1), 32–37. https://doi.org/10.1177/1035719X1201200105
72.
Productivity Commission. (2013). Better indigenous policies: The role of evaluation – Roundtable proceedings. Productivity Commission.
73.
Productivity Commission. (2016). Overcoming indigenous disadvantage: Key indicators 2016 (Steering committee for the review of government service provision). Productivity Commission.
74.
RigneyL. I. (1999). Internationalization of an Indigenous anticolonial cultural critique of research methodologies: A guide to Indigenist research methodology and its principles. Wicazo Sa Review, 14(2), 109–121. https://doi.org/10.2307/1409555
75.
RogersA.BowerM.MallaC.ManhireS.RhodesD. (2017). Developing a cultural protocol for evaluation. Evaluation Journal of Australasia, 17(2), 11–19. https://doi.org/10.1177/1035719X1701700203
76.
RogersJ. (2017). Photoyarn: Aboriginal and Maori girls’ researching contemporary boarding school experiences. Australian Aboriginal Studies, 1, 3–13.
77.
RossinghB.YunupinguY. (2016). Evaluating as an outsider or an insider: A two-way approach guided by the knowers of culture. Evaluation Journal of Australasia, 16(3), 5–14. https://doi.org/10.1177/1035719X1601600302
78.
ShayM. (2021). Extending the yarning yarn: Collaborative Yarning Methodology for ethical Indigenist education research. The Australian Journal of Indigenous Education, 50(1), 62–70.
79.
SherifB. (2001). The ambiguity of boundaries in the fieldwork experience: Establishing rapport and negotiating insider/outsider status. Qualitative Inquiry, 7(4), 436–447. https://doi.org/10.1177/107780040100700403
SmithL. T. (1999). Decolonizing methodologies: Research and indigenous peoples. Zed Books.
83.
TuckE.McKenzieM. (2014). Place in research: Theory, methodology, and methods. Routledge.
84.
WainT.SimM.BessarabD.MakD.HaywardC.RuddC. (2016). Engaging Australian Aboriginal narratives to challenge attitudes and create empathy in health care: A methodological perspective. BMC Medical Education, 16(1), 156. https://doi.org/10.1186/s12909-016-0677-2
85.
WaldenI. (2016). Talking back to policy: Aboriginal participation in policy making. [Doctoral thesis, University of New South Wales].
86.
WehipeihanaN. (2019). Increasing cultural competence in support of Indigenous-led evaluation: A necessary step toward Indigenous-led evaluation. Canadian Journal of Program Evaluation, 34(2), 368–384. https://doi.org/10.3138/cjpe.68444
87.
WehipeihanaN.McKeggK.ThompsonV.PipiK. (2015). Cultural responsiveness through developmental evaluation: Indigenous innovations in sport and traditional Māori recreation. In PattonM. Q.McKeggK.WehipeihanaN. (Eds.). Developmental evaluation exemplars: Principles in practice (pp. 25–34). Guilford Press.
88.
WhitauR. (Ed.). (2022). Kaya Kwopetok Koorlang Yok: Dear beautiful young woman. Shooting Stars.
89.
WhitauR.Bolton-BlackL.OckerbyH.CorleyL. (2022). Western Australian Aboriginal young women and community representatives identify barriers to school attendance and solutions to school non-attendance. The Australian Journal of Indigenous Education, 51(2). https://doi.org/10.55146/ajie.v51i2.22
90.
WhitauR.OckerbyH. (2019). Yarning with the stars project: An indigenous evaluation protocol for a sport for development and peace program. Journal of Sport for Development, 7(13), 46–54.
