Abstract
Objective:
To test the hypothesis that a continuing educational strategy (ie, “the manual”) in primary health-care improves infant feeding practices among infants under 1 year of age.
Methods:
A before and after study was conducted at primary health-care units in Embu das Artes, Brazil. The intervention was the use of a manual created to support continuing educational activities on breastfeeding and complementary feeding to be performed by tutors of Estratégia Amamenta e Alimenta Brasil with health-care teams, in a period of 8 months. Five hundred sixty-one mothers before and 598 mothers after intervention were interviewed about breastfeeding and complementary feeding practices. Multivariate analysis was performed using Poisson multilevel regression to test the hypothesis.
Results:
Lack of minimum food diversity (before 62.9%; after 50.3%) and lack of food adequacy (before 77.5%; after 63.3%) decreased significantly. Regression analysis confirmed that infants after the intervention had lower prevalence of inadequacy of complementary feeding. While the intervention did not show significant association with exclusive breastfeeding, it showed association with the improvement of complementary feeding practices.
Conclusions:
The manual is a continuing educational strategy that improved complementary feeding practices in primary health care.
Introduction
Breastfeeding and adequate complementary feeding (CF) in the first years of life provide short- and long-term benefits for health and child development, in addition to economic and environmental advantages for children, women, and society. 1,2 According to the World Health Organization (WHO) recommendations, infants should be exclusively breastfed for the first 6 months and after that infants should receive nutritionally adequate and safe complementary foods while breastfeeding continues for up to 2 years of age or beyond. 3 Such healthy feeding habits in early childhood can provide a lifetime of protection against chronic diseases such as overweight and obesity. 4 -7
Despite numerous global initiatives, breastfeeding rates, especially exclusive breastfeeding (EBF), are below recommended levels and CF is often offered at inadequate time (ie, early or late) and with low-quality food. 8 -11 Historically, in Brazil, breastfeeding promotion was focused on changing hospital practices by implementing The Baby Friendly Hospital Initiative, but more recently, this focus has expanded to promote EBF and adequate infant feeding in primary health-care settings.
In 2013, the Brazilian Ministry of Health developed an innovative program, the Estratégia Amamenta e Alimenta Brasil (EAAB), freely translated as the “Brazilian Breastfeeding and Complementary Feeding Strategy.” The EAAB’s goal is to improve the quality of the assistance provided by primary health-care teams to ultimately improving infant feeding practices in the Brazilian population. The EAAB is grounded on a problem-based learning methodology and proposes a continuing education process to both change working process in primary health-care settings and facilitate the transformation of knowledge in evidence-based practices. The continuing education in breastfeeding and CF is facilitated by a health professional who works as a coach (ie, EAAB tutor) supporting health-care teams within each primary health-care unit (PHU). 12
Estratégia Amamenta e Alimenta Brasil implementation in the PHU starts with a 6-hour workshop conducted by the tutor with the entire PHU staff. The PHU can be certified in the EAAB program if they meet 6 certification criteria determined by the Ministry of Health: (1) developing systematic actions to promote breastfeeding and healthy CF; (2) monitoring breastfeeding and CF indicators; (3) maintaining a flowchart to organize the child care related to breastfeeding and CF; (4) complying with the Brazilian Code of Marketing of breast milk substitutes, foods for infants and toddlers, pacifiers, and bottles; (5) involving at least 85% of current staff in the workshops developed by tutors; (6) implementing at least one breastfeeding and one CF promotion action as agreed in the action plan developed by the health-care team during the workshops. 12 The tutor should support primary health-care teams to meet these 6 certification criteria to improve the quality of assistance to promote breastfeeding and CF. 12 However, data reported by the Brazilian Ministry of Health show that the number of tutors trained is 40 times higher than the number of PHU certified in the EAAB program. Thus, there is a clear challenge to advance toward EAAB certification in the Brazilian Unified Health System, where there are more than 40 000 PHUs.
In order to strengthen the implementation of EAAB, a manual with supporting material was developed. In partnership with the Ministry of Health the Manual to Support EAAB Tutors (the manual) was outlined to clarify the EAAB tutor’s role and to suggest some comprehensive training activities to be led by him/her with the health-care team. The themes and contents of the comprehensive training activities were designed to guide PHU to EAAB certification. The manual follows a problem-based learning methodology to propose an educational process of teaching (“coaching”) and encouraging changes in health workers’ practice and improvements in the work process within the PHU to provide a high-quality standard care to promote breastfeeding and CF. The use of the manual is the intervention evaluated in this study.
Our hypothesis is that the use of the manual as a tool of continuing education in primary health care can strengthen the EAAB implementation and thereafter improve infant feeding practices. Thus, this article aims to evaluate the effectiveness of using the manual by analyzing infant feeding practices.
Methods
Design and Study Setting
In this before and after study were conducted 2 cross-sectional surveys on infant feeding practices at the 13 PHU located in the urban area of the city of Embu das Artes. Embu das Artes is a low-income city in Brazil, part of the metropolitan region of Sao Paulo, with its total population of 240 230 inhabitants.
A formal permission from the authority of the Health Department of Embu das Artes was obtained as well as written informed consent from mothers of infants who participated in the study. The research protocol was approved by the Research Ethics Committee of the Public Health School of the University of Sao Paulo, Brazil (protocol 43317315.0.0000.5421, approved May 07, 2015).
Intervention
At the beginning of the study, the municipality of Embu das Artes had already 13 EAAB tutors trained but they had not started the EAAB implementation. The intervention consisted in the use of the manual by EAAB tutors who performed some comprehensive training activities with health-care teams, in a period of 8 months. The manual was presented to the tutors by the research coordination and they were asked to follow the manual as written, without any interference of the researchers in the intervention. The manual proposes 5 comprehensive training activities (CAs) with step-by-step suggestions for the tutor to carry out such activities with health-care teams. Each CA was estimated to last no longer than 2 and a half hours. The CAs include clinical case-studies (a narrative situation of clinical difficulties that a mother/family may face during breastfeeding or CF) and discussion guides. The 5 themes (outlined to support the PHU in meeting the EAAB certification criteria) cover: (1) action plan to promote breastfeeding and CF; (2) how to integrate the promotion of breastfeeding and CF into existents primary health-care activities; (3) clinical management to encouraging breastfeeding in primary health-care units; (4) how to promote healthy CF in primary health-care units; and (5) feeding and nutrition surveillance.
Figure 1 presents the Program Impact Pathways of the intervention (the use of the manual) clarifying the mechanisms that lead to the expected outcomes, 13 that is, changes in the infant feeding practices considering the context of EAAB implementation. Thus, in this study the focus of the analysis will be on the intervention impact, that is on the EBF and CF indicators.

Program impact pathways (PIP) diagram of the implementation of the use of the manual to support Estratégia Amamenta e Alimenta Brasil tutors.
Participants
Participants consisted of mothers of infants under 1 year of age attended at 1 of the 13 PHUs. A required sample size of 460 infants under 6 months of age was estimated to be able to detect an increase of 6% in the prevalence of EBF after intervention. For children aged 6 to 12 months, the sample size was based on the prevalence of consumption of stuffed cookies, chips, or salty or otherwise seasoned crackers. A sample size of 140 children was estimated to be required in order to detect a reduction of 10% in the prevalence of consumption of unhealthy foods. 14 In total, the estimated sample size of 600 children under 1 year of age was needed for each cross-sectional survey, considering the sample size required to compare independent samples. 15 Considering the number of children attending each PHU, the total estimated sample was proportionally distributed among the PHU, totaling a sample size from 35 to 60 infants per PHU. For the obtaining sample, mothers were interviewed if their child had an appointment in the PHU in the period of data collection. The sample size was calculated assuming a margin of error of 5% and a statistical power of 90%.
Data Collection
Data collection was carried out in the before and after intervention phases, from July to September 2015 and from August to September 2016, respectively, at the 13 PHU. Mothers of children under 1 year of age were invited to participate in the study while awaiting appointment at the PHU. In both phases, the interviews were conducted by trained staff and supervised by the leading researcher. The questionnaire was composed of 2 parts. The first had closed-ended questions related to socioeconomic, demographic, and biomedical conditions of the mother, child, and other family members and some questions about the care received in the PHU. In the second part, data were collected on food consumption adopting the Food Intake Markers Questionnaire for infants between 6 and 24 months, as proposed by the Brazilian Food and Nutrition Surveillance System. These questionnaires consist of yes or no answers about food consumption, such as breast milk, water, fluids, other types of milk, food groups, food frequency, food consistency, and unhealthy foods. All questions were applied to child consumption in the previous 24 hours of the interview. This questionnaire enables assessment of food consumption markers once it identifies healthy and unhealthy eating practices. 16
In the before and after intervention phases, the manager from each PHU was asked about the presence of some criteria required by the Ministry of Health to certify a PHU for EAAB.
Study Variables
Outcomes
The outcomes were defined as follows: Exclusive breastfeeding when a child from 0 to 5 months of age is fed with breast milk exclusively. The specific questions (yes/no) that mothers were asked to determine exclusivity were: (a) breast milk consumption, (b) porridge, (c) water/tea, (d) cow milk, (e) infant formula, (f) fruit juice, (g) fruit, (h) salt meals (solid, semi-solid, or soft foods), and (i) any other foods or beverages. A child was considered in EBF if the mother answer “yes” for breast milk consumption and “no” for all other questions. Minimum food diversity (MFD): when a child from 6 to 11 months of age received at least one serving from each of these 6 food groups (yes/no): (1) complex carbohydrates (like rice, roots and tubers); (2) breast milk or dairy products; (3) meats or eggs; (4) beans; (5) vitamin-A-rich fruits and vegetables; and (6) other fruits or vegetables. Food adequacy (FA): yes/no variable calculated based on 3 information, MFD, minimum frequency, and proper consistency. Minimum food diversity was estimated as describe above. Minimum frequency and proper consistency were estimated at the same time and was considered when a 6-month-old child received solid, semi-solid, or soft foods once a day whether in a mashed consistency or in chunks; and when a 7 to 11-month-old child received solid, semi-solid, or soft foods twice a day whether in a mashed consistency or in chunks.
Independent variable
The main independent variable was the intervention, that is, before intervention or after intervention.
Covariables
To estimate the individual influence of the outcome-associated variables, we used a multiple hierarchical model. The covariables were grouped into blocks and ordered according to the influence that they would have on each outcome (ie, EBF and CF indicators). Figure 2 presents the theoretical models that guided the 2 levels of the analysis, contextual, and individual variables. The maternal education level was used as a proxy for socioeconomic status. The contextual variable number of certification criteria fulfilled was created based on manager’s responses before and after the intervention. Each PHU was categorized in accordance with the number of certification criteria fulfilled: 6 criteria; 5 to 4 criteria; 3 to 2 criteria; 0 to 1 criterion.

Hierarchical theoretical model of outcomes: Exclusive breastfeeding (A) and minimum food diversity and food adequacy (B).
Data Analysis
All data were double entered for subsequent validation in the Epi-Info, version 3.5 software (Center for Disease Control and Prevention, Atlanta, Georgia). Data management and statistical analysis were performed using the Stata statistical software package version 14.1 (Stata Corp, College Station, Texas).
In the analyzes it was not excluded PHU where no CAs were carried out as we considered that the availability of the manual could influence in some way, even if the tutor did not support the health team as proposed in the manual.
A comparison between the before- and after-intervention groups for the characteristics of child, family/maternal and care received in the PHU was conducted using χ2 test. Differences in the prevalence of the outcomes before and after intervention were tested by the application of χ2 and were explored among the specific age ranges.
To analyze the associations between the intervention and the 3 outcomes, a Poisson multilevel regression was conducted with robust variance following the hierarchical model in Figure 2. Poisson regression was adopted because of the cross-sectional data with nonrare outcomes. 17 In the multilevel analysis, the contextual level (level 2) included the PHU variable to organize individual data according to clusters; the individual level (level 1) included family/maternal and child data and characteristics of care received in the PHU. Considering the multilevel structure, initially, the prevalence ratio (PR) and confidence intervals (95% CI) were estimated for each variable and outcome (step 1). Variables with P < .50 were entered into multiple internal analyses of each block (step 2). Then, variables with P < .20 in the internal analysis of each block were included in the multilevel modeling analysis (step 3).
Step 3 consists of the stepwise hierarchical multilevel modeling following Figure 2. Both variables PHU and infant age were added to the empty model (data not shown). Model 1 included the number of certification criteria fulfilled (contextual level); this variable remained in the model as an adjustment for subsequent models. Subsequently, maternal education (proxy for socioeconomic status) was added to model 2 after adjustment for the model 1 variable, and then remained as another control variable for the subsequent model. Likewise, variables related to characteristics of care received in the PHU and the variable intervention were included in model 3 after adjustments for the model 1 and 2 variables and then remained as control variables for the subsequent model. A similar procedure was adopted for variables related to maternal and family characteristics (model 4) and to child characteristics (model 5). Significant variables were maintained in the model even if they became insignificant after the inclusion of lower order variables. A significance level of 5% was adopted after adjustment for variables within the same model and for upper order variables. The quality of model adjustment was assessed using the 2-log likelihood test. In the multilevel analysis, the fixed effects/random intercept model described by Snijders and Bosker 18 was used.
Considering that this study has 3 different outcomes, the steps for data analysis were separately reproduced for each outcome.
Results
The results of the implementation process (ie, use of the manual) were as follows: 9 of 13 tutors conducted Cas with the health-care teams of 11 PHU. The reasons why 4 tutors did not remain in the study were retirement, dismissal, and maternity leave. Tutors from 7 PHU conducted 5 CAs; 1 tutor conducted 4 CAs; 3 tutors conducted 2 CAs; and in 2 PHU none activity was developed. A total of 153 health workers were exposure to the CAs. The number of attendees in each CAs varied widely among PHU. Only 21 health-care workers participated in 5 CAs.
Before the intervention, of the 571 mothers interviewed initially, 561 children were enrolled into the study (an 1.7% loss); after the intervention, 609 mothers were interviewed initially, and 598 children were enrolled into the study (an 1.8% loss), totalizing 1159 children under 1 year of age analyzed in this study. Figure 3 outlines the stages of the study and shows the reasons for losses. Refusals were negligible.

Flowchart of the intervention study in primary health-care units. Embu das Artes, Brazil, 2015 to 2016.
Table 1 shows the comparison of mother, child, family, PHU, and care characteristics between the before- and after-intervention groups. There was no difference between the 2 groups in terms of gender, birth weight, or use of pacifier or bottle. Maternal age and education were similar for all participants, and a significant difference was observed in the maternal work. Regarding the care received, there were some significant differences between the groups. The number of certification criteria fulfilled by PHU was significantly higher in the after-intervention group (P = .000).
Number and Proportion of Infants Under 1 Year of Age According to Child, Maternal, Family, Care Received and Primary Health-Care Unit Characteristics, by Study Group. Embu das Artes, Sao Paulo, Brazil, 2015 to 2016.
Abbreviations: BF, breastfeeding; CF, complementary feeding; EAAB, Estratégia Amamenta e Alimenta Brasil; PHU, primary health-care unit.
aThe total was smaller for some variables due to missing information.
bOnly infants from 6 to 11 months and 29 days, n = 357.
Regarding the outcomes, in descriptive analyses, the prevalence of EBF cessation presented nonsignificant difference between the groups (before 58.0%; after 53.7%; P = .229); while the lack of MFD (before 62.9%; after 50.3%; P = .023) and the lack of FA (before 77.5%; after 63.3%; P = .005) decreased significantly.
Table 2 presents the bivariate analysis and the covariates included in the multivariate model (P < .50) for each outcome. The multilevel hierarchical analysis indicates that mothers having difficulties in breastfeeding, maternal daily dedication to child care, and pacifier use were independent factors associated with EBF cessation, but the intervention did not show association with this outcome (Table 3). For both CF indicators, the multilevel hierarchical analysis shows that infants in the after-intervention group had a lower chance of nutritional inadequacy: lack of MFD PR = 0.70 (0.50-0.97; P < .05); and lack of FA PR = 0.74 (0.55-0.99; P < .05; Table 4).
Poisson Bivariate Analysis of Exclusive Breastfeeding (EBF) Cessation, Lack of Minimum Food Diversity (MFD) and Lack of Food Adequacy (FA) in Infants Under 1 Year of Age. Embu das Artes, Sao Paulo, Brazil, 2015 to 2016.
Abbreviations: BF, breastfeeding; CF, complementary feeding; EAAb, Estratégia Amamenta e Alimenta Brasil; EBF, exclusive breastfeeding; PHU, primary health-care unit; PR, prevalence ratio.
aInfants under 6 months.
bInfants from 6 to 11 months and 29 days.
Multilevel Hierarchical Regression Models to Estimate the Prevalence Ratio of Exclusive Breastfeeding (EBF) Cessation in Infants Under 6 Months According to Child, Maternal, Family, Care Received and Primary Healthcare Unit (PHU) Characteristics, Adjusted by Infant Age. Embu das Artes, SP, Brazil, 2015 to 2016.a,b
Abbreviation: EAAb, Estratégia Amamenta e Alimenta Brasil.
aInfants under 6 months, n = 794.
bIndividual data from the 2 phases of the study.
cModel 1: number of certification criteria and infant age.
dModel 2: Model 1 + maternal education.
eModel 3: Model 2 + intervention and PHU attends without appointment.
fModel 4: Model 3 + difficulties to breastfeed, lives with the child’s father, maternal daily dedication to child care.
gModel 5: Model 4 + pacifier use.
fP < .001.
Multilevel Hierarchical Regression Models to Estimate the Prevalence Ratio of Lack of Minimum Food Diversity (MFD) and Lack of Food Adequacy (FA) in Infants from 6 to 11 Months According to Child, Maternal, Family, Care Received and Primary Healthcare Unit (PHU) Characteristics, Adjusted by Infant Age. Embu das Artes, SP, Brazil—2015 to 2016.a,b
aInfants from 6 to 11 months and 29 days, n = 322.
bIndividual data from the 2 phases of the study.
cModel 1: number of certification criteria and infant age.
dModel 2: model 1 + maternal education.
eModel 3: model 2 + intervention.
fModel 4: model 3 + maternal age.
gModel 5: model 4 + infant gender.
hP < .05.
iModel 4: model 3 + lives with the child’s father.
Discussion
Our findings show that the educational intervention delivered by EAAB tutors using the manual to guide their work with a health-care team can effectively improve the quality of CF in infants aged between 6 and 12 months. The Manual to Support EAAB Tutors proved to be useful for continuing education and capable of improving infant feeding practices.
In this study, we observed a prevalence of 42% EBF before the intervention and 46% after the intervention. While our results indicated a lower prevalence of EBF cessation after intervention, it did not reach statistical significance. Indeed, the intervention was not associated with changes in EBF prevalence. In Embu das Artes, EBF rates increased gradually from 16% in 2001 to 42% in 2010 and decreased to 34% in 2012. 14 Perhaps no additional benefit due to our intervention was observed because historically the municipality has been developing regular actions to promote breastfeeding and has reached higher prevalence in comparison to national data which currently is 37% for EBF. 19 Maternal daily dedication, breastfeeding problems, and pacifier use were independently associated with the early cessation of EBF. These results are in accordance with recently systematic reviews addressing determinants and barriers to EBF 2,10,20 and might be a clue to develop focused interventions to improve EBF in Embu das Artes.
The intervention was an independent factor associated with lack of MFD and with lack of FA confirming our hypothesis that the use of the manual can improve CF indicators. These results are consistent with a previous study that evaluated a program to promote appropriate CF and found that the intervention program resulted in lower consumption of food considered unhealthy. 21 Our findings also support the conclusions of a systematic review about the effectiveness of educational interventions on CF indicators that found nutrition training for health workers can improve feeding frequency, energy intake and dietary diversity in infants from 6 months to 2 years. 22
Moreover, simple, valid, and reliable indicators are crucial to track progress and guide investment to improve nutrition and health during the first 2 years of life. 23 In this study, we evaluated important indicators widely used in many studies, such as EBF under 6 months, as recommended by the WHO. 24 The CF indicators selected based on the Food Intake Markers proposed by the Brazilian Ministry of Health that have shown high sensibility to assessing infant feeding practices in contexts where malnutrition rates are low, and the prevalence of overweight and obese children is increasing, such as in Brazil. 25
In the comparative analyses of the study population, the number of EAAB certification criteria fulfilled (considered to be a quality indicator of EAAB implementation) by PHU was expressively higher in the after-intervention group. This variable reflects the immediate effect of the intervention on health-care team’s practices as well as the level of EAAB implementation. Reinforcing the value of this result, 5 PHU from Embu das Artes received the EAAB certification soon after the study ended. Around the country, despite having many tutors already trained by the Ministry of Health, the number of PHU that have been tutored is very small (there are almost 3 times more tutors than the number of PHU being followed, according to data reported by the Ministry of Health), which makes clear the need to orient/offer guidance to the tutor’s work. In addition, the very small number of PHU certified shows that even if the tutors are performing their work, the certification is not being reached. Thus, our results answer the need presented by the Ministry of Health of an effective manual to provide direction to tutor’s work. It is important to highlight that despite the increasing in the number of EAAB certification criteria fulfilled by PHU and the improvement found in the infant practices, these 2 variables did not present association. This unexpected result leads us to think that the certification criteria should be interpreted as a normative indicator of EAAB implementation but may be not a good marker of the impact of EAAB on population outcomes.
The design can be seen as a weakness in this study. It was not possible to conduct a randomized controlled trial because the EAAB local coordinator decided to implement the EAAB using the manual in all PHU. However, plausibility evaluations design has been considered a good alternative when studying the feasibility of a material such as described in this study. 26 Some limitations have to be considered while generalizing the findings presented: (1) mothers have been interviewed at the PHU and this context could have influenced their answers, and (2) the instrument of data collection did not allow to characterize which changes in health workers’ practice contributed to changes in food behavior. On the other hand, it is important to consider that some factors are likely to have underestimated the intervention effects: (1) the short period between the intervention and the evaluation; (2) in 2 PHU there were no Cas implemented according to the manual recommendation; (3) only 7 PHU conducted all the 5 CAs, and (iv) the small number of health-care workers involved in the CAs.
Despite these limitations, several strengths reinforce our results. It can be characterized as a plausibility evaluation because the data allow to evaluate whether the observed effect was due to the intervention or to external factors. 27 By considering the conceptual framework built for each outcome, the effect of the manual on the indicators was adjusted for the characteristics as described. In addition, the multilevel analysis is based on the concept that individuals interact in social contexts in which they are involved and the characteristics of these social groups are influenced by the individuals that compose them. 28 Individual variables were included in the model following a hierarchical modeling strategy. In this approach, variables are placed into hierarchies according to a previously established conceptual framework based on the influence that they would have on the outcome of interests, then the choice of criteria for selecting variables stretches beyond purely statistical considerations. 29
Conclusions
This article has highlighted the importance of the use of a continuing education strategy grounded on a problem-based learning methodology in order to produce improvements in CF practices in primary health care. Despite innumerable interventions attempting to improve the quality of infant feeding, the small advances or even any stagnation in epidemiological scenarios makes clear the challenges of scaling-up effective interventions. In this perspective, the EAAB differs from other programs as it is not a punctual or formal course, but a strategy of continuing education focused on changes in health workers’ practice to promote breastfeeding and CF. To contribute in this process, the manual consists of a tool that has the potential to be adapted for different contexts and easy to disclose to all EAAB tutors in the country. This feature reinforces the strong potential of this material to strengthen the EAAB implementation.
Footnotes
Acknowledgments
This study was fully supported by State Health Department of Mato Grosso, Brazil, and partially supported by Capes Foundation, Ministry of Education, Brazil. We wish to thank the authorities at the Health Department of Embu das Artes and the staff of the Brazilian Ministry of Health by supporting the research project. Special thanks to Lucimeire de Sales Magalhães Brockveld for her unconditional support with the data collection and to Regina Tomie Ivata Bernal for her assistance with the sample size calculation.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
