Equipping the Circle of Care with the Tools to Support Kids Well-Being and Development

Financial Literacy Episodes, Social and Emotional Learning (SEL), Quasi-experimental Difference-in-Differences Design, Treatment and Comparison Groups,
Learning Outcomes ,Wellbeing

Location: Kenya

Reference citation: Impact Evaluation Endline Report, Coffey International (October, 2019). 

Access the full study   Here

Study Summary 

The Impact Evaluation Endline Report for Ubongo, conducted by Coffey International in October 2019, aimed to assess the effectiveness of Ubongo’s educational programs. The evaluation used a quasi-experimental difference-in-differences design with treatment and comparison groups to determine the impact of Ubongo’s financial literacy episodes on various outcomes.

Evaluation Objective:

• To evaluate the impact of Ubongo’s educational content on learning outcomes, financial literacy, and well-being.

Evaluation Methodology:

• The impact evaluation used a quasi-experimental difference-in-differences design employing treatment and comparison groups to determine the effect of the Ubongo financial literacy episodes on outcomes of interest. The impact evaluation tests Ubongo Impact’s Theory of Change at the impact level by seeking to attribute the impact of watching three 20-minute financial literacy episodes on related knowledge, attitudinal, and behavioral indicators amongst the target audience of adolescent girls aged 10–18.
  
• To evaluate attribution, the impact evaluation was conducted with participants in a treatment group who were exposed to the Ubongo Impact financial literacy episodes and a matched comparison group who were exposed to unrelated Ubongo Kids episodes. The evaluation also included 18 in-depth interviews with treatment group girls to further explore how the episodes have achieved learning, earning, saving, and well-being-related impacts.
• Data collection took place in three counties in Kenya— Nairobi (urban), Kilifi (peri-urban), and Kwale (rural)—with a sample of 420 girls across 18 public day schools. Data was collected at three points in time:
• Pre-episode viewing (baseline) (January 2019)
  
• Post-episode viewing (January 2019)
  
• Endline (May 2019)

Key Findings:

• Ubongo’s programming had a positive effect on learning outcomes, financial literacy, and well-being.
• The financial literacy episodes provided learning that influenced different segments of the target audience

.Significance for Ubongo:

• The evaluation provided evidence of the effectiveness of Ubongo’s educational content.
• It helped validate Ubongo’s Theory of Change and informed future program development.
• The findings supported the continuation and scaling of Ubongo’s initiatives to promote education and gender equality in Africa.

DOWNLOAD STUDY SUMMARY INFOGRAPHIC   Here