Monitoring and Evaluation
Case Study on Monitoring and Evaluation: Supporting the Global Oxygen Alliance
Introduction
This case study explores the monitoring and evaluation (M&E) approach taken in the consultancy for the Global Oxygen Alliance (GO₂AL), focusing on the implementation of an internal M&E system and oxygen data mapping. The consultancy, led by Dr. Kevin Baker, aimed to enhance the effectiveness and efficiency of oxygen management systems, particularly in low- and middle-income countries (LMICs), by employing a systematic M&E framework.
Background
Medical oxygen is a crucial treatment in healthcare, essential for various acute and chronic conditions. The COVID-19 pandemic highlighted global inequities in access to medical oxygen and underscored the need for robust oxygen management systems. The Global Oxygen Alliance was established to address these challenges through multi-stakeholder collaboration and innovative solutions.
The consultancy was divided into two main projects:
- Embedded Implementation Research: This project aimed to identify key priorities for implementation research within health service delivery in priority countries. It involved conducting literature reviews and developing protocols for high-quality research studies.
- Dissemination and Application of Findings: This project focused on facilitating workshops and other forums to disseminate findings from existing implementation research, ensuring that the insights gained would inform policy and practice.
Approach and Methodology
The consultancy was structured into three key phases: Inception, Delivery, and Validation and Feedback.
- Phase One – Inception:
– Conducted a kick-off meeting with key stakeholders to establish expectations and communication strategies.
– Performed a rapid project document review to gather background information on GO₂AL and its strategic objectives.
– Mapped key stakeholders to engage in scoping interviews and workshops, ensuring diverse perspectives were included in the project planning.
- Phase Two – Delivery:
– For Project 1, the M&E system was developed based on an agreed theory of change, ensuring that objectives, activities, outcomes, and impacts were clearly defined. This involved co-development meetings to refine the system and finalize key performance indicators (KPIs).
– For Project 2, various research methods were employed, including desk reviews, stakeholder interviews, and country case studies, to assess existing oxygen management systems and identify gaps and areas for improvement.
- Phase Three – Validation and Feedback:
– Conducted meetings to review and finalize the M&E system and discuss preliminary findings from Project 2. Stakeholders were encouraged to provide feedback, which was integrated into the final deliverables to enhance their relevance and applicability.
Outputs (planned)
As this work is ongoing the consultancy will produce a range of key outputs:
– M&E System Brief: A comprehensive document outlining the M&E framework and its components.
– Data Collection Tools: Standardized tools developed for consistent data collection across projects.
– Reporting Tools: Mechanisms established for effective reporting and communication of findings.
– Standard Operating Procedures (SOPs): Detailed SOPs created to guide implementation and ensure adherence to best practices.
– Case Studies: In-depth analyses of specific country contexts, highlighting oxygen management system functionality and barriers to implementation.
Conclusion
This case study illustrates the importance of a structured M&E approach in enhancing the effectiveness of oxygen management systems globally. By employing a participatory methodology that engaged stakeholders throughout the process, the consultancy successfully developed a robust M&E framework that will inform future interventions and contribute to improved health outcomes in LMICs.
Recommendations
– Ongoing Stakeholder Engagement: Continuously involve stakeholders in the M&E process to ensure that the system remains relevant and responsive to emerging challenges.
– Regular Data Audits: Implement periodic data audits to assess the quality and completeness of data collected, ensuring that it meets established standards.
– Capacity Building: Provide training and resources to local teams to enhance their ability to conduct M&E activities effectively and sustainably.
This case study serves as a model for future M&E initiatives, emphasizing the need for collaboration, stakeholder involvement, and a systematic approach to monitoring and evaluation in public health interventions.