Evaluation of Gavi’s Private Sector Engagement Approach 2016-2020
Gavi, the Vaccine Alliance, appointed Mott MacDonald to conduct an evaluation of Gavi’s Private Sector Engagement Approach (PSEA) 2016-2020.
Gavi, the Vaccine Alliance, appointed Mott MacDonald to conduct an evaluation of Gavi’s Private Sector Engagement Approach (PSEA) 2016-2020.
Gavi’s exploratory Private Sector Engagement Approach (PSEA) 2016-2020 aimed to enhance immunisation programmes by leveraging private sector resources, expertise and innovation capacity. It was implemented through distinct modalities, namely, a Financial Contributions modality and a Leveraged / Operational modality. It also incorporated an ‘Innovation through Uptake, Scale and Equity’ (INFUSE) mechanism.
The independent evaluation of Gavi’s PSEA aimed to assess the delivery, results and sustainability of the approach over the period 2016-2020. Lessons learnt and recommendations will inform the design of the PSEA for the Gavi 5.0 strategic period (2021-2025). The evaluation findings are structured around three evaluation question areas covering: mobilisation of additional resources; PSEA fit to purpose; and lessons and unintended consequence
METHODS
The evaluation used a theory-based approach to explore three evaluation Question Areas. To systematically address each of the three evaluation Question Areas, the evaluators incorporated each evaluation question into a standard evaluation framework to develop a triangulated mixed method approach. Data collection methods for this evaluation included: over 60 key informant interviews across key stakeholder groupings; document and secondary data reviews; seven in-depth project case studies; and comparisons with similar organisations.
MAIN FINDINGS AND CONCLUSIONS
The PSEA has succeeded in meeting its targets on additional financial commitments, funding diversification and leveraging private sector expertise for innovation at scale. The PSEA target for financial commitments was to raise US$150m of additional resources in new private sector investments over 2016-2020. Gavi has exceeded this target if new commitments of public and private funding for the approach are taken into account. The amount of funding mobilised/pledged during the years 2016 to 2020 totalled US$ 397m from both public and private sources.
The evaluation confirmed the design of the PSEA, 2016-2020, was broadly consistent with Gavi’s 4.0 strategic goals and objectives. There was particularly strong alignment to Goal 2 health systems strengthening objectives. However, the principle of sustainability had yet to be fully demonstrated, and there was scope for increasing support to the strategic enabler on monitoring and evaluation (M&E).
There is good evidence that the Gavi Secretariat’s structures, procedures and processes are functioning adequately to support transparency and sound administration of private sector partnerships. Only the INFUSE mechanism involves a competitive process for private sector partner (Pacesetter) engagement.
Gavi has made good efforts to ensure PSEA projects address the VFM criteria of relevance at both global and country levels. However, since data on results, expenditure and costs are not generated until the end of projects, it is too early to draw definitive conclusions on the VFM criteria of effectiveness, cost-effectiveness and sustainability within or across partnerships. Recent efforts to cost innovation projects for Gavi’s Innovation Catalogue are a welcome development. This could be a useful first step towards the introduction of systematic ‘total cost of ownership’ assessments for innovation projects.
From the seven in-depth case studies, the evaluators confirmed that some projects are demonstrating substantial benefits and have taken steps towards scale-up. In most cases, project start-up took considerable time – on average about two years. It was still too early to assess which of the technical solutions were likely to be sustainable over the longer term – although there were some good examples of skills transfer and contributions to infrastructure (e.g. the Zipline-UPS project).
For INFUSE Pacesetters there was general acknowledgement that a partnership with Gavi could raise their international profile and facilitate entry into new product markets.
Positive unintended consequences of the exploratory PSEA included strengthening of Secretariat expertise in working with private sector innovators and, potentially, enhanced COVID-19 readiness. Negative unintended consequences included the additional time demands placed on the Secretariat.
TOP FIVE RECOMMENDATIONS FROM THE EVALUATION
Align to the Gavi 5.0 Strategy – especially Goal 2 objectives; also align to 5.0 operational plans and innovation / digital health strategies.
Review Secretariat roles, responsibilities and incentives for delivering the PSEA – optimise capacity.
Invest in a coherent and aligned M&E system for PSEA projects and the PSEA as a whole.
Consider and capture costs at project and portfolio levels; consider commissioning ‘total cost of ownership’ studies.
Improve structured learning – focus on lessons regarding partnership types, strategic priorities and approaches to scale-up.
Documents
Evaluation of Gavi’s Private Sector Engagement Approach, 2016-2020
