• Identify implementation considerations for policy options
• Select key relevant stakeholders for semi-structured interviews/litmus testing

Feedback from country teams on preparatory work/progress to date:

Uganda, Malawi, Nepal briefly shared progress and EVIPNet/K2P team commented on the progress.

Webinar Session 13: Organizing a policy dialogue presented by EVIPNet-K2P Center, focusing on how policy dialogues influence the use of evidence in health policy and decision-making including:

• Considerations for conducting policy dialogues, i.e., does the dialogue address a high priority issue? Does it provide opportunities to discuss/address the issue, and considerations for implementation? Is there fair representation among those involved in/affected by future decisions related to the issue? Are follow-up activities undertaken to support action?

• Preparation for policy dialogues, i.e., informed by pre-circulated evidence on the policy issue.

• Stakeholder selection, i.e., degree of involvement in/knowledge about the issue and relevant solutions; ability to constructively engage in discussions; ability to take forward recommended actions within respective constituencies; and the importance of the dialogue facilitator’s role.

• Dialogue summary, i.e., tools to outline the results of the discussions during the policy dialogue; and post-dialogue summaries.

The preparatory work outlined in Webinar 5 was to:

• Develop a search strategy for policy options
• Identify 3-4 policy options to address the problem (and its causes) and prepare evidence tables for the selected options

Feedback from country teams on progress to date (10 minutes per team)
Uganda, Malawi, Nepal briefly shared progress and EVIPNet/K2P team commented on the progress.

Webinar 6 provided a ‘Refresher: from problem statement to policy options‘ on the content of Evidence-to-Policy Briefs (EBP) including the problem statement, options and elements, and implementation considerations; framing the problem, clarifying its underlying causes, the appropriate types of evidence to use in framing problems, and framing, developing, and expanding on the options/ elements to address the problem. The refresher session finished with ‘Case examples’.

The webinar then focused on

Session 11: Identifying Key Implementation Considerations Framing presented by EVIPNet-K2P Center. Session 11 included: approaches to policy implementation (i.e. ‘top-down’ and ‘Bottom-up’); identifying and addressing barriers to implementing policies; health system, and social and political constraints; and tips on developing the implementation considerations.

Session 12: Overview of EBP outline (and semi-structured interviews/litmus) including: the policy brief outline, e.g., identification of how the problem related to risk factors/disease, to a program or service, and/or to the current health system; viable policy or programmatic options to address the problem; and potential barriers that could influence implementation policy options. The session also covered: stake- holder selection framework for litmus testing, and semi-structured interviews with stakeholders.

The next steps for countries include:

• To agree on preliminary timeline for the updated policy brief outlines

• To coordinate with assigned team lead for each country team

Group or individual work with support from EVIPNet/K2P
The webinar ended with Group work – using the EBP template – based upon Sessions 11 and 12.

• Presentation slides are available here

The preparatory work outlined in Webinar 4 was to:

• Frame the problem statement and underlying causes for your selected priority topic/area

The introduction to the webinar provided: an Overview of methodologies to measure antibiotic use, and the use of surveillance data; the link between AMR and use of antimicrobials; and the integrated national action needed on optimal use of antimicrobials, including through data, surveillance, and monitoring.

The webinar then focused on Session 10: Framing Viable Policy Options to Address a Problem: A Step-by-Step Guide presented by EVIPNet-K2P Center. Session 10 included: Content of EBPs (i.e. problem statement, options or elements, and implementation considerations); Developing options/elements to address the problem (i.e. policy options, and health system/governance/financial arrangements/delivery arrangements); Steps for developing options/elements to address the issue (literature review, thematic analysis, tailoring to the country issue/context, and selecting 3-4 options); and practical examples of AMR and underlying causes to policy options.

The webinar ended with Group work – with support from EVIPNet/K2P and using the EBP template to:

• Identify 3-4 policy options/elements to address the problem and its underlying causes

• Presentation slides are available here

​

A total of 57 participants from Bangladesh, Nepal, Uganda, and Malawi attended the webinar, together with those from IVI-RADAAR and EVIPNet/WHO.

Webinar 4 began with the ‘Feedback on preparatory work’ outlined in Webinar 3, which was to:

• – Develop a search strategy for your selected priority topic
• -Prepare an inventory of AMR-specific indicators in your country

Dr Fadi El-Jardali from the American University of Beirut updated participants on the progress of the four countries including: on the topics selected (Uganda on irrational antibiotic use; Nepal on AMR National Action Plan (NAP) implementation [adjudged to be more about the solution than the problem]; Malawi on the utilization of AMR evidence generated at facility/national level and translation into policy [also more about the solution than the problem]; and Bangladesh, which had not yet been reviewed. The review also included country search strategies. The feedback included questions from participants.

The webinar then focused on the next (of the 15) training sessions:

Session 9. Preparing the EBPs: clarifying and framing the problem including:

• Knowledge Translation (KT). Which facilitates the process of translating research into policy and action; and KT products which allow evidence generated from systematic reviews – the basic units of KT – to be packaged in a user-friendly format, written in clear language, and with key messages to increase the likelihood of adoption by policy-makers, and resonance among different target audiences. The use of systematic reviews enable policy-makers to scan large bodies of research evidence to address key features of any policy issue of interest.

• Evidence briefs for policy (EBP) or simply ‘policy briefs’, the most widely used KT product. Which bring together: global research evidence (from systematic reviews), local evidence (from primary studies, reports, indicators), context-specific knowledge (key informant interviews with targeted policy-makers/stakeholders) to inform deliberations on health policies/programmes.

• The content of EBPs comprise:

  – Problem statement: A policy problem that summarizes the best available evidence to clarify the size and nature of the problem and its underlying causes.

  – Options or elements: Three or more viable policy and programmatic options described.

  – Implementation considerations: Potential barriers to implementing the options/elements and strategies for addressing those.

• The EBP does not provide recommendations for action.

The remainder of Webinar 4 featured the Group work exercise facilitated by Racha Fadlallah from K2P Lebanon (and support from EVIPNet). The group work comprised four groups – one for each country (including representatives from WHO country offices, and observers from EVIP/RADAAR) – with the aim:

• Frame a problem statement for selected priority topic
• Refer to the evidence brief for policy template
• Develop a Problem (problem statement) and the underlying causes of the problem section

A template was provided by EVIP facilitators (based on the presentation from Session 9) with sections for completion by country groups.

​

• Presentation slides are available here

​

Webinar 3 began with the ‘Feedback on preparatory work’ outlined in Webinar 2, which was to:

• Complete the mapping of the policy and political context and key stakeholders related to AMR
• Select a priority topic/area related to AMR in your country

Fadi El-Jardali from the American University in Beirut updated participants on the progress of the four countries and provided further guidance for countries on completing these two crucial stages. Malawi was used as an example applicable to other countries, in terms of structuring thinking in relation to identifying the issue, the political context, what has already been done in terms of AMR, what is missing and why, and stakeholder mapping. Country participants summarised their experiences. The feedback ended with a discussion on the priority areas of focus for the Evidence Brief for Policy (EBP), with updates from countries.

Following feedback reporting, the webinar focused on the next two (of 15) training sessions:

Session 7. Designing search strategies to identify and access research evidence on priority topics including: the importance of effective searches (6,500 medical articles published daily); the use of ‘Boolean Operators (e.g., And, Or, Not); identification of search terms; building a search strategy, including formulating the question/issue, choosing appropriate databases, dividing the question/issue into 2 or 3 concepts, generating search terms for each concept, and combining concepts – and search terms within concepts – using Boolean operators; and validating/documenting the search.

An example of a ‘search’ template was presented, and which participants would complete in the group work at the end of the webinar. The template included: the Problem/Issue being addressed, the Options, the Concepts, the Search terms for each concept, and Combining concepts using Boolean operators

The importance of collecting the best available evidence for EBPs was stressed: local evidence and global research evidence from systematic reviews. Guidance was provided on where to search for such information, including local and national databases, websites of relevant organisations, search engines, ‘grey’ literature, and systematic reviews.

Session 8: Understanding the role of systematic reviews in influencing policy decisions including: the Concept of a systematic review; key databases to search – and how to search – for reviews (e.g., Health Systems Evidence, Cochrane, PubMed); a live demonstration of a search on Health Systems Evidence and PubMed databases; and assessing the quality of reviews (e.g., using AMSTAR).

The remainder of Webinar 3 featured the Group work exercise facilitated by Racha Fadlallah and
Lama Bou Karroum from K2P Lebanon (with support from EVIPNet). The group work was comprised of four groups
– one for each country (including representatives from WHO country offices, with observers from EVIP/RADAAR) – with the aim: To develop a search strategy and search key databases for systematic reviews.

A template was provided by EVIP facilitators (based on the presentation from Session 7) with sections for completion by country groups as follows: the Topic/Issue being addressed, the Concepts, the Search terms for each concept, Combining concepts using Boolean operators, and the Databases searched.

​

• Presentation slides are available here

After a brief introduction, Webinar 2 began with ‘Feedback on preparatory work’ outlined in Webinar 1:

• To form Evidence Briefs for Policy (EBP) core team (with assigned roles/tasks)
• To identify relevant stakeholders involved in or affected by AMR in your country

The EBP Team is responsible for developing the EBP and conducting key informant interviews (KIIs), hence an appropriate mixture of expertise is key to a successful team, including members with experience in: methods of writing an EBP; administration; evidence search, appraisal and synthesis; technical expertise on the topic being addressed in the EBP; and communication. Each country must also appoint an EBP steering committee to support the EBP development process, comprising: 4-6 multisectoral, multidisciplinary and high-level stakeholders from government/policy-makers/researchers knowledgeable in the topic and able to contribute to the development of the EBP for AMR.

Each of the four countries reported briefly on the steps taken to form the Core Team, Steering Committee, and in identifying AMR stakeholders (some countries had also informed RADAAR/EVIP prior to the Webinar via email).

Following reporting, the Webinar focused on the next two (of 15) training sessions:

Session 5. Understanding the political and health system and outlining key areas to keep in mind when mapping the policy and political context including: the importance of context-specific and actionable evidence, in particular the political/policy context (e.g., characteristics of government structures, civil service – and interests of – policy-making stakeholders, societal values and external factors, such as social and economic); and health system context (e.g., evidence on health system inputs, processes, and outputs and the analysis of how they combine to produce outcomes, such as – the WHO defined – service delivery, health workforce, information, medical technologies, finance, and  leadership/governance).

Session 6:Stakeholder mapping including: on stakeholder interests, i.e., concerns over how a policy may impact them; their positions, i.e., degree of agreement or disagreement with the policy; and their power, i.e., capacity to influence policy. The steps in stakeholder mapping include: defining the goal and implications of the proposed policy change; listing interest groups involved in the issue; categorizing stakeholders according to their influence and power over, and level of interest in the issue; determining a strategy to engage relevant stakeholders; conducting KIIs; and presenting stakeholder analysis.

Stakeholders identified include: decision-/policy-makers (e.g., ministries, government agencies, parliamentarians, municipalities); influencers (e.g., NGOs/CSOs, religious leaders, media, private sector); and the public (e.g., those affected by AMR).

A case example from Ghana was presented to highlight the steps in stakeholder mapping.

Webinar 2 concluded with a Group work exercise (with support from EVIPNet/K2P)
Group work was comprised of four groups – one for each country (including representatives from WHO country offices) – with the aim of:

• Mapping of the Political/Policy context
• AMR Stakeholder Mapping

A template was provided by facilitators with nine questions to capture the above details including: the issue; progress made in addressing the issue; previous related policies/laws/regulations; whether the issue is on the government agenda; windows of opportunity; requirements to reach the policy objective; how laws/regulations are implemented to this purpose; stakeholders involved; and the power interplay among/between stakeholders. The questions provided background information to enable completion of full ‘Stakeholder Mapping’ template (including stakeholder, description, name, power, interest).

​

• Presentation slides are available here

After an introduction to evidence-informed policy-making (EIP) and EVIPNet, Webinar 1 included the first four (of 15) training sessions:

Session 1. Brief overview of the policy-making process including: promoting the use of research evidence in policy-making to improve health systems; increasing country capacity in/institutionalising knowledge translation (KT); approaches to increase research utilization; developing evidence briefs to inform health policy deliberations, and assess the impacts of policy options; and the evidence-action cycle, including priority-setting, evidence, convening deliberative dialogue, and policy implementation.

•  Presentation slides are available here

Session 2: Understanding role of evidence in policy-making process and efforts to support use of evidence in policy-making including: policy process overview; major public policy theories/frameworks; stages in public policy making, i.e., definition, agenda setting, and policy instruments/implementation/ evaluation; importance of robust research/data/evidence, as well as KT tools/strategies; and enhancing awareness/capacity of, and engaging policy-makers/stakeholders early, and sustaining engagement.

• Presentation slides are available here

Session 3: Knowledge generation and knowledge translation as a spectrum: evidence on establishing and/or strengthening national health research system using a systems approach and the need of cross evidence ecosystem collaboration including: the National health research system (NHRS); WHO guides/ tools; key workstreams of the evidence ecosystem, i.e., partnering for complementary support in decision-making; HO workstreams, i.e., data analytics, guidelines, health technology assessment (HTA), evidence-informed policy-making supports, modelling, and behavioral research; and the evidence ecosystem framework and policy/action cycle.

• Presentation slides are available here

Session 4: Learning from success stories of EVIPNet Member Countries: development of evidence briefs for policy on AMR including: Slovenia case study on ‘Translating AMR data and evidence into effective policies (EBP development); driving factors, challenges, and lessons learned; importance of a multi-level/sectoral approach; the need to integrate local evidence; the crucial role of Ministries of Health to put options on the political agenda (and sufficient capacity within the MoH and NIPH).

• Presentation slides are available here