[Editor’s note: This post is the fifth of a series produced by Andrea Ordóñez and Leandro Echt from Politics & Ideas to share what we learned through the online course Doing policy relevant research, ran for the first time in the first quarter of 2016. The course was supported by the Think Tank Fund and the Think Tank Initiative.]
In our previous post we introduced the seven principles for policy relevant research identified in existing literature and through practice. In this post we focus on the second proposed principle: a policy relevant research agenda should be internally and externally validated.
Once you defined its main components, analyzed the context, and framed the agenda, the challenge is: how do we actually go about it? How do we collect information and knowledge to create a proper analysis of the context so that we can keep policy influence in the loop? Also, how do we receive and process inputs from internal and external stakeholders?
The process of developing a policy relevant research agenda is an endeavor that requires both internal organization and planning and external engagement with others who are key for its work. Without connecting our initial ideas and interests with the opinions and needs of others, the research agenda might become only a wish list disconnected from reality, losing social and political relevance. The figure below summarizes the key aspects of this process that will be detailed in the following subsections.
The cycle of developing a research agenda benefits from four general steps: 1) an internal process of brainstorming and discussions, 2) the engagement with relevant stakeholders 3) the inclusion and arbitrage of the suggestions received and 4) communicating the agenda (this final step will be addressed in Module 6). Here we share some tips for your consideration in steps 1) and 2).
1. Internal brainstorming
The process of internal discussion might occur at two different levels: within each team and also institutionally, including the board. Depending on each think tank’s functioning it will be important to decide on how these levels interact but it is important to maintain an alignment between the board and the staff. Furthermore, it will be ideal to identify key spaces already institutionalized in the think tank that can also be used to discuss the research agenda, such as the annual planning process so as not to demand too much extra energy from the organization and its staff.
2. Deciding on levels and methods of engagement with stakeholders
Within the internal discussion, there must be an agreement about which other external stakeholders should also be engaged, including how to do it. It is advisable that various staff members are involved in defining this (though different areas could make different decisions), given that each one might have diverse expertise and connections with key stakeholders.
Among the possible stakeholders are other researchers and experts, policymakers, and representatives of civil society, among others. But beyond their nominal labels, what is critical is to understand the roles they play in a policy process and what research can bring into their table. Generally, we can categorize the different stakeholders in four groups: decision-makers, advisors, external proponents or supporters, and veto players.
But before approaching some of the most critical stakeholders about your research topics, it is important to also clarify within the think tank, what level of engagement is desired and what is the objective of the engagement. Do you want to just gain an understanding of their priorities? Do you want to develop partnerships? What can the stakeholders expect from relating to you? Based on Van de Ven (2007), here we present four levels of engagement as an initial guideline:
Direct or indirect consultation. In some policy context, think tanks cannot approach all their stakeholders for direct involvement. This is the case of settings where governments are not open to independent voices. It could also be difficult for newer think tanks to get active participation of others in the development of a research agenda. In this case, the understanding of needs and priorities might have to be done indirectly. For example, through more general interviews, an analysis of newspapers articles and interviews of policymakers or review of public documents. Of course, not having a direct contact with policymakers may be an important drawback. However, it is important to note that, even in the toughest environments creative strategies can be set in place to understand the positions of other stakeholders and including them in the research agenda.
Advisory. In this model a think tank invites some key stakeholders to formally or informally inform the research agenda. In this model, the think tank maintains full control of the agenda, and can take or not the comments and suggestions of the advisors. This model is usually very detached, with occasional participations (i.e workshops, year or bi year conferences, ad hoc meetings, etc). It might not lead to long term relationships but it might get you a wider range of interested participants. In this model, the advisors are not necessarily direct beneficiaries of the research, but can guide with their expertise.
Exchange. In this form of engagement, the stakeholders are clearly the users of the research. The engagement is different than that of the advisor because the stakeholders may be directly affected by the research. This is particularly the case of research that is evaluative or action research. In the case of the evaluation, the research proposes evaluating a policy in place, and this might require direct participation of those involved. In the case of action research, a researcher becomes part of an organization to improve it from within. In both these cases, the researcher maintains an outsider’s perspective but needs insider access to information and processes. Unlike just the advisory model, in this case, the other stakeholders can be very impacted by the research and can also have a strong influence on the research process. Ideally, however, the researcher maintains a high level of independence from the users.
Collaboration. In a collaborative engagement, the partner policy institution, NGO or business, holds equal stakes at the project. In this case, the research is the result of an explicit negotiation of priorities, and the outcomes are shared between the think tank and the partners. In this case, the role of the partners is much more intensive, and may even divert the course of a project from what the think tank expected in the beginning. In the case where the partner is a public institution, the results of a project will be affected by the public positioning of the institution. On the other hand, their in-depth participation may result in more impact since the outcomes might be more implementable or applicable for the organization. This higher possibility of impact may affect the think tanks full ownership of the research.
The process of validating your research agenda can also benefit from a reflection on the better strategies to receive the comments of others, that is, the method of engagement, which will also be aligned with the level of engagement that has been chosen. This instance, as well as different ideas on how to make sense of the consultation process, are addressed in our course, together with steps 3) Introducing changes to the agenda & finalizing a working document, and 4) Communicating the agenda.
[Editor’s note: Read other post of this series:
Comments