S07_ Re-thinking Evaluation Professionalism for Vibrant Democracies: Ethics, Values, and Systemic Capacity in Institutions
S09_ Evidence for Climate and Environmental Action (E4CA): Evaluating What Works in Climate Mitigation and Adaptation, as well as in Environmental Sustainability.
S07_ Re-thinking Evaluation Professionalism for Vibrant Democracies: Ethics, Values, and Systemic Capacity in Institutions
S09_ Evidence for Climate and Environmental Action (E4CA): Evaluating What Works in Climate Mitigation and Adaptation, as well as in Environmental Sustainability.
S08_ Evaluation, Democracy and Bias in an AI-shaped, Sustainability-focused Development World
Ananda Millard, Tom Ling
Rationale and Objectives
In international development, evaluations often report broadly positive findings. Meanwhile, progress towards SDGs has slowed or halted, democracies are backsliding, persistent poverty, the ecological crisis, etc.
This strand explores whether, and how far, development evaluation should be seen as being “too positive” and whether development evaluation as a practice is shaped by institutional and methodological biases. At the same time, it highlights approaches that make biases visible, strengthen democratic ownership in partner countries and support genuinely sustainable development pathways.
The strand aligns with the conference focus on evaluation for vibrant democracies by examining how bias in data, methods, and institutional incentives affects the credibility and usefulness of development evaluation in politically contested and ecologically constrained contexts. It also asks how AI-enabled tools improve or worsen these problems.
It is often said that locally led evaluation and new forms of training can help re centre accountability toward affected populations, support decolonisation of evidence, and address trade offs between growth, rights and sustainability. We will invite examples where this has been achieved.
Theory: clarifying how problem framing, power and bias shape evaluative judgement in development cooperation, and how AI and new methods alter these dynamics.
Practice: showcasing designs, methods and governance arrangements that move beyond “polite positivity” towards candid, constructive findings.
Policy dialogue: bringing together evaluators, commissioners and local actors to discuss how evaluation can better inform strategic decisions on democracy, sustainability and AI use in development.
We invite submissions evaluators or researchers in development and humanitarian sector. We welcome contributions that show how evaluation – including the use or critique of AI – has challenged “too positive” narratives, shifted who defines problems and success, and helped create more democratic and sustainable development practices, including concrete tools, methods, or training models to strengthen such work and help us explore ways in which evaluation practices can be better placed to include marginalised voices, identify what is not working in order to learn how to do better, and strengthen accountability. Younger contributors are particularly invited.
We invite submissions evaluators or researchers in development and humanitarian sector. We welcome contributions that show how evaluation – including the use or critique of AI – has challenged “too positive” narratives, shifted who defines problems and success, and helped create more democratic and sustainable development practices, including concrete tools, methods, or training models to strengthen such work and help us explore ways in which evaluation practices can be better placed to include marginalised voices, identify what is not working in order to learn how to do better, and strengthen accountability. Younger contributors are particularly invited.
Strand Structure
A development focused set of three interconnected themes that move from diagnosis, through practice, to solutions/future directions. Together, they build a narrative:
(1) uncovering how bias operates, in relation to AI and methods;
(2) highlighting locally led practices that can democratise evidence;
(3) identifying actionable solutions in the form of education, training/ capability-building.
1 – Data collection, analysis, processing and AI: when positive findings hide democratic and sustainability risks Facilitators: Coordinators Opening session will surface the problems that arise when development evaluations underplay negative outcomes or the experiences of those most affected. It will set the stage to examine a wide range of methods and tools and explore how, for example, counting outputs while ignoring shrinking civic space or environmental damage, can be challenging. It will emphasise the role of power and identity in shaping how problems are defined, how ‘acceptable solutions’ are identified, how ‘success’ is measured, and how findings are communicated.
2 – Local evaluation, local power in development: democratising evidence for sustainable futures Facilitator: Laura Tagle Focusing on locally led embedded evaluation within development. It will feature municipal, national, civil society or grassroots evaluations in the Global South to explore, power, benefit and permanence.
3 – Repurposing development evaluation: education, training and capabilities for bias aware, democratic practice Facilitators: Coordinators Closing session is solution oriented and aims to co create pathways for repurposing development evaluation so it can be what it aspires to be in contested democracies and fragile settings. The session will draw on these contributions to sketch a shared capability map.
(1) uncovering how bias operates, in relation to AI and methods;
(2) highlighting locally led practices that can democratise evidence;
(3) identifying actionable solutions in the form of education, training/ capability-building.
1 – Data collection, analysis, processing and AI: when positive findings hide democratic and sustainability risks Facilitators: Coordinators Opening session will surface the problems that arise when development evaluations underplay negative outcomes or the experiences of those most affected. It will set the stage to examine a wide range of methods and tools and explore how, for example, counting outputs while ignoring shrinking civic space or environmental damage, can be challenging. It will emphasise the role of power and identity in shaping how problems are defined, how ‘acceptable solutions’ are identified, how ‘success’ is measured, and how findings are communicated.
2 – Local evaluation, local power in development: democratising evidence for sustainable futures Facilitator: Laura Tagle Focusing on locally led embedded evaluation within development. It will feature municipal, national, civil society or grassroots evaluations in the Global South to explore, power, benefit and permanence.
3 – Repurposing development evaluation: education, training and capabilities for bias aware, democratic practice Facilitators: Coordinators Closing session is solution oriented and aims to co create pathways for repurposing development evaluation so it can be what it aspires to be in contested democracies and fragile settings. The session will draw on these contributions to sketch a shared capability map.