Last week, I spent the day with the Big Lottery Fund and a bunch of evaluators who are running five large evaluations of major BLF programmes. The evaluators come together regularly to exchange and learn from each other’s experiences. This meeting was focusing on the topic of evaluation and complexity. I was asked by BLF to set the scene by talking about what complexity is and why it is relevant for evaluation. Afterwards, I enjoyed listening to the evaluators on how they made sense of complexity and the consequences for their evaluations. Here a summary of my inputs and some insights from the subsequent discussion.
Continue reading
Monthly Archives: February 2018
Is it systemic change or is it not? These two concepts help answer the question.
Quite a few market systems development projects I have come across in my practice have a goal in their logframe to achieve systemic change. In most cases this is spelled out around some or other market function that is supposed to be improved (e.g. improved access of poor farmers to seed). But in some cases, the log frame simply asks for a number of unspecified systemic changes to be achieved. Both cases are interesting in their own right, but particularly in the latter case evaluators need to be able to answer the question “is it systemic change or is it not?”. There has not been a clear way to answer the question.
In this post, I want to introduce two concepts that can be helpful to answer this question. Firstly, the idea of ‘depth of change’ taken from the systems thinking literature, which helps us understand how fundamental a change is with regards to a system’s architecture. Secondly, the idea of resilience and the question if development interventions build the resilience of the market system or economy. Continue reading