Friday, December 30, 2011

Monitoring & Evaluation (M&E)

A part of my role in Somalia is to look at M&E, either through joint initiatives or internally, within the programmes and the emergency assistance that Concern is providing.

So this is a very simplified definition of M&E that I will expand upon in the future (you will notice that M&E draws on many of the principles of programme, risk, capacity, etc that are described in other parts of this blog)...

Monitoring is Performance Management and should provide sufficient information support decision-making that allows you to continue as planned or make changes, on an on-going basis, to activities that contribute to the achievement of the objectives/outcomes.
•The progress made on agreed activities
•The impact of risks that have materialised on Progress (activities) and Purpose (objectives/outcomes)
•The impact of assumptions that were incorrect on Progress (activities) and Purpose (objectives/outcomes)

Evaluation is Impact Assessment & Lesson Learning - that is to say, did we achieve what we set out to achieve and how did we do it. This is measured in two phases:
1.Did we do what we said we would do (meet the objectives/outcomes)
2.Did we meet the expectations of the various stakeholders (the Goal)

Evaluation is always a "point in time" assessment and so, itself will have assumptions ("our conclusion is based on..."). The opportunity for continuous improvement is to capture practical lessons that can be applied to Performance Management (decision-making & resource optimisation) for the future.

Resources: activities use resources, so performance management is resource optimisation. There are only three resources that are affected by decision-making:
1.Time: the number of people that you have, their skills, experience and ability to complete the activities
2.Things: the tangible things that are available to you to help you complete the activities
3.Money: the flexibility to buy either more time (1) or more things (2) that will help you complete the activities.

A RISK is a definable, describable but unknowable event that we presume will happen ("there is a risk of rain…"). As a result a risk requires additional resources/activities to mitigate its impact (umbrella, raincoat, sandbags, etc.)
An ASSUMPTION is a definable, describable but unknowable event that we presume will not happen ("we assume it will not rain..."). No additional resources are set aside - but the assumption must be monitored in case it is wrong.

Footnote: I am currently working on developing "Theories of change" for humanitarian and resilinece-based programmes. An important definition that I draw upon is for Strength (as in SWOT): Strength – is a tangible resource (time, things, money) that you can leverage to directly achieve your objective (strength-to-opportunity) or; influence the achievement of the objective by using those tangible resources to overcome a weakness or threat

Snapshot from Somalia

My most recent placement - as Food Assistance Programme Manager with Concern, responding to the famine in Somalia. One of my most challenging posts so far, the following is just a snapshot (note - much has changed in recent weeks, but that is for a later update when the security situation allows):

The Food Assistance programme is a 6 month life-saving programme designed around Food Vouchers. It is scheduled to cover the hunger period – which as we are all aware has been exasperated by the famine in Concern’s areas of operations in south/central Somalia; between the two harvest seasons (the Gu in July and the Deyr in January). The Food Assistance programme, which also includes blanket supplementary feeding plus recovery assistance such as seed provision for the Deyr season, will be completed with the final distribution of food vouchers in late January 2012. After which there will be programme closure activities including lesson learning, evaluations and donor reporting.

More importantly, with the changing security and political situation in Somalia, the Food Assistance programme requires active management & monitoring – we have seen in September the need for first-hand engagement in programme delivery by all members of the team – in the regions, in Mogadishu and in Nairobi. On behalf of Concern, as the lead agencyin south & central Somalia, I am actively engaging with cluster coordination and peer-organisations to ensure that assistance continues in these regions during the on-going instability.

Our teams have been able to procure / pre-position food stocks for our nutrition programmes to complement the food assistance that we are providing and the focus now is on continuity of the programme activities. As the programme manager I travel in regularly to Mogadishu, leading these teams with the support of the in-country managers & coordinators. As an organisation we know, from both current and past experience, that day-to-day management will be required right up to the final distributions in January 2012, where Concern is feeding more than 200,000 people every month.

There are also a number of initiatives that I am leading including a consolidated M&E initiative with several other NGOs that offer similar modalities of assistance (cash transfers/food vouchers). This will support our own lesson learning plus broader advocacy on these types of programmes. I am preparing a Standard Operating Procedures manual to cover the various procedures (from adhering to Concern policies to checklists for field activities). And I will be supporting the programme teams as Concern prepares for the transition from Emergency to Recovery in line with the changing circumstances and operational plans for 2012.