Alexandra Zeitz, St. Antony’s College, Oxford
Speakers:
Adam Bennett, St. Antony’s College, Oxford and
Robin McConnachie, Oxford Analytica
Chair: Stewart Fleming, St. Antony’s College, Oxford
When the IMF is called in during a time of
economic crisis, the programme agreed is often politically contentious. One of
the defining questions in the aftermath of the IMF’s intervention is
frequently: “did it work?” In late November, PEFM heard from Adam Bennett,
formerly of the IMF, about the effectiveness of IMF programmes in a region
where the Fund has played a prominent role in recent decades: the Balkans.
Robin McConnachie, who has acted as an advisor to governments in the region,
contributed his insights into what makes for successful reform programmes.
How does one capture the impact of an IMF
programme? Bennett explained that the Fund itself has grappled with the
numerous measurement challenges of evaluating effectiveness. Simple measures
comparing indicators before and after an IMF programme neglect the
counterfactual of how the country would be faring in the absence of an IMF
programme. Comparisons between countries with and without IMF programmes cannot
account for the fact that countries with IMF programmes often faced worse
conditions than those that received no programme.
The Fund has responded to these measurement
concerns by building complex models that attempt to capture the impact of
policy interventions. These models, however, can only be as accurate as the
assumptions they are built on. For his evaluation of the IMF’s programmes in
the Balkans, therefore, Bennett used simple comparisons between those Balkan
countries with and without IMF programmes and contrasted countries’ actual performance
with the targets set in the programme.