Section 2 The Challenges
An intro paragraph that explains that difficulties arise because of challenges in measurement, attribution, and other factors.
2.0.1 Measurement
A section that discusses the challenges of job creation measurement. Topics for discussion:
- direct measurement of jobs not always feasible (perhaps the beneficiaries are not identified, or there is a scale/resource limitation).
- concept specification: differences between definitions between major stakeholders
- estimation methods
- models
- rampant assumptions and the propagation of error
- typically there is no randomisation of beneficiaries, and there is undoubtedly is self-selection bias. The extend of this bias on the measured results is not clear.
2.0.2 Attribution
Talk about the challenges of data-driven development:
- Development is active: it often cannot wait for the research
- There are often resource contraints on research
- the incentives structure rewards nice-looking numbers, not necessarily the truth. Those who implement are typically the same as those who measure their own performance.
- little appreciation for good data
- lack of accountability means there is no transparency: much data is proprietary.
2.0.3 Other factors
Talk about:
- Institutional momentum: it is hard to drive mentality shifts. Adopting new practices is slow and can often be hindered because of institutional rules that favor the status quo and the past.
- skills gap: good M&E analysts and researchers are hard to come by