In order to measure the various goals we have defined, a Results Framework was established in 2011. The Results Framework includes specific indicators including targets and thus provides a framework for us to gauge progress toward the achievement of results and to adjust relevant activities accordingly.
The various indicators of the Results Framework are analysed on an annual basis and presented in a short report.
On project level
In order to assess the developmental effects of OeEB's portfolio, all projects are evaluated with an adapted version of the Development Effectiveness Rating (DERa) tool originally developed by the German development finance institution (DEG).Read more
DERa builds on international best practice by using predominantly quantitative and harmonised indicators and is applied to the entire portfolio and all new commitments of OeEB since beginning of 2019.
DERa rates individual clients' contribution to development and follows up on changes in performance since OeEB's investment. Based on the DERa assessments, OeEB can build its impact reporting and steer the overall development quality of its portfolio.
5 key outcome categories
Guided by the Sustainable Development Goals (SDGs), DERa uses five outcome categories to assess the development contributions of each customer:
- Decent jobs
- Local income
- Market and sector development
- Environmental stewardship
- Community benefits
DERa produces a cumulative score with a maximum of 150 points. The first three categories (the main development effects of private sector activities) make up 75% of the total score whereas the last two categories (the way of sustainably doing business) make up 25% of the total score.
For ease of interpretation, the score is linked to a qualitative categorisation:
- ≥ 100 points: Exceptional
- 85 – 99 points: Very good
- 70 – 84 points: Good
- 50 – 69 points: Satisfactory
- ≤ 49 points: Unsatisfactory
In 2019, OeEB's projects had an average DERa score of 81.35 ("Good").
On specific occasions, we commission an external expert to conduct an ex post evaluations of a project. An evaluation refers to a systematic and objective assessment of an on-going or completed project in which all phases of the project (its design, implementation and results) are included.Read more
The aim of an evaluation is to determine the relevance, efficiency, effectiveness, development impact and sustainability of the respective project. In doing so, the evaluation should enable the incorporation of lessons learned into the decision-making process of future projects.
The main purposes of evaluation thus are
- to provide an overall assessment of the project
- to improve future projects through feedback of lessons learned
- to provide a basis for accountability, including the provision of information to the public.
In its evaluations, OeEB follows the "Evaluation Policy of the Austrian Development Cooperation". This policy was developed in collaboration with the Ministry of Foreign Affairs, the Ministry of Finance, the Federal Ministry for Sustainability and Tourism and the Austrian Development Agency and sets out quality standards and benchmarks for Austrian development evaluation.