Ex post evaluation

from Wikipedia, the free encyclopedia

The ex-post evaluation focuses on the subsequent analysis of research programs, processes or projects, taking into account the knowledge newly acquired through the previous evaluation. The ex-post evaluation aims to check the sustainability (performance, quality, impact) of a research project in order to reveal whether the goals set in advance have been achieved.

Framework conditions and implementation of the ex-post evaluation

Basics of an ex-post evaluation

First of all, the object of the evaluation must be presented in its exact form and the goals of the ex-post evaluation must be checked. If necessary, the evaluation process must be adapted to the requirements of those involved. In addition, the resources required (e.g. finances, time frame, suitable methods) for carrying out the impact analysis must be named and organized.

Aspects for the implementation and identification of the need for an ex-post evaluation

For example, the following aspects should be considered when performing and determining the need for an ex post evaluation:

  • Results and effectiveness of the previous research project
  • Sensible use of given research funds
  • Sustainability of the project
  • Missing goals and expectations
  • Improvement measures

In the empirical part of the study, a meaningful basis of usable data must first be created and its availability checked. The main focus here must be on maintaining objectivity and transparency.

Evaluation of ex-post evaluations

In order to draw consistent conclusions, when evaluating the collected data, care must be taken to ensure that any basics and framework conditions that prevailed during the evaluation are included in the subsequent interpretation.

According to Weiss, the analysis could be carried out in the following steps:

  1. Describe the research subject and the framework conditions
  2. Counting the results
  3. Breakdown of the data material into smaller, clear units
  4. Group the results according to similarities (e.g. with the help of factor analyzes or cluster analyzes )
  5. Compare the results and search for differences (e.g. using analyzes of variance and regression analyzes )
  6. Finding similarities between the results
  7. Consider outliers and exceptions that do not fit into the overall picture and may need to be examined separately.
  8. Finding covariations to identify interdependent effects.
  9. Exclusion of alternative explanations in order to be able to trace the results as directly as possible back to the interventions carried out.
  10. Creating models of the relationships between the collected data.

Goals of the ex-post evaluation

The ex-post evaluation aims to identify potential for improvement in the research work. It claims to analyze the quality, performance and sustainability of the research work carried out. The aim here is to reveal whether the effects aimed for in the project were actually triggered.

Literature on the subject of ex-post evaluation

  • Sandra Skeries: Critical success factors for the ex-post evaluation of research projects using the example of the social and economic sciences. Conception and implementation of a Delphi expert survey. Hamburg 2006.
  • CH Weiss: Evaluation - methods for studying programs and policies. Upper Saddle River, 1998.

See also

Footnotes

  1. ↑ Quoted from: Skeries, Sandra: Critical success factors for the ex-post evaluation of research projects using the example of the social and economic sciences. Conception and implementation of a Delphi expert survey, Hamburg 2006. see: Weiss, CH: Evaluation - methods for studying programs and policies. Upper Saddle River, 1998, p. 285.

Web links