Resources

The methods presented for "Self Evaluation exercises" [SEE], are a "toolbox of methods" to assist in "assessing the past, present and future situations" and "establish willingness/readiness of actors to be involved in sustaining the programme". Fundamental to this approach is the assertion that "the views, concerns and involvement of the beneficiaries and workers alike matters". The resulting discussion means that, although PRA is not specifically mentioned in this report, the content may well be of relevance to those reading this bibliography. Methods discussed include "rapport building", "matrix ranking", "presentations", "role playing" and "situation analysis".

This summary is based on a report written for the Monitoring and Evaluation Division of the IFAD, with the general objective of examining the use of RRA methods for M&E. That report proposes a taxonomy of survey/RRA techniques and methods, which can be regarded as "a menu", thereby allowing choices to fit the precise needs of the user of information and institutional context. As such, the author argues, RRAs and formal surveys can be mixed to great effect. The criteria for such a taxonomy is outlined in this paper, as is a summary table of the main RRA techniques. The lessons from case study RRAs discussed in the original report are mostly positive, confirming "the value of weaving an RRA in to existing data" and showing how a low cost M&E system could be built on this. This is a useful and stimulating report with some clear summary diagrams and an extensive bibliography.

The use of RAP in evaluation in UNICEF is briefly outlined in this paper. In UNICEF, a Rapid Assessment Procedure [RAP] exercise "includes as a central base, the use of techniques derived from the field of anthropology such as focus group discussions, observation, and unstructured one-on-one interviews, that form a body of mainly qualitative data". Normally the qualitative information derived from RAP will be used in conjunction with quantitative data, which might already be available, or which might be collected as part of a RAP investigation itself. Although the report includes an admission that "RAP is not a particularly useful type of method to use for evaluations of a participatory nature..", the author does point out that RAP evaluations do have an important role in encouraging participatory development processes in projects, and that RAP style evaluation "can be used, if so desired, as a way of instilling a sense that more peoples participation may be more desirable in a development project".

Two methods are used to elicit the participation of rural people ("stakeholders") in the monitoring and evaluation of development programs: the Stakeholder based evaluation [SBE], and the participatory assessment monitoring and evaluation [PAME]. The difference is in the degree and stage of the involvement of stakeholders. The SBE pertains to a larger perspective where all possible stakeholders are identified and involved; the PAME involves mostly the direct and indirect beneficiaries of a program. The advantages and limitations of the stakeholder approach are discussed as well as the concept, the benefits and the focus of PAME [see also Davis-Case (1990; 1989 in this bibliography]. Although the use of PRA methodologies is not discussed, the article systematically explores the same set of questions, concerning the relative merits of certain approaches (or tools) to Participatory M&E, that are likely to be raised in the PRA literature.

In this article the author describes the experience of an international NGO [ACCORD] in its attempt to develop, with community groups, a process known as "auto-evaluation" - which aims to establish project objectives that are consistent with both community and agency criteria, and to evaluate their achievement against "community-determined indicators". While PRA is not explicitly mentioned, the discussion concerning the practical lessons that have been learnt to date with the implementation of this type of participatory or community-based evaluation mechanism, is highly relevant.

Beneficiary Assessment [BA] is described as "tool for mangers who wish to improve the quality of development organisations". In this World Bank manual the author gives the rationale for BA, describes its design and comments on the techniques (direct observation, conversational interviews, and participant observation) which are employed. Although PRA is not mentioned, the discussion may be of interest, due to these latter comments - which are further elaborated in the annexes. Examples of the impact of BAs are provided and the question concerning the limited prevalence of participatory evaluation techniques, such as BAs, in Bank projects is briefly discussed.

The International Conference on Rapid Assessment Methodologies for Planning and Evaluating Health Related Programmes, was organised by the United Nations University, at the Pan American Health Organisation headquarters in 1990, to "explore anthropologically based methodologies for the design, evaluation, and improvement of programmes of nutrition and primary health care". The 42 chapters on Rapid Assessment Procedures [RAP], Rapid Rural Appraisal [RRA], and related approaches deal with a range of research tools. The book is divided in to seven sections: 1. The expanding role of Qualitative research in International Development; 2. Development and applications of RAP procedures in Africa, Asia and the Americas; 3. Community Participation and RRA; 4. Institutionalization of RAP; 5. Training for RAP and other qualitative methods; 6. Bringing RAP to the decision-making realm: effective communication and use; 7. Conference summary, comments, speakers and participants. The overall focus is on planning and evaluation of nutrition and health related intervention programs, but much that is discussed will have a direct bearing on other social development sectors. The stated aim of the volume, of contributing "toward increasing the understanding of RAP and RRA, both as tools of investigation and potentially as integrated components of the community development process itself", highlights this point.