Monitoring and evaluating advocacy: lessons from Oxfam GB's Climate Change campaign

This article examines Oxfam GB's learning from its attempts to improve monitoring and evaluation (M&E) processes within a global advocacy campaign. It outlines the Climate Change campaign team's practical experience of piloting different approaches to M&E, and the lessons emerging from the process. The experience suggests that while some ‘traditional’ elements of M&E are helpful in advocacy work, a greater focus on light, real-time monitoring systems is necessary. The findings highlight the organisational as well as methodological challenges of integrating M&E into advocacy campaigns: without a culture that rewards reflection and learning, improvements in staff capacities or data-collection systems will not be sustained. Indeed, the process of improving M&E practice mirrors that of an advocacy campaign itself, requiring analysis of power relations, opportunities, and constraints; monitoring of progress; and adapting plans on the basis of on-going learning. Finally, the article suggests possible ways forward, based on experience.     

Why a managerialist pursuit will not necessarily lead to achievement of MDGs

With case studies on Millennium Development Goal (MDG)-oriented reform projects in Vietnam, this article focuses upon a persistent dilemma in attempting to turn worthy goals into implementable programmes and sustainable results. How to achieve these goals is uncertain, but modern performance management, as expressed in Logical Frameworks, demands certainty. The article suggests how an open management style can allow for pragmatic adaptation to circumstances; or, more radically, how Log Frames could be redesigned to focus upon interpretation of contextual challenges. But such a dynamic requires a high degree of delegation and an acceptance that accountability must also be an interactive learning process.     

Measuring the impact of fair trade on development

This study of the impact of fair trade relies on new field data from coffee and banana co-operatives in Peru and Costa Rica, including a detailed assessment of its welfare effects by comparing FT farmers with non-FT farmers as a benchmark. Attention is focused on three major effects: (a) direct tangible impact of FT arrangements on the income, welfare, and livelihoods of rural households; (b) indirect effects of fair trade for improving credit access, capital stocks, investments, and attitudes to risk; and (c) institutional implications of fair trade for farmers' organisations and externalities for local and regional employment, bargaining, and trading conditions. Although direct effects in terms of net income remain fairly modest, important benefits are found to include capitalising farmers and strengthening their organisations.     

Mapping the road to development: a methodology for scaling up participation in policy processes

Understanding local variability in context and mobilising local participation to define development agendas are widely accepted development strategies. There remain, however, significant challenges to the systematic and effective inclusion of local communities and households. Projeto MAPLAN, a pilot project in Ceará, Brazil, is a joint effort of the public sector and civil society designed to create a process of participatory development planning which integrates local-level contextual variations. In this effort, the use of a Participatory Geographic Information System (PGIS) stimulates the participation of community members in analysing their needs, goals, and priorities. The visualisation of these factors through easily understood maps facilitates communication and contributes to a democratic and transparent planning process, thus permitting the articulation of local priorities with the state-level planning apparatus. MAPLAN represents part of a shifting paradigm for rural development planning in the state and provides the tools for the effective inclusion of citizen voice in development policy.     

Attitude counts: engaging with rice farmers in West Africa

An international project called PADS promoted participatory learning and action research with inland valley rainfed rice farmers in West Africa. All countries received the same training, similar funding, and the same leadership. Although the staff in Ghana were conscientious and gave much training to the farmer beneficiaries, the Mali staff explicitly encouraged farmers to experiment. Farmers in Mali responded to this favourable attitude by experimenting more than those in Ghana, and in qualitatively more interesting ways. Long-term engagement with grassroots organisations may be as conducive to changing public servants' attitudes as the actual participatory approach promoted on the ground.

L'attitude compte: travail avec des riziculteurs en Afrique de l'Ouest

Un projet international appelé PADS a favorisé l'apprentissage participatif et la recherche-action avec des riziculteurs pratiquant la culture pluviale dans les vallées de l'intérieur des terres en Afrique de l'Ouest. Tous les pays ont reçu la même formation, un financement similaire et le même leadership. Alors que les membres du personnel du Ghana étaient consciencieux et dispensaient une formation considérable aux agriculteurs bénéficiaires, le personnel du Mali encourageait expressément les riziculteurs à faire des expériences. Les riziculteurs du mali ont réagi à cette attitude favorable en faisant plus d'expériences que ceux du Ghana, et ce de manières plus intéressantes sur le plan qualitatif. L'engagement à long terme avec les organisations de la base populaire peut être tout aussi propice à la modification des attitudes des fonctionnaires que l'approche participative même promue sur le terrain.

As atitudes contam: Engajamento com produtores de arroz na África Ocidental

Um projeto internacional chamado PADS promoveu uma pesquisa sobre aprendizado e ação participativa com produtores de arroz irrigado com água da chuva no interior do vale na África Ocidental. Todos os países receberam o mesmo treinamento, financiamento semelhante e a mesma liderança. Embora os funcionários de Gana estivessem cientes e oferecessem bastante treinamento aos produtores beneficiários, os funcionários de Mali incentivaram explicitamente os produtores a experimentar. Os produtores de Mali responderam a esta atitude favorável experimentando mais do que aqueles de Gana e de maneiras mais interessantes em termos qualitativos. O engajamento de longo prazo com organizações de base pode contribuir para mudar as atitudes dos servidores públicos tanto quanto a abordagem participativa real promovida na base.

La actitud cuenta: el trato personal con campesinos arroceros de África Occidental

Un proyecto internacional llamado PADS promovió el aprendizaje participativo y la investigación-acción entre campesinos que cultivaban arroz de secano en los valles centrales de África Occidental. Todos los países participantes recibieron la misma capacitación, un financiamiento similar y las mismas orientaciones. Si bien el personal de Ghana era muy diligente y transmitió muchos conocimientos a los campesinos beneficiarios en capacitaciones, el personal de Malí se centró más explícitamente en animarlos para que experimentaran. Los campesinos de Malí respondieron a esta actitud estimuladora realizando más experimentos y de maneras cualitativamente más interesantes que los campesinos de Ghana. El compromiso de largo plazo con organizaciones de base puede ser tan importante para lograr un cambio en la actitud del servidor público como el método participativo que se promueve en la actualidad sobre el terreno.     

Why can't development be managed more like a funeral? Challenging participatory practices

The adoption of techniques to elicit community participation in development practice is an important step forward. The question remains whether this is sufficient for development outcomes that accord with the aspirations of ‘participants’. Community perceptions are somewhat different, as our own conclusions demonstrate. We have developed a ‘methodology of inclusiveness’, based on community institutions which embed collective social action in everyday life. We use the analogy of funerals as collective action in which activities are planned, roles are demarcated, responsibilities are assigned, and desired outcomes are realised. We ask the question: why can't development be managed more like a funeral?     

Qualitative Comparative Analysis (QCA), Anno 2013: Reframing The Comparative Method's Seminal Statements

This review article examines the ways in which QCA is being (re)framed by some main authors in the field, in a context of expansion and diversification of this approach and set of techniques. Charles Ragin's seminal The Comparative Method (1987) is first synthetized in the form of eight statements which are then confronted to eight recent book‐length publications: three QCA textbooks and five methodological volumes also touching upon QCA. On the whole, it appears that most statements have been considerably refined, both conceptually and technically, whereas only one statement is not taken on board anymore. In addition, QCA is being reframed and extended in different ways beyond Charles Ragin's initial statements.     

Working from strengths to assess changes in gender equality

This paper describes an empirical application of a strengths-based approach (SBA) to assess changes in gender equality, and draws out implications for research, evaluation, and wider development practice. We outline what constitutes a strengths-based approach and present a case study where a participatory methodology informed by appreciative inquiry was used to investigate gender outcomes of two water, sanitation, and hygiene-focused development initiatives. We consider the value and limitations of taking an explicitly strengths-based approach to assessing gender outcomes, and also propose that there are important arguments for why SBAs might be usefully applied in addressing (not just assessing) gender equality.

Travailler à partir des forces pour évaluer les changements sur le plan de l'égalité entre les sexes

Ce document décrit une application empirique d'une approche fondée sur les forces (AFF) pour évaluer les changements sur le plan de l'égalité entre les sexes, et en tire les implications pour les recherches, l'évaluation et les pratiques plus générales en matière de développement. Nous décrivons ce qui constitue une approche fondée sur les forces et présentons une étude de cas dans laquelle une méthodologie participative éclairée par une enquête appréciative a été utilisée pour examiner les résultats sur le plan du genre de deux initiatives portant sur l'eau, l'assainissement et l'hygiène. Nous considérons la valeur et les limites de l'adoption d'une approche expressément fondée sur les forces pour évaluer les résultats sur le plan du genre, et avançons par ailleurs qu'il y a des arguments importants concernant les raisons pour lesquelles les ABS pourraient être utilement appliquées au moment de tenter d'obtenir (et pas seulement d'évaluer) l'égalité entre les sexes.

Evaluando cambios en la igualdad de género a partir de las fortalezas

El presente artículo examina la aplicación empírica de un enfoque basado en fortalezas (SBA por sus siglas en inglés), destinado a valorar cambios en la igualdad de género y a analizar sus implicaciones en la investigación, la evaluación y las prácticas más generales relacionadas con el desarrollo. Las autoras hacen un bosquejo de lo que constituye un SBA. Presentan un estudio de caso en el que se utilizó una metodología participativa a partir de una investigación apreciativa, con el objetivo de realizar una pesquisa en torno a los resultados vinculados al género obtenidos en dos iniciativas de desarrollo enfocadas en agua, saneamiento e higiene. Asimismo, examinan el valor y las limitaciones implicadas en el uso explícito de un SBA para valorar los resultados relacionados con el género, sosteniendo que existen razones importantes para defender la utilización del SBA con el fin de obtener (y no sólo valorar) la igualdad de género.

Trabalhando a partir dos pontos fortes para avaliar mudanças na igualdade de gênero

Este artigo descreve uma aplicação empírica de uma abordagem baseada nos pontos fortes (SBA) para avaliar mudanças na igualdade de gênero e extrai as implicações para a pesquisa, avaliação e prática de desenvolvimento mais geral. Esboçamos o que constitui uma abordagem baseada nos pontos fortes e apresentamos um estudo de caso onde uma metodologia participativa com informações de uma investigação apreciativa foi utilizada para examinar os resultados de gênero de duas iniciativas de desenvolvimento focalizadas no fornecimento de água, saneamento e higiene. Consideramos o valor e as limitações de se adotar uma abordagem explicitamente baseada nos pontos fortes para avaliar os resultados de gênero e também propomos que há argumentos importantes que explicam por que as SBAs podem ser utilmente aplicadas na abordagem da igualdade de gênero (não apenas avaliando).     

One size does not fit all: choosing methods to inform area development

There have always been debates about the methods that should be used to inform and assess development programmes. Experimental methods have become highly advocated as agencies seek rigorous ways to show programme value. However, the benefits and appropriateness of these methods are frequently overstated. We use the Aga Khan Development Network's Quality of Life studies to show that periodic mixed methods approaches are useful to analyse programme contributions and inform area development. We argue that experimental methods should not be idealised, and that research questions and organisational learning should guide pragmatic methodological choices to inform development intervention in real-life contexts.

Une taille unique ne convient pas toujours : comment choisir des méthodes pour éclairer le développement des régions

Il y a toujours eu des débats sur les méthodes qui devraient être employées pour éclairer et évaluer les programmes de développement. Les méthodes expérimentales sont devenues très préconisées dans le cadre de la quête par les organisations de manières rigoureuses de démontrer la valeur de leurs programmes. Cependant, les avantages et le caractère approprié de ces méthodes sont souvent exagérés. Nous utilisons les études sur la qualité de la vie de l'Aga Khan Development Network pour montrer que les approches périodiques basées sur des méthodes mixtes sont utiles pour analyser les contributions des programmes et éclairer le développement des régions. Nous soutenons que les méthodes expérimentales ne devraient pas être idéalisées, et que les questions des recherches et l'apprentissage organisationnel devraient orienter des choix méthodologiques pragmatiques afin d'éclairer les interventions en matière de développement dans les contextes réels.

La unitalla no le queda a todos: seleccionando métodos que informen el desarrollo de áreas

Siempre han existido debates en torno a los métodos que deben usarse para fundamentar los programas de desarrollo y valorarlos. A medida que las agencias han buscado métodos rigurosos para demostrar el valor de sus programas, ciertos métodos experimentales han sido altamente promovidos. Sin embargo, los beneficios y lo apropiado de tales métodos a menudo se ha exagerado. En el presente artículo, los autores utilizan los estudios sobre la Calidad de Vida realizados por la Red de Desarrollo Aga Khan, con el fin de mostrar que los enfoques de métodos mixtos aplicados periódicamente resultan útiles para analizar los aportes de los programas y para potenciar el área de desarrollo. Asimismo, sostienen que no deben idealizarse los métodos experimentales y que las inquietudes de investigación y el aprendizaje organizacional deberán guiar las opciones metodológicas pragmáticas orientadas a fundamentar las acciones de desarrollo en la vida cotidiana.

Um único tamanho não serve para todos: Escolhendo métodos para informar a área de desenvolvimento

Tem havido frequentemente debates sobre os métodos que deveriam ser utilizados para informar e avaliar programas de desenvolvimento. Métodos experimentais têm sido altamente defendidos quando as agências buscam formas rigorosas de mostrar o valor do programa. Porém, os benefícios e adequação destes métodos são frequentemente superestimados. Utilizamos os estudos sobre Qualidade de Vida da Aga Khan Development Network para mostrar que abordagens de métodos mistos periódicos são úteis para analisar as contribuições dos programas e informar o desenvolvimento de área. Argumentamos que métodos experimentais não devem ser idealizados e que questões de pesquisa e aprendizado organizacional devem orientar escolhas metodológicas pragmáticas para fornecer informações à intervenção de desenvolvimento em contextos da vida real.     

Cultivated,caught, and collected: defining culturally appropriate foods in Tallé, Niger

The indigenous plants and fish of Niger are incorporated into the Songhai people's daily life but are largely underemphasised in development programmes. In this paper we describe the culturally appropriate foods of Tallé, Niger. Based on information obtained from 42 participants using interviews and focus groups, we identified 11 commonly consumed fish species, 22 plant species, and nine factors that made them culturally appropriate: taste, perceived health effects, economic value, use as snacks or staple, storability, seasonal availability, use in celebrations, abundance, and cultural identity. We conclude with a discussion of how local knowledge can be incorporated into development programmes.

Cultivés, pêchés et cueillis : définir des aliments culturellement appropriés à Tallé, au Niger

Les plantes et le poisson autochtones du Niger sont incorporés dans le quotidien des Songhais, mais on ne leur accorde généralement pas une attention suffisante dans les programmes de développement. Dans cet article, nous décrivons les aliments culturellement appropriés de Tallé, au Niger. Sur la base d'informations obtenues de 42 participants à l'aide d'entretiens et de groupes de réflexion, nous avons identifié 11 espèces de poisson fréquemment consommées, 22 espèces de plantes et neuf facteurs qui les rendent culturellement appropriés : goût, effets perçus sur la santé, valeur économique, utilisation comme en-cas ou denrées de base, facilité de conservation, disponibilité saisonnière, utilisation lors de célébrations, abondance et identité culturelle. Nous concluons par une discussion sur la manière dont les connaissances locales peuvent être incorporées dans les programmes de développement.

Cultivados, cazados y recolectados: la definición de alimentos culturalmente adecuados en Tallé, Níger

Las plantas y los peces endémicos de Níger han sido incorporados a la dieta cotidiana del pueblo songhai. Sin embargo, dicha dieta recibe escasa atención de parte de los programas de desarrollo. En el presente artículo, los autores analizan aquellos alimentos culturalmente adecuados en Tallé, Níger. Apoyándose en la información recopilada entre 42 personas que participaron en entrevistas y en grupos de enfoque, los autores identificaron 11 variedades de peces consumidas con frecuencia, 22 especies de plantas, así como nueve factores que determinan que estos alimentos sean culturalmente adecuados: sabor, efectos percibidos en la salud, valor económico de los mismos, posibilidad de uso como tentempiés o como alimentos principales, período de almacenamiento, disponibilidad estacional, uso de los mismos en celebraciones, abundancia e identidad cultural. El ensayo concluye realizando un análisis acerca de cómo los conocimientos locales pueden ser incorporados a los programas de desarrollo.

Cultivados, colhidos e coletados: definindo alimentos culturalmente apropriados em Tallé, Níger

As plantas e peixes consumidos pelos indígenas de Níger estão incorporados na vida cotidiana das pessoas de Songhai mas, geralmente, recebem pouco destaque nos programas de desenvolvimento. Neste artigo, descrevemos os alimentos culturalmente apropriados de Tallé, Níger. Com base nas informações obtidas de 42 participantes utilizando entrevistas e grupos de enfoque, identificamos 11 espécies de peixe frequentemente consumidas, 22 espécies de plantas e nove fatores que os tornam culturalmente apropriados: paladar, percepção de seus efeitos na saúde, valor econômico, uso como aperitivo ou alimento básico, armazenagem, disponibilidade sazonal, uso em comemorações, abundância e identidade cultural. Concluímos com uma discussão de como o conhecimento local pode ser incorporado em programas de desenvolvimento.