Abstract
Evaluating participatory decision processes serves two key purposes: validating the usefulness of specific interventions for stakeholders, interveners and funders of conflict management processes, and improving practice. However, evaluation design remains challenging, partly because when attempting to serve both purposes we may end up serving neither well. In fact, the better we respond to one, the less we may satisfy the other. Evaluations tend to focus on endogenous factors (e.g., stakeholder selection, BATNAs, mutually beneficial tradeoffs, quality of the intervention, etc.), because we believe that the success of participatory decision processes hinges on them, and they also seem to lend themselves to caeteris paribus statistical comparisons across cases. We argue that context matters too and that contextual differences among specific cases are meaningful enough to undermine conclusions derived solely from comparisons of process-endogenous factors implicitly rooted in the caeteris paribus assumption. We illustrate this argument with an environmental mediation case. We compare data collected about it through surveys geared toward comparability across cases to information elicited through in-depth interviews geared toward case specifics. The surveys, designed by the U.S. Institute of Environmental Conflict Resolution, feed a database of environmental conflicts that can help make the (statistical) case for intervention in environmental conflict management. Our interviews elicit case details - including context - that enable interveners to link context specifics and intervention actions to outcomes. We argue that neither approach can "serve both masters.".
Original language | American English |
---|---|
Pages (from-to) | 11-20 |
Number of pages | 10 |
Journal | Evaluation and Program Planning |
Volume | 42 |
DOIs | |
State | Published - Feb 2014 |
Keywords
- Environmental conflicts
- Evaluation instruments
- Intervention practice
- Participatory decision processes
All Science Journal Classification (ASJC) codes
- Public Health, Environmental and Occupational Health
- Geography, Planning and Development
- Social Psychology
- Business and International Management
- Strategy and Management