Background: Program logic is one of the most used tools by the public policy evaluator. There is, however, little explanation in the evaluation literature about the logical foundations of program logic or discussion of how it may be determined if a program is logical. This paper was born on a long journey that started with program logic and ended with the logic of evaluation. Consistent throughout was the idea that the discipline of program evaluation is a pragmatic one, concerned with applied social science and effective action in complex, adaptive systems. It gradually became the central claim of this paper that evidence-based policy requires sound reasoning more urgently than further development and testing of scientific theory. This was difficult to reconcile with the observation that much evaluation was conducted within a scientific paradigm, concerned with the development and testing of various types of theory.
Purpose: This paper demonstrates the benefits of considering the core essence of a program to be a proposition about the value of a course of action. This contrasts with a research-based paradigm in which programs are considered to be a type of theory, and in which experimental and theory-driven evaluations are conducted. Experimental approaches focus on internal validity of knowledge claims about programs and on discovering stable cause and effect relationships—or, colloquially, ‘what works?’. Theory-driven approaches tend to focus on external validity and in the case of the realist approach, the search for transfactual causal mechanisms—extending the ‘what works’ mantra to include ‘for whom and in what circumstances’. On both approaches, evaluation aspires to be a scientific pursuit for obtaining knowledge of general laws of phenomena, or in the case of realists, replicable context-mechanism-outcome configurations. This paper presents and seeks to justify an approach rooted in logic, and that supports anyone to engage in a reasonable and democratic deliberation about the value of a course of action.
It is consistent with systems thinking, complexity and the associated limits to certainty for determining the value of a proposed, or actual, course of action in the social world. It suggests that evaluation should learn from the past and have an eye toward the future, but that it would be most beneficial if concerned with evaluating in the present, in addressing the question ‘is this a good idea here and now?
Findings: In seeking foundations of program logic, this paper exposes roots that extend far deeper than the post-enlightenment, positivist and post-positivist social science search for stable cause and effect relationships. These roots lie in the 4th century BCE with Aristotle’s ‘enthymeme’. The exploration leads to conclusions about the need for a greater focus on logic and reasoning in the design and evaluation of programs and interventions for the public good. Science and research are shown to play a crucial role in providing reasons or warrants to support a claim about the value of a course of action; however, one subordinate to the alpha-discipline of logical evaluation and decision making that must consider what is feasible given the context, capability and capacity available, not to mention values and ethics. Program Design Logic (PDL) is presented as an accessible and incremental innovation that may be used to determine if a program makes sense ‘on paper’ in the design stage as well as ‘in reality’ during delivery. It is based on a configurationalist theory of causality and the concepts of ‘necessary’ and ‘sufficient’ conditions. It is intended to guide deliberation and decision making across the life cycle of any intervention intended for the public good.

After reflecting on the shortcomings of ToC and program logic in practice, the author proposes Program Design Logic (PDL) as an accessible and incremental innovation that may be used to determine if a program makes sense 'on paper' and 'in reality'.

Program logic foundations: Putting the logic back into program logic

theory-of-change-slides-no-q-a

Theory of Change slides - no Q & A

More than a logic model, a Theory of Change is an organization’s “theory”, or story, of how it will make change in the world. A theory explains the group’s beliefs about how change will unfold. It is usually represented visually as an &#8220;outcomes chain&#8221; and is supported by a narrative &#8211; including underlying assumptions and indicators.
In this webinar presentation on Theory of Change on the what, why and hows of theory of change, the Environmental Leadership Programme (ELP) shares more value experience on the subject matter.
<iframe loading="lazy" src="https://player.vimeo.com/video/141917631?dnt=1" width="640" height="400" frameborder="0" allowfullscreen="allowfullscreen"></iframe>

A webinar presentation on Theory of Change on the what, why and hows. This event was organised by The Environmental Leadership Programme (ELP) as a way to share more value experience on the subject matter.

Theory of Change: What is it? Why does it matter? How do I develop one?

theory_of_change_guidance_for_applicants_

A short guide on ToC development from Nesta&#8217;s Centre for Social Action Innovation Fund (CSAIF).

A short guide on ToC development from Nesta's Centre for Social Action Innovation Fund (CSAIF).

Source URL

Attachments theory_of_change_guidance_for_applicants_.pdf