tbae-aeat-eng

<p>Over the last 20 years, theory-based approaches—under various names ― have increasingly moved into the mainstream of thinking and practice about how interventions (i.e., programs, policies, initiatives or projects) are designed, described, measured and evaluated. During that time, theory-based approaches have demonstrated promise in helping evaluators address a variety of challenges, such as coming to terms with the inherent complexity of certain types of interventions and overcoming the limitations of experimental evaluation designs.</p>
<p>To help ensure that evaluation continues to play a key role in providing a neutral, evidence-based assessment of the value for money (i.e., relevance and performance) of federal government programs, the Treasury Board of Canada Secretariat recognizes the importance of expanding the “tool box” available to federal evaluators. Theory-based approaches to evaluation represent a potentially powerful tool.</p>


<p>This document introduces some of the key concepts of theory-based approaches to evaluation.</p>


Theory-based approaches to evaluation: Concepts and practices

ccvri-dfid-practical-approaches-to-theories-of-change

CCVRI-DFID-Practical-approaches-to-theories-of-change

theories-of-change-part-1-final-30mar13

theories of change part 1 Final (30MAR13)

<p>This is a two-part series on practical approaches to theories of change in conflict, security and justice programmes.</p>
<p>Part I first explores the fundamentals of theories of change: what they are, why they are important, and how to create a theory of change. It explores theories of change at different levels, and concludes with advice on how theories of change can enhance the effectiveness and relevance of programming.</p>
<p>Part II continues to build upon Part I by focusing on how theories of change can be used in the monitoring and evaluation stages of the project cycle. It provides practical guidance on how and why to use theories of change-focused monitoring and evaluation strategies, particularly exploring the ways in which theories of change can be included in any evaluation approach.</p>
<h2>Key questions this document addresses</h2>
<ul>
<li>Why are Theories of Change important in evaluating programmes and projects?</li>
<li>How can Theories of Change be used in Monitoring and Evaluation?</li>
<li>How can Theories of Change be used to generate programme and project indicators?</li>
<li>What are the limitations of Theories of Change and how can they be overcome?</li>
</ul>
<h2>Key messages/essential “take aways”</h2>
<ul>
<li>Using theories of change during the monitoring stage of project implementation provides feedback on whether a project, programme or strategy is ‘on track’ to accomplish the desired change and if the environment is evolving as anticipated in the project or programme design.</li>
<li>The power of using theories of change is not only important in monitoring but also in evaluation. Using theories of change during the evaluation enables evaluators to ask hard questions about why certain changes are expected, the assumptions of how the change process unfolds, and which outcomes are being selected to focus on and why.</li>
<li>Developing and explicitly articulating multiple levels of theories of change allows for a greater efficiency in evaluation and identifying problems and successes.</li>
<li>The process of monitoring our assumptions and theories of change is the same as traditional monitoring of output and performance indicators: it involves an iterative cycle of regular data collection, analysis, reflection, feedback and action. The only thing that changes is what you are monitoring.</li>
<li>Theory-based Evaluation helps assess whether underlying theories of change or assumptions of a programme are correct by identifying the causal linkages between different variables: from inputs to expected results. In a broad definition, any evaluation uncovering implicit or explicit assumptions, hypotheses or theories can be categorized as theory-based evaluation. This approach is particularly useful for learning and accountability as it allows for identifying whether the success, failure or mixed results of the intervention was due to programme theories and assumptions, or implementation.</li>
<li>Theories of change are not a solve-all panacea for challenges in design, monitoring and evaluation for conflict, crime and violence initiatives: they must be used in conjunction with other tools and concepts.</li>
<li>Theories of change are more than simple ‘if-then’ statements. As testable hypotheses, we need theories of change to be as reflective of the actual environment as possible without overly complicating the situation. Clearly defining the boundaries of the theory and its assumptions is critical.</li>
</ul>


<p>This is a two-part series on practical approaches to theories of change in conflict, security and justice programmes.</p>


Practical approaches to Theories of Change in conflict, security, and justice programmes: Using Theories of Change in monitoring and evaluation

<p>This article presents a theory of change approach to planning educational reform initiatives with a focus on district level efforts. Using examples from ongoing consulting work with urban school districts, we walk through steps in a planning process that can yield a theory of change that meets 4 criteria: plausible, doable, testable, and meaningful. The benefits of this planning approach for evaluation and implementation of district level educational reform are also discussed. We conclude with implications of this approach for educational and psychological consultants working with educational reform initiatives.</p>


<p>This article presents a Theory of Change approach to planning educational reform initiatives with a focus on district level efforts.</p>
