{"id":176,"date":"2017-03-01T20:04:18","date_gmt":"2017-03-01T20:04:18","guid":{"rendered":"http:\/\/torontoevaluation.ca\/centre\/?page_id=176"},"modified":"2017-03-01T20:04:29","modified_gmt":"2017-03-01T20:04:29","slug":"steps-7-8","status":"publish","type":"page","link":"https:\/\/torontoevaluation.ca\/centre\/?page_id=176","title":{"rendered":"Steps 7-8"},"content":{"rendered":"<h1 class=\"heading2\"><strong>Impacts and Learning (Steps 7 .. 8 .. )<\/strong><\/h1>\n<table border=\"0\" width=\"100%\" cellspacing=\"0\" cellpadding=\"5\" align=\"center\">\n<tbody>\n<tr>\n<td>\n<table border=\"0\" width=\"946px\" cellspacing=\"0\" cellpadding=\"0\" align=\"center\">\n<tbody>\n<tr>\n<td colspan=\"2\">\n<table border=\"0\" width=\"950\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td class=\"heading2\" valign=\"top\">\n<table border=\"0\" width=\"100%\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td class=\"heading4\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/info-boxes\/965-step07.gif\" width=\"965\" height=\"65\" \/><\/td>\n<\/tr>\n<tr>\n<td>\n<table border=\"0\" width=\"100%\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td width=\"1%\"><\/td>\n<td width=\"98%\">A fundamental step in the evaluation is developing a design that includes methods and measures to understand if an intervention is \u201cworking\u201d as intended. This implies:\u00a0 (i) understanding what successful impact means for an intervention; (ii) developing clarity on the timeline of impact, (iii) developing clear measures\u00a0 that can be used to study progress;\u00a0 (iv) the measures need to be informed by the theory of change of the intervention, that is, the results expected to occur and the related mechanisms; (v) the measurement system should include a focus on the dynamic contexts and mechanisms that might be necessary for the interventions to work; (vi) an evaluation design informed by the program theory that can help rule out alternative explanations for changes in key outcomes.\u00a0<a href=\"https:\/\/torontoevaluation.ca\/centre\/?page_id=166\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/back_%20green_arrow_icon-small.jpg\" alt=\"Back to the ten steps main page\" width=\"100\" height=\"67\" align=\"left\" border=\"0\" \/><\/a><\/td>\n<td width=\"1%\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/info-boxes\/965-bottom.gif\" width=\"965\" height=\"37\" \/><\/td>\n<\/tr>\n<tr>\n<td class=\"heading4\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/info-boxes\/965-step08.gif\" width=\"965\" height=\"65\" \/><\/td>\n<\/tr>\n<tr>\n<td>\n<table border=\"0\" width=\"100%\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td width=\"1%\"><\/td>\n<td width=\"98%\">Learning about the theory of change of the intervention over the course of implementation is key in the evaluation.\u00a0 Given the nonlinear nature of some interventions, there are likely to be many \u201csurprises\u201d in the processes by which interventions impact outcomes.\u00a0 An emergent theory of change needs to reflect on the processes by which complex interventions can impact the public good.\u00a0 Some points to consider in developing an emergent theory of change include: <strong>\u00a0(i) <\/strong>pay close attention to the\u00a0 unintended consequences of an intervention; (ii)\u00a0 both the \u201cmacro\u201d social processes and the \u201cmicro\u201d individual level contexts that are essential for the impacts of the intervention need to be considered; (iii)\u00a0 the systems dynamics inherent in the process of change;\u00a0 (iv) the networks that were critical in creating an optimal context for impacts; (v) key events in the course of implementation that were important for the impact of the intervention.\u00a0 A wide variety of methodologies are available to explicate the emergent theories of change.<a href=\"https:\/\/torontoevaluation.ca\/centre\/?page_id=166\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/back_%20green_arrow_icon-small.jpg\" alt=\"Back to the ten steps main page\" width=\"100\" height=\"67\" align=\"left\" border=\"0\" \/><\/a><\/td>\n<td width=\"1%\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.torontoevaluation.ca\/evaluatingcomplexity\/images\/info-boxes\/965-bottom.gif\" width=\"965\" height=\"37\" \/><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td valign=\"top\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>Impacts and Learning (Steps 7 .. 8 .. ) A fundamental step in the evaluation is developing a design that includes methods and measures to understand if an intervention is \u201cworking\u201d as intended. This implies:\u00a0 (i) understanding what successful impact means for an intervention; (ii) developing clarity on the timeline of impact, (iii) developing clear &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/torontoevaluation.ca\/centre\/?page_id=176\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Steps 7-8&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":166,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"_links":{"self":[{"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/pages\/176"}],"collection":[{"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=176"}],"version-history":[{"count":1,"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/pages\/176\/revisions"}],"predecessor-version":[{"id":177,"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/pages\/176\/revisions\/177"}],"up":[{"embeddable":true,"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=\/wp\/v2\/pages\/166"}],"wp:attachment":[{"href":"https:\/\/torontoevaluation.ca\/centre\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}