{"id":538,"date":"2020-11-24T16:51:52","date_gmt":"2020-11-24T16:51:52","guid":{"rendered":"https:\/\/toolkit.sicanada.org\/?post_type=tool&#038;p=538"},"modified":"2021-07-08T14:12:16","modified_gmt":"2021-07-08T14:12:16","slug":"developing-evaluations-that-are-used","status":"publish","type":"tool","link":"https:\/\/toolkit.sicanada.org\/fr\/tool\/developing-evaluations-that-are-used\/","title":{"rendered":"Developing Evaluations That Are Used"},"content":{"rendered":"<div data-elementor-type=\"wp-post\" data-elementor-id=\"538\" class=\"elementor elementor-538\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-37e07a3c elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"37e07a3c\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-5ab87a72\" data-id=\"5ab87a72\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-d4bd9da elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"d4bd9da\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-981043d\" data-id=\"981043d\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ab1f29c elementor-widget elementor-widget-toggle\" data-id=\"ab1f29c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"toggle.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-toggle\">\n\t\t\t\t\t\t\t<div class=\"elementor-toggle-item\">\n\t\t\t\t\t<div id=\"elementor-tab-title-1791\" class=\"elementor-tab-title\" data-tab=\"1\" role=\"button\" aria-controls=\"elementor-tab-content-1791\" aria-expanded=\"false\">\n\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-toggle-icon elementor-toggle-icon-left\" aria-hidden=\"true\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-toggle-icon-closed\"><i class=\"fas fa-plus\"><\/i><\/span>\n\t\t\t\t\t\t\t\t<span class=\"elementor-toggle-icon-opened\"><i class=\"elementor-toggle-icon-opened fas fa-caret-up\"><\/i><\/span>\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\t\t\t\t<a class=\"elementor-toggle-title\" tabindex=\"0\">Notes pour l'animateur<\/a>\n\t\t\t\t\t<\/div>\n\n\t\t\t\t\t<div id=\"elementor-tab-content-1791\" class=\"elementor-tab-content elementor-clearfix\" data-tab=\"1\" role=\"region\" aria-labelledby=\"elementor-tab-title-1791\"><p><span style=\"font-weight: 400;\"><a href=\"https:\/\/www.tamarackcommunity.ca\/hubfs\/Developing%20Evaluations%20that%20are%20Used%20Tool.pdf?hsCtaTracking=595905c0-9a6e-424e-abff-6ee45d31e134%7C59d234ab-c125-4be2-b269-8821e7cb573b\">The Tamarack Institute<\/a> calls evaluation reality testing: a <\/span><span style=\"font-weight: 400;\">systematic process of testing ideas, <\/span><span style=\"font-weight: 400;\">hunches and beliefs about the nature <\/span><span style=\"font-weight: 400;\">of a challenge and how it might be <\/span><span style=\"font-weight: 400;\">addressed through the use of data and rigorous \u2018sense-making\u2019. <\/span><span style=\"font-weight: 400;\">Most evaluation findings are not used by <\/span><span style=\"font-weight: 400;\">their intended users for their intended use.<\/span><\/p><ul><li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">There are a variety of different factors that affect the uptake of evaluation findings; e.g. interest in findings of evaluation user, evaluability of intervention, skill of the evaluator, political context, etc.<\/span><\/li><li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Research suggests that the \u201cpersonal factor\u201d is the most important: the interest of the evaluation user in the evaluation process and findings, the quality of the evaluator, and the trustful working relationship between the two.<\/span><\/li><li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">The probabilities of getting intended users to use evaluation findings can be improved by embracing a utilization-focused approach.<\/span><\/li><li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">There are many helpful strategies typical of a utilization-focused approach.<\/span><\/li><\/ul><p><b>WHAT DO WE MEAN BY \u201cUSE\u201d?<\/b><\/p><ol><li><b>Instrumental use<\/b><span style=\"font-weight: 400;\"> \u2013 evaluation findings are used to directly inform a decision, improve a program or policy, develop new directions, or contribute to solving a problem \u2013 the findings are linked to some subsequent, identifiable action.<\/span><\/li><li><b>Conceptual use<\/b><span style=\"font-weight: 400;\"> \u2013 when an evaluation influences how key people think about a program or policy and understand it better in some significant way \u2013 but no immediate action or decision flows from the findings.\u00a0<\/span><\/li><li><b>Process use<\/b><span style=\"font-weight: 400;\"> \u2013 when an evaluation encourages people to more fully embrace the process of evaluative thinking, learning, and use of data in making decisions \u2013 but no immediate action or decision flows from the findings.\u00a0<\/span><\/li><li><b> Misuse<\/b><span style=\"font-weight: 400;\"> \u2013 when evaluation users manipulate evaluation data findings or process for some political or self-interested purpose.<\/span><\/li><\/ol><p><b>TYPES OF USES (PURPOSES)<\/b><\/p><ol><li><b>Judgment<\/b><span style=\"font-weight: 400;\"> (Summative) \u2013 to help decision-makers decide whether to sustain, wind-down or expand an intervention.<\/span><\/li><li><b>Learning<\/b><span style=\"font-weight: 400;\"> (Formative) \u2013 improve or refine an intervention.<\/span><\/li><li><b> Accountability<\/b><span style=\"font-weight: 400;\"> \u2013 demonstrate that resources are well-managed, intervention plan followed and results attained.<\/span><\/li><li><b>Monitoring <\/b><span style=\"font-weight: 400;\">\u2013 manage the intervention, routine reporting, early identification problems.<\/span><\/li><li><b>Development<\/b><span style=\"font-weight: 400;\"> \u2013 create or radically adapt an intervention in dynamic conditions.<\/span><\/li><li><b>Knowledge generation<\/b><span style=\"font-weight: 400;\"> \u2013 enhance general understandings and identify generic principles about effectiveness.<\/span><\/li><\/ol><p><strong>Three Critical Questions<\/strong><\/p><ol><li>Primary Intended Users: Who are the primary intended users of the evaluation and what are their major questions?<\/li><li>Primary Intended Use: What is the intended user\u2019s primary intended use of the evaluation findings?<\/li><li>Tailoring Key Features: What are the key features to keep in mind to improve the probability that primary intended users \u201cuse\u201d the evaluation findings (\u2018interpretive lens\u2019, preferences for data and methods, window-of-use)?<\/li><\/ol><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>","protected":false},"featured_media":1146,"template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":""},"categories":[27],"time":[5],"participants":[9],"skill_level":[14],"place":[17],"language":[62],"class_list":["post-538","tool","type-tool","status-publish","has-post-thumbnail","hentry","category-strategic-learning-evaluation","time-1-2-hours","participants-1-5","skill_level-medium","place-in-person","language-en-ca"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Developing Evaluations That Are Used - Social Innovation Unlocked<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/toolkit.sicanada.org\/fr\/tool\/developing-evaluations-that-are-used\/\" \/>\n<meta property=\"og:locale\" content=\"fr_CA\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Developing Evaluations That Are Used - Social Innovation Unlocked\" \/>\n<meta property=\"og:description\" content=\"Facilitator Notes The Tamarack Institute calls evaluation reality testing: a systematic process of testing ideas, hunches and beliefs about the nature of a challenge and how it might be addressed through the use of data and rigorous \u2018sense-making\u2019. Most evaluation findings are not used by their intended users for their intended use. There are a &hellip; Developing Evaluations That Are Used Read More &raquo;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/toolkit.sicanada.org\/fr\/tool\/developing-evaluations-that-are-used\/\" \/>\n<meta property=\"og:site_name\" content=\"Social Innovation Unlocked\" \/>\n<meta property=\"article:modified_time\" content=\"2021-07-08T14:12:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2020\/11\/developing-evaluations-that-are-used.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/\",\"url\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/\",\"name\":\"Developing Evaluations That Are Used - Social Innovation Unlocked\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/toolkit.sicanada.org\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/developing-evaluations-that-are-used.png\",\"datePublished\":\"2020-11-24T16:51:52+00:00\",\"dateModified\":\"2021-07-08T14:12:16+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/#breadcrumb\"},\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/#primaryimage\",\"url\":\"https:\\\/\\\/toolkit.sicanada.org\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/developing-evaluations-that-are-used.png\",\"contentUrl\":\"https:\\\/\\\/toolkit.sicanada.org\\\/wp-content\\\/uploads\\\/2020\\\/11\\\/developing-evaluations-that-are-used.png\",\"width\":1080,\"height\":1080,\"caption\":\"Image of two machine cogs\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/tool\\\/developing-evaluations-that-are-used\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/toolkit.sicanada.org\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Developing Evaluations That Are Used\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#website\",\"url\":\"https:\\\/\\\/toolkit.sicanada.org\\\/\",\"name\":\"Social Innovation Unlocked\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/toolkit.sicanada.org\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#organization\",\"name\":\"Social Innovation Unlocked\",\"url\":\"https:\\\/\\\/toolkit.sicanada.org\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/toolkit.sicanada.org\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/SIUnlocked_Logo.svg\",\"contentUrl\":\"https:\\\/\\\/toolkit.sicanada.org\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/SIUnlocked_Logo.svg\",\"width\":375,\"height\":119,\"caption\":\"Social Innovation Unlocked\"},\"image\":{\"@id\":\"https:\\\/\\\/toolkit.sicanada.org\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Developing Evaluations That Are Used - Social Innovation Unlocked","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/toolkit.sicanada.org\/fr\/tool\/developing-evaluations-that-are-used\/","og_locale":"fr_CA","og_type":"article","og_title":"Developing Evaluations That Are Used - Social Innovation Unlocked","og_description":"Facilitator Notes The Tamarack Institute calls evaluation reality testing: a systematic process of testing ideas, hunches and beliefs about the nature of a challenge and how it might be addressed through the use of data and rigorous \u2018sense-making\u2019. Most evaluation findings are not used by their intended users for their intended use. There are a &hellip; Developing Evaluations That Are Used Read More &raquo;","og_url":"https:\/\/toolkit.sicanada.org\/fr\/tool\/developing-evaluations-that-are-used\/","og_site_name":"Social Innovation Unlocked","article_modified_time":"2021-07-08T14:12:16+00:00","og_image":[{"width":1080,"height":1080,"url":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2020\/11\/developing-evaluations-that-are-used.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/","url":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/","name":"Developing Evaluations That Are Used - Social Innovation Unlocked","isPartOf":{"@id":"https:\/\/toolkit.sicanada.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/#primaryimage"},"image":{"@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/#primaryimage"},"thumbnailUrl":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2020\/11\/developing-evaluations-that-are-used.png","datePublished":"2020-11-24T16:51:52+00:00","dateModified":"2021-07-08T14:12:16+00:00","breadcrumb":{"@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/#breadcrumb"},"inLanguage":"fr-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/"]}]},{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/#primaryimage","url":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2020\/11\/developing-evaluations-that-are-used.png","contentUrl":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2020\/11\/developing-evaluations-that-are-used.png","width":1080,"height":1080,"caption":"Image of two machine cogs"},{"@type":"BreadcrumbList","@id":"https:\/\/toolkit.sicanada.org\/tool\/developing-evaluations-that-are-used\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/toolkit.sicanada.org\/"},{"@type":"ListItem","position":2,"name":"Developing Evaluations That Are Used"}]},{"@type":"WebSite","@id":"https:\/\/toolkit.sicanada.org\/#website","url":"https:\/\/toolkit.sicanada.org\/","name":"Social Innovation Unlocked","description":"","publisher":{"@id":"https:\/\/toolkit.sicanada.org\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/toolkit.sicanada.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-CA"},{"@type":"Organization","@id":"https:\/\/toolkit.sicanada.org\/#organization","name":"Social Innovation Unlocked","url":"https:\/\/toolkit.sicanada.org\/","logo":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/toolkit.sicanada.org\/#\/schema\/logo\/image\/","url":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2021\/02\/SIUnlocked_Logo.svg","contentUrl":"https:\/\/toolkit.sicanada.org\/wp-content\/uploads\/2021\/02\/SIUnlocked_Logo.svg","width":375,"height":119,"caption":"Social Innovation Unlocked"},"image":{"@id":"https:\/\/toolkit.sicanada.org\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/tool\/538","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/tool"}],"about":[{"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/types\/tool"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/media\/1146"}],"wp:attachment":[{"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/media?parent=538"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/categories?post=538"},{"taxonomy":"time","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/time?post=538"},{"taxonomy":"participants","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/participants?post=538"},{"taxonomy":"skill_level","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/skill_level?post=538"},{"taxonomy":"place","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/place?post=538"},{"taxonomy":"language","embeddable":true,"href":"https:\/\/toolkit.sicanada.org\/fr\/wp-json\/wp\/v2\/language?post=538"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}