{"id":2749,"date":"2015-06-05T15:28:22","date_gmt":"2015-06-05T22:28:22","guid":{"rendered":"http:\/\/nnlm.gov\/evaluation\/blog\/?p=2749"},"modified":"2019-09-24T10:10:46","modified_gmt":"2019-09-24T17:10:46","slug":"outputs-are-cool","status":"publish","type":"post","link":"https:\/\/news.nnlm.gov\/nec\/2015\/06\/05\/outputs-are-cool\/","title":{"rendered":"Lesson Learned: Outputs are Cool!"},"content":{"rendered":"<p style=\"text-align: left\"><a href=\"\/neo\/wp-content\/uploads\/sites\/3\/2015\/06\/AEA-Summer-Institute-Logo.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-2765\" src=\"\/neo\/wp-content\/uploads\/sites\/3\/2015\/06\/AEA-Summer-Institute-Logo-300x217.jpg\" alt=\"AEA Summer Institute Logo\" width=\"300\" height=\"217\" align=\"left\" hspace=\"10\" \/><\/a><\/p>\n<p>Cindy Olney and I just returned from the American Evaluation Association Summer Institute in Atlanta, GA. The blog posts for the next couple of months will be filled with lessons learned from the Institute. I am going to start with Outputs, because they were the greatest surprise to me.<\/p>\n<p>In his \u201cIntroduction to Program Evaluation,\u201d Thomas Chapel, Chief Evaluation Officer for the Centers for Disease Control and Prevention, said that he thought outputs were just as important as outcomes. This was quite shocking to me, since it always seemed like outputs were just the way of counting what had been done, and not nearly as interesting as finding out if the desired outcome had happened.<\/p>\n<p>Outputs are the tangible products of the activities that take place in a project. For example, let\u2019s say the project\u2019s goal is to reduce the number of children with Elevated Blood Lead Levels (EBLL) by screening children to identify the ones with EBLL and then referring them to health professionals for medical management. In this brief project description, the activities would be to:<\/p>\n<p style=\"padding-left: 30px\">1) Screen children to identify the ones with EBLL<br \/>\n2) Refer them to health professionals for medical management<\/p>\n<p>If outputs are the tangible products of the activities, they are sometimes thought to be something countable, like \u201cthe number of children screened for EBLL\u201d and \u201cthe number of referrals.\u201d This is how the project manager can ensure that the activities took place that were planned.<\/p>\n<p>However, if you think about the way an activity can take place, you can see that some methods of completing the activities might lead to a successful outcomes, and some might not. A better way of thinking of the outputs might be \u201cwhat would an output look like that would lead to the outcome that we are looking for?\u201d To use \u201creferrals\u201d as an example, let\u2019s say that during the program 100% of the children identified with EBLL were referred to health professionals, but only 30% of them actually followed up and went to a health professional. If the only information you gathered was the number of referrals, you cannot tell why the success rate was so low. Some of the things that could go wrong in a referral is that people are referred to physicians who are not taking more patients, or to physicians who don\u2019t speak the same language as the parents of the child. So you might want to define the referral output as including those factors. The new output measure could be &#8220;the number of referrals to &#8216;qualified&#8217; physicians,&#8221; in which &#8216;qualified&#8217; is defined by the attributes you need to see in the physicians, such as physicians who are taking new patients, or physicians who speak the same language as the family.<\/p>\n<p>The lesson for me is that outputs are as important as outcomes because by thinking carefully about outputs at the beginning of the planning process, you can ensure that the project has the greatest chance of successful outcomes, and by using outputs during process evaluation, you can make any needed corrections in the process as it is happening to ensure the greatest success of the project.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cindy Olney and I just returned from the American Evaluation Association Summer Institute in Atlanta, GA. The blog posts for the next couple of months will be filled with lessons learned from the Institute. I am going to start with Outputs, because they were the greatest surprise to me. In his \u201cIntroduction to Program Evaluation,\u201d&#8230; <a href=\"https:\/\/news.nnlm.gov\/nec\/2015\/06\/05\/outputs-are-cool\/\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-2749","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-Il","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/2749","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=2749"}],"version-history":[{"count":1,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/2749\/revisions"}],"predecessor-version":[{"id":6548,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/2749\/revisions\/6548"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=2749"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=2749"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=2749"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}