{"id":6039,"date":"2017-09-15T14:29:06","date_gmt":"2017-09-15T21:29:06","guid":{"rendered":"https:\/\/news.nnlm.gov\/neo\/?p=6039"},"modified":"2019-09-24T10:10:43","modified_gmt":"2019-09-24T17:10:43","slug":"results-based-accountability-and-outcomes-based-evaluation-same-thing","status":"publish","type":"post","link":"https:\/\/news.nnlm.gov\/nec\/2017\/09\/15\/results-based-accountability-and-outcomes-based-evaluation-same-thing\/","title":{"rendered":"Results-Based Accountability and Outcomes-Based Evaluation: Same Thing?"},"content":{"rendered":"<p><a href=\"https:\/\/news.nnlm.gov\/neo\/wp-content\/uploads\/sites\/3\/2017\/09\/line-graph.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-6044\" src=\"https:\/\/news.nnlm.gov\/neo\/wp-content\/uploads\/sites\/3\/2017\/09\/line-graph-300x212.jpg\" alt=\"Green line graph\" width=\"300\" height=\"212\" srcset=\"https:\/\/news.nnlm.gov\/nec\/wp-content\/uploads\/sites\/3\/2017\/09\/line-graph-300x212.jpg 300w, https:\/\/news.nnlm.gov\/nec\/wp-content\/uploads\/sites\/3\/2017\/09\/line-graph-768x543.jpg 768w, https:\/\/news.nnlm.gov\/nec\/wp-content\/uploads\/sites\/3\/2017\/09\/line-graph.jpg 841w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>We are currently working with performance measures and indicators in assessing the programs of the NNLM. As a starting point, we&#8217;ve looked to the <a href=\"https:\/\/forteresearch.com\/news\/ctsa-common-metrics-and-how-to-track-them\/\" target=\"_blank\" rel=\"noopener noreferrer\">Common Metrics Initiative<\/a> being used by Clinical and Translational Science Award (CTSA) institutions. \u00a0CTSA institutions vary widely in their projects, but they\u00a0are using a set of common metrics to demonstrate\u00a0measurable improvements towards advancing translational research and workforce development.<\/p>\n<p>The Common Metrics Initiative is based on the Results-Based Accountability (RBA) Framework. \u00a0A guide to understanding this concept is on the Illinois Department of Human Services website: <a href=\"http:\/\/www.dhs.state.il.us\/OneNetLibrary\/27896\/documents\/By_Division\/DCHP\/RFP\/RBAGuide.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">The Results-Based Accountability Guide<\/a>. This was my first encounter with Results-Based Accountability. While it has a lot in common with the outcomes-based evaluation, it has some additional facets.<\/p>\n<p>One thing they have in common is that the first thing you do is start at the end &#8211; the change you want to see &#8211; and then work backwards to the activities. \u00a0However in RBA, one interesting distinction is whether or not the &#8220;end&#8221; change was &#8220;population accountability&#8221; or &#8220;performance accountability.&#8221; \u00a0Population accountability is used if the desired end is to improve the quality of life for a population. \u00a0Performance accountability is if the desired end concerns how well a program, agency or service system is performing.<\/p>\n<p>In the vocabulary of RBA, the metrics used for &#8220;population accountability&#8221; are called indicators, and they are what you would measure to show the changes you want to see in a population. \u00a0At this point, I&#8217;m thinking &#8220;aha, population accountability is like outcomes evaluation, and performance accountability is like process evaluation.&#8221;<\/p>\n<p>But not so fast. According to the RBA framework, in performance accountability, the metrics are called performance measures, and they show how well your program is performing. \u00a0Here&#8217;s where it&#8217;s different from process evaluation. \u00a0In performance accountability, there are three kinds of performance measures:<\/p>\n<ul>\n<li>How much are we doing?<\/li>\n<li>How well are we doing it?<\/li>\n<li>Is anyone better off?<\/li>\n<\/ul>\n<p>Ultimately that last kind of performance measure, &#8220;is anyone better off,&#8221; is what we would have called an outcome measure. \u00a0But in terms of the RBA&#8217;s performance accountability, the focus is whether or not the program is doing what it needs to to ensure that someone is better off. \u00a0Performance accountability includes outcomes in its understanding of the degree to which a program has been performed successfully.<\/p>\n<p>There is a lot more than this to the process of Results-Based Accountability. In fact, I feel a little guilty leaving it at this. \u00a0However, you can read the guide for yourself. \u00a0If we use any of the processes they recommend, we will be sure to share how they work here in the <em>Shop Talk.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are currently working with performance measures and indicators in assessing the programs of the NNLM. As a starting point, we&#8217;ve looked to the Common Metrics Initiative being used by Clinical and Translational Science Award (CTSA) institutions. \u00a0CTSA institutions vary widely in their projects, but they\u00a0are using a set of common metrics to demonstrate\u00a0measurable improvements&#8230; <a href=\"https:\/\/news.nnlm.gov\/nec\/2017\/09\/15\/results-based-accountability-and-outcomes-based-evaluation-same-thing\/\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-6039","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-1zp","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/6039","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=6039"}],"version-history":[{"count":7,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/6039\/revisions"}],"predecessor-version":[{"id":6501,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/6039\/revisions\/6501"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=6039"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=6039"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=6039"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}