{"id":5762,"date":"2017-05-19T17:22:17","date_gmt":"2017-05-19T17:22:17","guid":{"rendered":"https:\/\/news.nnlm.gov\/neo\/?p=5762"},"modified":"2019-09-24T10:13:28","modified_gmt":"2019-09-24T17:13:28","slug":"the-good-news-about-bad-news","status":"publish","type":"post","link":"https:\/\/news.nnlm.gov\/nec\/2017\/05\/19\/the-good-news-about-bad-news\/","title":{"rendered":"The Good News about Bad News"},"content":{"rendered":"<p style=\"text-align: right\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5765\" src=\"https:\/\/news.nnlm.gov\/neo\/wp-content\/uploads\/sites\/3\/2017\/05\/stockfresh_6104011_pims20100519as0080jpg_sizeS-200x300.jpg\" alt=\"Broken egg in a carton with other eggs, showing how the attention is drawn to negatives.\" width=\"304\" height=\"456\" align=\"right\" hspace=\"10\" srcset=\"https:\/\/news.nnlm.gov\/nec\/wp-content\/uploads\/sites\/3\/2017\/05\/stockfresh_6104011_pims20100519as0080jpg_sizeS-200x300.jpg 200w, https:\/\/news.nnlm.gov\/nec\/wp-content\/uploads\/sites\/3\/2017\/05\/stockfresh_6104011_pims20100519as0080jpg_sizeS.jpg 577w\" sizes=\"auto, (max-width: 304px) 100vw, 304px\" \/><\/p>\n<p>Years ago, I conducted a campus climate assessment for a smallish university. Campus climate assessments are just an academic-fancy word for student satisfaction surveys. Our results were mostly\u00a0positive because, in general, our college students were a happy bunch.<\/p>\n<p>But, even in the Magic Kingdom of College, nothing is perfect.\u00a0 Ratings for the campus computer labs were less than stellar. Which statistic do you think the campus vice presidents wanted to talk about? \u00a0That\u2019s right: that darkish mark on their otherwise pristine record. Specifically, they wanted me to explain <em>why<\/em> students were not completely satisfied with the computer labs.<\/p>\n<p>Of course, I had no idea.\u00a0 We didn\u2019t asked students to <em>explain<\/em> their satisfaction levels.<\/p>\n<p>I learned an important lesson that day: No one has much to say about good news. Don\u2019t get me wrong: positive program metrics rock. They make great sound bites for elevator speeches. Thing is, you can say all that needs to be said in five floors or less.<\/p>\n<p>On the other hand, discussions about negative findings can&#8217;t be resolved in\u00a0a lift to the moon. Everyone wants to know why respondents aren\u2019t happy, don\u2019t learn, won\u2019t engage. Unfortunately, metrics are just facts. They have no meaning without context. If I\u2019m in a windowless office and my phone app tells me the outdoor temperature dropped 15 degrees in the last hour, I know almost nothing. \u00a0I need to tune into the Weather Channel\u00a0or, at least,\u00a0look out a window.<\/p>\n<h3><strong>Learning Opportunity Alert<\/strong><\/h3>\n<p>The good news is, a negative evaluation finding alerts you to a learning opportunity.\u00a0 However, you need to be prepared to capitalize on it. Your evaluation plan should include follow-up discussions with key informants, so you can understand your metrics. Preferably, you prepared to \u00a0talk with a mix of stakeholders. <em>Customers or users<\/em> can explain the <em>why<\/em> behind the findings and provide ideas for improvement. <em>Service providers or program implementers <\/em>can tell you how they might\u00a0act on customer feedback. Key decision makers, such as\u00a0<em>administrators or funders,<\/em> will express their level of concern for findings and provide feedback about their willingness to invest in improvements.<\/p>\n<h3><strong>Be Prepared<\/strong><\/h3>\n<p>If your resources or time is limited, the easiest way to get feedback is through key informant interviews.\u00a0 If you go this route, choose key findings to address and present them in a highly visual manner. You don&#8217;t want to use up valuable interview time forcing your interviewees to process your information. You can send them a more extensive report in advance, but don&#8217;t assume they will read it. Advanced reports should be &#8220;top shelf,&#8221; with distilled findings in bullet points.<\/p>\n<p>Ideally, you can convene discussion groups. You get more varied feedback and groups often generate more creative solutions\u00a0compared to sole interviewees. Plus, you provide more people with an opportunity to engage in your evaluation findings. However, you need careful plans and reliable assistants to systematically collect feedback from larger groups of people\u00a0 Here are some tips for multi-group evaluation discussions:<\/p>\n<ul>\n<li><strong>Develop a structured discussion guide for your small groups.<\/strong> See our <a href=\"https:\/\/news.nnlm.gov\/neo\/2016\/06\/24\/party-guides-for-data-dives\/\">blog article on data parties<\/a> \u00a0or check out the <a href=\"http:\/\/www.liberatingstructures.com\/ls-menu\/\">discussion methods described at the Liberating Structures\u00a0website.<\/a><\/li>\n<li><strong>Carefully select your invitees (your sample).<\/strong> You may want to strategically create groups with different types of stakeholders. \u00a0For example, service providers and users might create awesome brainstorming groups. \u00a0 On the other hand, you want to be careful mixing people of varying statuses.\u00a0 For post hoc discussion on campus climate data, I would think twice about seating\u00a0administrators with service providers, who might not speak freely in front of the &#8220;higher ups.&#8221;<\/li>\n<li><strong>Have a plan for capturing comments.<\/strong> <em>This is critical.<\/em> If possible, have a team of reliable notetakers whose sole function is to take notes and write them up. They need to have good listening and writing skills. They also should be available to you after the meeting to answer questions about the conversations. If you do not have access to a supply of table facilitators, plan for individual table report-backs to the larger group. Record the discussion, if possible.\u00a0 Listen carefully and ask questions.<\/li>\n<li><strong>Validate your findings from the discussion process<\/strong><em>:\u00a0<\/em> If you have notetakers or co-facilitators, ask them to read your final report for accuracy and completion. You can also present findings to others who participated in the discussion. When you are inviting participants, ask a handful if they will commit to reading a summary of the meeting.<\/li>\n<\/ul>\n<p>The challenges in life are where we grow and improve.\u00a0 It is as true for programs as it is for humans.\u00a0 Be prepared to take the advantage of the learning opportunities offered by bad news.<\/p>\n<p>&nbsp;<br \/>\nNote: link updated 9\/21\/2017.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Years ago, I conducted a campus climate assessment for a smallish university. Campus climate assessments are just an academic-fancy word for student satisfaction surveys. Our results were mostly\u00a0positive because, in general, our college students were a happy bunch. But, even in the Magic Kingdom of College, nothing is perfect.\u00a0 Ratings for the campus computer labs&#8230; <a href=\"https:\/\/news.nnlm.gov\/nec\/2017\/05\/19\/the-good-news-about-bad-news\/\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-5762","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-1uW","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5762","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=5762"}],"version-history":[{"count":13,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5762\/revisions"}],"predecessor-version":[{"id":6081,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5762\/revisions\/6081"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=5762"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=5762"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=5762"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}