{"id":5853,"date":"2017-07-14T15:41:48","date_gmt":"2017-07-14T22:41:48","guid":{"rendered":"https:\/\/news.nnlm.gov\/neo\/?p=5853"},"modified":"2019-09-24T10:13:28","modified_gmt":"2019-09-24T17:13:28","slug":"elegantly-simple-evaluation-the-engage-for-health-prepost-assessment","status":"publish","type":"post","link":"https:\/\/news.nnlm.gov\/nec\/2017\/07\/14\/elegantly-simple-evaluation-the-engage-for-health-prepost-assessment\/","title":{"rendered":"Elegantly Simple Evaluation: The <i>Engage for Health <\/i> Pre\/Post Assessment"},"content":{"rendered":"<p style=\"text-align: left\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5856\" src=\"https:\/\/news.nnlm.gov\/neo\/wp-content\/uploads\/sites\/3\/2017\/07\/engageforhealth_logo_small.jpg\" alt=\"Two converging conversaton bubbles that say engage for health\" width=\"337\" height=\"269\" align=\"left\" hspace=\"10\" \/><\/p>\n<p>I wrote a post in May 2016 about a <a href=\"https:\/\/news.nnlm.gov\/neo\/2016\/05\/06\/data-party-for-public-librarians\/\">participatory evaluation<\/a> conducted with a group of public librarians from the <a href=\"https:\/\/nnlm.gov\/mar\/guides\/engageforhealth\"><em>Engage for Health<\/em><\/a>\u00a0program, a statewide collaboration led by the NNLM Middle Atlantic Region (MAR) and the Pennsylvania Library Association (PaLA). \u00a0This was a community education program, offered by 17 libraries throughout Pennsylvania, which taught community members how to take an active role in their own health care. The training sessions introduced them to the National Library of Medicine&#8217;s <a href=\"https:\/\/medlineplus.gov\/\"><em>MedlinePlus<\/em><\/a> and presented techniques for \u00a0managing their health issues. \u00a0The NNLM MAR recently published a web page providing access to all\u00a0<a href=\"https:\/\/nnlm.gov\/mar\/guides\/engageforhealth\"><em>Engage for Health<\/em>\u00a0materials<\/a>, which include a Word version of the <a href=\"https:\/\/nnlm.gov\/sites\/default\/files\/mar\/files\/Engage_for%20Health_Evaluation_Form.doc\">pre\/post assessment\u00a0form<\/a>\u00a0used to assess the program outcomes. The <em>Engage for Health<\/em> evaluation form is the topic for today&#8217;s blog post.<\/p>\n<p>The form itself is short and simple, but was carefully crafted with significant input from the \u00a0<em>Engage for Health<\/em> librarians. It is a pre\/post assessment form, completed by 88% of the training participants. Below are some highlights of the <em>Engage for Health<\/em> assessment method \u00a0that I think are particularly noteworthy.<\/p>\n<p><em><strong>It was developed directly from the program logic model.<\/strong> \u00a0<\/em>The <em>Engage for Health<\/em>\u00a0librarians developed a logic model to identify the positive changes they hoped to see in participants who enrolled in the sessions. \u00a0Specifically, the librarians said their participants ideally would report, at the end of training, that they knew how to find trustworthy online health information and that they intended to implement health management strategies introduced in the session. (If you aren\u2019t familiar with logic models, here\u2019s a list of <a href=\"https:\/\/news.nnlm.gov\/neo\/category\/logic-models\">NEO Shop Talk logic model posts<\/a> about the topic.) As you can see, \u00a0the questions on page 2 of the evaluation form directly relate to these outcomes.<\/p>\n<p><em><strong>The pre-assessment information allowed a more valid interpretation of the post-session findings. <\/strong><\/em>The questions on the first page of the form (the pre-assessment page) allowed us to get a baseline measure of participants&#8217; engagement in their own health care. We learned two very important things about the participants from our preliminary assessment. \u00a0First, they were highly motivated to manage their health. Yes, one would assume that a class like ours would attract participants already engaged in their own health care. However, we <em>documented<\/em> that assumption and the information affected how we interpreted the post-assessment findings. \u00a0Furthermore, the majority said our class improved their health management skills, so the program did offer this health-savvy group some valuable new techniques. \u00a0 Second, we discovered that almost none of the participants had never used MedlinePlus before attending the class. We knew, therefore, that most of the 70% who said they intended to use MedlinePlus were new adopters of the resource.<\/p>\n<p><strong><em>The assessment form doubled as a good teaching tool<\/em>. \u00a0<\/strong>The pre-assessment form primed the participants for the information to be presented in the class. They reflected on how they managed their health appointments and the form&#8217;s mention of <em>MedlinePlus<\/em> peaked their interest in a resource that most of them had never used. \u00a0 The post-assessment engaged them in reviewing and reflecting on the main points of the training. \u00a0One open-ended question asked them to \u00a0&#8220;List one or two things you will do differently as a result of today&#8217;s class,&#8221; reinforcing in their memories \u00a0a couple of the strategies that resonated with them.<\/p>\n<p><em>T<strong>he pre\/post assessment allowed anonymity<\/strong><\/em><strong>.<\/strong>\u00a0Pre\/post assessments have the advantage of showing changes in individuals over time, but they often require participant names or identifiers to match data across time periods. \u00a0By printing the pre-assessment and post-assessment forms on two sides of a single sheet of paper, we did not need participant identifiers and, therefore, could protect anonymity. This increased the likelihood that our participants would \u00a0provide candid answers to our questions. (If you want to use this anonymous method, be sure to read the <a href=\"https:\/\/nnlm.gov\/sites\/default\/files\/mar\/files\/Engage_for_Health_Evaluation_Form_Instructions.pdf\"><em>Engage for Health Pre\/Post Evaluation Instructions<\/em><\/a>.<\/p>\n<p>There is always room for improvement in any evaluation method, and the \u00a0<em>Engage for Health<\/em>\u00a0librarians identified changes they would make to the first version of the assessment form. For example, a few eyebrows were raised over the 45% of participants who said they could easily find online health information. The <em>Engage for Health<\/em> librarians suspected that participants were using search engines like Google and probably turning up health information from sketchy sources. They suggested that future assessment forms ask participants where they got their health information.<\/p>\n<p>Overall, this pre\/post assessment method was a hit with the <em>Engage for Health<\/em> public librarians. \u00a0In our data party discussions, \u00a0many said they planned to adapt the method to evaluate other programs offered in their libraries. That was an<em> Engage for Health<\/em> evaluation finding I particularly liked!<\/p>\n<p>About <em>Elegantly Simple Evaluation<\/em> posts: The NEO Shop Talk uses this series to feature simple evaluations that produce highly useful information. \u00a0We are particularly interested in projects that promote health information literacy, library programs, or outreach related to National Library of Medicine resources. \u00a0If you have a project to recommend for a future blog post, please send an email to nnlmneo@uw.edu.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I wrote a post in May 2016 about a participatory evaluation conducted with a group of public librarians from the Engage for Health\u00a0program, a statewide collaboration led by the NNLM Middle Atlantic Region (MAR) and the Pennsylvania Library Association (PaLA). \u00a0This was a community education program, offered by 17 libraries throughout Pennsylvania, which taught community&#8230; <a href=\"https:\/\/news.nnlm.gov\/nec\/2017\/07\/14\/elegantly-simple-evaluation-the-engage-for-health-prepost-assessment\/\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-5853","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-1wp","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5853","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=5853"}],"version-history":[{"count":17,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5853\/revisions"}],"predecessor-version":[{"id":6440,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5853\/revisions\/6440"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=5853"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=5853"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=5853"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}