{"id":4893,"date":"2016-10-28T14:38:09","date_gmt":"2016-10-28T21:38:09","guid":{"rendered":"https:\/\/nnlm.gov\/evaluation\/blog\/?p=4893"},"modified":"2019-09-24T10:13:28","modified_gmt":"2019-09-24T17:13:28","slug":"how-i-learned-to-stop-worrying-and-love-logic-models","status":"publish","type":"post","link":"https:\/\/news.nnlm.gov\/nec\/2016\/10\/28\/how-i-learned-to-stop-worrying-and-love-logic-models\/","title":{"rendered":"How I Learned to Stop Worrying and Love Logic Models (The Chili Lesson)"},"content":{"rendered":"<p style=\"text-align: left\"><a href=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/Michelle.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-4895 size-medium\" src=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/Michelle-225x300.jpg\" alt=\"Picture of Michelle Malizia\" width=\"225\" height=\"300\" align=\"left\" hspace=\"10\" \/><\/a><\/p>\n<p><strong>By Michelle Malizia,\u00a0Director of Library Services for the Health Sciences, University of Houston<\/strong><\/p>\n<p>I\u2019ll start with a full disclosure: I am a late convert to logic models. Many years ago, I worked in a department that, for a period of time, became governed by logic models. This experience made me fear\u2026 no, hate\u2026 logic models.\u00a0 Several years later, through external workshops and assistance from the NN\/LM Evaluation Office, I was introduced to the tremendous value of logic models.<\/p>\n<p>My closest personal analogy relates to my feelings about chili. I grew up eating my mother\u2019s chili, which basically consisted of cans of many different types of beans floating in a type of broth. I hated it. When I was 22 years old, I had no choice but to eat someone else\u2019s chili. This chili had lots of ground beef and spices. It was delicious. Then it occurred to me, my mother\u2019s chili was my only frame of reference for chili. I didn\u2019t dislike chili &#8211; I disliked <em>my mother\u2019s <\/em>chili.<\/p>\n<p>And so it goes with logic models. Once I learned a different way to make and apply them, I became a dedicated user. I now design logic models whenever I plan a new service, activity or initiative.<\/p>\n<p>In 2014, I was hired as the Director of Library Services for the Health Sciences at the University of Houston (UH). In 2017, UH will have its first medical library and my task is to plan the services for the new facility. Of course, I turned to logic models because they provided the framework of not only what I am planning but why I am planning each service and ultimately, how I will evaluate if I achieved the goal.<\/p>\n<p>When I started with my logic models, I was tempted to begin with the activity. I had to remind myself that it is more important to document what I hope to accomplish by that activity (i.e. outcome).\u00a0 Think about it: Why do librarians teach PubMed classes? Why do librarians want to be embedded in a nursing class? Why do so many libraries provide liaison services? Many of you are probably thinking: \u201cThat\u2019s easy, Michelle. We do those things to better serve our customers.\u201d My response is:\u00a0 How do you know those activities better serve your customers?\u00a0 How can you prove it to your stakeholders?\u00a0 That is the reason you should start with your outcomes rather than activities.<\/p>\n<p>For example, my new library will be providing assistance with NIH Public Access Policy compliance. When I developed my logic model, I called upon my inner 3-year old to ask the question best asked by toddlers:\u00a0 Why.\u00a0 Because I have a creative side, I use the software Visio (a Microsoft Office software) to create my logic models. It allows me to visually see connections between activities. The chart below shows \u00a0a portion of my logic model.<\/p>\n<p style=\"text-align: center\"><a href=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/10.28.16-NIH-Public-Policy-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-4894\" src=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/10.28.16-NIH-Public-Policy-1-300x140.jpg\" alt=\"NIH Public Access Policy Assistance Services logic Model One. Activities are conduct workshops and assistance with compliance. Outputs are number of workshops and number of consultations. Short-term outcomes are increase awareness of NIH Public Access Policy and increased knowledge of compliance specifics. Intermediate outcome is compliance and long-term outcome is UH retains and receives NIH grants.\" width=\"718\" height=\"335\" align=\"middle\" hspace=\"10\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>As you can see, my long-term outcome for this activity was to ensure that UH retains and receives NIH Grants. If UH researchers don\u2019t comply with the NIH Public Access Policy mandate, their current and future funding is in jeopardy. The intermediate outcome leading to the long-term outcome is increased compliance with the policy. In order to increase compliance, I need to make researchers aware of the policy and how to comply.\u00a0 That\u2019s when I was able to determine the best methods for me to accomplish those outcomes. For my university environment, the best way to achieve these outcomes is through workshops and consultations.<\/p>\n<p>Now that I knew the \u201cwhat and the why,\u201d I needed to determine the how.\u00a0 How would I know if I accomplished my goals? Again, I turned to Visio to visualize how I could assess if I achieved my outcomes.<\/p>\n<p>My final step was to determine my measurable indicators. For example, in the case of workshops, my indicator was \u201c% of workshop attendees who reported being more\u00a0knowledgeable about how to comply with the policy.\u201d\u00a0 My target was 85% of attendees. To evaluate this outcome, I would use a pre- and post-test.<\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center\"><a href=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/10.28-Logic-model-2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-4896\" src=\"\/neo\/wp-content\/uploads\/sites\/3\/2016\/10\/10.28-Logic-model-2-300x160.jpg\" alt=\"Evaluation plan for NIH Public Access Policy Assistance Services. Outputs are workshops and consultations, leading to short-term outcomes of increased awareness of NIH Public Access policy and increased knowledge of compliance specifics. The outcomes will be assessed with a pre-post test and follow-up questionnaire. The intermediate outcome is increased compliance, which will be assessed with a survey and\/or other follow-up\" width=\"684\" height=\"365\" align=\"middle\" hspace=\"10\" \/><\/a><\/p>\n<p>My overall work with logic models led to a pleasant surprise. Mid-way through my process, UH Libraries adopted a new strategic plan. Strategic plans are usually written in terms of goals. Some of my colleagues tried to feverishly determine where their activities fit into the library\u2019s overall goals. Because I had already determined my outcomes, it was easy to slot my activities into the library\u2019s overall plan.<\/p>\n<p>If you have had a previous bad experience creating logic models, try it again. Ask the NEO for assistance and look at their extremely helpful guides. Like me, you may finally realize that logic models are worth the time and energy. Remember, there are many different types of chili.\u00a0 Find the one that you like best.<\/p>\n<p><strong><em>NEO note<\/em><\/strong><em>: <\/em>The evaluation field has come a long way in discovering new, less painful approaches to creating and using logic models. \u00a0If, like Michelle, you had bad experiences years ago with logic models, you might want to give them another chance.<em>\u00a0<\/em>\u00a0You can learn one approach through the NEO booklet Michelle mentioned, which is \u00a0<a href=\"https:\/\/nnlm.gov\/sites\/default\/files\/migrated\/file\/e2553b8cc617dca02eb4fa043fefe320.pdf\"><em>Planning Outcomes-Based Projects<\/em><\/a> (Booklet 3 in our <em>Planning and Evaluating Health Information Outreach Programs<\/em> series). For alternative approaches, check out our NEO Shop Talk blog entries \u00a0<a href=\"https:\/\/nnlm.gov\/evaluation\/blog\/2016\/02\/04\/logic-model-for-a-birthday-party\/\">Logic Model for a Birthday Party<\/a> and <a href=\"https:\/\/nnlm.gov\/evaluation\/blog\/2015\/04\/10\/tearless-logic-models\/\">An Easier Way to Plan: Tearless Logic Models<\/a>.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Michelle Malizia,\u00a0Director of Library Services for the Health Sciences, University of Houston I\u2019ll start with a full disclosure: I am a late convert to logic models. Many years ago, I worked in a department that, for a period of time, became governed by logic models. This experience made me fear\u2026 no, hate\u2026 logic models.\u00a0&#8230; <a href=\"https:\/\/news.nnlm.gov\/nec\/2016\/10\/28\/how-i-learned-to-stop-worrying-and-love-logic-models\/\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-4893","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-1gV","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/4893","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=4893"}],"version-history":[{"count":1,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/4893\/revisions"}],"predecessor-version":[{"id":6454,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/4893\/revisions\/6454"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=4893"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=4893"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=4893"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}