![\"Cindy](\"https:\/\/news.nnlm.gov\/neo\/wp-content\/uploads\/sites\/3\/2017\/05\/2017-03-21-13.16.56-e1490384526715-768x1024.jpeg\")
<\/a><\/p>\nKalyna Durbak, the NEO\u2019s novice evaluator, recently posted the five things she learned about evaluation<\/a> since joining our staff. I thought I would steal, er, borrow Kalyna\u2019s \u201cfive things\u201d topic and write about the most important lessons I’ve learned after 25+ -years in the evaluation field.<\/p>\n My first experience with program evaluation was in the 1980s, as a graduate assistant in the University of Arizona School of Medicine\u2019s evaluation office.\u00a0 Excel was just emerging as the cool new tool for data crunching. SPSS ran on room-sized mainframes, and punch cards were fading fast from the computing world. Social security numbers were routinely collected and stored along with other information about our research or evaluation participants. Our desktop computers ran on DOS. The Internet had not even begun wreaking havoc.<\/p>\n Yep, I\u2019m old. The field has evolved over time\u00a0and the work is more meaningful than ever. Here\u00a0are five things I know now that I wish I had known when I started.<\/p>\n #1 Evaluation is different from research:<\/strong> Evaluation and research have distinctly different end goals. The aim of research is to add to general knowledge and understanding. \u00a0Evaluation, on the other hand, is designed to improve the value of something specific (programs, products, personnel, services) and to guide decision-making. Evaluation borrows many techniques from research methodology because those methods are a means to accurate, credible information. Technical accuracy of data means nothing if it cannot be applied to program improvement or decision-making.<\/p>\n #2 Evaluation is not the most important kid in the room.<\/strong> Evaluation, unchecked, can be resource-intensive, both in money and time. For every dollar and hour spent on evaluation, one dollar and hour is subtracted from funds used to produce or enhance a program or service. Project plans should focus first on service or program design and delivery, with proportional funding allocated to evaluation. Evaluation studies should not be judged by the same criteria used for research. Rather, the goal is to collect usable information in the most cost-effective manner possible.<\/p>\n #3 What gets measured gets done: <\/strong>Evaluation is a management tool that\u2019s worth the investment. Project teams are most successful when they begin with the end in mind,<\/em> and evaluation plans force discussion about desired results (outcomes) early on. \u00a0(Thank you, Stephen Covey, for helping evaluators advocate for their early involvement in projects.) \u00a0You must articulate what you want to accomplish before you can measure it.\u00a0 You need a good action plan, logically linked to desired outcomes, before you can design an process assessment. Even if your resources limit you to the most rudimentary of evaluation methods, the mere process of committing to outcomes, activities and measure on paper (in a logic model<\/a>, please!) allows a team to take one giant step forward toward program success.<\/p>\n #4 Value is in the eyes of the stakeholders:<\/strong> While research asks \u201cWhat happened,\u201d evaluation asks \u201cWhat happened, how important is it, and, knowing what we know, what do we do?\u201d\u00a0 That\u2019s why an evaluation report that merely collects dust on a shelf is a travesty. The evaluation process is not complete until stakeholders have interpreted the information and contributed their perspectives on how to act on the findings. In essence, I am talking about rendering judgement: what do the findings say about the value of the program? That value judgment should, in turn, inform decisions about the future of the program. While factual findings should be objective, judgments are not. \u00a0Value is in the eyes of the people invested in the success of your program, aka, stakeholders. Assessment of value\u00a0may vary and even conflict among various stakeholder groups. For example, a public library health literacy program has several types of stakeholders. The library users will judge the program based on its usefulness to their lives. City government officials will judge the program based on how many taxpayers express satisfaction with the program.\u00a0 Public librarians will value the program if it aligns with their library mission and brings visibility to their organization. \u00a0Evaluation is not complete until these multiple perspectives of value are explored and integrated into program decision-making.<\/p>\n #5 Everything I need to know about evaluation reporting I learned in kindergarten. <\/strong>Kindergarten was the first and possibly the last place I got to learn through play. In grad school, I learned to write 25-50 page research and evaluation reports. In my career, I discovered people read the executive summaries (if I was lucky), then stop. Evaluations are supposed to lead to learning about your programs, but no one thinks there’s anything fun about 50-page reports. Thankfully, evaluators have developed quite a few engaging ways to involve stakeholders in analyzing and using evaluation findings. For example, data dashboards<\/a> allow stakeholders to interact with data visualizations and answer their own evaluation questions. \u00a0Data parties<\/a> provide a social setting to share coffee, snacks, and data interpretations. \u00a0New innovations in evaluation reporting are being generated every year.\u00a0It’s a great time to be an evaluator! More bling; less writing, and it’s all for the greater good.<\/p>\n So,there you have it: my five things. \u00a0These five lessons have served me well. I suspect they will continue to do so until bigger and better evaluation ideas come along. What about you? Share your insights below in our comments section.<\/p>\n","protected":false},"excerpt":{"rendered":" Kalyna Durbak, the NEO\u2019s novice evaluator, recently posted the five things she learned about evaluation since joining our staff. I thought I would steal, er, borrow Kalyna\u2019s \u201cfive things\u201d topic and write about the most important lessons I’ve learned after 25+ -years in the evaluation field. My first experience with program evaluation was in… Read More »<\/a><\/p>\n","protected":false},"author":2959,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[27],"tags":[],"class_list":["post-5345","post","type-post","status-publish","format-standard","hentry","category-blog"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8ICUo-1od","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/users\/2959"}],"replies":[{"embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/comments?post=5345"}],"version-history":[{"count":3,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5345\/revisions"}],"predecessor-version":[{"id":6447,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/posts\/5345\/revisions\/6447"}],"wp:attachment":[{"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/media?parent=5345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/categories?post=5345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.nnlm.gov\/nec\/wp-json\/wp\/v2\/tags?post=5345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}