Articles

The Level 1 Evaluation

If your college is like most across the country, you have a standard Level 1 Evaluation form you ask participants to fill out at the completion of all open-enrollment and contract courses. This form is designed to collect information from our customers about their reaction to the learning event. Most of these Level 1 Evaluations are mostly about us and our environment. Do your questions look something like this?

We ask our customers their thoughts about our content, our instructor, our methods, and our environment. Instead, we should be asking them about them and how they are experiencing the learning event in relation to their needs.

I recently delivered a few workshops for college leaders across the state of California at the Statewide Contract Education Summit in San Jose, CA. During some down time I had the opportunity to sit in a session called "Measuring (& Driving) the Value of Training" delivered by Bruce Winner, Custom Training Manager at Los Rios Community College District (Sacramento, CA). Bruce’s presentation was as valuable as his name! While I was already very familiar with the Kirkpatrick Levels of Evaluation, Bruce introduced an approach to collecting participant feedback that touched on all four levels (Reaction, Learning, Application, & Impact) in the context of a Level 1 Evaluation. Needless to say, I left the session feeling this was a better way to capture Level 1 feedback and couldn’t wait to get back to my office to use this "blended approach" to make improvements to the Level 1 Evaluation I have been using. With Bruce’s approval, I’m happy to share some of the major components of this new and improved Level 1 Evaluation. Some language may need to be modified to support different program areas.

REACTION (5=strongly agree, 1=strongly disagree)

LEARNING (5=extensive knowledge, 1=very little knowledge)

APPLICATION (5=strongly agree, 1=strongly disagree)

IMPACT

I think these impact measures will result from the application of knowledge/skills from this workshop (circle all that apply). Increased … Quality, Revenue, Margin, Productivity, Efficiency WORKSHOP SUGGESTIONS

SATISFACTION (5=strongly agree, 1=strongly disagree)

Here are a few reasons why this approach to a Level 1 Evaluation may work better for your college:

  1. If you didn’t define specific Level 2, 3, or 4 measurements on the front end of the learning initiative, you now have some data about your clients’ expectations in these areas.
  2. You are demonstrating to your clients that higher levels of measurement are important to you.
  3. You will collect data to support a “Client Report Out” and/or future conversations about new opportunities.
  4. Questions are asked from the learner perspective (not the trainer perspective).
  5. Collecting more “application” and “impact” data from your client will support a longer term, strategic partnership with them.

I’m not suggesting this evaluation should take the place of a thorough Level 2, 3, or 4 evaluation, but it is a way to capture more useful data that a traditional Level 1 Evaluation will not provide. If you would like to explore how Contract Training Edge can help your team improve business development skills and develop your own team dashboard, please contact Greg Surtman at (216) 509-6398 or gsurtman@ctedge.net.

Happy selling, my friends…