Solutions
Solutions for
K-12
Educator & Staff Training
Educator & Staff Training
Improve compliance and deliver critical professional development with online courses and management system
Learn moreStudent Safety & Wellness Program NEW
Student Safety & Wellness Program
Keep students safe and healthy with safety, well-being, and social and emotional learning courses and lessons
Learn moreProfessional Growth Management
Professional Growth Management
Integrated software to manage and track evaluations and professional development and deliver online training
Learn moreAnonymous Reporting & Safety Communications
Anonymous Reporting & Safety Communications
Empower your school community to ask for help to improve school safety and prevent crises before they occur
Learn moreIncident & EHS Management
Incident & EHS Management
Streamline safety incident reporting and management to improve safety, reduce risk, and increase compliance
Learn moreHigher Education
Student Training
Student Training
Increase safety, well-being, and belonging with proven-effective training on critical prevention topics
Learn moreFaculty & Staff Training
Faculty & Staff Training
Create a safe, healthy, and welcoming campus environment and improve compliance with online training courses
Learn moreCampus Climate Surveys
Campus Climate Surveys
Simplify VAWA compliance with easy, scalable survey deployment, tracking, and reporting
Learn moreAnonymous Reporting & Safety Communications
Anonymous Reporting & Safety Communications
Empower your faculty, staff, and students to take an active role in protecting themselves and others
Learn moreIncident & EHS Management
Incident & EHS Management
Streamline safety incident reporting and management to improve safety, reduce risk, and increase compliance
Learn moreIndustrial
Industrial Skills Training
Industrial Skills Training
Close skills gap, maximize production, and drive consistency with online training
Learn morePaper Manufactuing Training
Enhance worker expertise and problem-solving skills while ensuring optimal production efficiency.
HR / Professional Development
HR / Professional Development
Provide role-specific knowledge, develop skills, and improve employee retention with career development training.
Learn moreAnti-Harassment and Diversity, Equity & Inclusion
Anti-Harassment and Diversity, Equity & Inclusion
Navigate an ever-evolving workforce with DE&I and Harassment Prevention Compliance training
Learn moreLearning Management System (LMS)
Learning Management System (LMS)
Assign, track, and report role-based skills and compliance training for the entire workforce
Learn moreEHS Management
EHS Management
Track, Analyze, Report Health and Safety Activities and Data for the Industrial Workforce
Learn moreSafety Communication
Safety Communication
Enhance the safety for the industrial workforce with two-way risk communications, tools, and resources
Learn moreFire Departments
Training Management
Training Management
A training management system tailored for the fire service--track all training, EMS recerts, skill evaluations, ISO, and more in one place
Learn moreCrew Shift Scheduling
Crew Shift Scheduling
Simplify 24/7 staffing and give firefighters the convenience of accepting callbacks and shifts from a mobile device
Learn moreChecks & Inventory Management
Checks & Inventory Management
Streamline truck checks, PPE inspections, controlled substance tracking, and equipment maintenance with a convenient mobile app
Learn moreExposure and Critical Incident Monitoring NEW
Exposure and Critical Incident Monitoring
Document exposures and critical incidents and protect your personnels’ mental and physical wellness
Learn moreEMS
Training Management and Recertification
A training management system tailored for EMS services—EMS online courses for recerts, mobile-enabled skill evaluations, and more
Learn moreEMS Shift Scheduling
EMS Shift Scheduling
Simplify 24/7 staffing and give medics the convenience of managing their schedules from a mobile device
Learn moreInventory Management
Inventory Management
Streamline vehicle checks, controlled substance tracking, and equipment maintenance with a convenient mobile app
Learn moreWellness Monitoring & Exposure Tracking NEW
Wellness Monitoring & Exposure Tracking
Document exposures and critical incidents and protect your personnels’ mental and physical wellness
Learn moreLaw Enforcement
Training and FTO Management
Increase performance, reduce risk, and ensure compliance with a training management system tailored for your FTO/PTO and in-service training
Learn moreEarly Intervention & Performance Management
Early Intervention & Performance Management
Equip leaders with a tool for performance management and early intervention that helps build positive agency culture
Learn moreOfficer Shift Scheduling
Officer Shift Scheduling
Simplify 24/7 staffing and give officers the convenience of managing their schedules from a mobile device
Learn moreAsset Mangagement & Inspections
Asset Mangagement & Inspections
Streamline equipment checks and vehicle maintenance to ensure everything is working correctly and serviced regularly
Learn more911 Emergency Communications
Training Management System
Training Management System
Track and manage all your employee training, certifications, and policies in one system
Learn morePersonnel Scheduling
Personnel Scheduling
Simplify shift scheduling and equip your Telecommunicators with an app to help manage their complex 24/7 schedules
Learn morePerformance, Conduct & Early Intervention
Performance, Conduct & Early Intervention
Protect the mental wellbeing of your Telecommunicators and improve QA
Learn moreAsset Management & Inspections
Asset Management & Inspections
Simplify ECC inspections, maintenance, and inventory management
Learn moreFederal & Military Training Management
Federal & Military Training Management
A mission-ready ecosystem for training and compliance
Learn moreLocal Government Training Management
Local Government Training Management
Technology to train, prepare, and retain your people
Learn moreState Regulatory and Standards Management
State Regulatory and Standards Management
Purpose-built standards and training software to manage compliance
Learn moreAEC
Learning Management System (LMS)
Learning Management System (LMS)
Ensure licensed professionals receive compliance and CE training via online courses and learning management.
Learn moreOnline Continuing Education
Keep AEC staff licensed in all 50 states for 100+ certifications with online training
Training
Drive organizational success with training that grows skills and aligns with the latest codes and standards
EHS Management
EHS Management
Track, Analyze, Report Health and Safety Activities and Data for AEC Worksites
Learn moreSafety Communication
Safety Communication
Enhance AEC workforce safety with two-way risk communications, tools, and resources
Learn moreCasino
Anti-Money Laundering Training NEW
Anti-Money Laundering Training
Reduce risk in casino operations with Title 31 and Anti-Money Laundering training compliance
Learn MoreEmployee Training
Employee Training
Deliver our leading AML and casino-specific online courses to stay compliant with national and state standards
Learn moreLearning Management System (LMS)
Learning Management System (LMS)
Streamline training operations, increase employee effectiveness, and reduce liability with our LMS for casinos
Learn moreEHS Management
EHS Management
Simplify incident reporting to OSHA and reduce risk with detailed investigation management
Learn moreEmployee Scheduling
Employee Scheduling
Equip your employees with a mobile app to manage their schedules and simplify your 24/7 staff scheduling
Learn moreIndustries
Industry
Resources
Company
Course Center
Companies pour a lot of money into training. And of course, they hope that money is well spent.
That would mean that the training worked, in casual terms. Or, to be more specific, that employees learned things, developed new skills, and changed their behaviors at work, and those changed behaviors ultimately contributed to progress toward a business goal, such as increased workplace safety, higher production efficiency, increased sales revenue, lower total costs, the roll-out of a new product, or similar goals.
But exactly how do you know if your training was effective?
To figure this out, Donald Kirkpatrick came up with something now called Kirkpatrick's Four Levels of Training Evaluation. There are other methods to do this, but Kirkpatrick's Four Levels are a widely used method. They became very popular after he published his book Evaluating Training Programs in 1994.
We'll learn more about the four-level Kirkpatrick evaluation in this article.
Kirkpatrick's model evaluates the effectiveness of the training at four different levels. All four levels of evaluation have their place and their significance, and each builds on the other. So, let's take a look at these levels, shall we?
Level 1-Reaction: what do the learners/employees themselves have to say about the learning experience?
Level 2-Learning: did the learners learn the knowledge, skills, or attitudes (KSAs) that the training was intended to convey, as determined by some form of test or assessment immediately after training?
Level 3-Behavior: did the learners transfer the newly learned KSAs to on-the-job performance?
Level 4-Results: what was the tangible result of the training in terms of meeting a business goal?
Level 1-Reaction: Surveys handed out to the learners, online evaluations, etc. (Read more about level 1 reactions here and read our interview with Dr. Will Thalheimer talking about so-called smile sheets here.)
Level 2-Learning: These are assessments during and/or immediately after training, and include role-playing scenarios during training, focus groups, case studies, pre-tests, post-tests, unscored practice tests, skill demonstrations, etc. (Read more about testing after workforce training here).
Level 3-On-the-Job Behaviors: Observation of on-the-job behaviors and other evaluation metrics. This is where you're watching to see if employees remember and apply the new knowledge and skills on the job.
Level 4-Business Results: Direct measurement of progress toward a business goal--cost, revenue, production, etc. (Read more about measurement of training's influence on business goals here and even more about level 4 training evaluations here).
So there you have it, a nice, easy, four-level method for evaluating the effectiveness of your training materials. Training is valuable, helpful, and necessary, and we're a big proponent of it, but you definitely want to make sure it's helping and this is one good way to do that.
Since this method was originally developed, a revised "new" Kirkpatrick Evaluation Model has been created. Click that link to get it from the horse's mouth; we'll add this to the list of things to write about in the future.
A final note: for a LOT more information related to this topic, check out Don Clark's always informative Big Dog/Little Dog blog.
Don't forget to download the free guide below.