Solutions
Solutions for
K-12
K-12
Learn MoreEducator & Staff Training
Educator & Staff Training
Improve compliance and deliver critical professional development with online courses and management system
Learn moreStudent Safety & Wellness Program NEW
Student Safety & Wellness Program
Keep students safe and healthy with safety, well-being, and social and emotional learning courses and lessons
Learn moreProfessional Growth Management
Professional Growth Management
Integrated software to manage and track evaluations and professional development and deliver online training
Learn moreAnonymous Reporting & Safety Communications
Anonymous Reporting & Safety Communications
Empower your school community to ask for help to improve school safety and prevent crises before they occur
Learn moreIncident & EHS Management
Incident & EHS Management
Streamline safety incident reporting and management to improve safety, reduce risk, and increase compliance
Learn moreCareer & Technical Education NEW
Career and Technical Education Solutions
Maximize Student Outcomes with Our All-in-One Work-Based Learning Platform and CTE Courses.
Learn moreHigher Education
Higher Education
Learn MoreStudent Training
Student Training
Increase safety, well-being, and belonging with proven-effective training on critical prevention topics
Learn moreFaculty & Staff Training
Faculty & Staff Training
Create a safe, healthy, and welcoming campus environment and improve compliance with online training courses
Learn moreCampus Climate Surveys
Campus Climate Surveys
Simplify VAWA compliance with easy, scalable survey deployment, tracking, and reporting
Learn moreAnonymous Reporting & Safety Communications
Anonymous Reporting & Safety Communications
Empower your faculty, staff, and students to take an active role in protecting themselves and others
Learn moreIncident & EHS Management
Incident & EHS Management
Streamline safety incident reporting and management to improve safety, reduce risk, and increase compliance
Learn moreProfessional Development Tracking
Professional Development Tracking
Efficiently plan, manage, track, and evaluate all professional development events and activities.
Learn moreFaculty & Staff Evaluations
Faculty & Staff Evaluations
Easily manage the evaluation and development process from start to finish.
Learn moreManufacturing
Manufacturing
Learn MoreSafety Training NEW
Safety Training
Elevate performance and productivity while reducing risk across your entire organization with online training.
Learn moreFood Safety Training NEW
Food Safety Training
Empower your workforce with industry-leading training solutions designed for Food and Beverage Manufacturing.
Learn moreIndustrial Skills Training NEW
Industrial Skills Training
Close skills gap, maximize production, and drive consistency with online training
Learn morePaper Manufacturing Training
Paper Manufacturing Training
Enhance worker expertise and problem-solving skills while ensuring optimal production efficiency.
Learn moreHR & Compliance
Provide role-specific knowledge, develop skills, and improve employee retention with career development training.
Learning Management System (LMS)
Learning Management System (LMS)
Assign, track, and report role-based skills and compliance training for the entire workforce
Learn moreEHS Management
EHS Management
Track, Analyze, Report Health and Safety Activities and Data for the Industrial Workforce
Learn moreSafety Communication
Safety Communication
Enhance the safety for the industrial workforce with two-way risk communications, tools, and resources
Learn moreFire Departments
Fire Departments
Learn MoreTraining Management
Training Management
A training management system tailored for the fire service—track all training, EMS recerts, skill evaluations, ISO, and more for 100% of training in one place.
Learn moreCrew Shift Scheduling
Crew Shift Scheduling
Simplify 24/7 staffing and give firefighters the convenience of accepting callbacks and shifts from a mobile device
Learn moreChecks & Inventory Management
Checks & Inventory Management
Streamline truck checks, PPE inspections, controlled substance tracking, and equipment maintenance with a convenient mobile app
Learn moreExposure and Critical Incident Monitoring NEW
Exposure and Critical Incident Monitoring
Document exposures and critical incidents and protect your personnels’ mental and physical wellness
Learn moreEMS
EMS
Learn MoreTraining Management and Recertification
Training Management and Recertification
A training management system tailored for EMS services—EMS online courses for recerts, mobile-enabled skill evaluations, and more for 100% of training in one place.
Learn moreEMS Shift Scheduling
EMS Shift Scheduling
Simplify 24/7 staffing and give medics the convenience of managing their schedules from a mobile device
Learn moreInventory Management
Inventory Management
Streamline vehicle checks, controlled substance tracking, and equipment maintenance with a convenient mobile app
Learn moreWellness Monitoring & Exposure Tracking NEW
Wellness Monitoring & Exposure Tracking
Document exposures and critical incidents and protect your personnels’ mental and physical wellness
Learn moreLaw Enforcement
Law Enforcement
Learn MoreTraining and FTO Management
Training and FTO Management
Increase performance, reduce risk, and ensure compliance with a training management system tailored for your FTO/PTO and in-service training for 100% of training in one place.
Learn moreEarly Intervention & Performance Management
Early Intervention & Performance Management
Equip leaders with a tool for performance management and early intervention that helps build positive agency culture
Learn moreOfficer Shift Scheduling
Officer Shift Scheduling
Simplify 24/7 staffing and give officers the convenience of managing their schedules from a mobile device
Learn moreAsset Mangagement & Inspections
Asset Mangagement & Inspections
Streamline equipment checks and vehicle maintenance to ensure everything is working correctly and serviced regularly
Learn moreEnergy
Learn MoreSafety Training
Safety Training
Elevate performance and productivity while reducing risk across your entire organization with online training.
Learn moreEnergy Skills Training
Energy Skills Training
Empower your team with skills and safety training to ensure compliance and continuous advancement.
Learn moreHR & Compliance
Provide role-specific knowledge, develop skills, and improve employee retention with career development training.
Learning Management System (LMS)
Learning Management System (LMS)
Assign, track, and report role-based skills and compliance training for the entire workforce
Learn moreEHS Management
EHS Management
Track, analyze, report health and safety activities and data for the industrial workforce
Learn moreLone Worker Safety
Lone Worker Safety
Enhance lone worker safety with two way risk communications, tools, and resources
Learn moreGovernment
Learn MoreFederal Training Management
Federal Training Management
Lower training costs and increase readiness with a unified system designed for high-risk, complex training and compliance operations.
Learn moreMilitary Training Management
Military Training Management
Increase mission-readiness and operational efficiency with a unified system that optimizes military training and certification operations.
Learn moreLocal Government Training Management
Local Government Training Management
Technology to train, prepare, and retain your people
Learn moreFire Marshall Training & Compliance
Fire Marshall Training & Compliance
Improve fire service certification and renewal operations to ensure compliance and a get a comprehensive single source of truth.
Learn moreFire Academy Automation
Fire Academy Automation
Elevate fire academy training with automation software, enhancing efficiency and compliance.
Learn morePOST Training & Compliance
POST Training & Compliance
Streamline your training and standards operations to ensure compliance and put an end to siloed data.
Learn moreLaw Enforcement Academy Automation
Law Enforcement Academy Automation
Modernize law enforcement training with automation software that optimizing processes and centralizes academy information in one system.
Learn moreEHS Management
EHS Management
Simplify incident reporting to OSHA and reduce risk with detailed investigation management.
Learn moreArchitecture, Engineering & Construction
Architecture, Engineering & Construction
Learn MoreLearning Management System (LMS)
Learning Management System (LMS)
Ensure licensed professionals receive compliance and CE training via online courses and learning management.
Learn moreOnline Continuing Education
Online Continuing Education
Keep AEC staff licensed in all 50 states for 100+ certifications with online training
Learn moreTraining
Training
Drive organizational success with training that grows skills and aligns with the latest codes and standards
Learn moreEHS Management
EHS Management
Track, Analyze, Report Health and Safety Activities and Data for AEC Worksites
Learn moreHR & Compliance
HR & Compliance
Provide role-specific knowledge, develop skills, and improve employee retention with career development training.
Safety Communication
Safety Communication
Enhance AEC workforce safety with two-way risk communications, tools, and resources
Learn moreCasino
Casino
Learn MoreAnti-Money Laundering Training
Anti-Money Laundering Training
Reduce risk in casino operations with Title 31 and Anti-Money Laundering training compliance
Learn moreEmployee Training
Employee Training
Deliver our leading AML and casino-specific online courses to stay compliant with national and state standards
Learn moreLearning Management System (LMS)
Learning Management System (LMS)
Streamline training operations, increase employee effectiveness, and reduce liability with our LMS for casinos
Learn moreEHS Management
EHS Management
Simplify incident reporting to OSHA and reduce risk with detailed investigation management
Learn moreEmployee Scheduling
Employee Scheduling
Equip your employees with a mobile app to manage their schedules and simplify your 24/7 staff scheduling
Learn moreIndustries
Industry
Resources
Resource Center
Expert insights to boost training
Resource type
Course Catalogs
Company
Course Center
An important part of designing, creating, and delivering job training materials is creating learning assessments--the test at the end of the training activity to determine if workers can perform the skill or skills required by the learning objective.
That test can come in many different forms, including performance demonstrations and, often in the world of online learning, multiple-choice questions.
Whatever type of test it is, you may sometimes find yourself wondering about the best practices for creating the test or assessment that employees must complete after training and before they perform the tasks for real on the job.
In this article, we're going to give you tips about something related to test creation that learning experts call fidelity (no, not THAT fidelity--this is not a juicy blog post). In training talk, fidelity is the extent to which your test or test question mirrors the real task your workers will have to perform on the job.
In describing fidelity and tests, we'll cover a few other best practices, too. Hope this helps you with your question writin'.
Convergence Training are workforce training and performance improvement experts.
Click the links below to learn more about how we can help you.
Before we get down to fidelity, let's take a moment to consider some basics.
All training activities should include a set of learning objectives. The learning objectives are the reason that you created the training--they are what you want employees to be able to do after the training is over.
If you begin to design or develop training without first crafting a good set of learning objectives, you've lost the battle before the fight begins. And, to the point of this article, you really can't create learning assessments without first creating good learning objectives, because these should map to and complement one another--they're a bit like the yin and yang of job training.
When you write learning objectives at the beginning of your training creation process, focus on observable behaviors that employees should be able to do after the training is over. And remember that those observable behaviors should be the same things that you want employees to be able to do on the job, as well.
If this idea of learning objectives is new to you, take a moment and check out our Guide to Writing Learning Objectives or check out our interview about Learning Objectives with learning researcher Dr Patti Shank and then come back and finish up here.
Once you've created your learning objectives, you should then:
I know that order may seem strange, but if you write your learning assessments (tests) right after you write your learning objectives, you have less chance of going astray. This is important because you want your learning objectives to directly inform your learning assessments.
Don't worry--once you're done with your learning assessments, there will be plenty of time to begin creating your learning content and learning activities.
Once you're ready to begin, the first step of writing an assessment item is to go back and look at the learning objective(s) for the training.
Ask yourself: what does the worker have to do to satisfy the learning objective? Once you know that, you can create a proper assessment. The assessment, obviously, must determine if the employee can satisfy the learning objective.
So for example, if the learning objective states that learners should be able to complete a specific performance, your learning assessment should ideally require the learner to complete that very same performance. That would be a direct 1:1 match between your learning objective and your learning assessment (the "gold standard" here) and your learning assessment would therefore have high fidelity.
And as mentioned earlier, you can then move on to designing and creating the learning content and activities to help learners pass your learning assessment.
Because when you're all done, there must be a direct relationship between the learning objective, the training material, and the learning assessments, as shown below.
Let's consider this example: the learning objective says a worker has to "perform a machine change over." You think about it, and you decide to create a question that presents the worker with each step of the process and asks the worker to "drag" the steps into the correct order, from first to last.
Now, here's a question for you: is this a proper assessment of the learning objective? If the worker does drag the various steps into the correct order, does that mean the worker can perform a machine change over?
We'll give you a little time to think about that....
OK, are you back? What's your answer? Did you say "this isn't a proper assessment" and "putting these items in the correct order doesn't mean the employee can perform a machine change over?"
If you DID say just that, you're right. If you didn't say that, let's explain why your friends were right and what you may have overlooked. The learning objective states that the worker has to be able to perform a machine changeover. That means the worker has to actually DO IT in the real world--perform the machine changeover procedure.
Putting the steps in the correct order is a nice start, but that doesn't mean the worker knows how to perform each of those steps. And so that wouldn't be a proper test for that learning objective.
Learning experts would tell you this question has a fidelity problem. When learning experts talk about fidelity in the context of assessments, they're talking about how well the assessment matches the objective. A high-fidelity assessment matches the terms of the objective well. A low-fidelity assessment doesn't match the terms of the objective well.
So, that's your takeaway here. Before you create an assessment, take a look back at the learning objective, ask yourself what the worker really has to do in order to satisfy the objective, and then figure out what kind of assessment would evaluate if the worker can do it or not.
In the example we just gave, you'd probably be better off creating an assessment in which the employee actually demonstrates physically how to perform a machine change over. That assessment would have high--even perfect--fidelity. Or you could create an interactive, simulation-based assessment that would not take place in the real-world but would still have high, if not perfect, fidelity.
All of which means that when you're writing questions for online tests, you'll have to ask yourself if you CAN accurately assess the worker's ability to satisfy the learning objective using the kind of questions you can make for a standard online test (things like true/false, multiple choice, matching, drag and drop, sequencing, etc.).
If so, great, go for it. You'll find you can often improve your multiple-choice questions (and improve their fidelity) by having them focus on having the learner solve a problem or make a decision in the same way they would have to on the job.
If you feel like a standard online question type can't be used with enough fidelity, consider making a more sophisticated scenario-based eLearning test or using a performance assessment that occurs in the "real world."
If you go with the real-world performance assessment option above, you can even create digital versions to help with administering these (see below).
You can read our related article Testing Employees After Training: Best Practices for Workforce Training Evaluation for more information about creating test questions and "real world" performance assessments.
So the takeaway here is to make your test match the real on-the-job performance as closely as possible. If it's realistic to get a perfect match, great. If not, consider near-perfect matches with scenarios or with questions like multiple-choice questions that require workers to solve problems and/or make decisions in the same way they would on the job.
If you've created a learning assessment with high fidelity, it should also have high validity (validity means you're measuring what you intend to measure). But you CAN create a learning assessment that's not super-high in terms of fidelity (for example, having employees answer questions that require them to make the same kind of decisions they'd make on the job) even though it still has good validity.
Creating proper learning assessments is an essential part of training design because (1) you want to know if workers can perform the job skill or task correctly before you send them back on the job to do it in "real life" and (2) you want to know how workers are doing after training as a way to evaluate the effectiveness of your training. As an added bonus, there's research that shows testing actually helps learners remember and later retrieve knowledge and skills from training (the so-called "testing effect").
For more on workforce training and testing, consider some of these articles:
Let us know your thoughts on workplace testing in the Comments below, and please feel free to download our free guide to writing learning objectives too.