A new MSPB report explores how using job simulations can improve your assessment practices.
The federal government is experiencing a surge in interest from potential applicants and agencies are reporting unprecedented numbers of applicants. This could be the result of current economic conditions or it could be the President’s appeal and his determination to make Government “cool” again.
As the number of applicants rise and as hiring reforms are initiated, agencies need to be careful to use good assessment tools that will help distinguish the most qualified applicants. Job simulations may help accomplish this goal. MSPB’s recent report, Job Simulations: Trying Out for a Federal Job, defines a job simulation as an assessment that presents applicants with realistic, job-related situations and documents their behaviors or responses to help determine their qualifications for the job. Job simulations include but are not limited to work samples, situational judgment tests, assessment centers, and job tryout procedures.
Job simulations can be an effective tool to evaluate applicant qualifications. They have many advantages. They tend to have higher predictive validity than other typical assessments, meaning they should be better at predicting future job performance. They can also provide a realistic job preview that helps applicants determine if the job is well suited to their knowledge, skills, abilities, and interests. Because job simulations replicate the tasks performed in the actual job, studies have found that applicants are more likely to view them as being fair and job-related. Finally, research has generally demonstrated that job simulation assessments have lower rates of adverse impact, as well as a lower degree of exposure to discrimination law suits based on the selection procedure.
Job simulations do have their drawbacks, though. In particular, they can be costly because they require more expertise to develop than simpler assessments. They also may require more staff and training to administer and score the results. In addition, while job simulations can be used to assess multiple competencies, a single simulation exercise will often focus on a limited number of tasks or duties performed on the job. Finally, some job simulations are not suited to all jobs because they require the applicant to already have a certain level of knowledge, skills, or abilities to complete the assessment.
Job simulations, therefore, may not work in every situation. That is why it is important for agencies to have a good grasp of the job for which they are hiring, the competencies needed for that job, and knowledge about what assessments would best fit their specific needs. MSPB’s report provides a strategy agencies can adapt that will help them determine what assessments would best fit their hiring situation.” v
[Reprinted from Issues of Merit, a publication of the Office of Policy and Evaluation , U.S. Merit Systems Protection Board. To view the full MSPB report, go to www.mspb.gov and click on “MSPB Studies.]
What do you think? What are the advantages/disadvantages of using this assessment practice at your agency?