Assessment Insights

Assessment Insights will help put you in total control of your hiring, with on-demand reporting that lets you see how your assessment is performing.

Dive into completions, score distributions, and question-by-question insights to check the health of your assessment with powerful user-friendly charts. Below is a video tutorial on how to view said Insights:

Where can I find Assessment Insights?

Assessment insights are available to all customers, including free trial users. Insights can be accessed from both active and inactive (open/closed) assessments by clicking on the insights icon either from any stage within an active assessment from the navigation bar:

 

or from the assessment card:

 

What's included in the Assessment Insights?

Assessment Insights contain 3 charts including:

• Completions over time

• Score distribution

• Question by question drop-off

Completions Over Time

This chart tracks the total number of completions by day for this assessment.

This chart will help you identify peak days or times when your team's assessments are most likely to be completed by candidates. It will also help you identify when applications are slowing down. These insights can be used to better plan when to invite candidates to an assessment and when to close applications for a role.

Important note: For this release, the date range filter only applies to the completions over time chart. The default is set to the last 30 days with click links to filter by the last 7 days and the last 30 days or the user can define their own date range. In a future release, we’ll move the date range filter to sit across all assessments.

Score Distribution

The score distribution graph can be used to determine the overall health of the assessment.

The image above depicts a healthy or good scenario for the assessment. You can see the Y-axis shows the number of candidates and the X-axis represents the bucket their overall score sits in.

With this chart, you can see that most candidate scores are distributed across the middle band from 30% - 80% which is expected behavior for an assessment that is not too hard and not too easy. There are also a few top performers and a few that didn’t fare so well so that the graph flows in a nice arc and tapers off at both ends. Users with charts that show variations of this augmented middle band have a healthy or good assessment.

This version of the score distribution chart (shown above) shows an assessment that is clearly too easy as most of the candidates have scored 70% or greater. Your team might be able to make improvements to the assessment by asking a few more complex questions that are more suited to the seniority of the candidates. You might also benefit from different skills or greater variation in the question types (eg. remove some multiple-choice questions and ask for text-based answers.)

This version, above, shows an example of an assessment that is potentially too difficult for the intended candidates as the majority have all scored below 40%. There are a number of reasons the assessment is low scoring:

• The assessment might be too complex for the candidates' experience level

• It might be too long (candidates are either burning out, or not completing the assessment)

• It might contain too many in-depth questions or question types

• It might not have the right mix of skills

In order to rectify this, users can follow our assessment guidelines and reduce the number of questions, include more question variety, and review the content of questions and skills.

Question-by-Question Drop-off

This chart shows how many candidates view and complete each question in the assessment.

The left-hand column for "Viewed", shows the number of candidates that view a question and the right-hand column for "Answered", shows the number that go on to actually complete the question.

This chart can be used to determine if there are any issues with particular questions that need to be reviewed. (i.e. question 6 shows that only 20% of candidates complete it. The question could be too hard or it could ask for information the candidates don’t have on hand.)

Important notes

• If question randomization is active in the assessment, this chart will not work and instead, the user will be shown an empty state graph explaining that randomization is in use and the chart cannot display:
  
  

 

 

 

CSAT Scores

After candidates complete each assessment, they will be prompted to complete a survey to provide feedback on their experience with the assessment. 

Key Notes:

• Candidates are able to see the survey one time per assessment

• Candidates are able to skip the survey

• Candidates are able to score experience from 1-5 points + leave a text comment (optional field)

  • Candidates are able to change points before the survey is submitted

  • Max number of characters for text comment - 500

• If an assessment is reset, candidates are able to see the survey again

The overall CSAT score can be viewed in the top right corner of the Assessment Insights page:

 

To learn more about best practices for creating an assessment, watch this video here.