When editing or creating skills assessments, it’s important to understand the available question settings. These settings impact how questions are scored, how AI interprets responses, and the candidate experience overall. Below is a breakdown of each option and how to use it effectively.
Skill Assessed
Each question is linked to a specific skill. This determines how candidate responses contribute to their score for that skill group.
-
The skill field is auto-filled but can be updated.
-
To change the skill or grouping, go to Assessment Settings > Skill Groups in the top-right corner of the assessment builder.
-
From there, you can rename skills or reassign questions to different groups.
Example of a Correct Answer
Providing an example answer is essential for questions requiring text, audio, or video responses.
-
Example answers train the AI on what a strong response looks like, which significantly improves grading accuracy.
-
Assessments without example answers for these question types are considered incomplete and may not perform correctly.
-
You can include one or multiple example answers for each question, especially if there are different ways candidates might respond well.
Scoring Instructions
If multiple reviewers will be scoring assessments, use the Scoring Instructions field to ensure consistency.
-
Include notes on what to look for in a strong response.
-
This is especially helpful when reviewing open-ended or creative answers where interpretation may vary.
Question Settings
These controls help shape the candidate experience and grading flow:
-
Timer: Set a time limit for the question. Use with caution—candidates can be blocked from submitting if a required, timed question goes unanswered.
-
Required: Forces the candidate to answer before moving on. Avoid marking timed questions as required to prevent submission issues.
-
Plagiarism Check: Flags potentially copied content in text-based responses.
-
Exclude from Grading: Ideal for questions that don’t require scoring, like introductions or instructions. These questions will not contribute to the overall score.
-
Manual Grading: Enables you to review and score the question yourself. AI will not auto-score these responses, and the overall assessment score won't be released until all manually graded questions are completed.
Previewing Your Assessment
You can preview your assessment at any time using the Preview button in the top right corner. This allows you to see the candidate experience and ensure everything functions as expected.