In this article:
Utilizing Multiple Choice (auto graded) Questions
Automatically Reject and Progress Candidates
How to set up an auto graded assessment
If you want to instantly qualify candidates based on certain criteria or test their knowledge in a certain field you can set up an auto graded assessment made up of question types that are graded automatically.
Navigate to the "Create New Assessment" tab in your dashboard. From there, input your job title and add at least three relevant skills that you want to evaluate in your assessment. Once you enter the job title and skills, click “Create Assessment”.
After inputting your job title, skills and selecting "Create Assessment" you will be brought to the Create tab where you then will be able to add your questions. Choose one of our automatically graded options as the question type and then add your question text.
In order for an assessment to be auto graded it must not include any questions types that require analysis by the AI or a manual score.
- Multiple Choice questions
- Spreadsheet (Auto Graded) questions
- Code questions with added auto graded test cases
- Info section questions, which do not require a response from the candidate
- Questions that you have marked as do not grade from the Advanced Question Settings menu
Adding Multiple Choice questions
You will need to select "+ Add Choice" to input your answer choices and assign a point value, ranging from 1-10, for answer selection. Once you have finished designing your question it will save automatically.
Assessment Settings
You can choose to randomize the questions the candidates receive by order and limit the number of questions out of a pool of questions in your assessment. You can set your preferences in the Settings section of your skills assessment.
Auto reject and progress candidates
When using auto graded skills assessments you have the ability to progress or reject candidates based on their assessment score. You can setup these parameters in your skills assessment settings. When creating or editing your assessment navigate to the "Settings" tab.
Towards the bottom of the settings page, you will see the option to activate auto reject and auto progress. Toggle the button to the right to enable these features.
Auto reject
To automatically reject candidates, set the minimum numerical percentage score that you would like to accept and candidates that score below that score will automatically be rejected.
If you would like for candidates to receive an email once they have been auto rejected, make sure that this setting is checked. You can also prevent candidates from being notified if they are rejected by un-checking the email notification box.
To customize or preview the rejection email sent to candidates, select the blue "Preview and edit rejection email" text. A pop-up window will open with the option to "Customize Email".
Auto progress
To auto progress candidates that complete your assessment to a different assessment stage, select another active assessment from the auto progress drop down menu. When this setting is enabled, candidates that score within your auto progress threshold for that assessment, will automatically be invited to take the proceeding assessment and see the option to start the next assessment in their candidate dashboard.
To set your condition choose the minimum score that you want candidates to achieve in order to automatically progress to the next assessment. If you would like all of the candidates that complete your assessment to progress, then you can set a threshold score of 0.
All candidates that are automatically progressed will receive an email notification inviting them to the next assessment. To preview or modify this email, select the blue "Preview and edit email for linked assessment" text. A pop-up window will open with the option to "Customize Email".
Grouped score
You can also group specific questions into the constructs they assess to see how well candidates perform in each of the attributes by navigating to the Question Groups tab. Scores will be calculated and displayed separately for each group of questions.
When editing your assessment, click on the Question groups icon.
Groups are auto formed based on the skills you chose for the role. You can update the names of the groups, move questions from one group to another, and add new groups if needed. When you add a new group, the group will start appearing in the Skills field in the question editor.
To add a new group in your Question Group settings, click "Add new Skill" at the top to add additional skills. You can edit the name and move the questions to the corresponding group. Any changes you make will be saved automatically.
You also have the option to randomize questions within a skill group. Slide the toggle button to the right to enable randomization. Once randomization is enabled, you have the option to choose how many questions in that group you want randomized.
Once you have added all the questions and save your settings click on "Save changes" in the top right to save your settings.
If you decide to group your assessment questions by skill, you will be able to view the candidate's score for each category when you expand the candidate's card in your "Results" view.
