Creating a Skills Assessment
Adding an assessment is easy!
The "Create New Assessment" button in your dashboard gives you the ability to create your own assessment for any role. By entering in your job title and the role's relevant skills you will be presented with the option to add your own questions, use our AI-generated suggested questions, or utilize both options; all while being guided on how to follow skills assessment best practices.
Once you enter the job title and skills, click “Create Assessment”.
The next step will populate an assessment template for you. You can follow these best practices or modify them as needed.
To add content, you have the following options:
AI-Assisted builder questions
Use our AI-Assisted builder to generate questions for you. Click on Generate now and the system will autofill questions into the template based on the skills you selected. You can modify each question if needed, or you can swap a question for another by clicking on the “Suggested” tab.
Adding your own content
If you would like to add questions one by one, you can:
- Create your own questions
- Use the recommended questions from the Suggested tab
- Choose from your own question bank under the Saved tab
If you prefer, you can start by adding your own questions for each skill. Click on the “Create” tab to activate the question type options. Select the question type from the available formats, this will determine how the candidate can respond.
Please note that immersive options such as Google Docs, Slides, Spreadsheet and Code Editor questions cannot be answered through a mobile device. Candidates will be prompted to switch to desktop if they are using a mobile device that includes any of the immersive options.
To read more about immersive question types, read here.
Once you select your question type, add your question in the content box. You can also include a video, audio, image, code, or a file download to the questions.
The following field allows you to enter the skill being assessed by the question. This is filled out by default, and you can update it if necessary.
Next, you should add examples of correct answers. You can add as many correct answer samples as you like. Correct answer samples will help increase the AI’s grading accuracy.
To learn more about AI grading, read here.
You have the option to save any question you add to your assessment in your own Question bank. These questions will appear under the “Saved” tab and can be filtered by skills.
If you would like to include guidance for your team on how to manually grade a response for a question, you can include these details in the scoring instructions field.
Under this section, you can add a question timer, mark the question as required, or exclude a question from AI and manual grading.
Please note that if you are using timers, having required questions may prevent candidates from submitting a required answer if they run out of time.
If you have a question that does not require grading (e.g. introductory video, instructional multiple-choice, or text questions) then we recommend enabling the do not grade option.
You can preview your assessment any time, by clicking on the Preview button located on the top right.
Deleting, Adding and Reordering questions
To delete any questions simply click on the trash icon found in the questions panel or in the question editor for the particular question.
To add more questions to the assessment, click on the + Add question button located towards the button of the question panel.
To reorder questions, click on the 2 arrows next to the trash icon.
A small dialog box will open. Choose the position (Before or After) and select the specific question from the question drop-down list. This will position the question you want to move either before or after the specific question you select from the drop-down.
Once you are done adding all your questions, you are ready to move to the assessment settings.
To manage the settings, click on the Settings tab, located on the left side panel.
Within the Assessment Settings, you can adjust the following features:
- Enable/Disable final feedback question
- Randomize question order for each candidate
- Randomize answer order for multiple choice answers
- Update the Assessment Name and Description
- Set Assessment time limit and deadline (maximum of 29 days)
- Auto-reject and/or auto-progress (only if assessment is autograded)
If you would like to add an overall timer to the assessment, please keep the following in mind:
- If you choose a time frame that is more than 4 days, this will not work. The current default is 4 days for customers on our Trial and Pro plans.
- If you have individual timers set to an assessment and then choose this option, all individual timers will be disabled.
- If you have added individual timers to questions, you will not be able to add a timer to the entire assessment as well.
Grouped Questions and Display of Scores
Grouping questions is a great way to examine specific skills. You can group your questions by any skills essential to the role, and scores will be displayed for each group plus the overall assessment score.
Group the questions into the constructs they assess to see how well candidates perform in each of the attributes, as well as performance on the overall assessment. Is customer empathy more important than attention to detail in this role? You will be able to see where the candidate’s strengths lie and how well they perform in each of the constructs you have selected, to better inform your decision-making
Click on the Skill groups tab on the left side panel.
Groups are auto-formed based on the skills you chose for the role. You can update the names of the groups, move questions from one group to another, and add new groups if needed. When you add a new group, the group will start appearing in the Skills field in the question editor.
To add a new group in your Skill Group settings, click "Add New Skill" at the top to add additional skills. You can edit the name and move the questions to the corresponding group. Any changes you make will be saved automatically.
You also have the option to randomize questions within a skill group. Slide the toggle button to the right to enable randomization. Once randomization is enabled, you have the option to choose how many questions in that group you want randomized.
We recommend displaying scores in percentages but if you prefer to see text displayed for a score range, then toggle the “Advanced Scoring” button to activate the options.
You can choose how to display the results by toggling the Advanced Scoring button to the right.
When you activate this button, the display options will appear under each group. You can choose to display the results as a percentage or custom text based on a score range.
If you choose to display text depending on a specific score, you will need to enter the specific text you would like to appear for a certain range of points like below.
Group the questions accordingly and choose how you want the scores displayed.
Creating your own Question Bank
You can now save any question you add to an assessment and create your own question bank. Next to each question you create or add from the AI recommended questions, there is a save icon on the top right of the question block.
The question will be stored and accessible under the “Saved” tab. Under the Saved tab, you can find the questions by searching in the search field or by clicking on the drop-down menu and choosing the specific skill group the question belongs to. Once you find the question you want to add from this section, click on +Add.