Creating a Skills Assessment
Are you ready to get started with hiring the most qualified candidates for your roles? Luckily with Vervoe, we’ve made creating assessments quick, easy, and completely reassuring. Let’s get started!
The Create New Assessment button in your dashboard gives you the ability to create your own unique assessment for any role. Simply enter your job title and the relevant skills a candidate will require to succeed in the role. From there, you’ll get the option to add your own questions (i.e., those super niche questions important to your role and company), use our AI-generated suggested questions, or utilize a mixture of both options for the best of both worlds. The cherry on top? We’ll guide you on how to follow skills assessment best practices as you go. Don’t worry, you’re in good hands with Vervoe.
Once you enter the job title and skills, click “Create Assessment”.
The next step will populate an assessment template for you. You can follow these best practices or modify them as needed.
To add content, you have the following options:
AI-assisted builder questions
Not sure what to ask your candidates or need a bit of guidance? No stress! Simply use our AI-assisted builder to generate questions for you. Click on Generate now and the system will autofill questions into the template based on the skills you selected. You can modify each question if needed, or you can swap a question for another by clicking on the Suggested tab.
Adding your own content
Know exactly what to ask to assess a candidate's suitability? No problem, opt for the option to add your own content!
If you would like to add questions one by one, you can:
- Create your own questions
- Use the recommended questions from the Suggested tab
- Choose from your own question bank under the Saved tab
If you prefer, you can start by adding your own questions for each skill. Click on the Create tab to activate the question type options. Select the question type from the available formats, which will determine how the candidate can respond.
Note: Before creating your assessment, it’s important that your organization and candidates are aware that immersive question types can’t be answered through a mobile device. Immersive question types refer to Google Docs, Slides, Spreadsheet, and Code Editor. But don’t stress, we’ll prompt candidates to switch to a desktop if we recognize they’re using a mobile phone to attempt those question types.
Want to find out a little more about our immersive question types and how they can add value to your hiring process? Click here.
Once you select your question type, simply add your question in the content box. You can also include a video, audio, image, code, or a file download to the questions.
The following field allows you to enter the skill being assessed by the question. This is filled out by default, but you’re more than welcome to edit it if required.
Next, you should add examples of correct answers. You can add as many correct answer samples as you like. But why? Every organization will have a different understanding of what a good and bad answer looks like depending on the industry, organization, company culture, and the skills required to succeed. As such, understanding what “good” looks like to your organization will help increase our machine learning AI’s grading accuracy, ensuring you’re getting the most out of Vervoe’s intuitive platform.
Not 100% sure how AI works and what this all means? No stress, we understand it can be a little mysterious at times. We recommend reading these AI FAQs to gain a better understanding.
You have the option to save any question you add to your assessment in your own Question bank. These questions will appear under the Saved tab and can be filtered by skills.
If you’d like to help guide your team on how to manually grade a response for a question, you can include these details in the Scoring instructions field.
To make your assessment truly unique and tailored to what your organization deems important indicators of success, we’ve added a selection of question settings. Under this section, you will find the option to add a question timer, mark the question as required, or exclude a question from AI and manual grading.
Please note that if you are using timers, having required questions may prevent candidates from submitting an answer if they run out of time.
If you have a question that does not require grading (e.g. introductory video, instructional multiple-choice, or text questions), we recommend enabling the “do not grade” option.
You can preview your assessment any time, by clicking on the Preview button located on the top right.
Deleting, Adding and Reordering questions
To delete any questions, simply click on the trash icon found in the questions panel or in the question editor for the particular question.
To add more questions to the assessment, click on the + Add question button located towards the button of the question panel.
To reorder questions, click on the two arrows next to the trash icon.
Upon clicking, a small dialog box will open, allowing you to choose the position (i.e., before or after) and select the specific question from the question drop-down list. This will position the question you want to move either before or after the specific question you select from the drop-down.
Once you are done adding all questions, you are ready to move to the assessment settings.
To manage the settings, click on the Settings tab located on the left side panel.
Within the Assessment Settings, you can adjust the following features:
- Enable or disable final feedback question
- Randomize question order for each candidate
- Randomize answer order for multiple-choice answers
- Update the assessment name and description
- Set an assessment time limit and deadline (maximum of 29 days)
- Auto-reject and/or auto-progress candidates (only if assessment is autograded)
If you would like to add an overall timer to the assessment, please keep the following in mind:
- If you choose a timeframe that is more than four days, this will not work. The current default is four days for customers on our trial and pro plans.
- If you have individual timers set to an assessment and then choose this option, all individual timers will be disabled.
- If you have added individual timers to questions, you will not be able to add a timer to the entire assessment as well.
Grouped Questions and Display of Scores
Grouping questions into Skill Groups is a great way to examine specific skills. You can group your questions by any skills essential to the role, and scores will be displayed for each group and the overall assessment score.
Group the questions into the constructs they assess to see how well candidates perform in each of the attributes, as well as performance on the overall assessment. Is customer empathy more important than attention to detail in this role? You will be able to see where the candidate’s strengths lie and how well they perform in each of the constructs you have selected, to better inform your decision-making
Click on the Skill groups tab on the left side panel.
Groups are auto-formed based on the skills you chose for the role. You can update the names of the groups, move questions from one group to another, and add new groups if needed. When you add a new group, the group will start appearing in the Skills field in the question editor.
To add a new group in your Skill Group settings, click Add New Skill at the top to add additional skills. You can edit the name and move the questions to the corresponding group. Any changes you make will be saved automatically.
You also have the option to randomize questions within a skill group. To do so, simply slide the toggle button to the right to enable randomization. Once randomization is enabled, you have the option to choose how many questions in that group you want randomized.
We recommend displaying scores in percentages but if you prefer to see text displayed for a score range, then toggle the Advanced Scoring button to activate the options.
You can choose how to display the results by toggling the Advanced Scoring button to the right.
When you activate this button, the display options will appear under each group. You can choose to display the results as a percentage or custom text based on a score range.
If you choose to display text depending on a specific score, you will need to enter the specific text you would like to appear for a certain range of points, like below.
Group the questions accordingly and choose how you want the scores displayed.
Creating your own Question Bank
You can now save any question you add to an assessment and create your own question bank. Next to each question you create or add from the AI-recommended questions, there is a save icon on the top right of the question block.
The question will be stored and accessible under the Saved tab. Under the Saved tab, you can find the questions by searching in the search field or by clicking on the drop-down menu and choosing the specific skill group the question belongs to. Once you find the question you want to add from this section, click on +Add.