Additional Create/Question Features
Creating an Auto Graded Multiple Choice Assessment
Welcome to the very first step in building a skills assessment and, ultimately, finding the best candidate for your open role! We've created a series of articles that thoroughly detail what each step entails. Below, we'll go over the many ways you can create questions for your assessment, and different settings you can utilize.
Borrow an assessment from our Assessment Library
If you prefer to use one of the many assessments created by industry experts found in our library, navigate to the Assessment Library tab in your dashboard or click Browse Library.
This section includes a collection of assessments created by people considered experts in their fields. Our experts have at least 3+ years of experience in their specific roles or fields of expertise. Our skills assessment team evaluates each assessment to ensure that it is appropriate.
Featured assessments are shown towards the top, and available categories appear above the featured section. Below the feature section, we highlight the most popular skills used by other employers. You can search for an assessment through a category or through the search bar.
You can search by the following attributes:
-
Assessment title
-
Skill
-
Category
You can preview questions from any of the assessments to help you decide whether you would like to utilize that assessment. Click on the assessment card to open the details section.
Once you decide which one you would like to use, click "Add to Assessments".
Once added, it will open the assessment editor. If you would like to make a change to a question or add a question in the assessment, you can do so from here.
Please note that if you make any changes to the questions created by experts, make sure to include a correct answer sample to help the AI calculate a more accurate score.
Once you are in the assessment editor, you will also have the option to create/edit Skill Groups, make additional changes to the Assessment Settings, and customize the candidate experience within the Invite tab.
Manually creating your own Skills Assessments
To maximize your AI accuracy and to increase candidate completion rates, please keep the following in mind:
- include a minimum of 6 questions
- at least a couple of questions that have multiple choice or text answers
- include a document, spreadsheet, or presentation question type
- don't start with a video, Google doc, spreadsheet, or presentation
- avoid adding timers to videos
- avoid starting with a video response
- ease into it, ask an easy question first, and then build up to the more difficult questions
- include a correct answer sample in the suggested answer field when relevant
For some great tips on how to write a quick and effective skills assessment, read this short article we wrote for our blog.
To create a custom skills assessment, click the blue button "Create New Assessment", located on the top right.
Next, by entering in your job title and the role's relevant skills, you will be presented with the option to add your own questions, use our AI-generated suggested questions, or utilize both options; all while being guided on how to follow skills assessment best practices.
Add content to your assessment
To add content, you have the following options:
- AI-Assisted builder questions
Use our AI-Assisted builder to generate questions for you. Click on Generate now and the system will autofill questions into the template based on the skills you selected. You can modify each question if needed, or you can swap a question for another by clicking on the “Suggested” tab.
- Add your own questions
Once you select your question type, add your question in the content box. You can also include a video, audio, image, code, or a file download to the questions.
Additional Create/Question features
Skill assessed
The "Skill assessed" field allows you to enter the skill that pertains to the question. This is filled out by default, and you can update it if necessary.
Example of a correct answer
We recommend adding example answers to your questions when creating skills assessments. Suggested answers maximize AI accuracy and provide guidance for manually scoring candidates. Read more about how this works here.
Scoring Instructions
If you will occasionally manually grade assessments, feel free to use this section to let your team know how you'd like them to do so.
Question Settings
Under this section, you can also add a question timer, mark the question as required, or exclude a question from AI and manual grading. Please note that if you are using timers, having required questions may prevent candidates from submitting a required answer if they run out of time.
If you have a question that does not require grading (e.g. introductory video, instructional multiple-choice, or text questions) then we recommend enabling the 'do not grade' option.
You can preview your assessment any time, by clicking on the Preview button located on the top right.
Deleting, Adding and Reordering questions
To delete any question, simply click on the trash icon found in the questions panel or in the question editor for the particular question.
To add more questions to the assessment, click on the + Add question button located towards the button of the question panel.
To reorder questions, click on the 2 arrows next to the trash icon.
A small dialog box will open. Choose the position (Before or After) and select the specific question from the question drop-down list. This will position the question you want to move either before or after the specific question you select from the drop-down.
Once you are done adding all your questions, you are ready to move to the assessment settings.
Assessment Settings
To manage the settings, click on the Settings tab, located on the left side panel.
Within the Assessment Settings, you can adjust the following features:
- Enable/Disable final feedback question
- Randomize question order for each candidate
- Randomize answer order for multiple choice answers
- Update the Assessment Name and Description
- Set Assessment time limit and deadline (maximum of 29 days)
- Auto-reject and/or auto-progress (only if assessment is autograded)
If you would like to add an overall timer to the assessment, please keep the following in mind:
- If you choose a time frame that is more than 4 days, this will not work. The current default is 4 days for customers on our Trial and Pro plans.
- If you have individual timers set to an assessment and then choose this option, all individual timers will be disabled.
- If you have added individual timers to questions, you will not be able to add a timer to the entire assessment as well.
Grouped Questions and Display of Scores
Grouping questions into Skill Groups is a great way to examine specific skills. You can group your questions by any skills essential to the role, and scores will be displayed for each group plus the overall assessment score.
Group the questions into the constructs they assess to see how well candidates perform in each of the attributes, as well as performance on the overall assessment. Is customer empathy more important than attention to detail in this role? You will be able to see where the candidate’s strengths lie and how well they perform in each of the constructs you have selected, to better inform your decision-making
Click on the Skill groups tab on the left side panel.
Groups are auto-formed based on the skills you chose for the role. You can update the names of the groups, move questions from one group to another, and add new groups if needed. When you add a new group, the group will start appearing in the Skills field in the question editor.
To add a new group in your Skill Group settings, click "Add New Skill" at the top to add additional skills. You can edit the name and move the questions to the corresponding group. Any changes you make will be saved automatically.
You also have the option to randomize questions within a skill group. Slide the toggle button to the right to enable randomization. Once randomization is enabled, you have the option to choose how many questions in that group you want randomized.
We recommend displaying scores in percentages but if you prefer to see text displayed for a score range, then toggle the “Advanced Scoring” button to activate the options.
You can choose how to display the results by toggling the Advanced Scoring button to the right.
When you activate this button, the display options will appear under each group. You can choose to display the results as a percentage or custom text based on a score range.
If you choose to display text depending on a specific score, you will need to enter the specific text you would like to appear for a certain range of points like below.
Group the questions accordingly and choose how you want the scores displayed.
Question Types
The following question/answer options are available:
- Text - traditional text questions without the use of any media
- Audio - your candidate will see an option to record audio.
- Video - your candidate will see an option to record or upload a video.
- Multiple Choice - you can choose if you want candidates to select more than one option or choose one option. When setting the options, you must assign a value of 10 to the correct option. You can also attach media to the answer choices.
- Number - this question type only allows a number in the response field and is auto-graded. You must enter the correct number value in the correct answer field when setting up this question.
- Info - this question type allows you to enter content for the candidate to review and is not graded
- Upload - candidate can upload a file to respond
- Code - You can test a candidate's coding skills.
- Document, Presentation, Spreadsheet, and Spreadsheet auto-graded - Immersive questions using Google Suite applications. These question types are explained in the following section.
Immersive Question Options
This feature integrates with Google Docs, Google Sheets, and Google Slides. This means that there is no need to have a candidate download a file and then upload a file as their response.
All the work can be done right on our platform. When you choose one of these question types, you will have the option to create the document right through our app or upload a file from your computer.
The following are the immersive question types you can choose from:
Spreadsheet - Integration with Google Sheets and equivalent to Microsoft Excel. Candidates have the ability to manipulate data and use formulas to solve problems
Spreadsheet Auto-graded: This question type has the same functionality as the Spreadsheet option but allows you to automatically grade an input by providing the cell information and the correct answer. You can see how this works here.
Presentation - Integration with Google Slides and equivalent to Microsoft Powerpoint. Candidates have the ability to create or edit presentations.
Document - Integration with Google Docs and equivalent to Microsoft Word. Candidates have the ability to create or edit text documents.
If you choose one of the Google question types the candidate will be able to provide an answer right in the document.
If you choose a code editor question and would like for candidates to create code, then you can choose Code in the question type option.
Auto-Graded, Multiple-Choice Assessment
If you want to instantly qualify candidates based on certain criteria or test their knowledge in a certain field you can set up an auto-graded assessment made up of question types that are graded automatically.
For a step-by-step guide on how to create an auto-graded assessment, read this article here.
Coding Challenges
Testing for coding skills on Vervoe just got easier. You can allow candidates to code in several languages. When you choose the code answer type, you will have the option to automatically grade candidate code with test cases.
Automatic grading allows you to add test cases and to assign point values to them. In addition, enabling this option allows candidates to run their code while taking the test and iterate on their solution.
For complete details on how to set up coding challenges, please read this article here.
Duplicating an Assessment
To duplicate an assessment, click on the 3 dots located in the bottom right corner of the assessment card and choose "Duplicate". A copy will appear with an updated title that includes the copy number. For example, the duplicated assessment title will be "Content Writer- 1" for the assessment shown in the image below.
Click open the assessment to make changes to the questions and changes to settings or groups.
Editing an Assessment
To edit an active assessment click on the assessment, then the "Create" tab to access the editor.
To edit an inactive assessment, click on the 3 dot menu on the bottom right of the card and choose "Edit".
Once you've completed this step, take a look at Step 2 - Share your assessment with candidates.