Additional Create/Question Features
Creating an Auto Graded Multiple Choice Assessment
Welcome to the very first step in building a skills assessment and, ultimately, finding the best candidate for your open role! We've created a series of articles that thoroughly detail what each step entails. Below, we'll go over the many ways you can create questions for your assessment, and different settings you can utilize.
Borrow an assessment from our Assessment Library
If you prefer to use one of the many assessments created by industry experts found in our library, navigate to the Assessment Library tab in your dashboard or click Browse Library.
This section includes a collection of assessments created by people considered experts in their fields. Our experts have at least 3+ years of experience in their specific roles or fields of expertise. Our skills assessment team evaluates each assessment to ensure that it is appropriate.
Featured assessments are shown towards the top, and available categories appear above the featured section. Below the feature section, we highlight the most popular skills used by other employers. You can search for an assessment through a category or through the search bar. You can search by category (the field/industry), assessment title, or skill.
You can preview questions from any of the assessments to help you decide whether you would like to utilize that assessment. Click on the assessment card to open the details section.
Once you decide which one you would like to use, click "Add to Assessments".
Once added, it will open the assessment editor. If you would like to make a change to a question or add a question in the assessment, you can do so from here.
Please note that if you make any changes to the questions created by experts, make sure to include a correct answer sample to help the AI calculate a more accurate score.
Once you are in the assessment editor, you will also have the option to create/edit Skill Groups, make additional changes to the Assessment Settings, and customize the candidate experience by clicking the "Settings" button in the top right side of our screen.
Manually creating your own Skills Assessments
To maximize your AI accuracy and to increase candidate completion rates, please keep the following in mind:
- include a minimum of 6 questions
- at least a couple of questions that have multiple choice or text answers
- include a document, spreadsheet, or presentation question type
- don't start with a video, Google doc, spreadsheet, or presentation
- avoid adding timers to videos
- avoid starting with a video response
- ease into it, ask an easy question first, and then build up to the more difficult questions
- include a correct answer sample in the suggested answer field when relevant
For some great tips on how to write a quick and effective skills assessment, read this short article we wrote for our blog.
To create a custom skills assessment, click the blue button "Create New Assessment", located on the top right.
Next, enter your job title and the role's relevant skills, and click Create Assessment. We recommend adding no more than 3-5 skills per assessment.
Add content to your assessment
To add content, you have the following options:
AI-Assisted builder questions
Use our AI-Assisted builder to generate questions for you. Click on the Suggested tab, and the system will generate questions from our library related to the skills selected within your assessment.
Add your own questions
Once you select your question type, add your question in the content box. You can also include a video, audio, image, code, or a file download to the questions.
Additional Create/Question features
Skill assessed
The "Skill assessed" field allows you to enter the skill that pertains to the question. This is filled out by default; you can update it if necessary.
Example of a correct answer
We recommend adding example answers to your questions when creating skills assessments. Suggested answers maximize AI accuracy and provide guidance for manually scoring candidates. Read more about how this works here.
Scoring Instructions
If you will occasionally manually grade assessments, feel free to use this section to let your team know how you'd like them to do so.
Question Settings
Under this section, you can add a question timer, mark the question as required, or exclude a question from AI and manual grading. Please note that if you are using timers, having required questions may prevent candidates from submitting a required answer if they run out of time.
We recommend enabling the' do not grade' option if you have a question that does not require grading (e.g., introductory video, instructional multiple-choice, or text questions).
You can preview your assessment any time, by clicking on the Preview button located on the top right.
Deleting, Adding, and Reordering questions
To delete any question, click on the trash icon found in the questions panel or the question editor for the particular question.
To add more questions to the assessment, click on the + Add question button located towards the button of the question panel.
To reorder questions, click the 2 arrows next to the trash icon.
A small dialog box will open. Choose the position (Before or After) and select the specific question from the question drop-down list. This will position the question you want to move before or after the specific question you select from the drop-down.
Once you add all your questions, you are ready to move to the assessment settings.
Assessment Settings
To manage the settings, click on the Settings tab, located on the top right side of your screen.
Within the Assessment Settings, you can adjust the following features:
- Randomize question order for each candidate
- Randomize answer order for multiple-choice answers
- Update the Assessment Name and Description
- Set Assessment time limit and deadline (maximum of 29 days)
- Auto-reject and/or auto-progress (only if the assessment is autograded)
If you would like to add an overall timer to the assessment, please keep the following in mind:
- If you choose a time frame that is more than 4 days, this will not work. The current default is 4 days for customers on our Trial and Starter plans.
- If you set individual timers to questions in the assessment and then choose this option, all individual timers will be disabled.
- If you have added individual timers to questions, you will not be able to add a timer to the entire assessment as well.
Skill Groups Settings
Grouping questions into Skill Groups are a great way to organize your assessment's contents. Once assessments are completed, you'll be able to analyze how a candidate has scored within each group.
To access Skill Group Settings, click the aforementioned "Settings" tab on the top right of your dashboard, then click on the Skill groups tab on the left side panel.
You'll notice your questions have been automatically grouped as soon as the assessment is created. However, you can update the names of the groups, move questions from one group to another, and add new groups if needed. When you add a new group, the group will start appearing in the Skills field in the question editor.
To add a new group in your Skill Group settings, click "Add New Skill". You can then edit the name and move the questions to the corresponding group. Any changes you make will be saved automatically.
Randomization
You also have the option to randomize questions within a skill group. Slide the toggle button to the right to enable randomization. Once randomization is enabled, you can choose how many questions in that group you want to be randomized.
Question Types
The following question/answer options are available:
- Text - traditional text questions without the use of any media
- Audio - your candidate will see an option to record audio.
- Video - your candidate will see an option to record or upload a video.
- Multiple Choice - you can choose if you want candidates to select more than one option or choose one option. When setting the options, you must assign a value of 10 to the correct option. You can also attach media to the answer choices.
- Number - this question type only allows a number in the response field and is auto-graded. You must enter the correct number value in the correct answer field when setting up this question.
- Info - this question type allows you to enter content for the candidate to review and is not graded
- Upload - candidate can upload a file to respond
- Code - You can test a candidate's coding skills.
- Document, Presentation, Spreadsheet, and Spreadsheet auto-graded (not mobile-compatible) - Immersive questions using Google Suite applications. These question types are explained in the following section.
Immersive Question Options
This feature integrates with Google Docs, Google Sheets, and Google Slides. This means that there is no need to have a candidate download a file and then upload a file as their response.
All the work can be done right on our platform. When you choose one of these question types, you will have the option to create the document right through our app or upload a file from your computer.
The following are the immersive question types you can choose from:
Spreadsheet - Integration with Google Sheets and equivalent to Microsoft Excel. Candidates have the ability to manipulate data and use formulas to solve problems
Spreadsheet Auto-graded: This question type has the same functionality as the Spreadsheet option but allows you to automatically grade an input by providing the cell information and the correct answer. You can see how this works here.
Presentation - Integration with Google Slides and equivalent to Microsoft Powerpoint. Candidates have the ability to create or edit presentations.
Document - Integration with Google Docs and equivalent to Microsoft Word. Candidates have the ability to create or edit text documents.
Please note that all immersive questions are not mobile-compatible
If you choose a code editor question and would like for candidates to create code, then you can choose Code in the question type option.
Auto-Graded, Multiple-Choice Assessment
If you want to instantly qualify candidates based on certain criteria or test their knowledge in a certain field, you can set up an auto-graded assessment made up of question types that are graded automatically.
Read this article here for a step-by-step guide on creating an auto-graded assessment.
Coding Challenges
Testing for coding skills on Vervoe just got easier. You can allow candidates to code in several languages. When you choose the code answer type, you will have the option to grade candidate code with test cases automatically.
Automatic grading allows you to add test cases and assign point values to them. In addition, enabling this option allows candidates to run their code while taking the test and iterate on their solution.
For complete details on how to set up coding challenges, please read this article here.
Duplicating an Assessment
To duplicate an assessment, click on the 3 dots in the bottom right corner of the assessment card and choose "Duplicate". A copy will appear with an updated title that includes the copy number. For example, the duplicated assessment title will be "Content Writer- 1" for the assessment shown in the image below.
Click open the assessment to make changes to the questions and changes to settings or groups.
Editing an Assessment
To edit an active assessment, click on the assessment, then the "Create" tab to access the editor.
To edit an inactive assessment, click the 3 dot (ellipsis) menu on the bottom right of the card and choose "Edit".
Once you've completed this step, look at Step 2 - Share your assessment with candidates.