Randomization and Selection of Questions and Question Groups

Brillium offers numerous ways to handle randomization and selection of questions and question groups. The options for randomizing and selecting groups are on the Basic Assessment Options page, whereas options for randomizing questions are on the Question Group Editor page (for each individual question group).

Randomization of Questions within a Group

It is very common for authors of Brillium assessments to want to randomly select a subset of questions from a question group. For example, if you wished to randomly select 5 questions from a question group that has 10 total questions. You would edit the question group that you wish to change the randomization options for by clicking the edit icon beside the question group in the Assessment Editor. Each question group can have its own randomization options.

Then you would set the Question Presentation setting to "Random" and the Questions to Ask setting to "5".

These settings would have Brillium randomize the assessment differently for each respondent that took the assessment. If more than 5 questions existed within the question group, Brillium would randomly select 5 from the total number of available questions. If there were 5 or less questions in the group, it would select all of the available questions and present them in a random order for each respondent.

The other options available for the Question Presentation on this page are "Sequential" and "Branching" (which is only available for the branching assessment mode). The "Sequential" setting will present the number of Questions to Ask sequentially (or in the order shown in the editor, instead of randomly). If you have 10 questions in the group and select to sequentially present 5 of them, Brillium will always select the first 5 questions in the group for each respondent and the last 5 questions will not be seen by respondents, so watch out for that. The "Branching" setting is there to allow branching style questions to be present within the question group. If a group isn't set to Branching, you will not be able to add branching style questions to it.

Note: A setting of "99999" for the Questions to Ask setting just indicates to ask ALL the questions in the group. It doesn't mean you have to have 99999 questions.

Randomization of Question Groups within an Assessment

Now that we know how to randomize questions within a question group, we will discuss how to randomize question groups within an assessment. For example, let's assume you wanted to randomly select 3 question groups from all of the question groups available within your assessment for each respondent. We will need to go to the Basic Assessment Options editor page for the assessment.

Then you would set the Group Presentation setting to "Random" and the Groups to Ask setting to "3".

These settings would also have Brillium randomize the assessment differently for each respondent that took the assessment. If more than 3 question groups existed within the assessment, Brillium would randomly select 3 from the total number of available question groups. If there were 3 or less question groups in the assessment, it would select all of the available question groups and present them in a random order for each respondent.

The other options available for the Group Presentation setting on this page are "Sequential" and "Random, Specify Total Questions". The "Sequential" setting will present the number specified in the Groups to Ask setting sequentially (or in the order shown in the editor, instead of randomly). If you have 7 question groups in the assessment and select to sequentially present 3 of them, Brillium will always select the first 3 question groups in the assessment for each respondent and the last 4 question groups will not be seen by respondents, so watch out for that. The "Random, Specify Total Questions" setting will allow you to specify the total number of questions that should appear on each respondent's assessment regardless of how many question groups or questions within each of those groups. Brillium will select questions evenly from each question group until all questions from each group are chosen or the Total Questions to Ask setting number is reached, whichever comes first.

In the example image above, Brillium will select a total number of 20 questions evenly from all of the available question groups. If there were 5 question groups in the assessment and each question group had 10 questions (for a total set of 50 available questions), Brillium would randomly select 4 questions from each of the 5 groups to give each respondent 20 questions as directed.

Note: Brillium never selects questions from the "Unassigned Question Set" regardless of what settings are used for Group Presentation or Question Presentation.

Have more questions? Submit a request

Comments

0 comments

Please sign in to leave a comment.