This article explains how to create a Generated Test with either unlimited or limited versions.
The test generator creates unique question sets for each candidate by applying customizable rules. Questions can be organized into pools based on knowledge areas, with specific proportions defined for each pool.
Creating a Generated Test
To create a generated test, follow these steps:
- Navigate to the Tests section and select New Test.
- Complete the first two steps of the test creation wizard. For detailed instructions on completing these steps, please refer to the following article.
- In the third step of the wizard, select Let the automated test generator select questions.
- Select this option if you want the test to be generated based on question difficulty.
- Select this option if you want the test to be generated based on the question categories.
Generate tests based on question difficulty
Once this method is selected, proceed by following the next steps:
- In the fourth step of the wizard, select Add Questions.
- Click the Select question pool button to include questions from as many question pools as you wish. The system will use questions from selected pools to generate different test versions. You can also allow different points in test versions. The point and penalty of each question will be pulled from the configuration of the question itself instead of making it uniform for all questions. By enabling this option, you can include branching questions and questions with the scoring method by answer weight in test versions as well.
- Click on the drop-down menu to view all available pools in the system and select the desired question pool.
- Select the number of easy questions that will be imported from the selected pool to the test. If no questions are labeled as Easy, you won’t be able to add them.
- Select the number of medium questions that will be imported from the selected pool to the test. If no questions are labeled as Medium, you won’t be able to add them.
- Select the number of hard questions that will be imported from the selected pool to the test. If no questions are labeled as Hard, you won’t be able to add them.
- Click the Save button.
- Include the frequency factor when generating test versions. The system will take into account the frequency factor defined for each question and determine how often it will appear in the test versions.
- Edit the question pool by clicking the pencil icon.
- Delete the added question pool by clicking the trash icon.
- Enable Allow different points in test versions option. By default, branching questions and questions with the scoring method by answer weight are not included when generating test versions. Enabling this option includes them in test versions. Additionally, it allows the point and penalty of each question to be pulled from the configuration of the question itself instead of being uniform for all questions.
Note: This option can only be selected before adding the question pools. - You can add more question pools if desired.
- Define the number of points per question difficulty category – Points a candidate will achieve for answering correctly easy, medium, and hard questions.
- Define the number of penalty points per question difficulty category – Points deducted when a candidate answers easy, medium, or hard questions incorrectly.
- Dynamically generate an unlimited number of test versions.
- Define the number of different test versions that will be created.
- When starting the test, allow candidates to specify the desired number of questions from each question pool that the test will contain.
Generate tests based on question categories
Once this method is selected, proceed by following the next steps:
- Click the New rule button to include questions from as many question pools as possible. The system will use questions from selected pools to generate different test versions.
- Click on the drop-down menu to view all available pools in the system and select the desired question pool.
- Choose the number of questions that will be imported from the selected pool to the test.
- Set the number of points for each question.
- Check the number of available questions.
- Include all questions from the question pool with the desired condition.
- Set the penalty for each question.
- Click the Add new condition button to set values for a question category that will be used for filtering in the test generation process.
- Click the Confirm button.
- Edit the settings by clicking the pencil icon.
- Delete the added rule by clicking the trash icon.
- Enable the option to generate test versions dynamically.
- Define the number of unique test versions as either unlimited or limited.
- Enable the Practice Test option.
For detailed instructions on filling out the remaining steps, please refer to the following article.
Frequency Factor
In addition to existing rules for generating questions, this article explains how to set frequency factor rules. These allow you to:
-
Ensure that essential questions appear more frequently.
-
Exclude outdated or irrelevant questions from generated tests.
This helps maintain consistent test quality and relevance over time.
