How to Conduct Item Analysis through YouTestMe GetCertified

Article verified for Release 15.1 on October 5, 2025.

This article provides a comprehensive guide on conducting Item analysis using YouTestMe GetCertified. Item analysis allows you to assess the reliability and effectiveness of test questions.

There are four ways to conduct item analysis:

Predefined Test Report – You can utilize the item reliability report provided by YouTestMe GetCertified. This report offers insights into the performance of each test question, allowing you to assess the reliability and effectiveness of the items.
Report Builder – The platform also offers a report builder feature that enables you to download all the answers to the questions. With this downloaded data, you can perform item analysis independently, gaining more flexibility and control over the analysis process.
Statistics on Question Level – Within YouTestMe GetCertified, you have access to detailed statistics at the question level. This feature allows you to evaluate the performance, difficulty, and effectiveness of each question in a test.
Statistics on Answer Level – You can also analyze statistics at the answer level to understand how candidates interact with each possible answer. This provides deeper insights into the quality and clarity of the answer choices, helping to refine test questions further.

Using predefined test reports

To access the Item Reliability report, follow the next steps:

Click the Reporting option in the main menu, and select Predefined Reports.
Click on Test Reports.

Choose the Item reliability report.

Click the Details button of the desired test to preview each question’s success ratio and item reliability.

On the displayed screen, the following metrics are shown:

Item reliability is based on point-biserial correlation and will let you know how items correlate with the test as a whole, allowing you to identify the questions that do not belong in a test. When determining the correlation between the item and the test as a whole, the system correlates:
- The responses on that item (dichotomous variable – correctly or incorrectly answered)
- With the test’s outcome (continuous variable – the score on a test)
The values can range between -1 and 1.

Negative values usually mean that:
- Candidates who got lower scores on the exam answered this question correctly.
- Candidates who got higher scores on the exam answered this question incorrectly.
In this case, the question does not correlate with the exam, and you may want to exclude it from the next exam versions or substitute it.

Positive values usually mean that:
- Candidates who got higher scores on the exam answered this question correctly.
- Candidates who got lower scores on the exam answered this question incorrectly.
In this case, the question correlates with the exam and should be included in the next exam versions.
The success ratio provides the percentage of candidates who answered the question correctly.
Standard deviation measures the variability of success ratios for individual questions, helping identify inconsistent performance and correlations between question difficulty and overall test scores

Using report builder

To access the report builder from the main application menu, select the Reporting tab in the left-side menu and select the Report Builder tab.
Select the test using the Name column or ID to display a Report Builder for a specific test.

For detailed instructions on how to create custom reports using Report Builder, please visit this article

Statistics on Question Level

Navigate to Test and select Manage Test.
Open the desired test.
Go to the Questions tab.
In the list of test versions, click on the eye icon from the Action tab.