How to conduct Item analysis through YouTestMe GetCeartifed

This article explains how to conduct Item analysis through YouTestMe GetCertified.

There are three ways to perform the analysis:

  1. You can use a predefined test report – An item reliability report.
  2. You can use a report builder to download all the answers to the questions and then perform the analysis yourself.
  3. You can see the success ratio for each test question through the Question tab.

1. Using Predefined Test Reports

To access the Item reliability report:

  1. Click the Reporting tab in the left-side menu, and select Predefined reports.

  2. Click on Test reports.

  3. Choose the Item reliability report.

 

Clicking on the report title, you will be able to preview each question’s success ratio and item reliability

The success ratio will let you know the percentage of candidates that answered the question correctly.

Item reliability is based on point-biserial correlation and will let you know how items correlate with the test as a whole, allowing you to identify the questions that do not belong in a test. When determining the correlation between the item and the test as a whole, the system correlates the responses on that item (dichotomous variable – correctly or incorrectly answered) with the test’s outcome (continuous variable – the score on a test).
The values can range between -1 and 1.  

 

Negative values usually mean that:
– Candidates that got lower scores on the exam answered this question correctly.
– Candidates that got higher scores on the exam answered this question incorrectly.
In this case, the question does not correlate with the exam, and you may want to exclude it from the next exam versions or substitute it.

 

Positive values usually mean that:
– Candidates that got higher scores on the exam answered this question correctly.
– Candidates that got lower scores on the exam answered this question incorrectly.

In this case, the question correlates with the exam and should be included in the next versions.

 

Optionally, you can download a report as Excel or PDF file.


2. Using Report Builder

Please visit the How to create custom reports using the report builder article for information on how to use report builder.

To see each user’s question and answer information, it is important to check the boxes: Username, Text, Correct answer, and Answered. This is optional, and you can add as many criteria as possible.

Once you create a custom report, you can perform the analysis yourself.

3.  Using the success ratio through the Question tab

To see the success ratio for each question:

  1. Open the desired test.
  2. Choose the Questions tab.
  3. Preview the success ratio for each question the test contains.

 

Was this article helpful?
Dislike 0
Previous: How to get reports with number of users that took the test
Next: How to customize a PDF version of a score report
Have questions? Search our knowledgebase.