The Question Basic Analysis Report displays a significant amount of statistical information that can be useful in analyzing the effectiveness of assessment material, offering guidance towards improvement
Below are detailed explanations of what each term means on the Question Basic Analysis.
Statistical Information
| Item | Description |
|---|---|
| Total Responses | The total number of respondents that answered the question. |
| Blank Responses | The total number of respondents that did not provide an answer to the question. |
| Response Mean | The mean (average) of the numeric position of the answer choices within the question. This is useful under certain circumstances such as when there is a linear progression of the answer choices. |
| Standard Deviation | The standard deviation of the numeric position of the answer choices within the question. This is useful under certain circumstances, such as when there is a linear progression of the answer choices. |
| Average Answer Time | The average amount of time respondents spend on this question. |
| Average Recap Time | The calculated average of all the Recap times for respondents answering the question. Recap time is the amount of time that could not be attributed to a single question on a page of questions. More specifically, the Recap Time is the amount of time between a respondent selecting an answer to the last question on a page of questions (or selects an answer to the only question on a page), and navigating to another page of questions. If there is more than one question displayed on a page, the total Recap Time is divided evenly between all the questions on the page when calculating the Average Recap Time. |
Item Analysis
| Item | Description |
|---|---|
| Mean Score When Item Correct (Mp) | The mean score value for respondents answering the question correctly |
| Mean Score When Item Incorrect (Mq) | The mean score value for respondents answering the question incorrectly |
| Overall Standard Deviation (St) | Measures the range of deviation across the entire group of respondents for the item across the assessment, showing how the respondent group scores are spread out from the average. |
| Proportion Answering Correctly (p-value) | The question Item Difficulty Index. The p-value, expressed as a decimal value between 0.0 and 1, displays the proportion of respondents answering the question item correctly. A higher p-value indicates a greater proportion of respondents answered the item correctly, meaning it was an easier question item. A lower p-value indicates a lower proportion of respondents answered the item correctly, meaning it was a more difficult question item. |
| Proportion Answering Incorrectly (q-value) | The False Discovery Rate or the proportion of false positives you can expect to get from a question item, typically used when working with smaller samples. |
| Point-Biserial Correlation Coefficient (rpbi) | The correlation between respondent scores on a question item and the respondents overall total assessment score. The correlation between respondent scores on a question item is measured as 1 if a respondent answers the question item correctly, and 0 if the respondent answers a question item incorrectly. |