# 5. Assessment Analytics — Test Cases

User Type: **Super Administrator**
Source: *Mi Digital Academy - Education CRM Features Document*
Spec: assessment_analytics.md — every feature, sub-feature, and rule covered

---

## Test Execution Policy
- Zero tolerance: any deviation from documented behavior = FAILED = bug
- Every bug is immediately logged/reported (Bug ID, feature, sub-feature,
  expected vs actual, severity) and fixed 100% before the group passes
- Feature group passes only at 100% test pass rate

## Coverage Matrix
| Feature | Sub-feature / Rule | Test IDs |
|---------|--------------------|----------|
| 5.1 Time Spent per Question | Time tracking: the duration per question recorded for each attempt | TC-SA-08-05-001 |
| 5.1 Time Spent per Question | Per-question average: the average time per question across attempts | TC-SA-08-05-002 |
| 5.1 Time Spent per Question | Slow-question flag: a question with an unusually high average time flagged | TC-SA-08-05-003 |
| 5.1 Time Spent per Question | Fast-question flag: a question with an unusually low average time flagged | TC-SA-08-05-004 |
| 5.1 Time Spent per Question | Learner view: a learner's own time per question (their pacing) | TC-SA-08-05-005 |
| 5.1 Time Spent per Question | Correlation: the time correlated with the correctness (slow-and-wrong signals difficulty) | TC-SA-08-05-006 |
| 5.1 Time Spent per Question | Audit/logging of the analytics reviews (where applicable) | TC-SA-08-05-007 |
| 5.1 Time Spent per Question | Rule: the time per question is recorded per attempt; the average is across the attempts | TC-SA-08-05-001 |
| 5.1 Time Spent per Question | Rule: a slow question is correlated with the correctness; the cause (difficulty vs. parsing) is distinguished | TC-SA-08-05-006 |
| 5.1 Time Spent per Question | Rule: a fast question is reviewed (trivial or guessed); it is not assumed fine | TC-SA-08-05-004 |
| 5.1 Time Spent per Question | Rule: the time data informs the question quality (a phrasing fix) and the content (a concept that needs clearer teaching) | TC-SA-08-05-008 |
| 5.1 Time Spent per Question | Rule: the learner's own time-per-question is visible; it supports their self-assessment | TC-SA-08-05-005 |
| 5.1 Time Spent per Question | Rule: analytics reviews are logged where applicable | TC-SA-08-05-007 |
| 5.2 Topic-Wise Accuracy | Topic-wise accuracy: the correct-answer proportion per topic | TC-SA-08-05-009 |
| 5.2 Topic-Wise Accuracy | Per-topic metric: the accuracy measured for each topic | TC-SA-08-05-010 |
| 5.2 Topic-Wise Accuracy | Weak-topic flag: a topic with a low accuracy flagged for review | TC-SA-08-05-011 |
| 5.2 Topic-Wise Accuracy | Strong-topic identification: the topics with a high accuracy | TC-SA-08-05-012 |
| 5.2 Topic-Wise Accuracy | Trend: the topic accuracy over time (improving or declining) | TC-SA-08-05-013 |
| 5.2 Topic-Wise Accuracy | Correlation: the accuracy correlated with the content (the topic's teaching) | TC-SA-08-05-014 |
| 5.2 Topic-Wise Accuracy | Audit/logging of the analytics reviews (where applicable) | TC-SA-08-05-015 |
| 5.2 Topic-Wise Accuracy | Rule: the topic-wise accuracy is the correct-answer proportion per topic; it measures mastery by topic | TC-SA-08-05-009 |
| 5.2 Topic-Wise Accuracy | Rule: the accuracy is read in context (the topic's difficulty, the questions' difficulty); a raw low accuracy is not automatically a failure | TC-SA-08-05-016 |
| 5.2 Topic-Wise Accuracy | Rule: the trend is over time; a single snapshot is not the whole picture | TC-SA-08-05-013 |
| 5.2 Topic-Wise Accuracy | Rule: a weak topic is correlated with the content; the cause (teaching vs. inherent difficulty) is distinguished | TC-SA-08-05-014 |
| 5.2 Topic-Wise Accuracy | Rule: a weak-topic flag marks the topic for review; the flag is a signal, not an automatic action | TC-SA-08-05-011 |
| 5.2 Topic-Wise Accuracy | Rule: analytics reviews are logged where applicable | TC-SA-08-05-015 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Peer comparison: the learner's result compared to the group (anonymous) | TC-SA-08-05-017 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Anonymity: the peer data does not identify individuals | TC-SA-08-05-018 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Comparison metric: the relative standing (the percentile, the band) | TC-SA-08-05-019 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Historical trend: the learner's results over time (the progression) | TC-SA-08-05-020 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Trend direction: the trend improving, stable, or declining | TC-SA-08-05-021 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Learner visibility: the comparison and trend shown to the learner | TC-SA-08-05-022 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Group visibility: the aggregate (anonymous) performance shown to the Super Admin | TC-SA-08-05-023 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Audit/logging of the configuration (where applicable) | TC-SA-08-05-024 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: the peer comparison is anonymous; the peer data does not identify individuals (only the aggregate and the learner's own standing) | TC-SA-08-05-018 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: the comparison metric is the relative standing (the percentile/band); it is a context, not a ranking of named individuals | TC-SA-08-05-019 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: the historical trend is the learner's results over time; the direction (improving, stable, declining) is visible | TC-SA-08-05-020 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: a declining trend is surfaced to the learner; a support/review path is available (it is not a silent decline) | TC-SA-08-05-025 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: the group aggregate is anonymous; the platform's performance is understood without exposing individuals | TC-SA-08-05-023 |
| 5.3 Peer Comparison (Anonymous) and Historical Performance Trends | Rule: the configuration is logged where applicable | TC-SA-08-05-024 |

## 5.1 Time Spent per Question

### TC-SA-08-05-001 — Time tracking: the duration per question recorded for each attempt; the time per question is recorded per attempt
**Type:** Positive
**Covers:** 5.1 → Time tracking: the duration per question recorded for each attempt; Rule: the time per question is recorded per attempt; the average is across the attempts
**Preconditions:** A learner is taking an assessment.
**Steps:**
1. As the learner, take the assessment, spending varying time on each question.
2. Verify the duration per question is recorded for the attempt.
**Expected Result:** The duration per question is recorded for each attempt.
**Priority:** Critical

### TC-SA-08-05-002 — Per-question average: the average time per question across attempts
**Type:** Positive
**Covers:** 5.1 → Per-question average: the average time per question across attempts
**Preconditions:** Multiple attempts have been recorded for a question.
**Steps:**
1. Review the per-question average time across the attempts.
2. Verify the average is computed correctly.
**Expected Result:** The per-question average time is computed across the attempts.
**Priority:** High

### TC-SA-08-05-003 — Slow-question flag: a question with an unusually high average time flagged
**Type:** Positive
**Covers:** 5.1 → Slow-question flag: a question with an unusually high average time flagged
**Preconditions:** A question has an unusually high average time.
**Steps:**
1. Review the time analytics.
2. Verify the question with the unusually high average time is flagged.
**Expected Result:** The slow question (unusually high average time) is flagged.
**Priority:** High

### TC-SA-08-05-004 — Fast-question flag: a question with an unusually low average time flagged; a fast question is reviewed (trivial or guessed); it is not assumed fine
**Type:** Negative
**Covers:** 5.1 → Fast-question flag: a question with an unusually low average time flagged; Rule: a fast question is reviewed (trivial or guessed); it is not assumed fine
**Preconditions:** A question has an unusually low average time.
**Steps:**
1. Review the time analytics.
2. Verify the question with the unusually low average time is flagged.
3. Review the fast question (trivial or guessed) and verify it is not assumed fine.
**Expected Result:** The fast question (unusually low average time) is flagged — it is reviewed (trivial or guessed), not assumed fine.
**Priority:** High

### TC-SA-08-05-005 — Learner view: a learner's own time per question (their pacing); it supports their self-assessment
**Type:** Positive
**Covers:** 5.1 → Learner view: a learner's own time per question (their pacing); Rule: the learner's own time-per-question is visible; it supports their self-assessment
**Preconditions:** A learner has completed an assessment.
**Steps:**
1. As the learner, view their own time per question.
2. Verify their pacing is visible (the time spent on each question).
**Expected Result:** The learner's own time per question is visible — it supports their self-assessment.
**Priority:** Medium

### TC-SA-08-05-006 — Correlation: the time correlated with the correctness (slow-and-wrong signals difficulty); the cause (difficulty vs. parsing) is distinguished
**Type:** Positive
**Covers:** 5.1 → Correlation: the time correlated with the correctness (slow-and-wrong signals difficulty); Rule: a slow question is correlated with the correctness; the cause (difficulty vs. parsing) is distinguished
**Preconditions:** A question has high average time and low correctness (slow-and-wrong).
**Steps:**
1. Review the correlation: the time per question vs. the correctness.
2. Verify the slow-and-wrong question signals difficulty.
3. Verify the cause (difficulty vs. parsing) is distinguished.
**Expected Result:** The time is correlated with the correctness — the slow-and-wrong question signals difficulty; the cause (difficulty vs. parsing) is distinguished.
**Priority:** High

### TC-SA-08-05-007 — Analytics reviews are logged where applicable
**Type:** Positive
**Covers:** 5.1 → Audit/logging of the analytics reviews (where applicable); Rule: analytics reviews are logged where applicable
**Preconditions:** An analytics review has been performed (a flagged question reviewed).
**Steps:**
1. Open the audit trail and filter by "analytics review".
2. Verify the review is logged (the question, the review, the timestamp).
**Expected Result:** The analytics review is logged where applicable.
**Priority:** Medium

### TC-SA-08-05-008 — The time data informs the question quality (a phrasing fix) and the content (a concept that needs clearer teaching)
**Type:** Positive
**Covers:** 5.1 → Rule: the time data informs the question quality (a phrasing fix) and the content (a concept that needs clearer teaching)
**Preconditions:** The time analytics show a slow-and-wrong question (a phrasing issue) and a concept with high time and low correctness (needs clearer teaching).
**Steps:**
1. Review the time data.
2. Verify the slow-and-wrong question is routed for a phrasing fix (question quality).
3. Verify the concept with high time and low correctness is routed for clearer teaching (content).
**Expected Result:** The time data informs the question quality (a phrasing fix) and the content (a concept that needs clearer teaching).
**Priority:** High

## 5.2 Topic-Wise Accuracy

### TC-SA-08-05-009 — Topic-wise accuracy: the correct-answer proportion per topic; it measures mastery by topic
**Type:** Positive
**Covers:** 5.2 → Topic-wise accuracy: the correct-answer proportion per topic; Rule: the topic-wise accuracy is the correct-answer proportion per topic; it measures mastery by topic
**Preconditions:** Assessment results exist across multiple topics.
**Steps:**
1. Review the topic-wise accuracy: the correct-answer proportion per topic.
2. Verify the accuracy is computed per topic.
**Expected Result:** The topic-wise accuracy is the correct-answer proportion per topic — it measures mastery by topic.
**Priority:** Critical

### TC-SA-08-05-010 — Per-topic metric: the accuracy measured for each topic
**Type:** Positive
**Covers:** 5.2 → Per-topic metric: the accuracy measured for each topic
**Preconditions:** Assessment results exist across multiple topics.
**Steps:**
1. Review the per-topic accuracy metric.
2. Verify each topic has its accuracy measured.
**Expected Result:** The accuracy is measured for each topic.
**Priority:** High

### TC-SA-08-05-011 — Weak-topic flag: a topic with a low accuracy flagged for review; the flag is a signal, not an automatic action
**Type:** Positive
**Covers:** 5.2 → Weak-topic flag: a topic with a low accuracy flagged for review; Rule: a weak-topic flag marks the topic for review; the flag is a signal, not an automatic action
**Preconditions:** A topic has a low accuracy.
**Steps:**
1. Review the topic-wise accuracy.
2. Verify the topic with the low accuracy is flagged for review.
3. Verify the flag is a signal (it marks the topic for review, not an automatic action).
**Expected Result:** The weak topic (low accuracy) is flagged for review — the flag is a signal, not an automatic action.
**Priority:** High

### TC-SA-08-05-012 — Strong-topic identification: the topics with a high accuracy
**Type:** Positive
**Covers:** 5.2 → Strong-topic identification: the topics with a high accuracy
**Preconditions:** Assessment results exist across multiple topics.
**Steps:**
1. Review the topic-wise accuracy.
2. Verify the topics with a high accuracy are identified (the strong topics).
**Expected Result:** The strong topics (high accuracy) are identified.
**Priority:** Medium

### TC-SA-08-05-013 — Trend: the topic accuracy over time (improving or declining); a single snapshot is not the whole picture
**Type:** Positive
**Covers:** 5.2 → Trend: the topic accuracy over time (improving or declining); Rule: the trend is over time; a single snapshot is not the whole picture
**Preconditions:** Topic accuracy data exists over multiple time periods.
**Steps:**
1. Review the topic accuracy trend over time.
2. Verify the trend (improving or declining) is visible.
3. Verify a single snapshot is not the whole picture (the trend is shown).
**Expected Result:** The topic accuracy trend over time is visible — improving or declining; a single snapshot is not the whole picture.
**Priority:** High

### TC-SA-08-05-014 — Correlation: the accuracy correlated with the content (the topic's teaching); the cause (teaching vs. inherent difficulty) is distinguished
**Type:** Positive
**Covers:** 5.2 → Correlation: the accuracy correlated with the content (the topic's teaching); Rule: a weak topic is correlated with the content; the cause (teaching vs. inherent difficulty) is distinguished
**Preconditions:** A weak topic (low accuracy) exists.
**Steps:**
1. Review the weak topic's accuracy.
2. Correlate it with the content (the topic's teaching).
3. Verify the cause (teaching vs. inherent difficulty) is distinguished.
**Expected Result:** The weak topic is correlated with the content — the cause (teaching vs. inherent difficulty) is distinguished.
**Priority:** High

### TC-SA-08-05-015 — Analytics reviews are logged where applicable
**Type:** Positive
**Covers:** 5.2 → Audit/logging of the analytics reviews (where applicable); Rule: analytics reviews are logged where applicable
**Preconditions:** A topic-wise accuracy review has been performed (a weak topic reviewed).
**Steps:**
1. Open the audit trail and filter by "analytics review".
2. Verify the review is logged (the topic, the review, the timestamp).
**Expected Result:** The analytics review is logged where applicable.
**Priority:** Medium

### TC-SA-08-05-016 — The accuracy is read in context (the topic's difficulty, the questions' difficulty); a raw low accuracy is not automatically a failure
**Type:** Edge
**Covers:** 5.2 → Rule: the accuracy is read in context (the topic's difficulty, the questions' difficulty); a raw low accuracy is not automatically a failure
**Preconditions:** A topic has a low accuracy, but the topic and its questions are high-difficulty.
**Steps:**
1. Review the topic's accuracy in context (the topic's difficulty, the questions' difficulty).
2. Verify the raw low accuracy is not automatically a failure (it is read in context).
**Expected Result:** The accuracy is read in context (the topic's difficulty, the questions' difficulty) — a raw low accuracy is not automatically a failure.
**Priority:** Medium

## 5.3 Peer Comparison (Anonymous) and Historical Performance Trends

### TC-SA-08-05-017 — Peer comparison: the learner's result compared to the group (anonymous)
**Type:** Positive
**Covers:** 5.3 → Peer comparison: the learner's result compared to the group (anonymous)
**Preconditions:** A learner has completed an assessment; the group has completed it too.
**Steps:**
1. As the learner, view their result compared to the group (anonymous).
2. Verify the comparison is shown (the learner's standing relative to the group).
**Expected Result:** The learner's result is compared to the group (anonymous) — the learner's standing is shown.
**Priority:** High

### TC-SA-08-05-018 — Anonymity: the peer data does not identify individuals; only the aggregate and the learner's own standing
**Type:** Negative
**Covers:** 5.3 → Anonymity: the peer data does not identify individuals; Rule: the peer comparison is anonymous; the peer data does not identify individuals (only the aggregate and the learner's own standing)
**Preconditions:** A learner views the peer comparison.
**Steps:**
1. As the learner, view the peer comparison.
2. Verify the peer data does not identify individuals (only the aggregate and the learner's own standing).
3. Verify no other learner's name or identity is exposed.
**Expected Result:** The peer data does not identify individuals — only the aggregate and the learner's own standing are shown.
**Priority:** Critical

### TC-SA-08-05-019 — Comparison metric: the relative standing (the percentile, the band); it is a context, not a ranking of named individuals
**Type:** Positive
**Covers:** 5.3 → Comparison metric: the relative standing (the percentile, the band); Rule: the comparison metric is the relative standing (the percentile/band); it is a context, not a ranking of named individuals
**Preconditions:** A learner has completed an assessment.
**Steps:**
1. As the learner, view the comparison metric (the percentile, the band).
2. Verify it is a context (the relative standing), not a ranking of named individuals.
**Expected Result:** The comparison metric is the relative standing (the percentile/band) — it is a context, not a ranking of named individuals.
**Priority:** High

### TC-SA-08-05-020 — Historical trend: the learner's results over time (the progression); the direction (improving, stable, declining) is visible
**Type:** Positive
**Covers:** 5.3 → Historical trend: the learner's results over time (the progression); Rule: the historical trend is the learner's results over time; the direction (improving, stable, declining) is visible
**Preconditions:** A learner has completed multiple assessments over time.
**Steps:**
1. As the learner, view their historical trend (the results over time).
2. Verify the direction (improving, stable, declining) is visible.
**Expected Result:** The historical trend is the learner's results over time — the direction (improving, stable, declining) is visible.
**Priority:** High

### TC-SA-08-05-021 — Trend direction: the trend improving, stable, or declining
**Type:** Positive
**Covers:** 5.3 → Trend direction: the trend improving, stable, or declining
**Preconditions:** A learner has a historical trend.
**Steps:**
1. As the learner, view the trend direction.
2. Verify the trend is classified as improving, stable, or declining.
**Expected Result:** The trend direction is visible — improving, stable, or declining.
**Priority:** Medium

### TC-SA-08-05-022 — Learner visibility: the comparison and trend shown to the learner
**Type:** Positive
**Covers:** 5.3 → Learner visibility: the comparison and trend shown to the learner
**Preconditions:** A learner has completed assessments.
**Steps:**
1. As the learner, view the peer comparison and the historical trend.
2. Verify both are shown to the learner.
**Expected Result:** The peer comparison and the historical trend are shown to the learner.
**Priority:** High

### TC-SA-08-05-023 — Group visibility: the aggregate (anonymous) performance shown to the Super Admin; the platform's performance is understood without exposing individuals
**Type:** Positive
**Covers:** 5.3 → Group visibility: the aggregate (anonymous) performance shown to the Super Admin; Rule: the group aggregate is anonymous; the platform's performance is understood without exposing individuals
**Preconditions:** Assessment results exist for a group.
**Steps:**
1. As the Super Admin, view the group's aggregate performance.
2. Verify the aggregate is anonymous (no individual identities exposed).
3. Verify the platform's performance is understood without exposing individuals.
**Expected Result:** The group aggregate is anonymous — the platform's performance is understood without exposing individuals.
**Priority:** High

### TC-SA-08-05-024 — The configuration is logged where applicable
**Type:** Positive
**Covers:** 5.3 → Audit/logging of the configuration (where applicable); Rule: the configuration is logged where applicable
**Preconditions:** The peer comparison configuration has been changed.
**Steps:**
1. Open the audit trail and filter by "peer comparison configuration".
2. Verify the configuration change is logged (the change, the timestamp).
**Expected Result:** The configuration is logged where applicable.
**Priority:** Medium

### TC-SA-08-05-025 — A declining trend is surfaced to the learner; a support/review path is available (it is not a silent decline)
**Type:** Negative
**Covers:** 5.3 → Rule: a declining trend is surfaced to the learner; a support/review path is available (it is not a silent decline)
**Preconditions:** A learner has a declining historical trend.
**Steps:**
1. As the learner, view the historical trend.
2. Verify the declining trend is surfaced (not silent).
3. Verify a support/review path is available.
**Expected Result:** The declining trend is surfaced to the learner — a support/review path is available (it is not a silent decline).
**Priority:** High