# 4. SRS Analytics — Test Cases

User Type: **Super Administrator**
Source: *Mi Digital Academy - Education CRM Features Document*
Spec: srs_analytics.md — every feature, sub-feature, and rule covered

## Test Execution Policy

- Zero tolerance: any deviation from the documented behavior is a defect.
- Every failed test is logged with a Bug ID, the feature, the sub-feature, the expected vs actual result, and the severity; 100% of bugs are fixed before the group passes.
- 100% pass rate is required for the group to be marked complete.

## Coverage Matrix

| Feature | Sub-feature / Rule | Test IDs |
|---------|--------------------|----------|
| 4.1 Retention Statistics | Recall success rate (overall, per content type, per subject) | TC-SA-SRS-12-001 |
| 4.1 Retention Statistics | Retention rate over time (7-day, 30-day, 90-day) and by grade band | TC-SA-SRS-12-002 |
| 4.1 Retention Statistics | Retention trend and benchmark comparison | TC-SA-SRS-12-003 |
| 4.1 Retention Statistics | Rule: no recall data → reports zero, not error | TC-SA-SRS-12-004 |
| 4.1 Retention Statistics | Rule: below-benchmark retention flagged for review | TC-SA-SRS-12-005 |
| 4.1 Retention Statistics | Audit logging of retention statistics access | TC-SA-SRS-12-006 |
| 4.2 Mastery Progression Reports | Concepts mastered per period | TC-SA-SRS-13-001 |
| 4.2 Mastery Progression Reports | Mastery by subject and grade band | TC-SA-SRS-13-002 |
| 4.2 Mastery Progression Reports | Time-to-mastery per concept and mastery distribution | TC-SA-SRS-13-003 |
| 4.2 Mastery Progression Reports | Rule: not-yet-mastered concept shows no time-to-mastery | TC-SA-SRS-13-004 |
| 4.2 Mastery Progression Reports | Rule: stalling trend flagged for review | TC-SA-SRS-13-005 |
| 4.2 Mastery Progression Reports | Audit logging of mastery progression access | TC-SA-SRS-13-006 |
| 4.3 SRS Effectiveness Metrics | Recall lift vs baseline | TC-SA-SRS-14-001 |
| 4.3 SRS Effectiveness Metrics | Review efficiency (reviews per mastered concept) | TC-SA-SRS-14-002 |
| 4.3 SRS Effectiveness Metrics | Interval calibration (actual vs predicted retention) | TC-SA-SRS-14-003 |
| 4.3 SRS Effectiveness Metrics | Graduation rate and re-entry rate | TC-SA-SRS-14-004 |
| 4.3 SRS Effectiveness Metrics | Rule: lift shown only with comparable baseline | TC-SA-SRS-14-005 |
| 4.3 SRS Effectiveness Metrics | Rule: high re-entry rate flags graduation criteria | TC-SA-SRS-14-006 |
| 4.3 SRS Effectiveness Metrics | Audit logging of effectiveness metrics access | TC-SA-SRS-14-007 |
| 4.4 Student Engagement with SRS | Review completion rate | TC-SA-SRS-15-001 |
| 4.4 Student Engagement with SRS | Daily review load adherence | TC-SA-SRS-15-002 |
| 4.4 Student Engagement with SRS | SRS skip/defer behavior | TC-SA-SRS-15-003 |
| 4.4 Student Engagement with SRS | Engagement by grade band/subject and trend | TC-SA-SRS-15-004 |
| 4.4 Student Engagement with SRS | Rule: no due reviews → excluded from completion rate | TC-SA-SRS-15-005 |
| 4.4 Student Engagement with SRS | Rule: declining trend flagged for review | TC-SA-SRS-15-006 |
| 4.4 Student Engagement with SRS | Audit logging of SRS engagement access | TC-SA-SRS-15-007 |

## 4.1 Retention Statistics

### TC-SA-SRS-12-001 — Recall success rate (overall, per content type, per subject)
**Type:** Positive
**Covers:** 4.1 → Recall success rate
**Preconditions:** A Super Admin account is active; SRS recall data exists.
**Steps:**
1. As a Super Admin, open SRS Management → Analytics → Retention.
2. Verify the recall success rate is shown overall, per content type, and per subject.
**Expected Result:** Recall success rate — delivered exactly as documented.
**Priority:** Critical

### TC-SA-SRS-12-002 — Retention rate over time (7-day, 30-day, 90-day) and by grade band
**Type:** Positive
**Covers:** 4.1 → Retention over time and grade band
**Preconditions:** SRS recall data exists over time.
**Steps:**
1. Track the retention rate over time (7-day, 30-day, 90-day).
2. Verify the retention rate by grade band is shown.
**Expected Result:** Retention rate over time and by grade band — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-12-003 — Retention trend and benchmark comparison
**Type:** Positive
**Covers:** 4.1 → Trend and benchmark
**Preconditions:** A retention benchmark (target rate) is set.
**Steps:**
1. Review the retention trend (improving/declining).
2. Compare the retention rate against the benchmark.
**Expected Result:** Retention trend and benchmark comparison — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-12-004 — Rule: no recall data → reports zero, not error
**Type:** Edge
**Covers:** 4.1 → Rule: no-data handling
**Preconditions:** A period has no recall data.
**Steps:**
1. View the retention statistics for the period.
2. Verify zero is reported, not an error.
**Expected Result:** A period with no recall data reports zero, not an error — delivered exactly as documented.
**Priority:** Medium

### TC-SA-SRS-12-005 — Rule: below-benchmark retention flagged for review
**Type:** Negative
**Covers:** 4.1 → Rule: benchmark flagging
**Preconditions:** The retention rate falls below the benchmark.
**Steps:**
1. View the retention statistics.
2. Verify the below-benchmark retention is flagged for review.
**Expected Result:** Retention falling below the benchmark is flagged for review — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-12-006 — Audit logging of retention statistics access
**Type:** Positive
**Covers:** 4.1 → Audit logging
**Preconditions:** Retention statistics have been accessed.
**Steps:**
1. Open the audit trail and filter by retention statistics access.
2. Verify entries show the actor, the scope, and the timestamp.
**Expected Result:** Audit logging of retention statistics access — delivered exactly as documented.
**Priority:** Critical

## 4.2 Mastery Progression Reports

### TC-SA-SRS-13-001 — Concepts mastered per period
**Type:** Positive
**Covers:** 4.2 → Concepts mastered per period
**Preconditions:** A Super Admin is viewing mastery progression.
**Steps:**
1. Open SRS Management → Analytics → Mastery Progression.
2. Verify the concepts mastered per period (daily, weekly, monthly) are shown.
**Expected Result:** Concepts mastered per period — delivered exactly as documented.
**Priority:** Critical

### TC-SA-SRS-13-002 — Mastery by subject and grade band
**Type:** Positive
**Covers:** 4.2 → Mastery by subject and grade
**Preconditions:** Mastery data exists across subjects and grades.
**Steps:**
1. Review mastery by subject.
2. Review mastery by grade band.
**Expected Result:** Mastery by subject and grade band — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-13-003 — Time-to-mastery per concept and mastery distribution
**Type:** Positive
**Covers:** 4.2 → Time-to-mastery and distribution
**Preconditions:** Concepts have been mastered over time.
**Steps:**
1. Review the time-to-mastery per concept (first exposure to mastered).
2. Review the mastery distribution (New / Learning / Familiar / Mastered counts).
**Expected Result:** Time-to-mastery per concept and mastery distribution — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-13-004 — Rule: not-yet-mastered concept shows no time-to-mastery
**Type:** Edge
**Covers:** 4.2 → Rule: no time-to-mastery until mastered
**Preconditions:** A concept is not yet mastered.
**Steps:**
1. View the time-to-mastery for the concept.
2. Verify no time-to-mastery is shown (not zero, not an error).
**Expected Result:** A concept not yet mastered shows no time-to-mastery — delivered exactly as documented.
**Priority:** Medium

### TC-SA-SRS-13-005 — Rule: stalling trend flagged for review
**Type:** Negative
**Covers:** 4.2 → Rule: stalling flag
**Preconditions:** No new concepts were mastered over a period.
**Steps:**
1. View the mastery trend for the period.
2. Verify the stalling trend is flagged for review.
**Expected Result:** A stalling mastery trend is flagged for review — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-13-006 — Audit logging of mastery progression access
**Type:** Positive
**Covers:** 4.2 → Audit logging
**Preconditions:** Mastery progression reports have been accessed.
**Steps:**
1. Open the audit trail and filter by mastery progression access.
2. Verify entries show the actor, the scope, and the timestamp.
**Expected Result:** Audit logging of mastery progression access — delivered exactly as documented.
**Priority:** Critical

## 4.3 SRS Effectiveness Metrics

### TC-SA-SRS-14-001 — Recall lift vs baseline
**Type:** Positive
**Covers:** 4.3 → Recall lift
**Preconditions:** A comparable non-SRS baseline exists.
**Steps:**
1. Open SRS Management → Analytics → Effectiveness.
2. Verify the recall lift vs the non-SRS baseline is shown.
**Expected Result:** Recall lift vs baseline — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-14-002 — Review efficiency (reviews per mastered concept)
**Type:** Positive
**Covers:** 4.3 → Review efficiency
**Preconditions:** Concepts have been mastered with review history.
**Steps:**
1. Review the review efficiency (reviews per mastered concept).
2. Verify the figure matches the underlying review and mastery data.
**Expected Result:** Review efficiency — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-14-003 — Interval calibration (actual vs predicted retention)
**Type:** Positive
**Covers:** 4.3 → Interval calibration
**Preconditions:** SRS scheduling and recall data exist.
**Steps:**
1. Review the interval calibration (actual vs predicted retention per interval).
2. Verify the calibration is shown per interval.
**Expected Result:** Interval calibration — delivered exactly as documented.
**Priority:** Medium

### TC-SA-SRS-14-004 — Graduation rate and re-entry rate
**Type:** Positive
**Covers:** 4.3 → Graduation and re-entry rates
**Preconditions:** Concepts have graduated and re-entered over a period.
**Steps:**
1. Review the graduation rate (concepts graduated per period).
2. Review the re-entry rate (graduated concepts re-entering).
**Expected Result:** Graduation rate and re-entry rate — delivered exactly as documented.
**Priority:** Medium

### TC-SA-SRS-14-005 — Rule: lift shown only with comparable baseline
**Type:** Negative
**Covers:** 4.3 → Rule: baseline requirement
**Preconditions:** No comparable non-SRS baseline exists.
**Steps:**
1. View the effectiveness metrics.
2. Verify the recall lift is not shown (not a fabricated value).
**Expected Result:** The recall lift is computed only when a comparable non-SRS baseline exists — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-14-006 — Rule: high re-entry rate flags graduation criteria
**Type:** Negative
**Covers:** 4.3 → Rule: re-entry flag
**Preconditions:** The re-entry rate is high (graduated concepts frequently re-entering).
**Steps:**
1. View the effectiveness metrics.
2. Verify the high re-entry rate flags the graduation criteria for review.
**Expected Result:** A high re-entry rate flags the graduation criteria for review — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-14-007 — Audit logging of effectiveness metrics access
**Type:** Positive
**Covers:** 4.3 → Audit logging
**Preconditions:** Effectiveness metrics have been accessed.
**Steps:**
1. Open the audit trail and filter by effectiveness metrics access.
2. Verify entries show the actor, the scope, and the timestamp.
**Expected Result:** Audit logging of effectiveness metrics access — delivered exactly as documented.
**Priority:** Critical

## 4.4 Student Engagement with SRS

### TC-SA-SRS-15-001 — Review completion rate
**Type:** Positive
**Covers:** 4.4 → Review completion rate
**Preconditions:** A Super Admin is viewing SRS engagement.
**Steps:**
1. Open SRS Management → Analytics → Engagement.
2. Verify the review completion rate (due reviews completed vs scheduled) is shown.
**Expected Result:** Review completion rate — delivered exactly as documented.
**Priority:** Critical

### TC-SA-SRS-15-002 — Daily review load adherence
**Type:** Positive
**Covers:** 4.4 → Daily load adherence
**Preconditions:** Students have daily review loads.
**Steps:**
1. Review the daily review load adherence per student cohort.
2. Verify the adherence figures match the underlying review data.
**Expected Result:** Daily review load adherence — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-15-003 — SRS skip/defer behavior
**Type:** Positive
**Covers:** 4.4 → Skip/defer behavior
**Preconditions:** Students have skipped or deferred reviews.
**Steps:**
1. Review the SRS skip/defer behavior.
2. Verify skipped and deferred reviews are reported.
**Expected Result:** SRS skip/defer behavior — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-15-004 — Engagement by grade band/subject and trend
**Type:** Positive
**Covers:** 4.4 → Engagement breakdown and trend
**Preconditions:** SRS engagement data exists across grade bands and subjects.
**Steps:**
1. Track engagement by grade band and subject.
2. Review the engagement trend (improving/declining).
**Expected Result:** Engagement by grade band and subject and trend — delivered exactly as documented.
**Priority:** Medium

### TC-SA-SRS-15-005 — Rule: no due reviews → excluded from completion rate
**Type:** Edge
**Covers:** 4.4 → Rule: no-due exclusion
**Preconditions:** A student has no due reviews in a period.
**Steps:**
1. View the review completion rate for the period.
2. Verify the student is excluded from the completion rate (not counted as a miss).
**Expected Result:** A student with no due reviews in a period is excluded from the completion rate — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-15-006 — Rule: declining trend flagged for review
**Type:** Negative
**Covers:** 4.4 → Rule: declining flag
**Preconditions:** The SRS engagement trend is declining.
**Steps:**
1. View the engagement trend.
2. Verify the declining trend is flagged for review.
**Expected Result:** A declining engagement trend is flagged for review — delivered exactly as documented.
**Priority:** High

### TC-SA-SRS-15-007 — Audit logging of SRS engagement access
**Type:** Positive
**Covers:** 4.4 → Audit logging
**Preconditions:** SRS engagement analytics have been accessed.
**Steps:**
1. Open the audit trail and filter by SRS engagement access.
2. Verify entries show the actor, the scope, and the timestamp.
**Expected Result:** Audit logging of SRS engagement access — delivered exactly as documented.
**Priority:** Critical