Quality Report Framework
Effectively monitor project quality, track defect resolution, and communicate posture to sponsors with this standard reporting artifact.
§1Purpose of the Quality Report
The Quality Report is the primary output of the "Manage Quality" process, serving as the bridge between raw testing data and strategic project governance.
Prepared periodically (often monthly or at phase gates) by the Project Manager or Quality Lead, the report synthesises granular metrics—such as defect density, test coverage, and audit findings—into a coherent posture. Sponsors and steering committees rely on this document to make informed, data-driven decisions regarding phase-gate approvals, corrective actions, and overall project health.
A properly structured report replaces anecdotal assessments of quality with empirical evidence, standardising how performance is communicated across the portfolio.
Contents§2Metric Tracking Architecture
At the core of the template is the Quality Status by Metric table. This forces the project team to define quantifiable criteria at the project's outset and continually measure against them. Each metric requires:
Metric Definition (ID)
A unique identifier and clear description of what is being measured (e.g., WCAG 2.1 AA Accessibility, Defect Resolution Time, Code Review Coverage).
Current Measurement
The empirical data captured during the reporting period. Avoid subjective terms; use percentages, average days, or explicit counts (e.g., 1.5d average resolution).
§3Defect Summaries & Corrective Action
Beyond raw metrics, the report must contextualise the defect landscape and outline a path forward. This prevents the document from becoming a passive log and transforms it into an active management tool.
- Defect Summary (Cumulative): Track the total volume of defects logged versus resolved. Crucially, break down the open defects by severity (Sev-1 to Sev-4) and categorise them (e.g., UI/Visual, Functional, Performance). Identifying a trend—such as a decreasing Sev-1/2 burn-down—provides confidence for upcoming User Acceptance Testing (UAT).
- Quality Audit Findings: If a phase gate or independent review occurred during the period, synthesise the good practices observed, the deficiencies identified, and any process bottlenecks.
- Process Improvements: For any metric marked "At Risk" or "Off Track", the PM must document a specific, assigned corrective action.
§4Worked Example: Digital Project
To demonstrate the template in practice, consider the data below synthesised from a recent digital implementation (Mary's Consulting Website). It illustrates how metrics, defects, and actionable recommendations are formatted at the end of a build phase.
| ID | Metric | Current Measurement | Status |
|---|---|---|---|
| QM-01 | Accessibility (WCAG 2.1 AA) | Pre-audit found 4 Sev-3 contrast issues, 0 Sev-1/2 | On Track |
| QM-02 | Performance – LCP | 1.9s (75th-percentile) on 4G | On Track |
| QM-04 | Defect Density | 0.6 Sev-1/Sev-2 defects per template | At Risk |
| QM-07 | Test Coverage | 62% on JS components (Target: 80%) | At Risk |
| QM-10 | Content Submission Rate | 44% (Target was 60% by Sep 25) | Off Track |
A total of 47 defects were logged over the period. By the gate review, 60% (28) were resolved, leaving 19 open. Crucially, the severity burn-down is healthy: zero Sev-1 defects remain, and the 4 remaining Sev-2 items are actively being worked. The defect categorisation shows a heavy skew toward visual issues (38%) over functional logic (28%).
Derived Corrective Actions: Based on the data above, the PM formulated specific interventions. Because test coverage was "At Risk" (QM-07), a developer was allocated six dedicated hours in the upcoming sprint to write tests for under-covered components. To address the "Off Track" content submission (QM-10), the PM proposed a tiered launch strategy to mitigate schedule slip, which was formally tracked in the issue register.
ContentsWhen to Use
At the end of standard reporting periods (monthly), immediately prior to phase-gate approvals, or ahead of major UAT cycles.
Key Inputs
Test execution logs, automated CI/CD pipeline metrics, accessibility/security scan results, and the project issue register.
Primary Audience
Project Sponsors, Steering Committees, and Quality Assurance Leads requiring visibility into project health.
