8.5 KiB
Metrics Review Instructions
Objective
Perform in-depth analysis of metric trends, identify patterns and anomalies, correlate metrics with events, and generate actionable insights for continuous improvement.
Prerequisites
- Historical metric data (at least 3 periods recommended)
- Module state with recorded metric history
- Context about recent changes (releases, team changes, process changes)
Define Review Scope
What type of metrics review is this? [s] Sprint retrospective review [m] Monthly business review [q] Quarterly planning review [a] Ad-hoc investigation
Review type:
Store as {{review_type}}
Is there a specific focus area for this review? [v] Velocity and delivery [q] Quality and testing [p] Process efficiency [c] Capacity and planning [n] No specific focus - comprehensive review
Focus:
Store as {{focus_area}}
What period should we analyze?
- From: (date or "last_sprint")
- To: (date or "current")
Period:
Store as {{analysis_period}}
Load Historical Data
Load metric history from module-state.yaml Load previous {{review_type}} review if exists Identify comparison baseline period
Data Loaded:
- Historical periods available: {{periods_count}}
- Earliest data: {{earliest_date}}
- Latest data: {{latest_date}}
- Baseline period: {{baseline_period}}
Trend Analysis
Calculate trends for each tracked metric Identify improving, stable, and declining metrics
Velocity Trends:
Sprint Velocity (Last 6 Sprints)
│
│ ▲
│ ▲ ▲ ▲
│ ▲ ▲ ▲
│ ▲ ▲
├─────────────────
S1 S2 S3 S4 S5 S6
Rolling Average: {{velocity_avg}}
Trend: {{velocity_trend}} ({{velocity_change}}%)
Quality Trends:
| Metric | 3 Periods Ago | 2 Periods Ago | Last Period | Current | Trend |
|---|---|---|---|---|---|
| Test Coverage | {{cov_3}}% | {{cov_2}}% | {{cov_1}}% | {{cov_0}}% | {{cov_trend}} |
| Pass Rate | {{pass_3}}% | {{pass_2}}% | {{pass_1}}% | {{pass_0}}% | {{pass_trend}} |
| Defect Rate | {{def_3}} | {{def_2}} | {{def_1}} | {{def_0}} | {{def_trend}} |
Delivery Trends:
| Metric | Trend | Change | Assessment |
|---|---|---|---|
| Cycle Time | {{cycle_trend}} | {{cycle_change}} | {{cycle_assessment}} |
| PR Review Time | {{pr_trend}} | {{pr_change}} | {{pr_assessment}} |
| Deploy Frequency | {{deploy_trend}} | {{deploy_change}} | {{deploy_assessment}} |
Anomaly Detection
Identify metrics with significant deviations from baseline Flag sudden changes (>20% swing) Check for correlation with known events
Anomalies Detected:
{{#each anomalies}}
{{metric_name}}
- Current Value: {{current}}
- Expected Range: {{expected_min}} - {{expected_max}}
- Deviation: {{deviation_percent}}%
- First Detected: {{first_detected}}
- Possible Causes: {{possible_causes}}
{{/each}}
{{anomaly_metric}} {{anomaly_current}} {{anomaly_expected}} {{anomaly_deviation}} {{anomaly_severity}} {{current_timestamp}}Correlation Analysis
Analyze relationships between metrics Identify leading and lagging indicators
Key Correlations Found:
| Metric A | Metric B | Correlation | Insight |
|---|---|---|---|
| Team Size | Velocity | {{team_vel_corr}} | {{team_vel_insight}} |
| PR Review Time | Cycle Time | {{pr_cycle_corr}} | {{pr_cycle_insight}} |
| Test Coverage | Defect Escape | {{cov_def_corr}} | {{cov_def_insight}} |
| Sprint Planning Accuracy | Completion Rate | {{plan_comp_corr}} | {{plan_comp_insight}} |
Leading Indicators: These metrics predict future performance: {{#each leading_indicators}}
- {{indicator}}: {{prediction}} {{/each}}
Period-over-Period Comparison
Compare current period to baseline Calculate improvements and regressions
Comparison: {{current_period}} vs {{baseline_period}}
| Category | Baseline | Current | Change | Status |
|---|---|---|---|---|
| Velocity | {{vel_base}} | {{vel_curr}} | {{vel_change}} | {{vel_status}} |
| Quality | {{qual_base}} | {{qual_curr}} | {{qual_change}} | {{qual_status}} |
| Delivery | {{del_base}} | {{del_curr}} | {{del_change}} | {{del_status}} |
| SLA Compliance | {{sla_base}}% | {{sla_curr}}% | {{sla_change}} | {{sla_status}} |
Improvements: {{#each improvements}}
- {{metric}}: Improved by {{improvement}} ({{cause}}) {{/each}}
Regressions: {{#each regressions}}
- {{metric}}: Declined by {{decline}} ({{cause}}) {{/each}}
Root Cause Analysis
For the identified regressions/anomalies, can you provide context?
Recent events to consider:
- Team changes (joiners/leavers)
- Process changes
- Technical changes (new tools, migrations)
- External factors (holidays, incidents)
Context:
Store as {{external_context}}
Root Cause Analysis:
{{#each issues_to_analyze}}
{{metric_name}} {{direction}}
Symptoms:
- {{symptom_1}}
- {{symptom_2}}
Potential Root Causes:
- {{cause_1}} (likelihood: {{likelihood_1}})
- {{cause_2}} (likelihood: {{likelihood_2}})
- {{cause_3}} (likelihood: {{likelihood_3}})
Recommended Investigation:
- {{investigation_step_1}}
- {{investigation_step_2}}
{{/each}}
Recommendations
Generate actionable recommendations based on analysis Prioritize by impact and effort
High Priority Recommendations:
{{#each high_priority_recs}}
{{number}}. {{title}}
- Issue: {{issue}}
- Impact: {{impact}}
- Recommendation: {{recommendation}}
- Expected Outcome: {{expected_outcome}}
- Effort: {{effort_level}}
{{/each}}
Medium Priority Recommendations: {{#each medium_priority_recs}}
- {{recommendation}} {{/each}}
Monitoring Suggestions: {{#each monitoring_suggestions}}
- {{suggestion}} {{/each}}
Generate Review Report
Generate a comprehensive metrics review report including: - Executive summary - Trend analysis with visualizations - Anomaly findings - Period comparison - Root cause analysis (if applicable) - Prioritized recommendations - Action items with owners - Follow-up metrics to watchReport Generated: {{output_file_path}}
Complete Review
{{review_type}} {{analysis_period}} {{key_findings_summary}} {{recommendations_count}} {{anomalies_count}} {{health_change}} {{output_file_path}} {{current_timestamp}}Update module state with review timestamp and summary
Completion
Metrics review complete for {{analysis_period}}.
Key Findings: {{#each key_findings}}
- {{finding}} {{/each}}
Health Assessment:
- Overall trend: {{overall_trend}}
- Areas improving: {{improving_count}}
- Areas declining: {{declining_count}}
- Anomalies detected: {{anomalies_count}}
Next Steps:
- Share report with stakeholders
- Discuss recommendations in retrospective
- Assign owners to action items
- Schedule follow-up review: {{next_review_date}}
Report Location: {{output_file_path}}