BMAD-METHOD/src/modules/bmm-metrics/workflows/metrics-review/instructions.md

8.5 KiB

Metrics Review Instructions

Objective

Perform in-depth analysis of metric trends, identify patterns and anomalies, correlate metrics with events, and generate actionable insights for continuous improvement.

Prerequisites

  • Historical metric data (at least 3 periods recommended)
  • Module state with recorded metric history
  • Context about recent changes (releases, team changes, process changes)

Define Review Scope

What type of metrics review is this? [s] Sprint retrospective review [m] Monthly business review [q] Quarterly planning review [a] Ad-hoc investigation

Review type:

Store as {{review_type}}

Is there a specific focus area for this review? [v] Velocity and delivery [q] Quality and testing [p] Process efficiency [c] Capacity and planning [n] No specific focus - comprehensive review

Focus:

Store as {{focus_area}}

What period should we analyze?

  • From: (date or "last_sprint")
  • To: (date or "current")

Period:

Store as {{analysis_period}}


Load Historical Data

Load metric history from module-state.yaml Load previous {{review_type}} review if exists Identify comparison baseline period

Data Loaded:

  • Historical periods available: {{periods_count}}
  • Earliest data: {{earliest_date}}
  • Latest data: {{latest_date}}
  • Baseline period: {{baseline_period}}

Trend Analysis

Calculate trends for each tracked metric Identify improving, stable, and declining metrics

Velocity Trends:

Sprint Velocity (Last 6 Sprints)
│
│    ▲
│   ▲ ▲    ▲
│  ▲   ▲  ▲
│ ▲     ▲
├─────────────────
  S1 S2 S3 S4 S5 S6

Rolling Average: {{velocity_avg}}
Trend: {{velocity_trend}} ({{velocity_change}}%)

Quality Trends:

Metric 3 Periods Ago 2 Periods Ago Last Period Current Trend
Test Coverage {{cov_3}}% {{cov_2}}% {{cov_1}}% {{cov_0}}% {{cov_trend}}
Pass Rate {{pass_3}}% {{pass_2}}% {{pass_1}}% {{pass_0}}% {{pass_trend}}
Defect Rate {{def_3}} {{def_2}} {{def_1}} {{def_0}} {{def_trend}}

Delivery Trends:

Metric Trend Change Assessment
Cycle Time {{cycle_trend}} {{cycle_change}} {{cycle_assessment}}
PR Review Time {{pr_trend}} {{pr_change}} {{pr_assessment}}
Deploy Frequency {{deploy_trend}} {{deploy_change}} {{deploy_assessment}}

Anomaly Detection

Identify metrics with significant deviations from baseline Flag sudden changes (>20% swing) Check for correlation with known events

Anomalies Detected:

{{#each anomalies}}

{{metric_name}}

  • Current Value: {{current}}
  • Expected Range: {{expected_min}} - {{expected_max}}
  • Deviation: {{deviation_percent}}%
  • First Detected: {{first_detected}}
  • Possible Causes: {{possible_causes}}

{{/each}}

{{anomaly_metric}} {{anomaly_current}} {{anomaly_expected}} {{anomaly_deviation}} {{anomaly_severity}} {{current_timestamp}}

Correlation Analysis

Analyze relationships between metrics Identify leading and lagging indicators

Key Correlations Found:

Metric A Metric B Correlation Insight
Team Size Velocity {{team_vel_corr}} {{team_vel_insight}}
PR Review Time Cycle Time {{pr_cycle_corr}} {{pr_cycle_insight}}
Test Coverage Defect Escape {{cov_def_corr}} {{cov_def_insight}}
Sprint Planning Accuracy Completion Rate {{plan_comp_corr}} {{plan_comp_insight}}

Leading Indicators: These metrics predict future performance: {{#each leading_indicators}}

  • {{indicator}}: {{prediction}} {{/each}}

Period-over-Period Comparison

Compare current period to baseline Calculate improvements and regressions

Comparison: {{current_period}} vs {{baseline_period}}

Category Baseline Current Change Status
Velocity {{vel_base}} {{vel_curr}} {{vel_change}} {{vel_status}}
Quality {{qual_base}} {{qual_curr}} {{qual_change}} {{qual_status}}
Delivery {{del_base}} {{del_curr}} {{del_change}} {{del_status}}
SLA Compliance {{sla_base}}% {{sla_curr}}% {{sla_change}} {{sla_status}}

Improvements: {{#each improvements}}

  • {{metric}}: Improved by {{improvement}} ({{cause}}) {{/each}}

Regressions: {{#each regressions}}

  • {{metric}}: Declined by {{decline}} ({{cause}}) {{/each}}

Root Cause Analysis

For the identified regressions/anomalies, can you provide context?

Recent events to consider:

  • Team changes (joiners/leavers)
  • Process changes
  • Technical changes (new tools, migrations)
  • External factors (holidays, incidents)

Context:

Store as {{external_context}}

Root Cause Analysis:

{{#each issues_to_analyze}}

{{metric_name}} {{direction}}

Symptoms:

  • {{symptom_1}}
  • {{symptom_2}}

Potential Root Causes:

  1. {{cause_1}} (likelihood: {{likelihood_1}})
  2. {{cause_2}} (likelihood: {{likelihood_2}})
  3. {{cause_3}} (likelihood: {{likelihood_3}})

Recommended Investigation:

  • {{investigation_step_1}}
  • {{investigation_step_2}}

{{/each}}


Recommendations

Generate actionable recommendations based on analysis Prioritize by impact and effort

High Priority Recommendations:

{{#each high_priority_recs}}

{{number}}. {{title}}

  • Issue: {{issue}}
  • Impact: {{impact}}
  • Recommendation: {{recommendation}}
  • Expected Outcome: {{expected_outcome}}
  • Effort: {{effort_level}}

{{/each}}

Medium Priority Recommendations: {{#each medium_priority_recs}}

  • {{recommendation}} {{/each}}

Monitoring Suggestions: {{#each monitoring_suggestions}}

  • {{suggestion}} {{/each}}

Generate Review Report

Generate a comprehensive metrics review report including: - Executive summary - Trend analysis with visualizations - Anomaly findings - Period comparison - Root cause analysis (if applicable) - Prioritized recommendations - Action items with owners - Follow-up metrics to watch

Report Generated: {{output_file_path}}


Complete Review

{{review_type}} {{analysis_period}} {{key_findings_summary}} {{recommendations_count}} {{anomalies_count}} {{health_change}} {{output_file_path}} {{current_timestamp}}

Update module state with review timestamp and summary


Completion

Metrics review complete for {{analysis_period}}.

Key Findings: {{#each key_findings}}

  • {{finding}} {{/each}}

Health Assessment:

  • Overall trend: {{overall_trend}}
  • Areas improving: {{improving_count}}
  • Areas declining: {{declining_count}}
  • Anomalies detected: {{anomalies_count}}

Next Steps:

  1. Share report with stakeholders
  2. Discuss recommendations in retrospective
  3. Assign owners to action items
  4. Schedule follow-up review: {{next_review_date}}

Report Location: {{output_file_path}}