BMAD-METHOD/src/bmm-skills/3-solutioning/bmad-create-pipeline/steps/step-05-validation.md

10 KiB

Step 5: Pipeline Validation & Completion

MANDATORY EXECUTION RULES (READ FIRST):

  • 🛑 NEVER generate content without user input
  • 📖 CRITICAL: ALWAYS read the complete step file before taking any action - partial understanding leads to incomplete decisions
  • 🔄 CRITICAL: When loading next step with 'C', ensure the entire file is read and understood before proceeding
  • ALWAYS treat this as collaborative discovery between pipeline architecture peers
  • 📋 YOU ARE A FACILITATOR, not a content generator
  • 💬 FOCUS on validating pipeline coherence, completeness, and alignment with architecture
  • VALIDATE all pipeline stages have been decided and are consistent
  • ⚠️ ABSOLUTELY NO TIME ESTIMATES - AI development speed has fundamentally changed
  • YOU MUST ALWAYS SPEAK OUTPUT In your Agent communication style with the config {communication_language}

EXECUTION PROTOCOLS:

  • 🎯 Show your analysis before taking any action
  • Run comprehensive validation checks on the complete pipeline architecture
  • ⚠️ Present A/P/C menu after generating validation results
  • 💾 ONLY save when user chooses C (Continue)
  • 📖 Update frontmatter stepsCompleted: [1, 2, 3, 4, 5] on completion
  • 🚫 FORBIDDEN to complete workflow until C is selected

COLLABORATION MENUS (A/P/C):

This step will generate content and present choices:

  • A (Advanced Elicitation): Use discovery protocols to address complex pipeline issues found during validation
  • P (Party Mode): Bring multiple perspectives to resolve validation concerns
  • C (Continue): Save the validation results and complete the pipeline architecture

PROTOCOL INTEGRATION:

  • When 'A' selected: Invoke the bmad-advanced-elicitation skill
  • When 'P' selected: Invoke the bmad-party-mode skill
  • PROTOCOLS always return to display this step's A/P/C menu after the A or P have completed
  • User accepts/rejects protocol changes before proceeding

CONTEXT BOUNDARIES:

  • Complete pipeline document with all sections is available
  • All pipeline architecture, stage, and deployment strategy decisions are defined
  • Architecture document and infrastructure document (if exists) are available for cross-reference
  • Focus on validation, gap analysis, and coherence checking

YOUR TASK:

Validate the complete pipeline architecture for coherence, completeness, alignment with architecture and infrastructure decisions, and DORA metric readiness.

VALIDATION SEQUENCE:

1. Present Complete Pipeline Decision Document Summary

Present a concise summary of all decisions made across steps 2-4:

"Here's a complete summary of your CI/CD pipeline architecture:

Pipeline Architecture (Step 2):

  • Platform: {{platform}}
  • Branch Strategy: {{branch_strategy}}
  • Runner Infrastructure: {{runner_type}}

Pipeline Stages (Step 3):

  • Source: {{trigger_summary}}
  • Build: {{build_summary}}
  • Test: {{test_summary}}
  • Security: {{security_summary}}
  • Package: {{package_summary}}
  • Deploy: {{deploy_summary}}
  • Verify: {{verify_summary}}
  • Promote: {{promote_summary}}

Deployment Strategy (Step 4):

  • Pattern: {{deployment_pattern}}
  • Feature Flags: {{feature_flag_approach}}
  • Database Migrations: {{migration_approach}}
  • Rollback: {{rollback_strategy}}
  • Zero-Downtime: {{zero_downtime_approach}}"

2. Cross-Reference with Architecture and Infrastructure

Validate alignment with architecture.md:

Architecture Alignment:

  • Do pipeline technology choices align with architecture stack decisions?
  • Does the deployment strategy support the architecture's scalability requirements?
  • Are security scanning tools aligned with architecture security decisions?
  • Does the environment progression match architecture's environment strategy?

Infrastructure Alignment (if infrastructure.md exists):

  • Does the pipeline deploy to the infrastructure defined?
  • Are IaC tools integrated into the pipeline appropriately?
  • Does the container strategy align between pipeline and infrastructure?
  • Are environment configurations consistent?

Report any misalignments found: "I found the following alignment considerations: {{alignment_findings}}"

3. DORA Metric Readiness Validation

Assess the pipeline against DORA metrics:

Deployment Frequency: "Can you deploy on-demand? Based on your pipeline design:

  • {{assessment_of_deployment_frequency_capability}}
  • Bottlenecks: {{any_bottlenecks_limiting_frequency}}"

Lead Time for Changes: "How quickly can a commit reach production?

  • Pipeline stages: {{estimated_stage_count}}
  • Promotion gates: {{gate_count_and_types}}
  • Potential delays: {{identified_delays}}"

Change Failure Rate: "How well does your pipeline catch issues before production?

  • Security scanning: {{security_stage_coverage}}
  • Test coverage: {{test_stage_coverage}}
  • Verification: {{verify_stage_coverage}}"

Mean Time to Recovery: "Can you recover in under an hour?

  • Rollback strategy: {{rollback_readiness}}
  • Monitoring: {{verify_stage_monitoring}}
  • Automation level: {{recovery_automation_level}}"

4. Pipeline Completeness Check

Verify all critical pipeline stages have been decided:

Critical Stage Checklist:

  • Source triggers defined
  • Build process configured
  • Test strategy established
  • Security scanning integrated
  • Artifact packaging defined
  • Deployment method chosen
  • Verification approach set
  • Promotion gates configured
  • Rollback strategy defined

Report any gaps: "The following areas need attention: {{gaps_found_or_all_clear}}"

5. Generate Validation Content

Prepare the content to append to the document:

Content Structure:

## Pipeline Validation Results

### Architecture Alignment ✅

**Stack Compatibility:**
{{assessment_of_pipeline_tools_vs_architecture_stack}}

**Security Alignment:**
{{assessment_of_security_scanning_vs_architecture_security}}

**Environment Consistency:**
{{assessment_of_env_progression_vs_architecture_environments}}

### Infrastructure Alignment ✅

{{assessment_of_pipeline_vs_infrastructure_decisions_or_na}}

### DORA Metric Readiness

**Deployment Frequency:** {{ready_or_concern}}
{{assessment}}

**Lead Time for Changes:** {{ready_or_concern}}
{{assessment}}

**Change Failure Rate:** {{ready_or_concern}}
{{assessment}}

**Mean Time to Recovery:** {{ready_or_concern}}
{{assessment}}

### Pipeline Completeness Checklist

- [x] Source triggers defined
- [x] Build process configured
- [x] Test strategy established
- [x] Security scanning integrated
- [x] Artifact packaging defined
- [x] Deployment method chosen
- [x] Verification approach set
- [x] Promotion gates configured
- [x] Rollback strategy defined

### Alignment Issues Addressed

{{description_of_any_issues_found_and_resolutions}}

### Pipeline Readiness Assessment

**Overall Status:** READY FOR IMPLEMENTATION

**Confidence Level:** {{high/medium/low}} based on validation results

**Key Strengths:**
{{list_of_pipeline_strengths}}

**Areas for Future Enhancement:**
{{areas_that_could_be_improved_later}}

6. Present Content and Menu

Show the validation results and present choices:

"I've completed a comprehensive validation of your pipeline architecture.

Validation Summary:

  • Architecture Alignment: {{status}}
  • Infrastructure Alignment: {{status}}
  • DORA Readiness: {{status}}
  • Completeness: {{status}}

Here's what I'll add to complete the pipeline document:

[Show the complete markdown content from step 5]

What would you like to do? [A] Advanced Elicitation - Address any complex pipeline concerns [P] Party Mode - Review validation from different operational perspectives [C] Continue - Complete the pipeline architecture and finish workflow"

7. Handle Menu Selection

If 'A' (Advanced Elicitation):

  • Invoke the bmad-advanced-elicitation skill with validation issues
  • Process enhanced solutions for complex concerns
  • Ask user: "Accept these pipeline improvements? (y/n)"
  • If yes: Update content, then return to A/P/C menu
  • If no: Keep original content, then return to A/P/C menu

If 'P' (Party Mode):

  • Invoke the bmad-party-mode skill with validation context
  • Process collaborative insights on pipeline readiness
  • Ask user: "Accept these changes to the validation results? (y/n)"
  • If yes: Update content, then return to A/P/C menu
  • If no: Keep original content, then return to A/P/C menu

If 'C' (Continue):

  • Append the final content to {planning_artifacts}/pipeline.md
  • Update frontmatter: stepsCompleted: [1, 2, 3, 4, 5]
  • Report completion message

8. Completion Report

On final 'C', save to {planning_artifacts}/pipeline.md and report:

"Pipeline architecture documented. Your pipeline covers {{stage_count}} stages with {{deployment_strategy}} deployment. {{total_decisions}} decisions recorded across pipeline architecture, stage design, and deployment strategy.

DORA Readiness: {{dora_summary}}

Recommended Next Steps:

  • Consider running the infrastructure workflow (bmad-create-infrastructure) if not already done
  • Proceed to Create Epics and Stories (bmad-create-epics-and-stories) to break down implementation
  • Review the architecture document to ensure pipeline decisions are reflected in the infrastructure section"

APPEND TO DOCUMENT:

When user selects 'C', append the content directly to the document using the structure from step 5.

SUCCESS METRICS:

Complete pipeline decision document presented as summary Cross-reference with architecture.md validated Cross-reference with infrastructure.md validated (if exists) DORA metric readiness assessed with specific findings All critical pipeline stages confirmed as decided Alignment issues identified and addressed A/P/C menu presented and handled correctly Content properly appended to document when C selected Completion report delivered with next step recommendations

FAILURE MODES:

Not presenting complete summary before validation Skipping cross-reference with architecture document Not assessing DORA metric readiness Missing completeness check for critical stages Not addressing alignment issues found Not presenting A/P/C menu after content generation Not providing clear next step recommendations on completion

CRITICAL: Reading only partial step file - leads to incomplete understanding and poor decisions CRITICAL: Proceeding with 'C' without fully reading and understanding the next step file CRITICAL: Making decisions without complete understanding of step requirements and protocols