BMAD-METHOD/src/modules/bmgd/gametest/knowledge/compatibility-testing.md

5.7 KiB

Compatibility Testing for Games

Overview

Compatibility testing ensures your game works correctly across different hardware, operating systems, and configurations that players use.

Types of Compatibility Testing

Hardware Compatibility

  • Graphics cards (NVIDIA, AMD, Intel)
  • CPUs (Intel, AMD, Apple Silicon)
  • Memory configurations
  • Storage types (HDD, SSD, NVMe)
  • Input devices (controllers, keyboards, mice)

Software Compatibility

  • Operating system versions
  • Driver versions
  • Background software conflicts
  • Antivirus interference

Platform Compatibility

  • Console SKUs (PS5, Xbox Series X|S)
  • PC storefronts (Steam, Epic, GOG)
  • Mobile devices (iOS, Android)
  • Cloud gaming services

Configuration Compatibility

  • Graphics settings combinations
  • Resolution and aspect ratios
  • Refresh rates (60Hz, 144Hz, etc.)
  • HDR and color profiles

Testing Matrix

Minimum Hardware Matrix

Component Budget Mid-Range High-End
GPU GTX 1050 RTX 3060 RTX 4080
CPU i5-6400 i7-10700 i9-13900
RAM 8GB 16GB 32GB
Storage HDD SATA SSD NVMe

OS Matrix

  • Windows 10 (21H2, 22H2)
  • Windows 11 (22H2, 23H2)
  • macOS (Ventura, Sonoma)
  • Linux (Ubuntu LTS, SteamOS)

Controller Matrix

  • Xbox Controller (wired, wireless, Elite)
  • PlayStation DualSense
  • Nintendo Pro Controller
  • Generic XInput controllers
  • Keyboard + Mouse

Testing Approach

1. Define Supported Configurations

  • Minimum specifications
  • Recommended specifications
  • Officially supported platforms
  • Known unsupported configurations

2. Create Test Matrix

  • Prioritize common configurations
  • Include edge cases
  • Balance coverage vs. effort

3. Execute Systematic Testing

  • Full playthrough on key configs
  • Spot checks on edge cases
  • Automated smoke tests where possible

4. Document Issues

  • Repro steps with exact configuration
  • Severity and frequency
  • Workarounds if available

Common Compatibility Issues

Graphics Issues

Issue Cause Detection
Crashes on launch Driver incompatibility Test on multiple GPUs
Rendering artifacts Shader issues Visual inspection across configs
Performance variance Optimization gaps Profile on multiple GPUs
Resolution bugs Aspect ratio handling Test non-standard resolutions

Input Issues

Issue Cause Detection
Controller not detected Missing driver/API Test all supported controllers
Wrong button prompts Platform detection Swap controllers mid-game
Stick drift handling Deadzone issues Test worn controllers
Mouse acceleration Raw input issues Test at different DPIs

Audio Issues

Issue Cause Detection
No sound Device selection Test multiple audio devices
Crackling Buffer issues Test under CPU load
Wrong channels Surround setup Test stereo vs 5.1 vs 7.1

Platform-Specific Considerations

PC

  • Steam: Verify Steam Input, Steamworks features
  • Epic: Test EOS features if used
  • GOG: Test offline/DRM-free functionality
  • Game Pass: Test Xbox services integration

Console

  • Certification Requirements: Study TRCs/XRs early
  • SKU Differences: Test on all variants (S vs X)
  • External Storage: Test on USB drives
  • Quick Resume: Test suspend/resume cycles

Mobile

  • Device Fragmentation: Test across screen sizes
  • OS Versions: Test min supported to latest
  • Permissions: Test permission flows
  • App Lifecycle: Test background/foreground

Automated Compatibility Testing

Smoke Tests

# Run on matrix of configurations
compatibility_test:
  matrix:
    os: [windows-10, windows-11, ubuntu-22]
    gpu: [nvidia, amd, intel]
  script:
    - launch_game --headless
    - verify_main_menu_reached
    - check_no_errors

Screenshot Comparison

  • Capture screenshots on different GPUs
  • Compare for rendering differences
  • Flag significant deviations

Cloud Testing Services

  • AWS Device Farm
  • BrowserStack (web games)
  • LambdaTest
  • Sauce Labs

Compatibility Checklist

Pre-Alpha

  • Minimum specs defined
  • Key platforms identified
  • Test matrix created
  • Test hardware acquired/rented

Alpha

  • Full playthrough on min spec
  • Controller support verified
  • Major graphics issues found
  • Platform SDK integrated

Beta

  • All matrix configurations tested
  • Edge cases explored
  • Certification pre-check done
  • Store page requirements met

Release

  • Final certification passed
  • Known issues documented
  • Workarounds communicated
  • Support matrix published

Documenting Compatibility

System Requirements

MINIMUM:
- OS: Windows 10 64-bit
- Processor: Intel Core i5-6400 or AMD equivalent
- Memory: 8 GB RAM
- Graphics: NVIDIA GTX 1050 or AMD RX 560
- Storage: 50 GB available space

RECOMMENDED:
- OS: Windows 11 64-bit
- Processor: Intel Core i7-10700 or AMD equivalent
- Memory: 16 GB RAM
- Graphics: NVIDIA RTX 3060 or AMD RX 6700 XT
- Storage: 50 GB SSD

Known Issues

Maintain a public-facing list of known compatibility issues with:

  • Affected configurations
  • Symptoms
  • Workarounds
  • Fix status