UNCLASSIFIED - NO CUI

Skip to content

[SPIKE]: Identify all existing documentation

Proposed Documentation Restructure

Current Issues with BigBang Docs:

  1. Scattered organization - Important content is buried in nested folders
  2. No clear learning path - Users don't know where to start
  3. Developer-centric focus - Lacks user journey orientation
  4. Inconsistent information architecture - Mixed concerns in same sections

Recommended Structure (Following Modern OSS Patterns):

docs/
├── index.md                          # Landing page with clear value prop
├── getting-started/                  # Quick wins & first-time user journey
│   ├── overview.md                   # What is BigBang? (from current README)
│   ├── prerequisites.md              # Moved from current prerequisites/
│   ├── quick-start.md                # Fast deployment guide
│   ├── first-deployment.md           # Step-by-step tutorial
│   └── next-steps.md                 # What to do after first install
├── concepts/                         # Core understanding (like K8s/Istio)
│   ├── architecture.md               # High-level system design
│   ├── gitops-workflow.md            # How BigBang uses GitOps
│   ├── package-management.md         # How packages work
│   ├── security-model.md             # Security principles & benefits
│   └── licensing.md                  # Moved from understanding-bigbang/
├── installation/                     # Comprehensive setup guides
│   ├── index.md                      # Installation overview
│   ├── environments/                 # Different deployment scenarios
│   │   ├── development.md            # Dev environment setup
│   │   ├── staging.md                # Staging considerations  
│   │   ├── production.md             # Production-ready deployment
│   │   └── airgap.md                 # Air-gapped installations
│   ├── platforms/                    # Platform-specific guides
│   │   ├── aws.md
│   │   ├── azure.md
│   │   ├── gcp.md
│   │   └── on-premises.md
│   └── advanced/                     # Complex scenarios
│       ├── custom-ca.md
│       ├── istio-ambient.md
│       └── multi-cluster.md
├── configuration/                    # How to configure BigBang
│   ├── index.md                      # Configuration overview
│   ├── values-schema.md              # Understanding values.yaml
│   ├── package-configs/              # Per-package configuration
│   ├── networking.md                 # Network policies, ingress, etc.
│   ├── storage.md                    # Persistent volume configuration
│   ├── security/                     # Security-specific configs
│   │   ├── authentication.md         # SSO setup
│   │   ├── authorization.md          # RBAC configuration
│   │   ├── policy-enforcement.md     # Gatekeeper, Kyverno policies
│   │   └── monitoring.md             # Security monitoring
│   └── examples/                     # Real-world configuration examples
├── packages/                         # Package documentation
│   ├── index.md                      # Package overview (current packages.md)
│   ├── core/                         # Core packages (Istio, Fluent Bit, etc.)
│   ├── addons/                       # Addon packages
│   ├── community/                    # Community packages
│   └── package-development/          # How to create packages
├── operations/                       # Day-2 operations (like Istio pattern)
│   ├── monitoring.md                 # Observability setup
│   ├── troubleshooting/              # Common issues & solutions
│   ├── upgrades.md                   # Upgrade procedures
│   ├── backup-restore.md             # Backup and restore
│   ├── disaster-recovery.md          # DR procedures
│   └── maintenance/                  # Regular maintenance tasks
├── tutorials/                        # Step-by-step learning
│   ├── deploy-app.md                 # Deploy your first app
│   ├── configure-sso.md              # Set up single sign-on
│   ├── custom-package.md             # Create a custom package
│   ├── policy-enforcement.md         # Implement security policies
│   └── observability.md              # Set up monitoring & logging
├── reference/                        # API & technical reference
│   ├── api/                          # CRD references
│   ├── cli/                          # Command-line tools
│   ├── configuration-reference/      # Complete values.yaml reference
│   ├── releases/                     # Release notes & changelogs
│   └── glossary.md                   # Terms and definitions
├── community/                        # Contribution & community
│   ├── contributing.md               # How to contribute
│   ├── development/                  # Developer guides (current developer/)
│   ├── governance.md                 # Project governance
│   ├── support.md                    # Getting help
│   └── adrs/                         # Architecture Decision Records
└── migration/                        # Migration guides
    ├── from-v2.md                    # Migrating from BigBang 2.x
    ├── from-manual.md                # Migrating from manual deployments
    └── breaking-changes.md           # Breaking changes by version

Key Improvements:

  1. User Journey Focused: Clear progression from getting-started → concepts → installation → configuration → operations
  2. Modern Information Architecture: Follows the successful patterns of Kubernetes, Istio, and Kyverno with logical groupings
  3. Multiple Entry Points:
    • Newcomers: getting-started/
    • Operators: operations/
    • Developers: community/development/
    • Reference users: reference/
  4. Task-Oriented: Operations and tutorials sections focus on "how to accomplish X" rather than "here's how Y works"
  5. Clear Separation of Concerns:
    • Concepts = understanding the "why"
    • Installation = getting it running
    • Configuration = making it work for your needs
    • Operations = keeping it running
    • Reference = looking up specifics
  6. Consistent with Industry Standards: Matches expectations users have from other cloud-native projects

BigBang Documentation Migration Plan

Phase Overview

This migration will be executed in 4 phases over approximately 8-12 weeks to minimize disruption and ensure content quality.

Phase 1: Foundation & Structure (Weeks 1-2)

Goal: Create new structure and migrate high-impact landing pages

1.1 Create New Directory Structure

# Create new directory structure
docs/
├── index.md                 # NEW - Landing page
├── getting-started/         # NEW directory
├── concepts/               # NEW directory  
├── installation/           # NEW directory
├── configuration/          # NEW directory
├── packages/              # NEW directory
├── operations/            # NEW directory
├── tutorials/             # NEW directory
├── reference/             # NEW directory
├── community/             # NEW directory (move developer/)
└── migration/             # NEW directory

1.2 Content Migration Mapping (Phase 1)

Current Location New Location Action Priority
README.md getting-started/overview.md Move + Edit High
README.md (root) index.md Move + Edit High
FAQ.md getting-started/faq.md Move High
packages.md packages/index.md Move High
prerequisites getting-started/prerequisites.md Consolidate High

1.3 Key Actions for Phase 1

  • Create new directory structure
  • Write new index.md landing page (following Kubernetes/Istio patterns)
  • Consolidate prerequisite documentation into single comprehensive guide
  • Update navigation/sidebar configuration (.pages files)
  • Set up redirects from old URLs to new URLs

Phase 2: Core User Journey (Weeks 3-5)

Goal: Complete the essential user flow documentation

2.1 Content Migration Mapping (Phase 2)

Current Location New Location Action Priority
concepts concepts/ Move + Reorganize High
architecture-diagrams concepts/architecture.md Consolidate High
configuration configuration/ Move + Restructure High
deployment-scenarios installation/environments/ Move + Edit High
using-bigbang tutorials/ Move + Edit Medium
licensing-model.md concepts/licensing.md Move Medium

2.2 New Content Creation (Phase 2)

  •  getting-started/quick-start.md - 15-minute deployment guide
  •  getting-started/first-deployment.md - Comprehensive first-time tutorial
  •  concepts/gitops-workflow.md - How BigBang uses GitOps
  •  concepts/package-management.md - Package system explanation
  •  concepts/security-model.md - Security benefits and model
  •  installation/index.md - Installation overview

2.3 Content Restructuring Tasks

  • Break down large concepts files into focused topics
  • Create installation workflow documentation
  • Reorganize configuration examples by use case

Phase 3: Package & Operations Documentation (Weeks 6-8)

Goal: Migrate and enhance package and operational documentation

3.1 Content Migration Mapping (Phase 3)

Current Location New Location Action Priority
package-architecture packages/core/packages/addons/ Categorize + Move High
backup-and-restore operations/backup-restore.md Move + Edit High
airgap installation/environments/airgap.md Consolidate High
airgap-zarf installation/advanced/zarf-airgap.md Move Medium
troubleshooting.md operations/troubleshooting/ Move + Expand High

3.2 Package Documentation Reorganization

packages/
├── index.md                    # Overview (current packages.md)
├── core/                       # Core platform packages
│   ├── istio.md               # From package-architecture/istio.md
│   ├── monitoring.md          # From package-architecture/monitoring.md
│   ├── fluentbit.md          # From package-architecture/fluentbit.md
│   └── ...
├── addons/                     # Optional packages
│   ├── gitlab.md              # From package-architecture/gitlab.md
│   ├── keycloak.md           # From package-architecture/keycloak.md
│   └── ...
├── community/                  # Community packages
└── package-development/        # How to create packages
    └── index.md               # From developer/develop-package.md

3.3 Operations Documentation Structure

operations/
├── index.md                   # Operations overview
├── monitoring.md             # Observability setup
├── troubleshooting/          # Organized troubleshooting
│   ├── index.md
│   ├── installation.md
│   ├── networking.md
│   ├── packages.md
│   └── performance.md
├── upgrades.md              # From developer/release-process.md (user parts)
├── backup-restore.md        # From guides/backup-and-restore/
└── maintenance/             # Regular maintenance tasks

Phase 4: Developer & Reference Documentation (Weeks 9-12)

Goal: Complete migration and create comprehensive reference materials

4.1 Content Migration Mapping (Phase 4)

Current Location New Location Action Priority
developer community/development/ Move + Reorganize Medium
adrs community/adrs/ Move Low
CONTRIBUTING.md community/contributing.md Move + Edit Medium
Various package-integration docs reference/api/ + packages/package-development/ Split + Reorganize Medium

4.2 Reference Documentation Creation

  •  reference/configuration-reference/ - Complete values.yaml documentation
  •  reference/api/ - CRD and API references
  •  reference/cli/ - Command-line tool documentation
  •  glossary.md - Comprehensive glossary
  •  reference/releases/ - Release notes and changelogs

4.3 Tutorial Creation

  •  tutorials/deploy-app.md - Deploy your first application
  •  tutorials/configure-sso.md - Set up single sign-on
  •  tutorials/custom-package.md - Create a custom package
  •  policy-enforcement.md - Implement security policies
  •  tutorials/observability.md - Set up monitoring & logging

Migration Execution Strategy

1. Content Audit & Quality Assessment

Before moving content:

  •  Review each file for accuracy and relevance
  •  Identify outdated information for removal/update
  •  Note cross-references that need updating
  •  Assess content gaps that need new material

2. URL Preservation & Redirects

  •  Document all current URLs
  •  Create redirect mapping table
  •  Implement redirects (using meta redirects or web server redirects)
  •  Update all internal links

3. Navigation & Discovery

  •  Update .pages files for new structure
  •  Create clear navigation hierarchy
  •  Add cross-references between related sections
  •  Implement breadcrumb navigation

4. Content Quality Improvements

During migration, enhance content with:

  •  Clear headings and structure
  •  Code examples with syntax highlighting
  •  Prerequisites and assumptions clearly stated
  •  Next steps and related links
  •  Consistent formatting and style

5. Testing & Validation

  •  Test all internal links
  •  Verify code examples work
  •  Get feedback from different user personas
  •  Test documentation navigation flows

Resource Requirements

Personnel (Estimated Effort)

  • Technical Writer/Documentation Lead: 40-60% for 12 weeks
  • Developer/SME Review: 10-20% for 12 weeks
  • UX/Information Architecture: 20% for 4 weeks
  • QA/Testing: 10% for 2 weeks

Technical Requirements

  • Documentation Site Generator (assuming MkDocs/similar)
  • Redirect capability (server-side or meta redirects)
  • Version control (Git branching strategy)
  • Preview/staging environment for testing

Risk Mitigation

High-Risk Areas

  1. Package Architecture Documentation - Complex, technical, high-value content
  2. Developer Integration Guides - Critical for contributors
  3. Installation/Configuration - Core user journey content

Mitigation Strategies

  • Parallel structure - Keep old structure until new is validated
  • Gradual rollout - Phase by phase with user feedback
  • Comprehensive redirects - Ensure no broken links
  • SME review - Technical validation at each phase
  • User testing - Validate new flows with real users

Success Metrics

Quantitative Metrics

  • User engagement: Time on documentation pages, bounce rate
  • Findability: Search success rate, navigation completion
  • Maintenance: Content update frequency, contributor ease

Qualitative Metrics

  • User feedback: Satisfaction surveys, usability testing
  • Contributor feedback: Ease of contributing to docs
  • Support burden: Reduction in documentation-related support tickets

Timeline Summary

Phase Duration Key Deliverables Risk Level
Phase 1 Weeks 1-2 New structure, landing pages, prerequisites Medium
Phase 2 Weeks 3-5 Core concepts, installation, basic tutorials High
Phase 3 Weeks 6-8 Package docs, operations guides Medium
Phase 4 Weeks 9-12 Reference materials, advanced content Low
Edited by Andrew Shoell