Skip to content

[Safety] Implement Shadow-Mode 'Slot Parity' Metric #102

@DsThakurRawat

Description

@DsThakurRawat

Description (Medium)

Aggregated parity statistics help decide when a shadow model is ready for promotion to production.

Task

  • Implement a rolling window that tracks 'Action Overlap' between two policies.
  • Report the percentage of time the two models agree within a configurable joint-epsilon.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions