Skip to main content
Modulo

Variant Groups

A variant group ties a set of variants to one pipeline. Create the group with weighted variants, then start runs through its run endpoint; each run draws one variant, so the pipeline definition stays untouched while results accumulate per variant.

API endpoints

  • POST /api/v1/variant-groups - Create a variant group with weighted variants
  • GET /api/v1/variant-groups - List variant groups (paginated, filterable by pipeline_id)
  • GET /api/v1/variant-groups/{id} - Get variant group by ID
  • PUT /api/v1/variant-groups/{id} - Update variant group
  • DELETE /api/v1/variant-groups/{id} - Delete variant group
  • POST /api/v1/variant-groups/{id}/run - Start one run against the group (weighted random selection picks the variant)
  • GET /api/v1/variant-groups/{id}/coverage-gaps - Detect eval coverage gaps per variant
  • GET /api/v1/variant-groups/{id}/prompt-diffs - Compare prompt version hashes across variant snapshots

Notes

  • Every endpoint carries organization context through Row-Level Security (RLS)
  • Weights apply when a run is started, so weighting changes affect subsequent runs rather than runs already in progress
  • run_context_overrides on the selected variant apply to that run alone

Selection order, quota behavior, and coverage-gap reporting are described in Variant Execution.