ModelSubscriptionRef¶

Reference to a model with rate limits within a subscription. Per-model inference status fields are read-only and populated from status.flowControlStatuses on the MaaSSubscription CR.

Type: object

Properties¶

Property	Type	Required	Description
`name`	string	Yes	Name of the MaaSModelRef Example: `llama-2-7b-chat`
`namespace`	string	Yes	Namespace where the MaaSModelRef lives Example: `maas-models`
`tokenRateLimits`	array of TokenRateLimit	No	Token-based rate limits for this model
`billingRate`	BillingRate	No
`objectiveName`	string	No	Inference objective name from status.flowControlStatuses (read-only) Example: `maas-models-as-a-service-gold-maas-model-user-inference-pool-a1b2c3d4e5`
`targetPool`	string	No	Inference pool name from status.flowControlStatuses.inferencePool.name (read-only) Example: `maas-model-user-inference-pool`
`ready`	boolean	No	Per-model readiness from status.flowControlStatuses.ready (read-only) Example: `true`
`reason`	string	No	Per-model status reason from status.flowControlStatuses (read-only) Example: `ObjectiveReconciled`
`message`	string	No	Per-model status message from status.flowControlStatuses (read-only) Example: `InferenceObjective sets priority 10`

Example¶

{
  "name": "llama-2-7b-chat",
  "namespace": "maas-models",
  "tokenRateLimits": [
    {
      "limit": 100000,
      "window": "24h"
    }
  ],
  "billingRate": {
    "perToken": "0.0001"
  },
  "objectiveName": "maas-models-as-a-service-gold-maas-model-user-inference-pool-a1b2c3d4e5",
  "targetPool": "maas-model-user-inference-pool",
  "ready": true,
  "reason": "ObjectiveReconciled",
  "message": "InferenceObjective sets priority 10"
}