Represents a server's preferences for model selection, requested of the client during sampling.

public sealed class ModelPreferences

Inheritance

ModelPreferences

Inherited Members

Properties

CostPriority

Gets or sets a value that indicates how much to prioritize cost when selecting a model.

[JsonPropertyName("costPriority")]
public float? CostPriority { get; set; }

Property Value

float?

Hints

Gets or sets optional hints to use for model selection.

[JsonPropertyName("hints")]
public IList<ModelHint>? Hints { get; set; }

Property Value

IList<ModelHint>

IntelligencePriority

Gets or sets a value that indicates how much to prioritize intelligence and capabilities when selecting a model.

[JsonPropertyName("intelligencePriority")]
public float? IntelligencePriority { get; set; }

Property Value

float?

SpeedPriority

Gets or sets a value that indicates how much to prioritize sampling speed (latency) when selecting a model.

[JsonPropertyName("speedPriority")]
public float? SpeedPriority { get; set; }

Property Value

float?