Share via


InferenceDetails interface

Details for an inference call

Properties

endpoint

The endpoint for the inference call

finishReasons

Array of finish reasons

inputTokens

Number of input tokens used

model

The model name/identifier

operationName

The operation name/type for the inference

outputTokens

Number of output tokens generated

providerName

The provider name (e.g., openai, azure, anthropic)

thoughtProcess

The thought process used by the agent

Property Details

endpoint

The endpoint for the inference call

endpoint?: ServiceEndpoint

Property Value

finishReasons

Array of finish reasons

finishReasons?: string[]

Property Value

string[]

inputTokens

Number of input tokens used

inputTokens?: number

Property Value

number

model

The model name/identifier

model: string

Property Value

string

operationName

The operation name/type for the inference

operationName: InferenceOperationType

Property Value

outputTokens

Number of output tokens generated

outputTokens?: number

Property Value

number

providerName

The provider name (e.g., openai, azure, anthropic)

providerName?: string

Property Value

string

thoughtProcess

The thought process used by the agent

thoughtProcess?: string

Property Value

string