Interface ApiExecutionMetadataCost

Hierarchy

  • ApiExecutionMetadataCost

Properties

batch_size: number

The number of requests made in a single batch; and a finish_reason entry, explaining why did the model stopped processing further tokens (length if stopped by n_tokens or by reaching the end of the text to process, or stop_word if reached one of the stop_words).

cost_type: string

String with the form model_name@skill, indicating the nature of the tokens used (if no skills are used, it will be replaced by default)

tokens_generated: number

The number of tokens generated by the model.

tokens_input: number

The number of tokens sent in input to the model.

tokens_used: number

The number of tokens used.

Generated using TypeDoc