Class: LlamaGrammarEvaluationState

Defined in: evaluator/LlamaGrammarEvaluationState.ts:19

Grammar evaluation state is used to track the model response to determine the next allowed characters for the model to generate.

Create a new grammar evaluation state for every response you generate with the model.

This is only needed when using the LlamaContext class directly, since LlamaChatSession already handles this for you.

Constructors

new LlamaGrammarEvaluationState()

new LlamaGrammarEvaluationState(options: LlamaGrammarEvaluationStateOptions): LlamaGrammarEvaluationState

Defined in: evaluator/LlamaGrammarEvaluationState.ts:23

Parameters

Parameter	Type
options	LlamaGrammarEvaluationStateOptions

Returns

LlamaGrammarEvaluationState

new LlamaGrammarEvaluationState()

new LlamaGrammarEvaluationState(existingState: LlamaGrammarEvaluationState): LlamaGrammarEvaluationState

Defined in: evaluator/LlamaGrammarEvaluationState.ts:24

Parameters

Parameter	Type
existingState	LlamaGrammarEvaluationState

Returns

LlamaGrammarEvaluationState

Methods

clone()

clone(): LlamaGrammarEvaluationState

Defined in: evaluator/LlamaGrammarEvaluationState.ts:41

Clone the grammar evaluation state

Returns

LlamaGrammarEvaluationState