Class: LlamaGrammarEvaluationState
Defined in: evaluator/LlamaGrammarEvaluationState.ts:19
Grammar evaluation state is used to track the model response to determine the next allowed characters for the model to generate.
Create a new grammar evaluation state for every response you generate with the model.
This is only needed when using the LlamaContext class directly, since LlamaChatSession already handles this for you.
Constructors
new LlamaGrammarEvaluationState()
ts
new LlamaGrammarEvaluationState(options: LlamaGrammarEvaluationStateOptions): LlamaGrammarEvaluationStateDefined in: evaluator/LlamaGrammarEvaluationState.ts:23
Parameters
| Parameter | Type |
|---|---|
options | LlamaGrammarEvaluationStateOptions |
Returns
LlamaGrammarEvaluationState
new LlamaGrammarEvaluationState()
ts
new LlamaGrammarEvaluationState(existingState: LlamaGrammarEvaluationState): LlamaGrammarEvaluationStateDefined in: evaluator/LlamaGrammarEvaluationState.ts:24
Parameters
| Parameter | Type |
|---|---|
existingState | LlamaGrammarEvaluationState |
Returns
LlamaGrammarEvaluationState
Methods
clone()
ts
clone(): LlamaGrammarEvaluationStateDefined in: evaluator/LlamaGrammarEvaluationState.ts:41
Clone the grammar evaluation state
Returns
LlamaGrammarEvaluationState