Class: LlamaContext
Constructors
new LlamaContext(options)
ts
new LlamaContext(options): LlamaContextnew LlamaContext(options): LlamaContextParameters
| Parameter | Type | Description |
|---|---|---|
options | LlamaContextOptions |
Source
llamaEvaluator/LlamaContext.ts:78
Accessors
prependBos
ts
get prependBos(): booleanget prependBos(): booleanSource
llamaEvaluator/LlamaContext.ts:124
Methods
decode()
ts
decode(tokens): stringdecode(tokens): stringParameters
| Parameter | Type |
|---|---|
tokens | number[] | Uint32Array |
Source
llamaEvaluator/LlamaContext.ts:114
encode()
ts
encode(text): Uint32Arrayencode(text): Uint32ArrayParameters
| Parameter | Type |
|---|---|
text | string |
Source
llamaEvaluator/LlamaContext.ts:107
evaluate()
ts
evaluate(tokens, options): AsyncGenerator<number, void, unknown>evaluate(tokens, options): AsyncGenerator<number, void, unknown>Parameters
| Parameter | Type | Description |
|---|---|---|
tokens | Uint32Array | |
options | { grammarEvaluationState: LlamaGrammarEvaluationState; repeatPenalty: LlamaContextRepeatPenalty; temperature: number; topK: number; topP: number; } | |
options.grammarEvaluationState? | LlamaGrammarEvaluationState | - |
options.repeatPenalty? | LlamaContextRepeatPenalty | - |
options.temperature? | number | - |
options.topK? | number | - |
options.topP? | number | - |
Returns
Source
llamaEvaluator/LlamaContext.ts:213
getBosString()
ts
getBosString(): null | stringgetBosString(): null | stringReturns
The BOS (Beginning Of Sequence) token as a string.
Source
llamaEvaluator/LlamaContext.ts:167
getBosToken()
ts
getBosToken(): null | numbergetBosToken(): null | numberReturns
The BOS (Beginning Of Sequence) token.
Source
llamaEvaluator/LlamaContext.ts:131
getContextSize()
ts
getContextSize(): numbergetContextSize(): numberSource
llamaEvaluator/LlamaContext.ts:200
getEosString()
ts
getEosString(): null | stringgetEosString(): null | stringReturns
The EOS (End Of Sequence) token as a string.
Source
llamaEvaluator/LlamaContext.ts:179
getEosToken()
ts
getEosToken(): null | numbergetEosToken(): null | numberReturns
The EOS (End Of Sequence) token.
Source
llamaEvaluator/LlamaContext.ts:143
getNlString()
ts
getNlString(): null | stringgetNlString(): null | stringReturns
The NL (New Line) token as a string.
Source
llamaEvaluator/LlamaContext.ts:191
getNlToken()
ts
getNlToken(): null | numbergetNlToken(): null | numberReturns
The NL (New Line) token.
Source
llamaEvaluator/LlamaContext.ts:155
printTimings()
ts
printTimings(): voidprintTimings(): void