Class: LlamaChatSessionPromptCompletionEngine
Defined in: evaluator/LlamaChatSession/utils/LlamaChatSessionPromptCompletionEngine.ts:41
Methods
dispose()
ts
dispose(): void;
Defined in: evaluator/LlamaChatSession/utils/LlamaChatSessionPromptCompletionEngine.ts:76
Returns
void
complete()
ts
complete(prompt: string): string;
Defined in: evaluator/LlamaChatSession/utils/LlamaChatSessionPromptCompletionEngine.ts:89
Get completion for the prompt from the cache, and begin preloading this prompt into the context sequence and completing it.
On completion progress, onGeneration
(configured for this engine instance) will be called.
Parameters
Parameter | Type |
---|---|
prompt | string |
Returns
string