node-llama-cpp

Appearance

Type Alias: LlamaChatSessionDecideOptions ​

ts
type LlamaChatSessionDecideOptions = {
  document?: string;
  signal?: LLamaChatCompletePromptOptions["signal"];
  evaluationPriority?: LLamaChatCompletePromptOptions["evaluationPriority"];
  functions?: ChatSessionModelFunctions;
  documentFunctionParams?: boolean;
};

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:417

Properties ​

document? ​

ts
optional document: string;

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:426

An optional document to add to the context window before a question. Only added for generating decisions in this call; won't be appended to the actual chat history.

Will be put in the same user message as the question, with "\n\n" in between the document and the question.

Note that a long document can incur a context shift, so make sure to not use a too big document.

signal? ​

ts
optional signal: LLamaChatCompletePromptOptions["signal"];

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:428

evaluationPriority? ​

ts
optional evaluationPriority: LLamaChatCompletePromptOptions["evaluationPriority"];

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:429

functions? ​

ts
optional functions: ChatSessionModelFunctions;

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:438

Functions are not used by the model here, but are used for keeping the instructions given to the model about the functions in the current context state, to avoid context shifts.

It's best to provide the same functions that were used for the previous prompt here.

documentFunctionParams? ​

ts
optional documentFunctionParams: boolean;

Defined in: evaluator/LlamaChatSession/LlamaChatSession.ts:447

Functions are not used by the model here, but are used for keeping the instructions given to the model about the functions in the current context state, to avoid context shifts.

It's best to provide the same value that was used for the previous prompt here.