node-llama-cpp

Appearance

Type Alias: LlamaChatGenerateDecisionsResponse<Questions> ​

ts
type LlamaChatGenerateDecisionsResponse<Questions> = {
  answers: DecisionAnswers<Questions>;
  lastEvaluation: {
     contextWindow: ChatHistoryItem[];
     contextShiftMetadata: any;
  };
  tokenUsage: {
     input: number;
     output: number;
  };
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:1387

Type Parameters ​

Type Parameter
Questions extends DecisionQuestions

Properties ​

answers ​

ts
answers: DecisionAnswers<Questions>;

Defined in: evaluator/LlamaChat/LlamaChat.ts:1388

lastEvaluation ​

ts
lastEvaluation: {
  contextWindow: ChatHistoryItem[];
  contextShiftMetadata: any;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:1390

contextWindow ​

ts
contextWindow: ChatHistoryItem[];

The content of the decision making process is not added to the context window result, but is loaded to the current context sequence state as tokens.

contextShiftMetadata ​

ts
contextShiftMetadata: any;

tokenUsage ​

ts
tokenUsage: {
  input: number;
  output: number;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:1399

input ​

ts
input: number;

output ​

ts
output: number;