node-llama-cpp

Appearance

Type Alias: LlamaChatResponseFunctionCallParamsChunk ​

ts
type LlamaChatResponseFunctionCallParamsChunk = {
  callIndex: number;
  functionName: string;
  paramsChunk: string;
  done: boolean;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:108

Properties ​

callIndex ​

ts
callIndex: number;

Defined in: evaluator/LlamaChat/LlamaChat.ts:116

Each different function call has a different callIndex.

When the previous function call has finished being generated, the callIndex of the next one will increment.

Use this value to distinguish between different function calls.

functionName ​

ts
functionName: string;

Defined in: evaluator/LlamaChat/LlamaChat.ts:121

The name of the function being called

paramsChunk ​

ts
paramsChunk: string;

Defined in: evaluator/LlamaChat/LlamaChat.ts:131

A chunk of the generated text used for the function call parameters.

Collect all the chunks together to construct the full function call parameters.

After the function call is finished, the entire constructed params text can be parsed as a JSON object, according to the function parameters schema.

done ​

ts
done: boolean;

Defined in: evaluator/LlamaChat/LlamaChat.ts:136

When this is true, the current chunk is the last chunk in the generation of the current function call parameters.