node-llama-cpp

Appearance

Type Alias: LlamaChatResponseFunctionCallParamsChunk ​

ts
type LlamaChatResponseFunctionCallParamsChunk = {
  callIndex: number;
  functionName: string;
  paramsChunk: string;
  done: boolean;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:117

Properties ​

callIndex ​

ts
callIndex: number;

Defined in: evaluator/LlamaChat/LlamaChat.ts:125

Each different function call has a different callIndex.

When the previous function call has finished being generated, the callIndex of the next one will increment.

Use this value to distinguish between different function calls.

functionName ​

ts
functionName: string;

Defined in: evaluator/LlamaChat/LlamaChat.ts:130

The name of the function being called

paramsChunk ​

ts
paramsChunk: string;

Defined in: evaluator/LlamaChat/LlamaChat.ts:140

A chunk of the generated text used for the function call parameters.

Collect all the chunks together to construct the full function call parameters.

After the function call is finished, the entire constructed params text can be parsed as a JSON object, according to the function parameters schema.

done ​

ts
done: boolean;

Defined in: evaluator/LlamaChat/LlamaChat.ts:145

When this is true, the current chunk is the last chunk in the generation of the current function call parameters.