node-llama-cpp

Appearance

Type Alias: LlamaChatOptions ​

ts
type LlamaChatOptions = {
  contextSequence: LlamaContextSequence;
  chatWrapper: "auto" | ChatWrapper;
  autoDisposeSequence: boolean;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:33

Properties ​

contextSequence ​

ts
contextSequence: LlamaContextSequence;

Defined in: evaluator/LlamaChat/LlamaChat.ts:34

chatWrapper? ​

ts
optional chatWrapper: "auto" | ChatWrapper;

Defined in: evaluator/LlamaChat/LlamaChat.ts:37

"auto" is used by default

autoDisposeSequence? ​

ts
optional autoDisposeSequence: boolean;

Defined in: evaluator/LlamaChat/LlamaChat.ts:44

Automatically dispose the sequence when the session is disposed

Defaults to false.