node-llama-cpp

Appearance

Type Alias: LlamaChatOptions ​

ts
type LlamaChatOptions = {
  contextSequence: LlamaContextSequence;
  chatWrapper?: "auto" | ChatWrapper;
  autoDisposeSequence?: boolean;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:35

Properties ​

contextSequence ​

ts
contextSequence: LlamaContextSequence;

Defined in: evaluator/LlamaChat/LlamaChat.ts:36

chatWrapper? ​

ts
optional chatWrapper: "auto" | ChatWrapper;

Defined in: evaluator/LlamaChat/LlamaChat.ts:39

"auto" is used by default

autoDisposeSequence? ​

ts
optional autoDisposeSequence: boolean;

Defined in: evaluator/LlamaChat/LlamaChat.ts:46

Automatically dispose the sequence when the session is disposed

Defaults to false.