node-llama-cpp

Appearance

Type Alias: LlamaChatOptions ​

ts
type LlamaChatOptions = {
  contextSequence: LlamaContextSequence;
  chatWrapper?: "auto" | ChatWrapper;
  autoDisposeSequence?: boolean;
};

Defined in: evaluator/LlamaChat/LlamaChat.ts:34

Properties ​

contextSequence ​

ts
contextSequence: LlamaContextSequence;

Defined in: evaluator/LlamaChat/LlamaChat.ts:35

chatWrapper? ​

ts
optional chatWrapper: "auto" | ChatWrapper;

Defined in: evaluator/LlamaChat/LlamaChat.ts:38

"auto" is used by default

autoDisposeSequence? ​

ts
optional autoDisposeSequence: boolean;

Defined in: evaluator/LlamaChat/LlamaChat.ts:45

Automatically dispose the sequence when the session is disposed

Defaults to false.