node-llama-cpp

Appearance

Type Alias: ResolveChatWrapperOptions ​

ts
type ResolveChatWrapperOptions = {
  type?:   | "auto"
     | SpecializedChatWrapperTypeName
     | TemplateChatWrapperTypeName;
  bosString?: string | null;
  architecture?: GgufArchitectureType;
  filename?: string;
  fileInfo?: GgufFileInfo;
  tokenizer?: Tokenizer;
  customWrapperSettings?: { [wrapper in keyof typeof chatWrappers]?: ConstructorParameters<typeof chatWrappers[wrapper]>[0] };
  warningLogs?: boolean;
  fallbackToOtherWrappersOnJinjaError?: boolean;
  noJinja?: boolean;
};

Defined in: chatWrappers/utils/resolveChatWrapper.ts:85

Properties ​

type? ​

ts
optional type: 
  | "auto"
  | SpecializedChatWrapperTypeName
  | TemplateChatWrapperTypeName;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:92

Resolve to a specific chat wrapper type. You better not set this option unless you need to force a specific chat wrapper type.

Defaults to "auto".

bosString? ​

ts
optional bosString: string | null;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:94

architecture? ​

ts
optional architecture: GgufArchitectureType;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:95

filename? ​

ts
optional filename: string;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:96

fileInfo? ​

ts
optional fileInfo: GgufFileInfo;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:97

tokenizer? ​

ts
optional tokenizer: Tokenizer;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:98

customWrapperSettings? ​

ts
optional customWrapperSettings: { [wrapper in keyof typeof chatWrappers]?: ConstructorParameters<typeof chatWrappers[wrapper]>[0] };

Defined in: chatWrappers/utils/resolveChatWrapper.ts:99

warningLogs? ​

ts
optional warningLogs: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:106

Defaults to true.

fallbackToOtherWrappersOnJinjaError? ​

ts
optional fallbackToOtherWrappersOnJinjaError: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:111

Defaults to true.

noJinja? ​

ts
optional noJinja: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:118

Don't resolve to a Jinja chat wrapper unless type is set to a Jinja chat wrapper type.

Defaults to false.